[hadoop读书笔记] 第十五章 sqoop1.4.6小实验 - 将mysq数据导入HBASE
导入命令
sqoop import --connect jdbc:mysql://192.168.200.250:3306/sqoop --table widgets --hbase-create-table --hbase-table WIDGETS_IN_HBASE --column-family product --hbase-row-key id --username 'root' -P
说明：
--connect jdbc:mysql://192.168.200.250:3306/sqoop 表示远程或者本地 Mysql 服务的URI，3306是Mysql默认监听端口， sqoop 是数据库，若是其他数据库，如Oracle,只需修改URI即可。
--table widgets 表示导出 sqoop 数据库的 widgets 表。
--hbase-table WIDGETS_IN_HBASE 表示在HBase中建立表 WIDGETS_IN_HBASE 。
--column-family product 表示在表A中建立列族 product 。
--hbase-row-key id 表示表 WIDGETS_IN_HBASE 的row-key是 widgets 表的id字段。
--hbase-create-table 表示在HBase中建立表。
--username 'root' 表示使用用户root连接Mysql。
sqoop import --connect jdbc:mysql://192.168.200.250:3306/sqoop --table widgets --hbase-create-table --hbase-table WIDGETS_IN_HBASE --column-family product --hbase-row-key id --username 'root' -P
报错：
如上可知，找不到HBASE的classpath，加载不到JAR，因此将$HBASE_HOME 设置到环境变量中：
再次执行sqoop导入
据说是兼容性问题，手动创建该表
再次执行，成功！
后台日志：
[hadoop@hadoop-allinone-200-123 bin]$
sqoop import --connect jdbc:mysql://192.168.200.250:3306/sqoop --table widgets --hbase-table WIDGETS_IN_HBASE --column-family product --hbase-row-key id --hbase-create-table --username 'root' -P17/01/24 01:55:47 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6 Enter password: 17/01/24 01:56:04 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset. 17/01/24 01:56:04 INFO tool.CodeGenTool: Beginning code generation 17/01/24 01:56:04 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `widgets` AS t LIMIT 1 17/01/24 01:56:04 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `widgets` AS t LIMIT 1 17/01/24 01:56:04 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /wdcloud/app/hadoop-2.7.3 Note: /tmp/sqoop-hadoop/compile/11c9bd6149c8897a4c8c24061ecae5f1/widgets.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. 17/01/24 01:56:08 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-hadoop/compile/11c9bd6149c8897a4c8c24061ecae5f1/widgets.jar 17/01/24 01:56:08 WARN manager.MySQLManager: It looks like you are importing from mysql. 17/01/24 01:56:08 WARN manager.MySQLManager: This transfer can be faster! Use the --direct 17/01/24 01:56:08 WARN manager.MySQLManager: option to exercise a MySQL-specific fast path. 17/01/24 01:56:08 INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull (mysql) 17/01/24 01:56:08 INFO mapreduce.ImportJobBase: Beginning import of widgets 17/01/24 01:56:08 INFO Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/wdcloud/app/hbase-1.1.6/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 17/01/24 01:56:09 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar 17/01/24 01:56:09 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps 17/01/24 01:56:10 INFO zookeeper.RecoverableZooKeeper:
Process identifier=hconnection-0x333d2dad connecting to ZooKeeper ensemble=hadoop-allinone-200-123.wdcloud.locl:2181,hadoop-allinone-200-123.wdcloud.locl:2182,hadoop-allinone-200-123.wdcloud.locl:2183 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:host.name=hadoop-allinone-200-123.wdcloud.locl 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:java.version=1.7.0_67 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:java.home=/wdcloud/app/jdk1u7/jre 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/wdcloud/app/hadoop-2.7.3/etc/hadoop:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/stax-api-1.0-2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/activation-1.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/log4j-1.2.17.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jets3t-0.9.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/httpclient-4.2.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/httpcore-4.2.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-configuration-1.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-digester-1.8.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/slf4j-api-1.7.10.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/avro-1.7.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/paranamer-2.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-compress-1.4.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/gson-2.2.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/hadoop-auth-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/zookeeper-3.4.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/netty-3.6.2.Final.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/curator-framework-2.7.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/curator-client-2.7.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jsch-0.1.42.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/htrace-core-3.1.0-incubating.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/junit-4.11.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/hamcrest-core-1.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/mockito-all-1.8.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/hadoop-annotations-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/guava-11.0.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jsr305-3.0.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-math3-3.1.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/xmlenc-0.52.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-httpclient-3.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-logging-1.1.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-net-3.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-collections-3.2.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jetty-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jetty-util-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jsp-api-2.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jersey-json-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jettison-1.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/hadoop-common-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/hadoop-common-2.7.3-tests.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/hadoop-nfs-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/guava-11.0.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/htrace-core-3.1.0-incubating.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-2.7.3-tests.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-nfs-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/guava-11.0.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/log4j-1.2.17.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/activation-1.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-client-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/guice-3.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/javax.inject-1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/aopalliance-1.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-json-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jettison-1.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-api-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-common-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-common-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-client-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-registry-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/hadoop-annotations-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/guice-3.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/javax.inject-1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/junit-4.11.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.3-tests.jar:/wdcloud/app/sqoop-1.4.6/conf::/wdcloud/app/sqoop-1.4.6/lib/ant-contrib-1.0b3.jar:/wdcloud/app/sqoop-1.4.6/lib/ant-eclipse-1.0-jvm1.2.jar:/wdcloud/app/sqoop-1.4.6/lib/avro-1.7.5.jar:/wdcloud/app/sqoop-1.4.6/lib/avro-mapred-1.7.5-hadoop2.jar:/wdcloud/app/sqoop-1.4.6/lib/commons-codec-1.4.jar:/wdcloud/app/sqoop-1.4.6/lib/commons-compress-1.4.1.jar:/wdcloud/app/sqoop-1.4.6/lib/commons-io-1.4.jar:/wdcloud/app/sqoop-1.4.6/lib/commons-jexl-2.1.1.jar:/wdcloud/app/sqoop-1.4.6/lib/commons-logging-1.1.1.jar:/wdcloud/app/sqoop-1.4.6/lib/hsqldb-1.8.0.10.jar:/wdcloud/app/sqoop-1.4.6/lib/jackson-annotations-2.3.0.jar:/wdcloud/app/sqoop-1.4.6/lib/jackson-core-2.3.1.jar:/wdcloud/app/sqoop-1.4.6/lib/jackson-core-asl-1.9.13.jar:/wdcloud/app/sqoop-1.4.6/lib/jackson-databind-2.3.1.jar:/wdcloud/app/sqoop-1.4.6/lib/jackson-mapper-asl-1.9.13.jar:/wdcloud/app/sqoop-1.4.6/lib/kite-data-core-1.0.0.jar:/wdcloud/app/sqoop-1.4.6/lib/kite-data-hive-1.0.0.jar:/wdcloud/app/sqoop-1.4.6/lib/kite-data-mapreduce-1.0.0.jar:/wdcloud/app/sqoop-1.4.6/lib/kite-hadoop-compatibility-1.0.0.jar:/wdcloud/app/sqoop-1.4.6/lib/mysql-connector-java-5.1.40-bin.jar:/wdcloud/app/sqoop-1.4.6/lib/opencsv-2.3.jar:/wdcloud/app/sqoop-1.4.6/lib/paranamer-2.3.jar:/wdcloud/app/sqoop-1.4.6/lib/parquet-avro-1.4.1.jar:/wdcloud/app/sqoop-1.4.6/lib/parquet-column-1.4.1.jar:/wdcloud/app/sqoop-1.4.6/lib/parquet-common-1.4.1.jar:/wdcloud/app/sqoop-1.4.6/lib/parquet-encoding-1.4.1.jar:/wdcloud/app/sqoop-1.4.6/lib/parquet-format-2.0.0.jar:/wdcloud/app/sqoop-1.4.6/lib/parquet-generator-1.4.1.jar:/wdcloud/app/sqoop-1.4.6/lib/parquet-hadoop-1.4.1.jar:/wdcloud/app/sqoop-1.4.6/lib/parquet-jackson-1.4.1.jar:/wdcloud/app/sqoop-1.4.6/lib/slf4j-api-1.6.1.jar:/wdcloud/app/sqoop-1.4.6/lib/snappy-java-1.0.5.jar:/wdcloud/app/sqoop-1.4.6/lib/xz-1.0.jar:/wdcloud/app/hbase-1.1.6/conf:/wdcloud/app/jdk1u7/lib/tools.jar:/wdcloud/app/hbase-1.1.6:/wdcloud/app/hbase-1.1.6/lib/activation-1.1.jar:/wdcloud/app/hbase-1.1.6/lib/aopalliance-1.0.jar:/wdcloud/app/hbase-1.1.6/lib/apacheds-i18n-2.0.0-M15.jar:/wdcloud/app/hbase-1.1.6/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/wdcloud/app/hbase-1.1.6/lib/api-asn1-api-1.0.0-M20.jar:/wdcloud/app/hbase-1.1.6/lib/api-util-1.0.0-M20.jar:/wdcloud/app/hbase-1.1.6/lib/asm-3.1.jar:/wdcloud/app/hbase-1.1.6/lib/avro-1.7.4.jar:/wdcloud/app/hbase-1.1.6/lib/commons-beanutils-1.7.0.jar:/wdcloud/app/hbase-1.1.6/lib/commons-beanutils-core-1.8.0.jar:/wdcloud/app/hbase-1.1.6/lib/commons-cli-1.2.jar:/wdcloud/app/hbase-1.1.6/lib/commons-codec-1.9.jar:/wdcloud/app/hbase-1.1.6/lib/commons-collections-3.2.2.jar:/wdcloud/app/hbase-1.1.6/lib/commons-compress-1.4.1.jar:/wdcloud/app/hbase-1.1.6/lib/commons-configuration-1.6.jar:/wdcloud/app/hbase-1.1.6/lib/commons-daemon-1.0.13.jar:/wdcloud/app/hbase-1.1.6/lib/commons-digester-1.8.jar:/wdcloud/app/hbase-1.1.6/lib/commons-el-1.0.jar:/wdcloud/app/hbase-1.1.6/lib/commons-httpclient-3.1.jar:/wdcloud/app/hbase-1.1.6/lib/commons-io-2.4.jar:/wdcloud/app/hbase-1.1.6/lib/commons-lang-2.6.jar:/wdcloud/app/hbase-1.1.6/lib/commons-logging-1.2.jar:/wdcloud/app/hbase-1.1.6/lib/commons-math-2.2.jar:/wdcloud/app/hbase-1.1.6/lib/commons-math3-3.1.1.jar:/wdcloud/app/hbase-1.1.6/lib/commons-net-3.1.jar:/wdcloud/app/hbase-1.1.6/lib/disruptor-3.3.0.jar:/wdcloud/app/hbase-1.1.6/lib/findbugs-annotations-1.3.9-1.jar:/wdcloud/app/hbase-1.1.6/lib/guava-12.0.1.jar:/wdcloud/app/hbase-1.1.6/lib/guice-3.0.jar:/wdcloud/app/hbase-1.1.6/lib/guice-servlet-3.0.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-annotations-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-auth-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-client-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-common-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-hdfs-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-mapreduce-client-app-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-mapreduce-client-common-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-mapreduce-client-core-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-mapreduce-client-jobclient-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-mapreduce-client-shuffle-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-yarn-api-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-yarn-client-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-yarn-common-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hadoop-yarn-server-common-2.5.1.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-annotations-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-annotations-1.1.6-tests.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-client-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-common-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-common-1.1.6-tests.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-examples-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-hadoop2-compat-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-hadoop-compat-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-it-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-it-1.1.6-tests.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-prefix-tree-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-procedure-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-protocol-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-resource-bundle-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-rest-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-server-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-server-1.1.6-tests.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-shell-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/hbase-thrift-1.1.6.jar:/wdcloud/app/hbase-1.1.6/lib/htrace-core-3.1.0-incubating.jar:/wdcloud/app/hbase-1.1.6/lib/httpclient-4.2.5.jar:/wdcloud/app/hbase-1.1.6/lib/httpcore-4.1.3.jar:/wdcloud/app/hbase-1.1.6/lib/jackson-core-asl-1.9.13.jar:/wdcloud/app/hbase-1.1.6/lib/jackson-jaxrs-1.9.13.jar:/wdcloud/app/hbase-1.1.6/lib/jackson-mapper-asl-1.9.13.jar:/wdcloud/app/hbase-1.1.6/lib/jackson-xc-1.9.13.jar:/wdcloud/app/hbase-1.1.6/lib/jamon-runtime-2.3.1.jar:/wdcloud/app/hbase-1.1.6/lib/jasper-compiler-5.5.23.jar:/wdcloud/app/hbase-1.1.6/lib/jasper-runtime-5.5.23.jar:/wdcloud/app/hbase-1.1.6/lib/javax.inject-1.jar:/wdcloud/app/hbase-1.1.6/lib/java-xmlbuilder-0.4.jar:/wdcloud/app/hbase-1.1.6/lib/jaxb-api-2.2.2.jar:/wdcloud/app/hbase-1.1.6/lib/jaxb-impl-2.2.3-1.jar:/wdcloud/app/hbase-1.1.6/lib/jcodings-1.0.8.jar:/wdcloud/app/hbase-1.1.6/lib/jersey-client-1.9.jar:/wdcloud/app/hbase-1.1.6/lib/jersey-core-1.9.jar:/wdcloud/app/hbase-1.1.6/lib/jersey-guice-1.9.jar:/wdcloud/app/hbase-1.1.6/lib/jersey-json-1.9.jar:/wdcloud/app/hbase-1.1.6/lib/jersey-server-1.9.jar:/wdcloud/app/hbase-1.1.6/lib/jets3t-0.9.0.jar:/wdcloud/app/hbase-1.1.6/lib/jettison-1.3.3.jar:/wdcloud/app/hbase-1.1.6/lib/jetty-6.1.26.jar:/wdcloud/app/hbase-1.1.6/lib/jetty-sslengine-6.1.26.jar:/wdcloud/app/hbase-1.1.6/lib/jetty-util-6.1.26.jar:/wdcloud/app/hbase-1.1.6/lib/joni-2.1.2.jar:/wdcloud/app/hbase-1.1.6/lib/jruby-complete-1.6.8.jar:/wdcloud/app/hbase-1.1.6/lib/jsch-0.1.42.jar:/wdcloud/app/hbase-1.1.6/lib/jsp-2.1-6.1.14.jar:/wdcloud/app/hbase-1.1.6/lib/jsp-api-2.1-6.1.14.jar:/wdcloud/app/hbase-1.1.6/lib/junit-4.12.jar:/wdcloud/app/hbase-1.1.6/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hbase-1.1.6/lib/libthrift-0.9.0.jar:/wdcloud/app/hbase-1.1.6/lib/log4j-1.2.17.jar:/wdcloud/app/hbase-1.1.6/lib/metrics-core-2.2.0.jar:/wdcloud/app/hbase-1.1.6/lib/netty-3.2.4.Final.jar:/wdcloud/app/hbase-1.1.6/lib/netty-all-4.0.23.Final.jar:/wdcloud/app/hbase-1.1.6/lib/paranamer-2.3.jar:/wdcloud/app/hbase-1.1.6/lib/protobuf-java-2.5.0.jar:/wdcloud/app/hbase-1.1.6/lib/servlet-api-2.5-6.1.14.jar:/wdcloud/app/hbase-1.1.6/lib/servlet-api-2.5.jar:/wdcloud/app/hbase-1.1.6/lib/slf4j-api-1.7.7.jar:/wdcloud/app/hbase-1.1.6/lib/slf4j-log4j12-1.7.5.jar:/wdcloud/app/hbase-1.1.6/lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hbase-1.1.6/lib/spymemcached-2.11.6.jar:/wdcloud/app/hbase-1.1.6/lib/xmlenc-0.52.jar:/wdcloud/app/hbase-1.1.6/lib/xz-1.0.jar:/wdcloud/app/hbase-1.1.6/lib/zookeeper-3.4.6.jar:/wdcloud/app/hadoop-2.7.3/etc/hadoop:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/stax-api-1.0-2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/activation-1.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/log4j-1.2.17.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jets3t-0.9.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/httpclient-4.2.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/httpcore-4.2.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-configuration-1.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-digester-1.8.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/slf4j-api-1.7.10.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/avro-1.7.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/paranamer-2.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-compress-1.4.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/gson-2.2.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/hadoop-auth-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/zookeeper-3.4.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/netty-3.6.2.Final.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/curator-framework-2.7.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/curator-client-2.7.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jsch-0.1.42.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/htrace-core-3.1.0-incubating.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/junit-4.11.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/hamcrest-core-1.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/mockito-all-1.8.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/hadoop-annotations-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/guava-11.0.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jsr305-3.0.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-math3-3.1.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/xmlenc-0.52.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-httpclient-3.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-logging-1.1.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-net-3.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/commons-collections-3.2.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jetty-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jetty-util-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jsp-api-2.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jersey-json-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/lib/jettison-1.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/hadoop-common-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/hadoop-common-2.7.3-tests.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/common/hadoop-nfs-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/guava-11.0.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/htrace-core-3.1.0-incubating.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-2.7.3-tests.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/hdfs/hadoop-hdfs-nfs-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-lang-2.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/guava-11.0.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-cli-1.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/log4j-1.2.17.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/activation-1.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/servlet-api-2.5.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-codec-1.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-client-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/guice-3.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/javax.inject-1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/aopalliance-1.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-json-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jettison-1.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/lib/jetty-6.1.26.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-api-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-common-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-common-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-tests-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-client-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/yarn/hadoop-yarn-registry-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/xz-1.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/hadoop-annotations-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/asm-3.2.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/guice-3.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/javax.inject-1.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/junit-4.11.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar:/wdcloud/app/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.3-tests.jar:/wdcloud/app/hadoop-2.7.3/contrib/capacity-scheduler/*.jar:/wdcloud/app/sqoop-1.4.6/sqoop-1.4.6.jar:/wdcloud/app/sqoop-1.4.6/sqoop-test-1.4.6.jar::/wdcloud/app/hadoop-2.7.3/contrib/capacity-scheduler/*.jar 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/wdcloud/app/hadoop-2.7.3/lib/native 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA> 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:os.version=3.10.0-229.el7.x86_64 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:user.name=hadoop 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/hadoop 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Client environment:user.dir=/wdcloud/app/sqoop-1.4.6/bin 17/01/24 01:56:10 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=hadoop-allinone-200-123.wdcloud.locl:2181,hadoop-allinone-200-123.wdcloud.locl:2182,hadoop-allinone-200-123.wdcloud.locl:2183 sessionTimeout=90000 watcher=hconnection-0x333d2dad0x0, quorum=hadoop-allinone-200-123.wdcloud.locl:2181,hadoop-allinone-200-123.wdcloud.locl:2182,hadoop-allinone-200-123.wdcloud.locl:2183, baseZNode=/hbase 17/01/24 01:56:10 INFO zookeeper.ClientCnxn: Opening socket connection to server hadoop-allinone-200-123.wdcloud.locl/192.168.200.123:2181. Will not attempt to authenticate using SASL (unknown error) 17/01/24 01:56:10 INFO zookeeper.ClientCnxn: Socket connection established to hadoop-allinone-200-123.wdcloud.locl/192.168.200.123:2181, initiating session 17/01/24 01:56:10 INFO zookeeper.ClientCnxn: Session establishment complete on server hadoop-allinone-200-123.wdcloud.locl/192.168.200.123:2181, sessionid = 0x159cecea3b60004, negotiated timeout = 40000 17/01/24 01:56:12 INFO mapreduce.HBaseImportJob: Creating missing column family product 17/01/24 01:56:12 INFO client.HBaseAdmin: Started disable of WIDGETS_IN_HBASE 17/01/24 01:56:15 INFO client.HBaseAdmin: Disabled WIDGETS_IN_HBASE 17/01/24 01:56:16 INFO client.HBaseAdmin: Started enable of WIDGETS_IN_HBASE 17/01/24 01:56:17 INFO client.HBaseAdmin: Enabled WIDGETS_IN_HBASE 17/01/24 01:56:17 INFO client.ConnectionManager$HConnectionImplementation: Closing master protocol: MasterService 17/01/24 01:56:17 INFO client.ConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x159cecea3b60004 17/01/24 01:56:17 INFO zookeeper.ZooKeeper: Session: 0x159cecea3b60004 closed 17/01/24 01:56:17 INFO zookeeper.ClientCnxn: EventThread shut down 17/01/24 01:56:17 INFO client.RMProxy: Connecting to ResourceManager at hadoop-allinone-200-123.wdcloud.locl/192.168.200.123:8032 17/01/24 01:56:24 INFO db.DBInputFormat: Using read commited transaction isolation 17/01/24 01:56:24 INFO db.DataDrivenDBInputFormat: BoundingValsQuery: SELECT MIN(`id`), MAX(`id`) FROM `widgets` 17/01/24 01:56:24 INFO mapreduce.JobSubmitter: number of splits:4 17/01/24 01:56:25 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1485230213604_0007 17/01/24 01:56:26 INFO impl.YarnClientImpl: Submitted application application_1485230213604_0007 17/01/24 01:56:26 INFO mapreduce.Job: The url to track the job: http://hadoop-allinone-200-123.wdcloud.locl:8088/proxy/application_1485230213604_0007/ 17/01/24 01:56:26 INFO mapreduce.Job: Running job: job_1485230213604_0007 17/01/24 01:56:42 INFO mapreduce.Job: Job job_1485230213604_0007 running in uber mode : false 17/01/24 01:56:42 INFO mapreduce.Job: map 0% reduce 0% 17/01/24 01:57:00 INFO mapreduce.Job: map 25% reduce 0% 17/01/24 01:57:01 INFO mapreduce.Job: map 75% reduce 0% 17/01/24 01:57:02 INFO mapreduce.Job: map 100% reduce 0% 17/01/24 01:57:03 INFO mapreduce.Job: Job job_1485230213604_0007 completed successfully 17/01/24 01:57:03 INFO mapreduce.Job: Counters: 31 File System Counters FILE: Number of bytes read=0 FILE: Number of bytes written=672888 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 HDFS: Number of bytes read=393 HDFS: Number of bytes written=0 HDFS: Number of read operations=4 HDFS: Number of large read operations=0 HDFS: Number of write operations=0 Job Counters Killed map tasks=1 Launched map tasks=4 Other local map tasks=4 Total time spent by all maps in occupied slots (ms)=59561 Total time spent by all reduces in occupied slots (ms)=0 Total time spent by all map tasks (ms)=59561 Total vcore-milliseconds taken by all map tasks=59561 Total megabyte-milliseconds taken by all map tasks=60990464 Map-Reduce Framework Map input records=4 Map output records=4 Input split bytes=393 Spilled Records=0 Failed Shuffles=0 Merged Map outputs=0 GC time elapsed (ms)=1163 CPU time spent (ms)=17450 Physical memory (bytes) snapshot=1051938816 Virtual memory (bytes) snapshot=11712344064 Total committed heap usage (bytes)=882900992 File Input Format Counters Bytes Read=0 File Output Format Counters Bytes Written=0 17/01/24 01:57:03 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 46.0288 seconds (0 bytes/sec) 17/01/24 01:57:03 INFO mapreduce.ImportJobBase: Retrieved 4 records.
查看作业历史执行情况
查看hbase表 WIDGETS_IN_HBASE 数据
追加数据，与导入hdfs不同，无需使用--append 参数，再次运行导入命令即可重新导入新数据
