sqoop从mysql导入hive的一些问题
1.错误:Sqoop:Import failed: java.lang.ClassNotFoundException: org.apache.hadoop.hive.conf.HiveConf
解决方法:
在/etc/profile中添加下面一行
export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:$HIVE_HOME/lib/*,修改完后可能会出现第四个错误
2.错误:main ERROR Could not register mbeans java.security.AccessControlException: access denied ("javax.management.MBeanTrustPermission" "register")
解决方法:
Just add the following lines to your java.policy file unter <JRE_HOME>/lib/security.
grant {
permission javax.management.MBeanTrustPermission "register";
};
3.错误:ERROR exec.DDLTask: java.lang.NoSuchMethodError: com.fasterxml.jackson.databind.ObjectMapper.readerFor(Ljava/lang/Class;)Lcom/fasterxml/jackson/databind/ObjectReader;
解决犯法:jackson jar包版本冲突,将sqoop/lib下的jackson*.jar备份,将hive/lib包下的jackson*.jar包拷贝过来
4.错误:INFO conf.HiveConf: Found configuration file null
WARN common.LogUtils: hive-site.xml not found on CLASSPATH
解决方法:
可知未找到hive-site.xml文件
在sqoop-env.sh中添加export HIVE_CONF_DIR=/usr/local/hive/conf
参考:http://blog.itpub.net/31506529/viewspace-2213877/