RICH-ATONE

java.lang.RuntimeException: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.OozieLauncherOutputCommitter not found

oozie报错:

java.lang.RuntimeException: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.OozieLauncherOutputCommitter not found
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2227)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$1.call(MRAppMaster.java:481)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$1.call(MRAppMaster.java:458)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.callWithJobClassLoader(MRAppMaster.java:1560)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.createOutputCommitter(MRAppMaster.java:458)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceInit(MRAppMaster.java:377)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1518)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1515)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1448)
Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.OozieLauncherOutputCommitter not found
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2195)
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2219)
	... 12 more
Caused by: java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.OozieLauncherOutputCommitter not found
	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2101)
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2193)

  

检查步骤:

1、执行命令

oozie admin -oozie http://{oozie-host}:11000/oozie -shareliblist

  查看oozie是否正常返回以下列表:

hive
distcp
mapreduce-streaming
spark
oozie
hcatalog
hive2
sqoop
pig

  

2、如果没有返回以下列表需进行Create the share lib

找到share相关目录进行打包压缩(命令示例:tar zcf share.tar.gz share),并执行一下命令生成hdfs相应目录及文件

./bin/oozie-setup.sh sharelib create -fs hdfs://hadoop01:8020 -locallib share.tar.gz

  

3、然后执行以下命令更新Update Sharelib,即可看到以上列表;

oozie admin -oozie http://{oozie-host}:11000/oozie -sharelibupdate

  

参考:

https://community.cloudera.com/t5/Support-Questions/Oozie-jobs-are-failing-with-class-not-found-error/td-p/175150

oozie的sharelib没有正确放到hadoop中,导致异常/user/oozie/share/lib does not exist

posted on 2022-10-12 13:45  RICH-ATONE  阅读(396)  评论(0编辑  收藏  举报

导航