Error: java.io.IOException: cannot find class org.apache.hudi.hadoop.HoodieParquetInputFormat at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getRecordReader(CombineHiveInputFormat.java:673) at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.<init>(MapTask.java:169) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:432) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

 

临时方案:

set xxx;

add jar hdfs://dw/tmp/wangyh/hudi/jar/hudi-hadoop-mr-bundle-0.10.0.jar;

insert  ...

 

平安方案:

  添加hudi-hadoop-mr-bundle-0.5.3.jar 到HIVE lib目录 重启Hive metastore 和hiveserver2

 

posted on 2022-03-29 15:09  架构艺术  阅读(734)  评论(0编辑  收藏  举报