Could not find or load main class org.apache.spark.deploy.yarn.ApplicationMaster 

Spark YARN Cluster mode get this error    

“Could not find or load main class org.apache.spark.deploy.yarn.ApplicationMaster”

spark.yarn.jars
spark.yarn.archive
配置错误可能会导致此问题

/tmp/spark-80645695-04d9-4801-b119-bf526e903334/__spark_libs__5482901671928622840.zip -> hdfs://WBMLP-cluster/user/feed_weibo/.sparkStaging/application_1512633771221_0309/__spark_libs__5482901671928622840.zip
posted @ 2018-06-21 12:14  澄轶  阅读(5228)  评论(0)  编辑  收藏  举报