Spark SQL on Yarn-Cluster

Spark SQL 或者Hive SQL在yarn-client模式下运行正常,但是在yarn-cluster模式下总是报 status failed错误,

需要把$SPARK_HOME/lib/spark-1.4.0-yarn-shuffle.jar复制到$HADOOP_HOME/share/hadoop/yarn下

posted @ 2015-06-30 13:26  Captain_Lucky  阅读(1352)  评论(1编辑  收藏  举报