会看日志 控制台输出

 

Connected to pydev debugger (build 172.4343.24)
pydev debugger: warning: trying to add breakpoint to file that does not exist: /usr/local/hadoop/spark-2.2.0-bin-hadoop2.7/mycode/mypy/e:/pyaction/test.py (will have no effect)
pydev debugger: warning: trying to add breakpoint to file that does not exist: /usr/local/hadoop/spark-2.2.0-bin-hadoop2.7/mycode/mypy/e:/pyaction/sqlserver_t.py (will have no effect)
Warning: Ignoring non-spark config property: YARN_CONF_DIR=/usr/local/hadoop/hadoop/etc/hadoop/yarn-site.xml
Exception in thread "main" java.lang.Exception: When running with master 'yarn' either HADOOP_CONF_DIR or YARN_CONF_DIR must be set in the environment.
at org.apache.spark.deploy.SparkSubmitArguments.validateSubmitArguments(SparkSubmitArguments.scala:263)
at org.apache.spark.deploy.SparkSubmitArguments.validateArguments(SparkSubmitArguments.scala:240)
at org.apache.spark.deploy.SparkSubmitArguments.<init>(SparkSubmitArguments.scala:116)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:112)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

posted @ 2017-12-01 15:35  papering  阅读(448)  评论(0编辑  收藏  举报