spark 提交任务学习

提交命令  --class 任务的包名全路径

spark-submit --name sparksql --class com.binzaijun.SQLContextApp --master local[2] sql-1.0-SNAPSHOT.jar people.json

 

spark-submit --principal admin/admin@HADOOP.COM --keytab /root/admin.keytab --class org.apache.spark.examples.SparkPi --master yarn spark-examples.jar 10

 

hadoop jar /usr/crh/5.0.2.4-1136/hadoop-mapreduce/hadoop-mapreduce-examples-2.7.3.jar wordcount -D mapreduce.job.queuename=test1 /test2/test.txt /test2/output

 

posted @ 2020-05-17 17:01  彬在俊  阅读(222)  评论(0)  编辑  收藏  举报