spark提交到集群的命令

先在idea中maven install 打jar包

[houzhq@agent sparkjob]$ spark2-submit --class Sparkjob.count --name countownerjob --num-executors 5 --executor-memory 6G --driver-memory 6G --master yarn --deploy-mode cluster /home/houzhq/sparkjob/SparkJob-1.0-SNAPSHOT.jar /user/houzhq/trips.csv /user/houzhq/output


版权声明:本文为qq_36342616原创文章,遵循CC 4.0 BY-SA版权协议,转载请附上原文出处链接和本声明。