How the spark runtime allocates resources and sets the-- num-executors parameter using yarn

This article mainly introduces the spark runtime how to use yarn to allocate resources and set-num-executors parameters, has a certain reference value, interested friends can refer to, I hope you can learn a lot after reading this article, the following let Xiaobian take you to understand.

The runtime uses yarn to allocate resources and sets the-- num-executors parameter

Nohup / home/SASadm/spark-1.4.1-bin-hadoop2.4/bin/spark-submit--name mergePartition--class main.scala.week2.mergePartition--num-executors 30--master yarnmergePartition.jar > server.log 2 > & 1 & Thank you for reading this article carefully. I hope the article "how to allocate Resources and set num-executors parameters using yarn during spark Runtime" shared by the editor will be helpful to you. At the same time, I hope you will support it. Pay attention to the industry information channel, more related knowledge is waiting for you to learn!