Shulou(Shulou.com)06/02 Report--

There is only one ResourceManager resource management (resources are represented in Container)

Every application submitted by the ApplicationMaster application management user contains an ApplicationMaster

One for each node of NodeManager

Ask ResourceManager for resources after ApplicationMaster starts

Each Executor corresponds to one Container

Each SparkContext has one ApplicationMaster

The difference between the two modes supported by spark where does Spark Driver run

Yarn-cluster (YarnClusterScheduler) (driver and ApplicationMaster run together, client can't see the result)

Yarn-client (YarnClientClusterScheduler) (driver and client run together, suitable for the terminal to return results)

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.