Get the App
SLTechnology News&Howtos  ›  Internet Technology  › 

Overview of Hadoop startup scripts

Shulou Source: shulou.com Published: 2022-06-03 07:16:36 11月23日 Update

Overview of startup scripts:

1 、 {sbin} start-dfs.sh

① hdfs-config.sh-> {libexec} hadoop-dfs.sh

② hadoop-daemons.sh-hostnames hostname start namenode (NN)

③ hadoop-daemons.sh start datanode (NN)

④ hadoop-daemon.sh start datanode (DN)

⑤ hadoop-daemons.sh-hostname hostname start secondarynamenode (NN)

Note:

The ① NN process can only be started on NN

All DN processes can be started and shut down on ② NN, but only all DN processes can be started or closed (with the help of SSH technology, you can start or shut down specified DN processes on NN)

③ 2NN processes can only be on NN

2 、 {sbin} start-yarn.sh

① {libexec} yarn-config.sh

② yarn-daemon.sh start resourcemanager (resourcemanager,NN)

③ yarn-daemons.sh start nodemanager (nodemanager,NN)

④ yarn-daemon.sh start nodemanager (nodemanager,DN)

Note:

The ① RM process can only be started on NN

The ② NM process can be started or shut down on NN or DN. (all RM processes can only be started or closed at one time on NN, and the specified node RM can be turned on or off with the help of SSH technology; the RM of this node can be started or closed on DN)

Tags: Process technology node overview script one-time Apple Docker Huawei Linux macOS MariaDB Microsoft MySQL NVidia OPPO Reno Shulou Tech Info Huawei MySQL Apple vpn