Get the App
SLTechnology News&Howtos  ›  Servers  › 

How to add nodes to hadoop

Shulou Source: shulou.com Published: 2022-05-31 21:07:45 09月22日 Update

Editor to share with you how to add hadoop nodes, I hope you will learn something after reading this article, let's discuss it together!

The hadoop cluster needs to add 3 nodes.

The three hosts are configured with host, ssh login mutual trust with all the machines in the cluster, jdk1.7 and so on. All configurations, directories, etc., are consistent with other machines in the cluster.

After copying the installation files to the three hosts, distribute the modified configuration files to the corresponding directories of the three hosts at the same time.

Modify the slaves file for namenode, add the host for three hosts, and then distribute it to all datanode.

Execute on each of the three hosts:

Yarn-daemon.sh start nodemanager

Hadoop-daemon.sh start datanode

The two commands start nodemanager and datanode, respectively.

Perform load balancing, start-balancer.sh-threshold 5

Ensure that the files of hadoop are evenly distributed among the nodes.

After reading this article, I believe you have a certain understanding of "how to add new nodes in hadoop". If you want to know more about it, please follow the industry information channel. Thank you for reading!

Tags: Host node file cluster three configuration machine directory article consistent balanced two at the same time command finished copy more knowledge industry information Apple Docker Huawei Linux macOS MariaDB Microsoft MySQL NVidia OPPO Reno NVidia Apple OPPO Reno Redmi vpn