How hadoop deploys fully distributed

This article mainly shows you "how to deploy hadoop completely distributed", the content is easy to understand, clear, hope to help you solve your doubts, the following let the editor lead you to study and learn "how to deploy hadoop fully distributed" this article.

1. Configure the hosts file to prepare for the establishment of keyless communication

Master,slave1,slave2 should be configured in the same way.

2. Configure SSH keyless communication to communicate with each other.

Pay attention to turn off the firewall and configure hosts network to set up DNS and gateway

The principle of communication allows both parties to hold each other's public key and put it in the authorized_keys.

3. Configure jdk

4. Import and configure hadoop

Configure jdk in hadoop_env.sh

Configure core-site.xml for hadoop

Configure mapred-site.xml

Configure hdfs-site.xml

Configuring masters,slaves is best written with address.

5. To format hadoop, you only need to format it once. If you want to format it the second time, you need to delete everything in the tmp folder.

6. Start

7. Configure it in eclipse, make a plug-in, put it under plugin, and set the permission to false if there is a permission problem.

8. Remember to change the permission verification in hdfs-site.xml to false.

These are all the contents of the article "how to deploy hadoop fully distributed". Thank you for reading! I believe we all have a certain understanding, hope to share the content to help you, if you want to learn more knowledge, welcome to follow the industry information channel!