Example Analysis of hadoop1.1.2 Cluster installation
Editor to share with you a sample analysis of hadoop1.1.2 cluster installation, I believe that most people do not know much about it, so share this article for your reference, I hope you can learn a lot after reading this article, let's go to know it!
Build hadoop cluster a > vmbox replication or vmware clone to get a new virtual machine b > create a new ip--Connection modification, then fix an IP value c > modify hostname 1 modify hostname
(1) execute the command hostname cloud4 to modify the hostname in the session
(2) Verification: execute the command hostname
(3) execute the command vi / etc/sysconfig/network to modify the hostname in the file
(4) Verification: execute the command reboot-h now to restart the machine
2 set the binding between ip and hostname
(1) execute the command vi / etc/hosts
Add a line of 192.168.80.101 cloud41 at the end of the text
(2) Verification: ping cloud4
(3) configure the ip corresponding to the hostname in window
C:\ Windows\ System32\ drivers\ etc\ hosts
D > ssh password-free login
If you create a new project, you need to configure it.
/ / (1) execute the command ssh-keygen-t rsa (then Enter all the way) to generate the key at / root/.ssh/
/ / (2) execute the command cp / root/.ssh/id_rsa.pub / root/.ssh/authorized_keys to generate the license file
/ / (3) Verification: ssh localhost
If the immediate next step of the clone:
Judge whether the password configuration of this system is successful:
Ssh cloud4 (ssh hostname)
(the master node sends the password to the slave node)
Ssh-copy-id-I cloud41
Go to slave node
Ssh cloud41
(pass the password from the slave node to the master node)
Ssh-copy-id-I cloud4
E > copy the jdk and hadoop of the primary node to each other
(- r recursion)
Scp-r / usr/local/jdk cloud41:/usr/local
Scp-r / usr/local/hadoop cloud41:/usr/local
Scp / etc/profile cloud41:/etc
Source / etc/profile configuration file takes effect
F > modify hadoop/conf/slaves to add slave node
The child node can be-Slaves content as follows:
Localhost (yes or no, determine whether you want the master node to store data, usually the dataNode is placed in the slave node)
Cloud41,cloud42
G > starts at the master node, and the slave node does not execute the following command to format the namenode of hadoop
Hadoop namenode-format
Start-all.sh
H > if the configuration is successful, the primary node:
[root@cloud41 ~] # jps
4020 NameNode
4353 JobTracker
4466 TaskTracker
4508 Jps
4275 SecondaryNameNode
4154 DataNode
Slave node:
[root@cloud41 ~] # jps
3286 TaskTracker
3352 Jps
3194 DataNode
I > addition of new nodes: 1. Start a new node: (datanode,tasktracker)
Hadoop/bin
Hadoop-daemon.sh start datanode
Hadoop-daemon.sh start tasktracker
two。 Re-get the slave node at the master node
Hadoop dfsadmin-refreshNodes
3. Primary node sets load balancer
Hadoop/bin
(optional) execute the load balancing command start-balance.sh on the primary node
4. Modify the number of copies
Hadoop fs-setrep 2 / hello
5. Modify safe mode status
Hadoop dfsadmin-safemode leave | enter | get (leave means to turn off safe mode)
The above is all the contents of the article "sample Analysis of hadoop1.1.2 Cluster installation". Thank you for reading! I believe we all have a certain understanding, hope to share the content to help you, if you want to learn more knowledge, welcome to follow the industry information channel!
