Hadoop distributed installation steps

This article mainly introduces "hadoop distributed installation steps". In daily operation, I believe many people have doubts about hadoop distributed installation steps. Xiaobian consulted various materials and sorted out simple and easy operation methods. I hope to help you answer the doubts of "hadoop distributed installation steps"! Next, please follow the small series to learn together!

1. Firewall;

1)Effective after restart

Open: chkconfig iptables on

Close: chkconfig iptables off

2)Effective immediately, invalid after restart

Open: service iptables start

Close: service iptables stop

3)Check firewall status: service iptables status

2. HDFS startup

sbin/hadoop-daemon.sh start/stop namenode

sbin/hadoop-daemon.sh start/stop secondarynamenode

sbin/hadoop-daemon.sh start/stop datanode

You need to operate under the sbin directory

yarn jar /opt/cloud/hadoop-2.6.0-cdh6.4.2/ws/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0-cdh6.4.2.jar wordcount /wordcount /output

sbin/yarn-daemon.sh start resourcemanager

sbin/yarn-daemon.sh start nodemanager

./ yarn-daemon.sh stop nodemanager

./ yarn-daeon.sh stop resourcemanager

How to clone virtual machines: www.centoscn.com/CentOS/2015/0208/4656.html

After CentOS Linux cloning, connection problems http://my.oschina.net/u/2356966/blog/469248

Make sure that all nodes in the cluster are configured the same,

So I configured it on the same node and synchronized it to other machines.

Temporary change of username: hostname New name

Permanent modifications: vim /etc/sysconfig/network

ssh This is a command that can be placed in a shell script, so that you can automatically connect to other machines and execute the corresponding command.

setting step

Generate your own public-private key pair: ssh-keygen -t rsa

Copy your own public key to the other party's machine and authorize;ssh-copy-id root@master

Don't forget to set it for yourself.

Use ssh to log in directly without adding a password

ssh-keygen -t rsa generated once

ssh-copy-id root@master multiple authorizations to different machines

synchronization;

scp -r hadoop-2.6.0-cdh6.4.2/ root@slave01:/opt/cloud/

scp -r jdk1.7.0_45/ root@slave01:/opt/cloud/

scp -r /etc/profile root@slave01:/etc/profile

master node format: hdfs namenode -format

datanode node startup, need to delete dn file in dfs

At this point, the study of "hadoop distributed installation steps" is over, hoping to solve everyone's doubts. Theory and practice can better match to help you learn, go and try it! If you want to continue learning more relevant knowledge, please continue to pay attention to the website, Xiaobian will continue to strive to bring more practical articles for everyone!