Shulou(Shulou.com)06/01 Report--

This article focuses on "how to solve the problems encountered in the installation and construction of hadoop", interested friends may wish to take a look. The method introduced in this paper is simple, fast and practical. Let the editor take you to learn "how to solve the problems encountered in the process of hadoop installation and construction".

When starting hadoop, datanode is missing after the slave node jps:

Reason: check the datanode log of ordinary users and find that datanode clusterID is inconsistent with namenode clusterID (you can view namenode clusterID in / home/zoe/hadoopdata/dfs/name/current/VERSION), which may be caused by formatting after configuring the hadoop environment many times.

Solution: clear the "~ / hadoopdata" of master and reformat

Otherwise, enter the core-site.xml of the hadoop configuration file and edit as follows:

Dfs.replication

one

Dfs.datanode.data.dir

/ home/zoe/hadoop/hadoopdata/dfs/name/

Dfs.datanode.data.dir

/ home/zoe/hadoop/hadoopdata/dfs/data/

Changed to: namenode clusterID

two。 "no roote to host" when calculating the pi value:

Solution: turn off the firewall: service iptables stop

At this point, I believe you have a deeper understanding of "how to solve the problems encountered in the process of hadoop installation and construction". You might as well do it in practice. Here is the website, more related content can enter the relevant channels to inquire, follow us, continue to learn!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.