Get the App
SLTechnology News&Howtos  ›  Servers  › 

How to solve the problems encountered in the process of hadoop installation and construction

Shulou Source: shulou.com Published: 2022-06-01 14:24:14 10月01日 Update

This article focuses on "how to solve the problems encountered in the installation and construction of hadoop", interested friends may wish to take a look. The method introduced in this paper is simple, fast and practical. Let the editor take you to learn "how to solve the problems encountered in the process of hadoop installation and construction".

When starting hadoop, datanode is missing after the slave node jps:

Reason: check the datanode log of ordinary users and find that datanode clusterID is inconsistent with namenode clusterID (you can view namenode clusterID in / home/zoe/hadoopdata/dfs/name/current/VERSION), which may be caused by formatting after configuring the hadoop environment many times.

Solution: clear the "~ / hadoopdata" of master and reformat

Otherwise, enter the core-site.xml of the hadoop configuration file and edit as follows:

Dfs.replication

one

Dfs.datanode.data.dir

/ home/zoe/hadoop/hadoopdata/dfs/name/

Dfs.datanode.data.dir

/ home/zoe/hadoop/hadoopdata/dfs/data/

Changed to: namenode clusterID

two。 "no roote to host" when calculating the pi value:

Solution: turn off the firewall: service iptables stop

At this point, I believe you have a deeper understanding of "how to solve the problems encountered in the process of hadoop installation and construction". You might as well do it in practice. Here is the website, more related content can enter the relevant channels to inquire, follow us, continue to learn!

Tags: Process problem content format learning configuration practical ordinary deeper consistent interest reason practical practical easy to operate file method more friends environment Apple Docker Huawei Linux macOS MariaDB Microsoft MySQL NVidia OPPO Reno MariaDB vpn MySQL NVidia Docker