Get the App
SLTechnology News&Howtos  ›  Internet Technology  › 

Build stand-alone Hadoop

Shulou Source: shulou.com Published: 2022-06-03 06:27:41 11月23日 Update

1. Download hadoop-2.7.3.tar.gz

http://www.apache.org/dyn/closer.cgi/hadoop/common/hadoop-2.7.3/hadoop-2.7.3.tar.gz

2. Unzip hadoop-2.7.3.tar.gz

3. Go to Hadoop-2.7.3 directory

4./hadoop/etc

(1)core-site.xml

(2)hdfs-site.xml

Note: Because it is a single machine, the number of copies is 1; the directory cannot be tmp to avoid data loss;

(3)mapred-site.xml

Note: If this file is not available, cp mapred-site.xml. template mapred-site.xml

(4)yarn-site.xml

5. Format hdfs

bin/hadoop namenode -format

6. Start hadoop

sbin/hadoop-daemon.sh start namenode

sbin/hadoop-daemon.sh start datanode

sbin/yarn-daemon.sh start resourcemanager

sbin/yarn-daemon.sh start nodemanager

jps (see if it starts successfully)

7. Check Hadoop and Yarn status

http://localhost:50070

http://localhost:8088

8. test

bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar pi 5 1000

The yarn page allows you to view the status of the task.

Tags: Directory stand-alone success task situation data file format status page check test run configuration Apple Docker Huawei Linux macOS MariaDB Microsoft MySQL NVidia OPPO Reno Linux Microsoft NVidia Shulou Technology Huawei