How to construct distributed Hadoop2.2.0 Cluster
This article focuses on "how to construct a distributed Hadoop2.2.0 cluster". Interested friends may wish to take a look. The method introduced in this paper is simple, fast and practical. Let's let the editor take you to learn how to construct a distributed Hadoop2.2.0 cluster.
Construction of distributed Hadoop2.2.0 Cluster
1. Install the VMware virtual machine on Windows 7 (the Spark cluster in this tutorial is running on 8 GB of Windows memory) (we installed VMware-workstation-full-9.0.2)
2. Install three Ubuntu machines in VMvare (we are using ubuntu-12.10-desktop-i386), each allocating 2GB of memory
1. Install the VMware virtual machine on Windows 7 (the Spark cluster in this tutorial is running on 8 GB of Windows memory) (we installed VMware-workstation-full-9.0.2)
3. Set the root user's machine password in the three Ubuntu machines, and log in with the root user every time you log in. The specific configuration is as follows:
Sudo-s enters root user rights mode
Vim / etc/lightdm/lightdm.conf
[SeatDefaults]
Greeter-session=unity-greeter
User-session=Ubuntu
Greeter-show-manual-login=true
Allow-guest=false
Start the root account:
Sudo passwd root
After the modification of the three machines, log in with the root user when you log in to the system again:
4. Configure / etc/hosts and / etc/hostname of the three machines and install ssh to set up password-free login between the three machines For specific steps, please refer to the road of Spark combat master-section 1 of chapter 1, http://t.cn/RPo13rO and Spark, section 2 of chapter 1, http://t.cn/RP9klmr. In the "/ etc/hostname" file, we set the hostname of the three machines to SparkMaster, SparkWorker1, and SparkWorker2 respectively, and configure the corresponding relationship between IP and machine name in the "/ etc/hosts" of each machine:
After configuring the ssh for three-day machines to communicate with each other, you will find that the three machines can log in without a password using ssh:
5, install Java on three Ubuntu machines
If the installation is complete, you can verify:
The above information on each of the three Ubuntu machines indicates that Java is installed correctly.
6. Install Hadoop 2.2.0 on the SparkMaster machine and download Hadoop 2.2.0 at:
Http://mirror.bit.edu.cn/apache/hadoop/common/hadoop-2.2.0/
What we downloaded is "hadoop-2.2.0.tar.gz", as shown in the following figure:
At this point, I believe you have a deeper understanding of "how to construct a distributed Hadoop2.2.0 cluster". You might as well do it in practice. Here is the website, more related content can enter the relevant channels to inquire, follow us, continue to learn!
