Shulou(Shulou.com)06/03 Report--

The environment set up in this case is as follows: Ambari 2.4.2 + HDP 2.5 (hadoop 2.7s; hive 1.2s; Tez; Spark 2.0s) + jdk1.8.25 + centos7.0. First of all, we should pay attention to some precautions and explain why.

Part one: points for attention:

Version must be lower than 7.2selinux must be closed firewalld must be closed 127.0.0.1 hosts this record deletion local warehouse must set up root account ssh enable specified hdfs data directory installation jdk1.8.0 all machine time must be synchronized

1: version must be less than 7.2, here stepped on a big hole, just selected 7.3, and finally found that often inexplicable exception, often installation failure. Later, it was found from the authorities (not in the most prominent position):

2. 127.0.0.1 hosts the record was deleted, which was also found after the burial pit

3. Local warehouses must be built, and it will be too painful if they are not built. The download process is extremely slow, and every time you start all over again, it takes a lot of time.

4.root account ssh enables this. I have also considered using a special account. Although ambari also supports this feature, it needs to make a lot of changes accordingly. If it is a test machine version, it is better to have a convenient point, which can be made up later through the relevant security policies of ambari.

5. We can understand the other points for attention at a glance, but it is better to examine them carefully. Otherwise, the wrong shooting process will cost a lot of energy.

Part II: start configuring the client and ambari-server

1. The allocation of cluster machines is as follows:

Centos7.010.1.11.1hadoop11-1centos7.010.1.11.2hadoop11-2centos7.010.1.11.3hadoop11-3centos7.010.1.11.4hadoop11-4centos7.010.1.11.5hadoop11-5centos7.010.1.11.6hadoop11-6centos7.010.1.11.7hadoop11-7

two。 Check centos version, close selinux, firewalld, add hosts record, install jdk1.8

Check whether the time zone and time are unified

Yum install ntp

Cp / usr/share/zoneinfo/Asia/Shanghai / etc/localtime

Configure root ssh login

Configure jdk1.8.025 to extract jdk to the / usr/local/java/jdk1.8.0_112 directory:

Add at the end of / etc/profile file

# add jdk-8u112

# # add for jdk

Export JAVA_HOME=/usr/local/java/jdk1.8.0_112

Export CLASSPATH=$JAVA_HOME/lib:$JAVA_HOME/jre/lib:$JAVA_HOME/lib/tools.jar

Export PATH=$JAVA_HOME/bin:$JAVA_HOME/jre/bin:$PATH

Configure the hosts file

Cat / etc/hosts

10.1.11.32 localRepository-11-32

10.1.11.10 ambari-11-10

10.1.11.1 hadoop11-1

10.1.11.2 hadoop11-2

10.1.11.3 hadoop11-3

10.1.11.4 hadoop11-4

10.1.11.5 hadoop11-5

10.1.11.6 hadoop11-6

10.1.11.7 hadoop11-7

As mentioned above, the relevant preparations for the client have been checked. The next step is to build a local warehouse for download.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.