[Hadoop] Hadoop2.8 compilation

Hadoop compilation steps: 1. Decompress the Hadoop source package [root@hadoop000 ~] # mkdir-p / opt/sourcecode [root@hadoop000 ~] # mkdir-p / opt/software [root@hadoop000 sourcecode] # cd / opt/sourcecode# and download hadoop-2.8.1-src.tar.gz (or upload it with rz) to the sourcecode directory [root@hadoop000 sourcecode] # lltotal 33756Mustang. 1 root root 34523353 Aug 20 12:14 hadoop-2.8.1-src.tar.gz# decompress [root@hadoop000 sourcecode] # tar-xzvf hadoop-2.8.1-src.tar.gz [root@hadoop000 sourcecode] # lltotal 33760drwxr-xr-x. 17 root root 4096 Jun 2 14:13 hadoop-2.8.1-src-rw-r--r--. 1 root root 34523353 Aug 20 12:14 hadoop-2.8.1-src.tar.gz [root@hadoop000 sourcecode] # cd hadoop-2.8.1-src2.JAVA installation [root@hadoop000 ~] # mkdir-p / usr/java [root@hadoop000 ~] # cd / usr/java [root@hadoop000 java] # rz # upload jdk-8u45-linux-x64.gz [root@hadoop000 java] # tar-xzvf jdk-8u45-linux-x64.gz# setting environment variable [root@hadoop000 Java] # vi / etc/profile# add export JAVA_HOME=/usr/java/jdk1.8.0_45export PATH=$JAVA_HOME/bin:$PATH# at the bottom to take effect [root@hadoop000 java] # source / etc/profile3.Maven install [root@hadoop000] # cd / opt/software/ [root@hadoop000 software] # rz # upload apache-maven-3.3.9-bin.zip [root@hadoop000 software] # lltotal 8432 Murray Murray. 1 root root 8617253 Aug 20 12:35 apache-maven-3.3.9-bin.zip# decompress [root@hadoop000 software] # unzip apache-maven-3.3.9-bin.zip# set environment variable [root@hadoop000 software] # vi / etc/profileexport MAVEN_HOME=/opt/software/apache-maven-3.3.9export MAVEN_OPTS= "- Xms256m-Xmx512m" export PATH=$MAVEN_HOME/bin:$JAVA_HOME/bin:$PATH# effective [root@hadoop000 software] # source / Etc/profile# View [root@hadoop000 software] # mvn-versionApache Maven 3.3.9 (bb52d8502b132ec0a5a3f4c09453c07478323dc5 2015-11-11T00:41:47+08:00) Maven home: / opt/software/apache-maven-3.3.9Java version: 1.8.0: 45, vendor: Oracle CorporationJava home: / usr/java/jdk1.8.0_45/jreDefault locale: en_US, platform encoding: UTF-8OS name: "linux", version: "2.6.32-431.el6.x86_64", arch: "amd64" Family: "unix" 4.Findbugs installation [root@hadoop000 ~] # cd / opt/software/ [root@hadoop000 software] # rz # upload findbugs-1.3.9.zip# decompression [root@hadoop000 software] # unzip findbugs-1.3.9.zip# setting environment variable [root@hadoop000 software] # vi / etc/profileexport FINDBUGS_HOME=/opt/software/findbugs-1.3.9export PATH=$FINDBUGS_HOME/bin:$MAVEN_HOME/bin:$JAVA_HOME/bin:$PATH# Effective [root@hadoop000 software] # source / etc/profile# View [root@hadoop000 software] # findbugs-version1.3.95.protobuf install [root@hadoop000 ~] # cd / opt/software/ [root@hadoop000 software] # rz # upload protobuf-2.5.0.tar.gz# decompress [root@hadoop000 software] # tar-xzvf protobuf-2.5.0.tar.gz [root@hadoop000 software] # cd protobuf-2.5.0 [root@hadoop000 protobuf-2. 5] # yum install-y gcc gcc-c++ make cmake [root@hadoop000 protobuf-2.5.0] #. / configure-- prefix=/usr/local/protobuf [root@hadoop000 protobuf-2.5.0] # make & & make install# set environment variable [root@hadoop000 java] # vi / etc/profileexport PROTOC_HOME=/usr/local/protobufexport PATH=$PROTOC_HOME/bin:$FINDBUGS_HOME/bin:$MAVEN_HOME/bin:$JAVA_HOME/bin:$PATH# effective [root@ Hadoop000 protobuf-2.5.0] # source / etc/profile# see [root@hadoop000 protobuf-2.5.0] # protoc-- versionlibprotoc 2.5.06. Install other dependencies on yum install-y openssl openssl-devel svn ncurses-devel zlib-devel libtoolyum install-y snappy snappy-devel bzip2 bzip2-devel lzo lzo-devel lzop autoconf automake7. Compile [root@hadoop000 sourcecode] # cd hadoop-2.8.1-src [root@hadoop000 hadoop-2.8.1-src] # mvn clean package-Pdist Native-DskipTests-Dtar# will compile [INFO]-[INFO] BUILD SUCCESS [INFO]-when the following message appears for a while. -[INFO] Total time: 13:38 min [INFO] Finished at: 2018-05-16T15:18:47+08:00 [INFO] Final Memory: 173M/478M [INFO]-

Compiled tar package path

/ opt/sourcecode/hadoop-2.8.1-src/hadoop-dist/target/hadoop-2.8.1.tar.gz