Shulou(Shulou.com)06/03 Report--

Many tutorials online on Hadoop-2.4 package 64-bit coding tutorials, the latest version 2.7.2 is almost the same, here for you to repeat.

Share two more authoritative attached links:

Ubuntu user recommended reference: http://www.aboutyun.com/forum.php?mod=viewthread&tid=8130&extra=page%3D1&page=1

CentOs series user reference: http://www.cnblogs.com/hadoop2015/p/4259899.html

1. Pre-tool preparation:

(1) CentOS and successfully connect to the Internet (Note: it is best to use root role compilation to reduce folder permissions problems. Novices should pay attention to command problems: such as the difference between Ubuntu using apt-get and CenOS using yum.)

(2) Source code, JDK7, maven, ant, protobuf (for each plug-in, consult the data on your own)

1. Steps to install the plug-in: (all operate under the root identity, and the environment variable is configured in / etc/profile)

1. Decompress JDK, configure environment variables JAVA_HOME and PATH, and verify java-version (you need to verify whether the configuration is successful as follows)

2. Decompress Maven and configure MAVEN_HOME and PATH.

3. Decompress ant and configure ANT _ HOME and PATH.

4. Install the glibc-headers and Gmail + commands as follows:

$yum install glibc-headers

$yum install gcc-c++

5. Install make and cmake

$yum install make

$yum install cmake

6. Decompress protobuf and enter the decompressed protobuf home directory

Then execute the commands one after another:

$. / configure

$make

$make check

$make install

$ldconfig

Modify the environment variable LD_LIBRARY_PATH. Verification (command: $protoc-- version)

Finally, refresh the configuration / etc/profile file for each configuration:

$source / etc/profile

The profile file on configuration is attached after configuration:

7. Install the opensl library

$yum install openssl-devel

8. Install the ncurses-devel library:

$yum install ncurses-devel

At this point, the installation of the compilation tool is almost complete.

II. Compilation phase:

Start the maven directive and start compiling hadoop 64-bit.

Jump to the home directory (src directory) in the extracted hadoop source folder, and execute:

$mvn package-Pdist,native-DskipTests-Dtar

It takes a long time to wait, and the final success is all SUCCESS:

The successful 64-bit hadoop package is under scr/hadoop-dist/target.

3. Problems encountered:

1. JVM memory overflow during MAVEN install

How to handle it: the heap size of MAVEN_OPT can be adjusted in both the environment configuration file and the execution file of maven. (for more information, please see MAVEN compilation JVM tuning issues, such as http://outofmemory.cn/code-snippet/12652/maven-outofmemoryerror-method)

2. Maven reports an error during compilation. It is possible that the network congestion problem leads to the incomplete download of the dependent library, so that the command can be executed multiple times (it is more difficult to pass once):

$mvn package-Pdist,native-DskipTests-Dtar

3. Report errors such as ant, protobuf, etc., incomplete download of plug-ins or problems with plug-in version. There are many special cases in the initial link, and it is recommended.

2.7.0 version of the question summary post http://www.tuicool.com/articles/IBn63qf

I seldom write and organize blogs. Thanks to about Cloud Community, I hope it will be helpful to you.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.