Shulou(Shulou.com)05/31 Report--

This article is about how to build a fully distributed Storm cluster. The editor thinks it is very practical, so share it with you as a reference and follow the editor to have a look.

Environment description

1. Hardware description

Using three PCs, the roles are assigned as follows

2. Software description

It is agreed that all software should be placed under the / usr/local/ path.

Preparatory work

1. Install jdk

2. Configure SSH

Storm cluster installation

Installation flow chart

1. Install Zookeeper cluster

2. Install Storm dependency

Zeromq 、 jzmq 、 python

2.1.Install zeromq

Tar-zxvf zeromq-2.1.7.tar.gz

Cd zeromq-2.1.7

It is the source code and needs to be compiled first.

. / configure checks the compilation environment

Installation dependency

Rpm-ivh libstdc++-devel-4.4.7-3.el6.i686.rpm

Rpm-ivh gcc-c++-4.4.7-3.el6.i686.rpm

Rpm-ivh libuuid-devel-2.17.2-12.9.el6.i686.rpm

. / configure checks the compilation environment

Make compilation

Make install installation

2.2.install jzmq

Unzip jzmq-master.zip

Installation dependency

Rpm-ivh autoconf-2.63-5.1.el6.noarch.rpm

Rpm-ivh automake-1.11.1-4.el6.noarch.rpm

Rpm-ivh libtool-2.2.6-15.5.el6.i686.rpm

Under / usr/local/jzmq-master path

. / autogen.sh

. / configure

Make

Make install

2.3.Check python

Which python

Python-V

3. Install storm

3.1 、 unzip storm-0.8.2.zip

3.2.1. Configure storm environment variables

# set storm environment

Export STORM_HOME=/usr/local/storm-0.8.2

Export PATH=$PATH:$STORM_HOME/bin

3.2.2. Modify the configuration file of Storm

Vi storm.yaml

Configure Zookeeper

Configure storm

4. Start the Storm cluster

4.1. each node starts Zookeeper zkServer.sh start

Master starts Storm storm nimbus >. / nimbus.log 2 > & 1 &

4.3.The child node starts bin/storm supervisor >. / supervisor.log 2 > & 1 &

Master starts the graphical management interface process (process name core) storm ui >. / core.log 2 > & 1 &

5. Start verification

5.1 Java daemon

5.2 web side

Http://hadoop100:8080/

Thank you for reading! This is the end of the article on "how to build a fully distributed Storm cluster". I hope the above content can be of some help to you, so that you can learn more knowledge. if you think the article is good, you can share it for more people to see!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.