Storm installation and configuration
1. Download Storm and related components, including:
Storm package: https://storm.apache.org/downloads.html
ZeroMQ package: http://zeromq.org/area:download
JZMQ package: https://github.com/nathanmarz/jzmq
2. Install the dependency package
1. Install ZeroMQ package and JZMQ package
General steps:
. / configure
Make
Make install
The prefix of the default configure-prefix=/usr/local
2, a collection of questions
1) gcc is not installed:
Configure: error: no acceptable C compiler found in $PATH
Solution: yum install gcc
2) gcc-related packet conflicts
Glibc-common-2.12-1.80.el6.i686 (installed) Requires: glibc = 2.12-1.80.el6
Solution: yum list glibc
Yum remove glibc.i686
Yum install gcc
3) C++ compiler is not installed
Configure: error: Unable to find a working C++ compiler
Solution: yum install gcc-c++
4) libsodium is not installed
No package 'libsodium' found
Solution: download and install libsodium:
Https://download.libsodium.org/libsodium/releases/
5) libsodium was not found
No package 'libsodium' found
Solution: set the environment variable: export PKG_CONFIG_PATH=/usr/local/lib/pkgconfig
3. Configure Storm
Add to the conf/storm.yaml:
Storm.zookeeper.servers:-"XHadoop1"-"XHadoop2"-"XHadoop3" storm.local.dir: "/ root/home/storm_work" nimbus.host: "XHadoop1" supervisor.slots.ports:-6700-6701-6702-6703
First parameter: all node servers where zookeeper is located
Second parameter: local path, which must be created manually
Third parameter: specify the primary node
Fourth parameter: specify the working port of the slave node
The first parameter and the fourth parameter are array types, which need to be written on separate lines, while the other two are string types that cannot be written separately, and a space is required after the colon, otherwise an error will be reported.
4. Run the program
Master node: bin/storm nimbus > / dev/null 2 > & 1 &
Slave node: bin/storm supervisor > / dev/null 2 > & 1 &
Master node management: bin/storm ui > / dev/null 2 > & 1 &
Management page: master node: 8080