欢迎您访问程序员文章站本站旨在为大家提供分享程序员计算机编程知识!
您现在的位置是: 首页

storm集群安装

程序员文章站 2022-05-22 09:44:15
...

 

系统环境:ubuntu-server 12.04 i386, 512M内存 vmware虚拟机
安装zookeeper,并测试通过zk安装参考
安装ZeroMQ: http://www.zeromq.org/area:download

问题:切记使用2.1.7版本的(见:storm/bin/install_zmq.sh)否则会出现问题

wget http://download.zeromq.org/zeromq-2.1.7.tar.gz
用3.2.2时work执行出现异常:
Caused by: org.zeromq.ZMQException: Invalid argument(0x16) 
    at org.zeromq.ZMQ$Socket.setLongSockopt(Native Method) 
## 准备工作(查看限制:ulimit -n),编辑:sudo nano /etc/security/limits.conf,增加配置:"* - nofile 10000"
sudo apt-get install libtool autoconf automake uuid-dev e2fsprogs build-essential 
cd zeromq-2.1.7
./autogen.sh
./configure
make
sudo make install
sudo ldconfig
安装JZMQ: http://github.com/nathanmarz/jzmq
wget https://github.com/nathanmarz/jzmq/archive/master.zip
unzip master.zip
cd jzmq-master
#sudo apt-get install pkg-config 
./autogen.sh
./configure
make
sudo make install

a. make问题

Making all in src
make[1]: Entering directory `/data/master/jzmq-master/src'
make[1]: *** No rule to make target `classdist_noinst.stamp', needed by `org/zeromq/ZMQ.class'.  Stop.
make[1]: Leaving directory `/data/master/jzmq-master/src'
make: *** [all-recursive] Error 1
### 修复
Changing classdist_noinst.stamp to classnoinst.stamp in src/Makefile.am and then re-running ./autogen.sh 
storm安装启动:

a. 配置:conf/storm.yaml

storm.zookeeper.servers:
 - "172.16.220.132"
nimbus.host: "172.16.220.132"

a. 启动守护进程:

# 总控:
bin/storm nimbus
# work机器上:
bin/storm supervisor
# 查看storm状态:
bin/storm ui