centos7下安装storm步骤

  前言

      真是后知后觉,最近忙也要学习,把以前丢的都要拾起来。原理懂不懂也把环境搭起来学习。

  环境 

          centos7

          jdk 1.8

          zookeeper 3.4.13

         storm 1.2.2

   安装

    1.zookeeper安装

         我装了三台虚拟机,配置如下:

                 jdk配置

         

vi /etc/profile

#java config export JAVA_HOME
=/opt/jdk/jdk1.8.0_201 export JRE_HOME=$JAVA_HOME/jre export CLASSPATH=$JAVA_HOME/lib:$JRE_HOME/lib:$CLASSPATH export PATH=$JAVA_HOME/bin:$JRE_HOME/bin:$PATH

 

                设置静态ip

vi /etc/sysconfig/network-scripts/ifcfg-ens33 

TYPE=Ethernet
PROXY_METHOD=none
BROWSER_ONLY=no
BOOTPROTO=static
DEFROUTE=yes
IPV4_FAILURE_FATAL=no
IPV6INIT=yes
IPV6_AUTOCONF=yes
IPV6_DEFROUTE=yes
IPV6_FAILURE_FATAL=no
IPV6_ADDR_GEN_MODE=stable-privacy
NAME=ens33
UUID=07864689-6643-454f-9172-d09dfde88267
DEVICE=ens33
ONBOOT=yes
IPADDR=192.168.5.201/202/203
GATEWAY=192.168.5.1
DNS1=114.114.114.114
DNS2=8.8.8.8

 

      设置hosts,方便使用

 

vi /etc/hosts

192.168.5.201 centos01
192.168.5.202 centos02
192.168.5.203 centos03

机器配置好了,我们开始安装zookeeper

    

vi zoo.cfg

# The number of milliseconds of each tick
tickTime=2000
# The number of ticks that the initial
# synchronization phase can take
initLimit=10
# The number of ticks that can pass between
# sending a request and getting an acknowledgement
syncLimit=5
# the directory where the snapshot is stored.
# do not use /tmp for storage, /tmp here is just
# example sakes.
dataDir=/opt/zookeeper/data
# the port at which the clients will connect
clientPort=2181
# the maximum number of client connections.
# increase this if you need to handle more clients
#maxClientCnxns=60
#
# Be sure to read the maintenance section of the
# administrator guide before turning on autopurge.
#
# http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance
#
# The number of snapshots to retain in dataDir
#autopurge.snapRetainCount=3
# Purge task interval in hours
# Set to "0" to disable auto purge feature
#autopurge.purgeInterval=1
server.0=centos01:2888:3888
server.1=centos02:2888:3888
server.2=centos03:2888:3888

        

vi /etc/profile

# zookeeper
export ZK_HOME=/opt/zookeeper/zookeeper-3.4.13
export PATH=$ZK_HOME/bin:$PATH

           2.storm安装

            nimbus上的配置

########### These MUST be filled in for a storm configuration
storm.zookeeper.servers:
     - "centos01"
     - "centos02"
     - "centos03"
#
# nimbus.seeds: ["host1", "host2", "host3"]
#
#
# ##### These may optionally be filled in:
storm.local.dir: "/usr/data/storm"
supervisor.slots.ports:
     - 6700
     - 6701
     - 6702
nimbus.host: "centos01"

## List of custom serializations
# topology.kryo.register:
#     - org.mycompany.MyType
#     - org.mycompany.MyType2: org.mycompany.MyType2Serializer
#
## List of custom kryo decorators
# topology.kryo.decorators:
#     - org.mycompany.MyDecorator
#
## Locations of the drpc servers
drpc.servers:
     - "centos01"
#     - "server2"
worker.childopts: "-Xmx2048m"

      

          supervisor上的配置

########### These MUST be filled in for a storm configuration
storm.zookeeper.servers:
     - "centos01"
     - "centos02"
     - "centos03"
#
# nimbus.seeds: ["host1", "host2", "host3"]
#
#
# ##### These may optionally be filled in:
storm.local.dir: "/usr/data/storm"
supervisor.slots.ports:
     - 6700
     - 6701
     - 6702
nimbus.host: "centos01"

## List of custom serializations
# topology.kryo.register:
#     - org.mycompany.MyType
#     - org.mycompany.MyType2: org.mycompany.MyType2Serializer
#
## List of custom kryo decorators
# topology.kryo.decorators:
#     - org.mycompany.MyDecorator
#
## Locations of the drpc servers
drpc.servers:
     - "centos01"
#     - "server2"
worker.childopts: "-Xmx2048m"
## Metrics Consumers
## max.retain.metric.tuples
## whitelist / blacklist
## - you can specify multiple whitelist / blacklist with regular expression
## expandMapType: expand metric with map type as value to multiple metrics
## - set to true when you would like to apply filter to expanded metrics
## - default value is false which is backward compatible value
## - only effective when expandMapType is set to true
# topology.metrics.consumer.register:
     - "centos02"
     - "centos03"
#
# nimbus.seeds: ["host1", "host2", "host3"]
#
#
# ##### These may optionally be filled in:
storm.local.dir: "/usr/data/storm"
supervisor.slots.ports:
     - 6700
     - 6701
     - 6702
nimbus.host: "centos01"

## List of custom serializations
# topology.kryo.register:
#     - org.mycompany.MyType
#     - org.mycompany.MyType2: org.mycompany.MyType2Serializer
#
## List of custom kryo decorators
# topology.kryo.decorators:
#     - org.mycompany.MyDecorator
#
## Locations of the drpc servers
drpc.servers:
     - "centos01"
#     - "server2"
worker.childopts: "-Xmx2048m"

 

vi /etc/profile


# storm
export STORM_HOME=/opt/apache-storm-1.2.2
export PATH=${STORM_HOME}/bin:$PATH

 

配置好后,我们开始启动吧!

先启动zookeeper 

zkServer.sh start

[root@centos03 bin]# zkServer.sh status
ZooKeeper JMX enabled by default
Using config: /opt/zookeeper/zookeeper-3.4.13/bin/../conf/zoo.cfg
Mode: leader

再启动storm  

nimbus上启动

./storm nimbus >> /dev/null &
storm drpc >> /dev/null &
storm ui >> /dev/null &


supervisor上启动

storm supervisor >> /dev/null &

  在我实体电脑上访问http://192.168.5.201:8080时找不到网页,是防火墙的事

 

firewall-cmd --zone=public --add-port=8080/tcp --permanent

  firewall-cmd --reload

 

 

好了!

 

posted on 2019-04-16 21:40  Java挖掘机  阅读(658)  评论(0编辑  收藏  举报

导航