Storm集群部署实战篇
Storm集群部署实战篇
作者：尹正杰
版权声明：原创作品，谢绝转载！否则将追究法律责任。
一.Storm概述
1>.离线计算和流式计算
离线计算是什么？ 离线计算：批量获取数据、批量传输数据、周期性批量计算数据、数据展示 代表技术：Sqoop批量导入数据、HDFS批量存储数据、MapReduce批量计算数据、Hive批量计算数据 流式计算是什么 流式计算：数据实时产生、数据实时传输、数据实时计算、实时展示 代表技术：Flume实时获取数据、Kafka实时数据存储、Storm/JStorm实时数据计算、Redis实时结果缓存、持久化存储(mysql)。
离线计算与实时计算最大的区别：实时收集、实时计算、实时展示
2>.什么是Storm
Storm是一个分布式计算框架，主要使用Clojure与Java语言编写，最初是由Nathan Marz带领Backtype公司团队创建，在Backtype公司被Twitter公司收购后进行开源。最初的版本是在2011年9月17日发行，版本号0.5.0。
2013年9月，Apache基金会开始接管并孵化Storm项目。Apache Storm是在Eclipse Public License下进行开发的，它提供给大多数企业使用。经过1年多时间，2014年9月，Storm项目成为Apache的顶级项目。
Storm是一个免费开源的分布式实时计算系统。Storm能轻松可靠地处理无界的数据流，就像Hadoop对数据进行批处理；
Storm是Twitter开源的分布式实时大数据处理框架，被业界称为实时版的Hadoop。随着越来越多的场景对Hadoop的MapReduce高延迟无法容忍，比如网站统计，推荐系统，预警系统，金融系统（高频交易，股票）等等，大数据实时处理解决方案（流计算）的应用日趋广泛，目前已是分布式技术领域最新爆发点，而Storm更是流计算技术中佼佼者和主流。 按照Storm作者的说法，storm对于实时计算的意义类似于Hadoop对于批处理的意义。Hadoop提供了map，reduce原语，而且Strom的Trident是基于Storm原语更高级的抽象框架。类似于基于Hadoop的Pig框架，让开发更加便利和高效。
3>.Strom常见应用场景
Storm用来实时计算源源不断产生的数据，如同流水线生产。
推荐系统：
实时推荐，根据下单或加入购物车推荐相关商品（而不是相似商品）。
金融系统：
实时分析股票信息数据。
预警系统：
根据实时采集数据，判断是否到了预警阀值。
网站统计：
实时销售，流量统计，如淘宝双11效果图。
4>.如何实现实时处理
数据源务必实时，所以采用Message Queue作为数据源，消息处理Comsumer实时从MQ获取数据进行处理，返回结果到Web或写Database。这种方式有以下几个缺陷： 1>.单机模式，能处理的数据量有限； 2>.不健壮，服务器挂掉即结束。而Storm集群节点挂掉后，任务会重新分配到其他节点，作业不受影响； 3>.失败重试，事物等，你需要在代码上进行控制，过多精力放在业务开发之外； 4>.伸缩性差，当一个消息处理者的消息量达到阈值，你需要对这些数据进行分流，你需要配置这些新的处理者以让他们处理分流的消息；
5>.Storm一些关键特性
1>.适用场景广泛： Storm可以实时处理和更新DB，对一个数据量进行持续的查询并返回客户端（持续计算），对一个耗资源的查询做实时并行化的处理（分布式方法调用，即DRPC），storm的这些基础API可以满足大量的场景。 2>.可伸缩性高： Storm的可伸缩性可以让storm每秒可以处理的消息量达到很高。扩展一个实时计算任务，你所需要做的就是加机器并且提高这个计算任务的并行度。Storm使用Zookeeper来协调集群内的各种配置使得Strom的集群可以很容易的扩展。 3>.保证无数据丢失： 实时系统必须保证所有的数据被成功的处理。哪些会丢失数据的系统的使用场景非常窄，而Storm保证每一条消息都会被处理，这一点和S4相比有巨大的反差。 4>.异常健壮： Storm集群非常容易管理，轮流重启节点不影响应用。 5>.容错性好： 在消息处理过程中发现异常，storm会进行重试。 6>.语言无关性： Storm和topplogy和消息处理组件（Bolt）可以用任意语言来定义，这一点使得任何人都可以使用storm。
6>.典型案例
案例一：京东-实时分析系统，实时分析用户的属性，并返回给搜索引擎。 案例二：携程-网站性能监控，实时分析系统监控的携程网的网站性能。 案例三：淘宝-双十一，实时统计销售总额。
二.Storm 基础知识
1>.Strom 和 Hadoop对比
1>.Storm用于实时计算，Hadoop用于离线计算。 2>.Storm处理的数据保存在内存中，源源不断；Hadoop处理的数据保存在文件系统中，一批一批处理。 3>.Storm的数据通过网络传输进来；Hadoop的数据保存在磁盘中。 4>.Storm与Hadoop的编程模型相似
Job： 任务名称 JobTracker： 项目经理（JobTracker对应于NameNode；JobTracker是一个master服务，软件启动之后JobTracker接收Job，负责调度Job的每一个子任务task运行于TaskTracker上，并监控它们，如果发现有失败的task就重新运行它。） TaskTracker： 开发组长（TaskTracker对应于DataNode；TaskTracker是运行在多个节点上的slaver服务。TaskTracker主动与JobTracker通信，接收作业，并负责直接执行每一个任务。） Child： 负责开发的人员 Mapper/Reduce： 开发人员中的两种角色，一种是服务器开发、一种是客户端开发
nimbus是整个集群的控管核心，负责topology的提交、运行状态监控、任务重新分配等工作。 zk就是一个管理者，监控者。 总体描述：nimbus下命令（分配任务），zk监督执行（心跳监控，worker、supurvisor的心跳都归它管），supervisor领旨（下载代码），招募人马(创建worker和线程等)，worker、executor就给我干活！task就是具体要干的活。 1>.主控节点与工作节点 Storm集群中有两类节点：主控节点（Master Node）和工作节点（Worker Node）。其中，主控节点只有一个，而工作节点可以有多个。 2>.Nimbus进程与Supervisor进程 主控节点运行一个称为Nimbus的守护进程类似于Hadoop的JobTracker。Nimbus负责在集群中分发代码，对节点分配任务，并监视主机故障。 每个工作节点运行一个称为Supervisor的守护进程。Supervisor监听其主机上已经分配的主机的作业，启动和停止Nimbus已经分配的工作进程。 3>.流分组（Stream grouping） 流分组，是拓扑定义中的一部分，为每个Bolt指定应该接收哪个流作为输入。流分组定义了流/元组如何在Bolt的任务之间进行分发。 Storm内置了8种流分组方式。 4>.工作进程（Worker） Worker是Spout/Bolt中运行具体处理逻辑的进程。一个worker就是一个进程，进程里面包含一个或多个线程。 5>.执行器（Executor） 一个线程就是一个executor，一个线程会处理一个或多个任务。 6>.任务（Task） 一个任务就是一个task。
2>.Strom集群架构
Nimbus和Supervisors之间所有的协调工作是通过一个zookeeper集群。Nimbus进程和supervisors进程是无法直接连接和无状态的；所有的状态维持在zookeeper中或保存在本地磁盘上。这意味着你可以 kill -9 Nimbus或supervisors进程，而不需要做备份。这种设计导致storm集群具有难以置信的稳定性，即无耦合。
3>.Strom原理
1>.Nimbus负责在集群分发的代码，topology只能在nimbus机器上提交，将任务分配给其他机器，和故障检测。 2>.Supervisor，监听分配给它的节点，根据Nimbus的委派在必要时启动和关闭工作进程。每个工作进程执行topology 的一个子集。一个运行中的topology由很多运行在很多机器上的工作进程组成。 3>.在Storm中有对于流stream的抽象，流是一个不间断的无界的连续tuple。注意，storm在建模事件流时，把流中的事件抽象为tuple即元组。
4>.storm认为每个stream都有一个源，也就是原始元组的源头，叫做Spout（管口）。
5>.处理Strom内的tuple，抽象为Bolt，bolt可以消费任意数量的输入流，只要将流方向导向该bolt，同时它也可以发送新的流给其他bolt使用。这样一来，只要打开特定的spout再将spout中流出的tuple导向特定的bolt，又bolt对导入的流做处理后在导向其他blot或者目的地。
6>.可以任务spout就是水龙头，并且每个水龙头是不同的，我们想拿到那种水就拧开哪个水龙头，然后使用管道将水龙头的水导向到一个水处理器（bolt），水处理器处理后在使用管道导向另一个处理器或者存储容器中。
7>.为了增大水处理效率，我们很自然就想到在同一个水源处接上多个水龙头并使用多个水处理器，这样就可以提高效率。
4>.Topology
Storm将流中元素抽象为tuple，一个tuple就是一个值列表value list，list中的每个value都有一个name，并且该value可以是任意可序列化的类型。拓扑的每个节点都要说明他所发射出的元组的字段的name，其他节点只需要订阅该name就可以接受处理。
5>.Storm 概念（相关术语介绍）
1>.消息流（Streams） 消息流是一个没有边界的tuple序列，而这些tuples会被以一种分布式并行创建和处理。每个tuple可以包含多列，字段类型可以是：integer，long，short，byte，string，double，float，boolean和byte array。你还可以自定义类型，只要你实现对应的序列化器。 2>.消息源（Spouts） 消息源是topology消息生产者。Spout从一个外部源（消息队列）读取数据向topology发出tuple。消息源spouts可以是可靠的也可以是不可靠的。一个可靠的消息可以重新发射一个处理失败的tuple，一个不可靠的消息源spouts不会。 souts类的方法nextTuple不断发射tuple到topology，storm在检测到一个tuple被整个topology成功处理的时候调用ack，否则调用fail。 Storm只对可靠的spout调用ack和fail。 3>.消息处理者（Bolts） 消息处理逻辑被封装在bolts里面，Bolts可以做很多事情：过滤，聚合，查询数据库等
Bolts可以简单的做消息流的传递。复杂的消息流处理往往需要很多步骤，从而也就需要经过很多Bolts。第一季Bolt的输出可以作为下一级Bolt的输入。而Spout不能有一级。
Bolts的主要方法是execute（死循环）连续处理传递的tuple，成功处理完每一个tuple调用OutputCollector的ack方法，以通知storm这个tuple被处理完成了。当处理失败时，可以调fail方法通过spout端可以重新发送该tuple。
大致流程为：Bolts处理一个输入tuple，然后调用ack通知storm自己已经处理过这个tuple了。storm提供了一个IBasicBolt会自动调用ack。
Bolt使用OutputCollector来发射tuple到下一级Blot。
5>.实时流计算常见架构图
1>.Flume获取数据。 2>.Kafka临时保存数据。 3>.Strom计算数据。 4>.Redis是个内存数据库，用来保存数据。
三.搭建zookeeper集群（我们选择3台虚拟机测试即可，操作环境选择CentOS7.6即可！）
1>.部署JDK环境（每个节点都需要按照jdk环境）
大家可以自行去Oracle官网下载相应的jdk，我这里给出下载地址：https://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html（推荐下载tar.gz的安装包）。
[root@node101 ~]# ls jdk-8u131-linux-x64.tar.gz local_policy.jar US_export_policy.jar [root@node101 ~]# [root@node101 ~]# [root@node101 ~]# mkdir -pv /yinzhengjie/softwares mkdir: created directory ‘/yinzhengjie’ mkdir: created directory ‘/yinzhengjie/softwares’ [root@node101 ~]# [root@node101 ~]# tar -zxf jdk-8u131-linux-x64.tar.gz -C /yinzhengjie/softwares/ [root@node101 ~]# [root@node101 ~]# ln -s /yinzhengjie/softwares/jdk1.8.0_131/ /yinzhengjie/softwares/jdk [root@node101 ~]# [root@node101 ~]# mkdir /usr/java [root@node101 ~]# [root@node101 ~]# ln -s /yinzhengjie/softwares/jdk1.8.0_131/ /usr/java/jdk1.8 [root@node101 ~]# ln -s /yinzhengjie/softwares/jdk1.8.0_131/ /usr/java/defalut [root@node101 ~]# [root@node101 ~]# vi /etc/profile [root@node101 ~]# [root@node101 ~]# tail -3 /etc/profile #ADD JAVA_PATH JAVA_HOME=/yinzhengjie/softwares/jdk PATH=$PATH:$JAVA_HOME/bin [root@node101 ~]# [root@node101 ~]# source /etc/profile [root@node101 ~]# [root@node101 ~]# java -version java version "1.8.0_131" Java(TM) SE Runtime Environment (build 1.8.0_131-b11) Java HotSpot(TM) 64-Bit Server VM (build 25.131-b11, mixed mode) [root@node101 ~]#
2>.安装zookeeper服务
[root@node101 ~]# yum -y install wget Loaded plugins: fastestmirror base | 3.6 kB 00:00:00 extras | 3.4 kB 00:00:00 updates | 3.4 kB 00:00:00 (1/4): base/7/x86_64/group_gz | 166 kB 00:00:00 (2/4): updates/7/x86_64/primary_db | 2.4 MB 00:00:01 (3/4): base/7/x86_64/primary_db | 6.0 MB 00:00:02 (4/4): extras/7/x86_64/primary_db | 180 kB 00:00:04 Determining fastest mirrors * base: mirrors.neusoft.edu.cn * extras: mirrors.nwsuaf.edu.cn * updates: mirrors.neusoft.edu.cn Resolving Dependencies --> Running transaction check ---> Package wget.x86_64 0:1.14-18.el7 will be installed --> Finished Dependency Resolution Dependencies Resolved =========================================================================================================================================================================================== Package Arch Version Repository Size =========================================================================================================================================================================================== Installing: wget x86_64 1.14-18.el7 base 547 k Transaction Summary =========================================================================================================================================================================================== Install 1 Package Total download size: 547 k Installed size: 2.0 M Downloading packages: warning: /var/cache/yum/x86_64/7/base/packages/wget-1.14-18.el7.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID f4a80eb5: NOKEY Public key for wget-1.14-18.el7.x86_64.rpm is not installed wget-1.14-18.el7.x86_64.rpm | 547 kB 00:00:00 Retrieving key from file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7 Importing GPG key 0xF4A80EB5: Userid : "CentOS-7 Key (CentOS 7 Official Signing Key) <security@centos.org>" Fingerprint: 6341 ab27 53d7 8a78 a7c2 7bb1 24c6 a8a7 f4a8 0eb5 Package : centos-release-7-2.1511.el7.centos.2.10.x86_64 (@anaconda) From : /etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7 Running transaction check Running transaction test Transaction test succeeded Running transaction Installing : wget-1.14-18.el7.x86_64 1/1 Verifying : wget-1.14-18.el7.x86_64 1/1 Installed: wget.x86_64 0:1.14-18.el7 Complete! [root@node101 ~]#
[root@node101 ~]# wget http://mirrors.hust.edu.cn/apache/zookeeper/zookeeper-3.4.13/zookeeper-3.4.13.tar.gz --2019-02-22 05:47:38-- http://mirrors.hust.edu.cn/apache/zookeeper/zookeeper-3.4.13/zookeeper-3.4.13.tar.gz Resolving mirrors.hust.edu.cn (mirrors.hust.edu.cn)... 202.114.18.160 Connecting to mirrors.hust.edu.cn (mirrors.hust.edu.cn)|202.114.18.160|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 37191810 (35M) [application/octet-stream] Saving to: ‘zookeeper-3.4.13.tar.gz’ 100%[=================================================================================================================================================>] 37,191,810 743KB/s in 48s 2019-02-22 05:48:26 (755 KB/s) - ‘zookeeper-3.4.13.tar.gz’ saved [37191810/37191810] [root@node101 ~]#
[root@node101 ~]# tar -zxf zookeeper-3.4.13.tar.gz -C /yinzhengjie/softwares/ [root@node101 ~]# [root@node101 ~]# ll /yinzhengjie/softwares/zookeeper-3.4.13/ total 1644 drwxr-xr-x. 2 501 games 4096 Feb 22 06:08 bin -rw-r--r--. 1 501 games 91400 Jun 29 2018 build.xml drwxr-xr-x. 2 501 games 74 Feb 22 06:08 conf drwxr-xr-x. 10 501 games 4096 Feb 22 06:08 contrib drwxr-xr-x. 2 501 games 4096 Feb 22 06:08 dist-maven drwxr-xr-x. 6 501 games 4096 Feb 22 06:08 docs -rw-r--r--. 1 501 games 1709 Jun 29 2018 ivysettings.xml -rw-r--r--. 1 501 games 8502 Jun 29 2018 ivy.xml drwxr-xr-x. 4 501 games 4096 Feb 22 06:08 lib -rw-r--r--. 1 501 games 11938 Jun 29 2018 LICENSE.txt -rw-r--r--. 1 501 games 3132 Jun 29 2018 NOTICE.txt -rw-r--r--. 1 501 games 1585 Jun 29 2018 README.md -rw-r--r--. 1 501 games 1770 Jun 29 2018 README_packaging.txt drwxr-xr-x. 5 501 games 44 Feb 22 06:08 recipes drwxr-xr-x. 8 501 games 4096 Jun 29 2018 src -rw-r--r--. 1 501 games 1508639 Jun 29 2018 zookeeper-3.4.13.jar -rw-r--r--. 1 501 games 833 Jun 30 2018 zookeeper-3.4.13.jar.asc -rw-r--r--. 1 501 games 33 Jun 29 2018 zookeeper-3.4.13.jar.md5 -rw-r--r--. 1 501 games 41 Jun 29 2018 zookeeper-3.4.13.jar.sha1 [root@node101 ~]#
[root@node101 ~]# cp /yinzhengjie/softwares/zookeeper-3.4.13/conf/zoo_sample.cfg /yinzhengjie/softwares/zookeeper-3.4.13/conf/zoo.cfg [root@node101 ~]# [root@node101 ~]# cat /yinzhengjie/softwares/zookeeper-3.4.13/conf/zoo.cfg | egrep -v "^#|^$" tickTime=2000 initLimit=10 syncLimit=5 dataDir=/home/yinzhengjie/zookeeper #指定数据存放目录 clientPort=2181 server.101=node101.yinzhengjie.org.cn:2888:3888 server.102=node102.yinzhengjie.org.cn:2888:3888 server.103=node103.yinzhengjie.org.cn:2888:3888 [root@node101 ~]# [root@node101 ~]# mkdir /home/yinzhengjie/zookeeper [root@node101 ~]# [root@node101 ~]# echo "101" > /home/yinzhengjie/zookeeper/myid [root@node101 ~]# [root@node101 ~]# cat /home/yinzhengjie/zookeeper/myid #注意，每个服务器的myid我们应该设置为不同的值，我们实验环境有3台虚拟机，那么该id的应该设置为不同的数字，建议用主机名上数字！代表着不同的server。 101 [root@node101 ~]# [root@node101 ~]#
3>.编写集群管理脚本并启动zookeeper集群
[root@node101 ~]# cat /usr/local/bin/xcall.sh #!/bin/bash #@author :yinzhengjie #blog:http://www.cnblogs.com/yinzhengjie #EMAIL:y1053419035@qq.com #判断用户是否传参 if [ $# -lt 1 ];then echo "请输入参数" exit fi #获取用户输入的命令 cmd=$@ for (( i=101;i<=103;i++ )) do #使终端变绿色 tput setaf 2 echo ============= node${i}.yinzhengjie.org.cn : $cmd ============ #使终端变回原来的颜色，即白灰色 tput setaf 7 #远程执行命令 ssh node${i}.yinzhengjie.org.cn $cmd #判断命令是否执行成功 if [ $? == 0 ];then echo "命令执行成功" fi done [root@node101 ~]#
[root@node101 ~]# cat /usr/local/bin/xrsync.sh #!/bin/bash #@author :yinzhengjie #blog:http://www.cnblogs.com/yinzhengjie #EMAIL:y1053419035@qq.com #判断用户是否传参 if [ $# -lt 1 ];then echo "请输入参数"; exit fi #获取文件路径 file=$@ #获取子路径 filename=`basename $file` #获取父路径 dirpath=`dirname $file` #获取完整路径 cd $dirpath fullpath=`pwd -P` #同步文件到DataNode for (( i=102;i<=103;i++ )) do #使终端变绿色 tput setaf 2 echo =========== node${i}.yinzhengjie.org.cn : $file =========== #使终端变回原来的颜色，即白灰色 tput setaf 7 #远程执行命令 rsync -lr $filename `whoami`@node${i}.yinzhengjie.org.cn:$fullpath #判断命令是否执行成功 if [ $? == 0 ];then echo "命令执行成功" fi done [root@node101 ~]#
[root@node101 ~]# cat /usr/local/bin/xzk.sh #!/bin/bash #@author :yinzhengjie #blog:http://www.cnblogs.com/yinzhengjie #EMAIL:y1053419035@qq.com #判断用户是否传参 if [ $# -ne 1 ];then echo "无效参数，用法为: $0 {start|stop|restart|status}" exit fi #获取用户输入的命令 cmd=$1 #定义函数功能 function zookeeperManger(){ case $cmd in start) echo "启动服务" remoteExecution start ;; stop) echo "停止服务" remoteExecution stop ;; restart) echo "重启服务" remoteExecution restart ;; status) echo "查看状态" remoteExecution status ;; *) echo "无效参数，用法为: $0 {start|stop|restart|status}" ;; esac } #定义执行的命令 function remoteExecution(){ for (( i=101 ; i<=103 ; i++ )) ; do tput setaf 2 echo ========== node${i}.yinzhengjie.org.cn zkServer.sh $1 ================ tput setaf 9 ssh node${i}.yinzhengjie.org.cn "source /etc/profile ; zkServer.sh $1" done } #调用函数 zookeeperManger [root@node101 ~]#
[root@node101 ~]# xcall.sh systemctl stop firewalld ============= node101.yinzhengjie.org.cn : systemctl stop firewalld ============ 命令执行成功 ============= node102.yinzhengjie.org.cn : systemctl stop firewalld ============ 命令执行成功 ============= node103.yinzhengjie.org.cn : systemctl stop firewalld ============ 命令执行成功 [root@node101 ~]# [root@node101 ~]# [root@node101 ~]# xcall.sh systemctl disable firewalld ============= node101.yinzhengjie.org.cn : systemctl disable firewalld ============ Removed symlink /etc/systemd/system/dbus-org.fedoraproject.FirewallD1.service. Removed symlink /etc/systemd/system/basic.target.wants/firewalld.service. 命令执行成功 ============= node102.yinzhengjie.org.cn : systemctl disable firewalld ============ Removed symlink /etc/systemd/system/dbus-org.fedoraproject.FirewallD1.service. Removed symlink /etc/systemd/system/basic.target.wants/firewalld.service. 命令执行成功 ============= node103.yinzhengjie.org.cn : systemctl disable firewalld ============ Removed symlink /etc/systemd/system/dbus-org.fedoraproject.FirewallD1.service. Removed symlink /etc/systemd/system/basic.target.wants/firewalld.service. 命令执行成功 [root@node101 ~]# [root@node101 ~]# [root@node101 ~]# [root@node101 ~]# [root@node101 ~]# xcall.sh systemctl status firewalld ============= node101.yinzhengjie.org.cn : systemctl status firewalld ============ ● firewalld.service - firewalld - dynamic firewall daemon Loaded: loaded (/usr/lib/systemd/system/firewalld.service; disabled; vendor preset: enabled) Active: inactive (dead) Feb 22 05:33:10 node101.yinzhengjie.org.cn systemd[1]: Starting firewalld - dynamic firewall daemon... Feb 22 05:33:13 node101.yinzhengjie.org.cn systemd[1]: Started firewalld - dynamic firewall daemon. Feb 22 06:34:15 node101.yinzhengjie.org.cn systemd[1]: Stopping firewalld - dynamic firewall daemon... Feb 22 06:34:16 node101.yinzhengjie.org.cn systemd[1]: Stopped firewalld - dynamic firewall daemon. Feb 22 06:34:21 node101.yinzhengjie.org.cn systemd[1]: Stopped firewalld - dynamic firewall daemon. ============= node102.yinzhengjie.org.cn : systemctl status firewalld ============ ● firewalld.service - firewalld - dynamic firewall daemon Loaded: loaded (/usr/lib/systemd/system/firewalld.service; disabled; vendor preset: enabled) Active: inactive (dead) Feb 22 05:34:08 node102.yinzhengjie.org.cn systemd[1]: Starting firewalld - dynamic firewall daemon... Feb 22 05:34:11 node102.yinzhengjie.org.cn systemd[1]: Started firewalld - dynamic firewall daemon. Feb 22 06:34:21 node102.yinzhengjie.org.cn systemd[1]: Stopping firewalld - dynamic firewall daemon... Feb 22 06:34:22 node102.yinzhengjie.org.cn systemd[1]: Stopped firewalld - dynamic firewall daemon. ============= node103.yinzhengjie.org.cn : systemctl status firewalld ============ ● firewalld.service - firewalld - dynamic firewall daemon Loaded: loaded (/usr/lib/systemd/system/firewalld.service; disabled; vendor preset: enabled) Active: inactive (dead) Feb 22 05:36:57 node103.yinzhengjie.org.cn systemd[1]: Starting firewalld - dynamic firewall daemon... Feb 22 05:36:59 node103.yinzhengjie.org.cn systemd[1]: Started firewalld - dynamic firewall daemon. Feb 22 06:34:22 node103.yinzhengjie.org.cn systemd[1]: Stopping firewalld - dynamic firewall daemon... Feb 22 06:34:23 node103.yinzhengjie.org.cn systemd[1]: Stopped firewalld - dynamic firewall daemon. [root@node101 ~]#
[root@node101 ~]# grep SELINUX=enforcing /etc/sysconfig/selinux SELINUX=enforcing [root@node101 ~]# [root@node101 ~]# xcall.sh sed -i s'#SELINUX=enforcing#SELINUX=disabled#' /etc/sysconfig/selinux ============= node101.yinzhengjie.org.cn : sed -i s#SELINUX=enforcing#SELINUX=disabled# /etc/sysconfig/selinux ============ 命令执行成功 ============= node102.yinzhengjie.org.cn : sed -i s#SELINUX=enforcing#SELINUX=disabled# /etc/sysconfig/selinux ============ 命令执行成功 ============= node103.yinzhengjie.org.cn : sed -i s#SELINUX=enforcing#SELINUX=disabled# /etc/sysconfig/selinux ============ 命令执行成功 [root@node101 ~]# [root@node101 ~]# xcall.sh grep ^SELINUX= /etc/sysconfig/selinux ============= node101.yinzhengjie.org.cn : grep ^SELINUX= /etc/sysconfig/selinux ============ SELINUX=disabled 命令执行成功 ============= node102.yinzhengjie.org.cn : grep ^SELINUX= /etc/sysconfig/selinux ============ SELINUX=disabled 命令执行成功 ============= node103.yinzhengjie.org.cn : grep ^SELINUX= /etc/sysconfig/selinux ============ SELINUX=disabled 命令执行成功 [root@node101 ~]# [root@node101 ~]# xcall.sh setenforce 0 ============= node101.yinzhengjie.org.cn : setenforce 0 ============ 命令执行成功 ============= node102.yinzhengjie.org.cn : setenforce 0 ============ 命令执行成功 ============= node103.yinzhengjie.org.cn : setenforce 0 ============ 命令执行成功 [root@node101 ~]# [root@node101 ~]# [root@node101 ~]# xcall.sh getenforce ============= node101.yinzhengjie.org.cn : getenforce ============ Permissive 命令执行成功 ============= node102.yinzhengjie.org.cn : getenforce ============ Permissive 命令执行成功 ============= node103.yinzhengjie.org.cn : getenforce ============ Permissive 命令执行成功 [root@node101 ~]#
[root@node101 ~]# xzk.sh start 启动服务 ========== node101.yinzhengjie.org.cn zkServer.sh start ================ ZooKeeper JMX enabled by default Using config: /yinzhengjie/softwares/zookeeper-3.4.13/bin/../conf/zoo.cfg Starting zookeeper ... STARTED ========== node102.yinzhengjie.org.cn zkServer.sh start ================ ZooKeeper JMX enabled by default Using config: /yinzhengjie/softwares/zookeeper-3.4.13/bin/../conf/zoo.cfg Starting zookeeper ... STARTED ========== node103.yinzhengjie.org.cn zkServer.sh start ================ ZooKeeper JMX enabled by default Using config: /yinzhengjie/softwares/zookeeper-3.4.13/bin/../conf/zoo.cfg Starting zookeeper ... STARTED [root@node101 ~]# [root@node101 ~]# [root@node101 ~]# xzk.sh status 查看状态 ========== node101.yinzhengjie.org.cn zkServer.sh status ================ ZooKeeper JMX enabled by default Using config: /yinzhengjie/softwares/zookeeper-3.4.13/bin/../conf/zoo.cfg Mode: follower ========== node102.yinzhengjie.org.cn zkServer.sh status ================ ZooKeeper JMX enabled by default Using config: /yinzhengjie/softwares/zookeeper-3.4.13/bin/../conf/zoo.cfg Mode: leader ========== node103.yinzhengjie.org.cn zkServer.sh status ================ ZooKeeper JMX enabled by default Using config: /yinzhengjie/softwares/zookeeper-3.4.13/bin/../conf/zoo.cfg Mode: follower [root@node101 ~]#
四.安装storm依赖的软件
1>.查看Storm官方网站
官方地址：http://storm.apache.org/。
GitHub地址：https://github.com/apache/storm。
2>.ZeroMQ安装（https://github.com/zeromq/zeromq4-1/）
[root@node101 ~]# wget https://github.com/zeromq/zeromq4-1/releases/download/v4.1.6/zeromq-4.1.6.tar.gz --2019-02-23 09:09:46-- https://github.com/zeromq/zeromq4-1/releases/download/v4.1.6/zeromq-4.1.6.tar.gz Resolving github.com (github.com)... 52.74.223.119, 13.229.188.59, 13.250.177.223 Connecting to github.com (github.com)|52.74.223.119|:443... connected. HTTP request sent, awaiting response... 302 Found Location: https://github-production-release-asset-2e65be.s3.amazonaws.com/25196738/5daa40f4-a071-11e6-8269-14a86dcfc1fc?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20190223%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20190223T170947Z&X-Amz-Expires=300&X-Amz-Signature=f808fc1f3a5e81026057184f80044417aafbda6c5d0cf47c2eb5736802c984de&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dzeromq-4.1.6.tar.gz&response-content-type=application%2Foctet-stream [following] --2019-02-23 09:09:47-- https://github-production-release-asset-2e65be.s3.amazonaws.com/25196738/5daa40f4-a071-11e6-8269-14a86dcfc1fc?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20190223%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20190223T170947Z&X-Amz-Expires=300&X-Amz-Signature=f808fc1f3a5e81026057184f80044417aafbda6c5d0cf47c2eb5736802c984de&X-Amz-SignedHeaders=host&actor_id=0&response-content-disposition=attachment%3B%20filename%3Dzeromq-4.1.6.tar.gz&response-content-type=application%2Foctet-stream Resolving github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)... 52.216.230.43 Connecting to github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)|52.216.230.43|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 799771 (781K) [application/octet-stream] Saving to: ‘zeromq-4.1.6.tar.gz’ 100%[=================================================================================================================================================>] 799,771 225KB/s in 3.5s 2019-02-23 09:09:52 (225 KB/s) - ‘zeromq-4.1.6.tar.gz’ saved [799771/799771] [root@node101 ~]#
[root@node101 ~]# tar -zxf zeromq-4.1.6.tar.gz -C /yinzhengjie/softwares/ [root@node101 ~]# [root@node101 ~]# cd /yinzhengjie/softwares/zeromq-4.1.6/ [root@node101 zeromq-4.1.6]# [root@node101 zeromq-4.1.6]# ll total 1320 -rw-rw-r--. 1 yinzhengjie yinzhengjie 36486 Nov 1 2016 acinclude.m4 -rw-rw-r--. 1 yinzhengjie yinzhengjie 44500 Nov 1 2016 aclocal.m4 -rw-rw-r--. 1 yinzhengjie yinzhengjie 2096 Nov 1 2016 AUTHORS -rwxrwxr-x. 1 yinzhengjie yinzhengjie 1707 Nov 1 2016 autogen.sh drwxrwxr-x. 9 yinzhengjie yinzhengjie 4096 Nov 1 2016 builds -rw-rw-r--. 1 yinzhengjie yinzhengjie 106981 Nov 1 2016 ChangeLog -rw-rw-r--. 1 yinzhengjie yinzhengjie 27893 Nov 1 2016 CMakeLists.txt drwxrwxr-x. 2 yinzhengjie yinzhengjie 4096 Nov 1 2016 config -rwxrwxr-x. 1 yinzhengjie yinzhengjie 697522 Nov 1 2016 configure -rw-rw-r--. 1 yinzhengjie yinzhengjie 17762 Nov 1 2016 configure.ac -rw-rw-r--. 1 yinzhengjie yinzhengjie 35149 Nov 1 2016 COPYING -rw-rw-r--. 1 yinzhengjie yinzhengjie 8504 Nov 1 2016 COPYING.LESSER drwxrwxr-x. 2 yinzhengjie yinzhengjie 4096 Nov 1 2016 doc drwxrwxr-x. 2 yinzhengjie yinzhengjie 36 Nov 1 2016 include -rw-rw-r--. 1 yinzhengjie yinzhengjie 9964 Nov 1 2016 INSTALL -rw-rw-r--. 1 yinzhengjie yinzhengjie 1259 Nov 1 2016 MAINTAINERS -rw-rw-r--. 1 yinzhengjie yinzhengjie 14957 Nov 1 2016 Makefile.am -rw-rw-r--. 1 yinzhengjie yinzhengjie 234077 Nov 1 2016 Makefile.in -rw-rw-r--. 1 yinzhengjie yinzhengjie 34742 Nov 1 2016 NEWS drwxrwxr-x. 2 yinzhengjie yinzhengjie 4096 Nov 1 2016 perf drwxrwxr-x. 2 yinzhengjie yinzhengjie 8192 Nov 1 2016 src drwxrwxr-x. 2 yinzhengjie yinzhengjie 4096 Nov 1 2016 tests drwxrwxr-x. 2 yinzhengjie yinzhengjie 29 Nov 1 2016 tools drwxrwxr-x. 4 yinzhengjie yinzhengjie 30 Nov 1 2016 tweetnacl -rwxrwxr-x. 1 yinzhengjie yinzhengjie 749 Nov 1 2016 version.sh -rw-rw-r--. 1 yinzhengjie yinzhengjie 6108 Nov 1 2016 zeromq.spec [root@node101 zeromq-4.1.6]#
[root@node101 ~]# yum -y install gcc c++ Loaded plugins: fastestmirror Loading mirror speeds from cached hostfile * base: mirrors.neusoft.edu.cn * extras: mirrors.cqu.edu.cn * updates: mirrors.neusoft.edu.cn Package gcc-4.8.5-36.el7.x86_64 already installed and latest version No package c++ available. Nothing to do [root@node101 ~]# yum -y install gcc gcc-c++ Loaded plugins: fastestmirror Loading mirror speeds from cached hostfile * base: mirrors.neusoft.edu.cn * extras: mirrors.aliyun.com * updates: mirrors.aliyun.com Package gcc-4.8.5-36.el7.x86_64 already installed and latest version Resolving Dependencies --> Running transaction check ---> Package gcc-c++.x86_64 0:4.8.5-36.el7 will be installed --> Processing Dependency: libstdc++-devel = 4.8.5-36.el7 for package: gcc-c++-4.8.5-36.el7.x86_64 --> Processing Dependency: libstdc++ = 4.8.5-36.el7 for package: gcc-c++-4.8.5-36.el7.x86_64 --> Running transaction check ---> Package libstdc++.x86_64 0:4.8.5-4.el7 will be updated ---> Package libstdc++.x86_64 0:4.8.5-36.el7 will be an update ---> Package libstdc++-devel.x86_64 0:4.8.5-36.el7 will be installed --> Finished Dependency Resolution Dependencies Resolved =========================================================================================================================================================================================== Package Arch Version Repository Size =========================================================================================================================================================================================== Installing: gcc-c++ x86_64 4.8.5-36.el7 base 7.2 M Installing for dependencies: libstdc++-devel x86_64 4.8.5-36.el7 base 1.5 M Updating for dependencies: libstdc++ x86_64 4.8.5-36.el7 base 304 k Transaction Summary =========================================================================================================================================================================================== Install 1 Package (+1 Dependent package) Upgrade ( 1 Dependent package) Total download size: 9.0 M Downloading packages: Delta RPMs disabled because /usr/bin/applydeltarpm not installed. (1/3): libstdc++-devel-4.8.5-36.el7.x86_64.rpm | 1.5 MB 00:00:00 (2/3): libstdc++-4.8.5-36.el7.x86_64.rpm | 304 kB 00:00:00 (3/3): gcc-c++-4.8.5-36.el7.x86_64.rpm | 7.2 MB 00:00:01 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Total 4.8 MB/s | 9.0 MB 00:00:01 Running transaction check Running transaction test Transaction test succeeded Running transaction Updating : libstdc++-4.8.5-36.el7.x86_64 1/4 Installing : libstdc++-devel-4.8.5-36.el7.x86_64 2/4 Installing : gcc-c++-4.8.5-36.el7.x86_64 3/4 Cleanup : libstdc++-4.8.5-4.el7.x86_64 4/4 Verifying : gcc-c++-4.8.5-36.el7.x86_64 1/4 Verifying : libstdc++-4.8.5-36.el7.x86_64 2/4 Verifying : libstdc++-devel-4.8.5-36.el7.x86_64 3/4 Verifying : libstdc++-4.8.5-4.el7.x86_64 4/4 Installed: gcc-c++.x86_64 0:4.8.5-36.el7 Dependency Installed: libstdc++-devel.x86_64 0:4.8.5-36.el7 Dependency Updated: libstdc++.x86_64 0:4.8.5-36.el7 Complete! [root@node101 ~]#
[root@node101 zeromq-4.1.6]# pwd /yinzhengjie/softwares/zeromq-4.1.6 [root@node101 zeromq-4.1.6]# [root@node101 zeromq-4.1.6]# ./configure checking for a BSD-compatible install... /usr/bin/install -c checking whether build environment is sane... yes checking for a thread-safe mkdir -p... /usr/bin/mkdir -p checking for gawk... gawk checking whether make sets $(MAKE)... yes checking how to create a ustar tar archive... gnutar checking whether make supports nested variables... yes checking for gcc... gcc checking whether the C compiler works... yes checking for C compiler default output file name... a.out checking for suffix of executables... checking whether we are cross compiling... no checking for suffix of object files... o checking whether we are using the GNU C compiler... yes checking whether gcc accepts -g... yes checking for gcc option to accept ISO C89... none needed checking for style of include used by make... GNU checking dependency style of gcc... gcc3 checking for gcc option to accept ISO C99... -std=gnu99 checking for g++... g++ checking whether we are using the GNU C++ compiler... yes checking whether g++ accepts -g... yes checking dependency style of g++... gcc3 checking whether gcc -std=gnu99 and cc understand -c and -o together... yes checking for a sed that does not truncate output... /usr/bin/sed checking for gawk... (cached) gawk checking for pkg-config... /usr/bin/pkg-config checking pkg-config is at least version 0.9.0... yes checking for xmlto... no checking for asciidoc... no checking build system type... x86_64-unknown-linux-gnu checking host system type... x86_64-unknown-linux-gnu checking how to print strings... printf checking for a sed that does not truncate output... (cached) /usr/bin/sed checking for grep that handles long lines and -e... /usr/bin/grep checking for egrep... /usr/bin/grep -E checking for fgrep... /usr/bin/grep -F checking for ld used by gcc -std=gnu99... /usr/bin/ld checking if the linker (/usr/bin/ld) is GNU ld... yes checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B checking the name lister (/usr/bin/nm -B) interface... BSD nm checking whether ln -s works... yes checking the maximum length of command line arguments... 1572864 checking whether the shell understands some XSI constructs... yes checking whether the shell understands "+="... yes checking how to convert x86_64-unknown-linux-gnu file names to x86_64-unknown-linux-gnu format... func_convert_file_noop checking how to convert x86_64-unknown-linux-gnu file names to toolchain format... func_convert_file_noop checking for /usr/bin/ld option to reload object files... -r checking for objdump... objdump checking how to recognize dependent libraries... pass_all checking for dlltool... dlltool checking how to associate runtime and link libraries... printf %s\n checking for ar... ar checking for archiver @FILE support... @ checking for strip... strip checking for ranlib... ranlib checking command to parse /usr/bin/nm -B output from gcc -std=gnu99 object... ok checking for sysroot... no checking for mt... no checking if : is a manifest tool... no checking how to run the C preprocessor... gcc -std=gnu99 -E checking for ANSI C header files... yes checking for sys/types.h... yes checking for sys/stat.h... yes checking for stdlib.h... yes checking for string.h... yes checking for memory.h... yes checking for strings.h... yes checking for inttypes.h... yes checking for stdint.h... yes checking for unistd.h... yes checking for dlfcn.h... yes checking for objdir... .libs checking if gcc -std=gnu99 supports -fno-rtti -fno-exceptions... no checking for gcc -std=gnu99 option to produce PIC... -fPIC -DPIC checking if gcc -std=gnu99 PIC flag -fPIC -DPIC works... yes checking if gcc -std=gnu99 static flag -static works... no checking if gcc -std=gnu99 supports -c -o file.o... yes checking if gcc -std=gnu99 supports -c -o file.o... (cached) yes checking whether the gcc -std=gnu99 linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes checking whether -lc should be explicitly linked in... no checking dynamic linker characteristics... GNU/Linux ld.so checking how to hardcode library paths into programs... immediate checking whether stripping libraries is possible... yes checking if libtool supports shared libraries... yes checking whether to build shared libraries... yes checking whether to build static libraries... yes checking how to run the C++ preprocessor... g++ -E checking for ld used by g++... /usr/bin/ld -m elf_x86_64 checking if the linker (/usr/bin/ld -m elf_x86_64) is GNU ld... yes checking whether the g++ linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes checking for g++ option to produce PIC... -fPIC -DPIC checking if g++ PIC flag -fPIC -DPIC works... yes checking if g++ static flag -static works... no checking if g++ supports -c -o file.o... yes checking if g++ supports -c -o file.o... (cached) yes checking whether the g++ linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes checking dynamic linker characteristics... (cached) GNU/Linux ld.so checking how to hardcode library paths into programs... immediate checking whether the C compiler works... yes checking whether we are using Intel C compiler... no checking whether we are using Sun Studio C compiler... no checking whether we are using clang C compiler... no checking whether we are using gcc >= 4 C compiler... yes checking whether the C++ compiler works... yes checking whether we are using Intel C++ compiler... no checking whether we are using Sun Studio C++ compiler... no checking whether we are using clang C++ compiler... no checking whether we are using gcc >= 4 C++ compiler... yes checking whether to enable debugging information... no checking whether to enable code coverage... no checking if TIPC is available and supports nonblocking connect... no checking for pthread_create in -lpthread... yes checking for clock_gettime in -lrt... yes checking whether C++ compiler supports -fvisibility=hidden... yes checking whether C++ compiler supports dso visibility... yes checking for asciidoc... no checking for xmlto... no configure: WARNING: You are building an unreleased version of 0MQ and asciidoc or xmlto are not installed. configure: WARNING: Documentation will not be built and manual pages will not be installed. checking whether to build documentation... no checking whether to install manpages... no configure: Choosing polling system from 'kqueue epoll devpoll poll select'... configure: Using 'epoll' polling system checking for ANSI C header files... (cached) yes checking errno.h usability... yes checking errno.h presence... yes checking for errno.h... yes checking time.h usability... yes checking time.h presence... yes checking for time.h... yes checking for unistd.h... (cached) yes checking limits.h usability... yes checking limits.h presence... yes checking for limits.h... yes checking stddef.h usability... yes checking stddef.h presence... yes checking for stddef.h... yes checking for stdlib.h... (cached) yes checking for string.h... (cached) yes checking arpa/inet.h usability... yes checking arpa/inet.h presence... yes checking for arpa/inet.h... yes checking netinet/tcp.h usability... yes checking netinet/tcp.h presence... yes checking for netinet/tcp.h... yes checking netinet/in.h usability... yes checking netinet/in.h presence... yes checking for netinet/in.h... yes checking sys/socket.h usability... yes checking sys/socket.h presence... yes checking for sys/socket.h... yes checking sys/time.h usability... yes checking sys/time.h presence... yes checking for sys/time.h... yes checking ifaddrs.h usability... yes checking ifaddrs.h presence... yes checking for ifaddrs.h... yes checking sys/uio.h usability... yes checking sys/uio.h presence... yes checking for sys/uio.h... yes checking sys/eventfd.h usability... yes checking sys/eventfd.h presence... yes checking for sys/eventfd.h... yes checking whether SO_PEERCRED is declared... yes checking whether LOCAL_PEERCRED is declared... no checking for stdbool.h that conforms to C99... yes checking for _Bool... no checking for an ANSI C-conforming const... yes checking for inline... inline checking for size_t... yes checking for ssize_t... yes checking whether time.h and sys/time.h may both be included... yes checking for uint32_t... yes checking for working volatile... yes configure: Using tweetnacl for CURVE security checking "with_norm_ext = no"... no checking how to enable additional warnings for C++ compiler... -Wall checking how to turn warnings to errors in C++ compiler... -Werror checking how to enable strict standards compliance in C++ compiler... -pedantic checking return type of signal handlers... void checking for perror... yes checking for gettimeofday... yes checking for clock_gettime... yes checking for memset... yes checking for socket... yes checking for getifaddrs... yes checking for freeifaddrs... yes checking for fork... yes checking alloca.h usability... yes checking alloca.h presence... yes checking for alloca.h... yes checking whether SOCK_CLOEXEC is supported... yes checking whether SO_KEEPALIVE is supported... yes checking whether TCP_KEEPCNT is supported... yes checking whether TCP_KEEPIDLE is supported... yes checking whether TCP_KEEPINTVL is supported... yes checking whether TCP_KEEPALIVE is supported... no configure: creating ./config.status config.status: creating Makefile config.status: creating src/libzmq.pc config.status: creating doc/Makefile config.status: creating builds/Makefile config.status: creating builds/msvc/Makefile config.status: creating builds/redhat/zeromq.spec config.status: creating src/platform.hpp config.status: executing depfiles commands config.status: executing libtool commands [root@node101 zeromq-4.1.6]# echo $? 0 [root@node101 zeromq-4.1.6]#
[root@node101 zeromq-4.1.6]# pwd /yinzhengjie/softwares/zeromq-4.1.6 [root@node101 zeromq-4.1.6]# [root@node101 zeromq-4.1.6]# [root@node101 zeromq-4.1.6]# [root@node101 zeromq-4.1.6]# make Making all in doc make[1]: Entering directory `/yinzhengjie/softwares/zeromq-4.1.6/doc' make[1]: Nothing to be done for `all'. make[1]: Leaving directory `/yinzhengjie/softwares/zeromq-4.1.6/doc' make[1]: Entering directory `/yinzhengjie/softwares/zeromq-4.1.6' CXX src/libzmq_la-address.lo CXX src/libzmq_la-clock.lo CXX src/libzmq_la-ctx.lo CXX src/libzmq_la-curve_client.lo CXX src/libzmq_la-curve_server.lo CXX src/libzmq_la-dealer.lo CXX src/libzmq_la-devpoll.lo CXX src/libzmq_la-dist.lo CXX src/libzmq_la-epoll.lo CXX src/libzmq_la-err.lo CXX src/libzmq_la-fq.lo CXX src/libzmq_la-gssapi_mechanism_base.lo CXX src/libzmq_la-gssapi_client.lo CXX src/libzmq_la-gssapi_server.lo CXX src/libzmq_la-io_object.lo CXX src/libzmq_la-io_thread.lo CXX src/libzmq_la-ip.lo CXX src/libzmq_la-ipc_address.lo CXX src/libzmq_la-ipc_connecter.lo CXX src/libzmq_la-ipc_listener.lo CXX src/libzmq_la-kqueue.lo CXX src/libzmq_la-lb.lo CXX src/libzmq_la-mailbox.lo CXX src/libzmq_la-mechanism.lo CXX src/libzmq_la-metadata.lo CXX src/libzmq_la-msg.lo CXX src/libzmq_la-mtrie.lo CXX src/libzmq_la-norm_engine.lo CXX src/libzmq_la-null_mechanism.lo CXX src/libzmq_la-object.lo CXX src/libzmq_la-options.lo CXX src/libzmq_la-own.lo CXX src/libzmq_la-pair.lo CXX src/libzmq_la-pgm_receiver.lo CXX src/libzmq_la-pgm_sender.lo CXX src/libzmq_la-pgm_socket.lo CXX src/libzmq_la-pipe.lo CXX src/libzmq_la-plain_client.lo CXX src/libzmq_la-plain_server.lo CXX src/libzmq_la-poll.lo CXX src/libzmq_la-poller_base.lo CXX src/libzmq_la-proxy.lo CXX src/libzmq_la-pub.lo CXX src/libzmq_la-pull.lo CXX src/libzmq_la-push.lo CXX src/libzmq_la-random.lo CXX src/libzmq_la-raw_decoder.lo CXX src/libzmq_la-raw_encoder.lo CXX src/libzmq_la-reaper.lo CXX src/libzmq_la-rep.lo CXX src/libzmq_la-req.lo CXX src/libzmq_la-router.lo CXX src/libzmq_la-select.lo CXX src/libzmq_la-session_base.lo CXX src/libzmq_la-signaler.lo CXX src/libzmq_la-socket_base.lo CXX src/libzmq_la-socks.lo CXX src/libzmq_la-socks_connecter.lo CXX src/libzmq_la-stream.lo CXX src/libzmq_la-stream_engine.lo CXX src/libzmq_la-sub.lo CXX src/libzmq_la-tcp.lo CXX src/libzmq_la-tcp_address.lo CXX src/libzmq_la-tcp_connecter.lo CXX src/libzmq_la-tcp_listener.lo CXX src/libzmq_la-thread.lo CXX src/libzmq_la-tipc_address.lo CXX src/libzmq_la-tipc_connecter.lo CXX src/libzmq_la-tipc_listener.lo CXX src/libzmq_la-trie.lo CXX src/libzmq_la-v1_decoder.lo CXX src/libzmq_la-v2_decoder.lo CXX src/libzmq_la-v1_encoder.lo CXX src/libzmq_la-v2_encoder.lo CXX src/libzmq_la-xpub.lo CXX src/libzmq_la-xsub.lo CXX src/libzmq_la-zmq.lo CXX src/libzmq_la-zmq_utils.lo CC tweetnacl/src/libzmq_la-tweetnacl.lo CC tweetnacl/contrib/randombytes/libzmq_la-devurandom.lo CXXLD libzmq.la CXX tools/curve_keygen.o CXXLD curve_keygen CXX perf/local_lat.o CXXLD local_lat CXX perf/remote_lat.o CXXLD remote_lat CXX perf/local_thr.o CXXLD local_thr CXX perf/remote_thr.o CXXLD remote_thr CXX perf/inproc_lat.o CXXLD inproc_lat CXX perf/inproc_thr.o CXXLD inproc_thr make[1]: Leaving directory `/yinzhengjie/softwares/zeromq-4.1.6' [root@node101 zeromq-4.1.6]# [root@node101 zeromq-4.1.6]# echo $? 0 [root@node101 zeromq-4.1.6]# [root@node101 zeromq-4.1.6]#
[root@node101 zeromq-4.1.6]# make install Making install in doc make[1]: Entering directory `/yinzhengjie/softwares/zeromq-4.1.6/doc' make[2]: Entering directory `/yinzhengjie/softwares/zeromq-4.1.6/doc' make[2]: Nothing to be done for `install-exec-am'. test -z "/usr/local/share/man/man3" || /usr/bin/mkdir -p "/usr/local/share/man/man3" test -z "/usr/local/share/man/man7" || /usr/bin/mkdir -p "/usr/local/share/man/man7" make[2]: Leaving directory `/yinzhengjie/softwares/zeromq-4.1.6/doc' make[1]: Leaving directory `/yinzhengjie/softwares/zeromq-4.1.6/doc' make[1]: Entering directory `/yinzhengjie/softwares/zeromq-4.1.6' make[2]: Entering directory `/yinzhengjie/softwares/zeromq-4.1.6' test -z "/usr/local/lib" || /usr/bin/mkdir -p "/usr/local/lib" /bin/sh ./libtool --mode=install /usr/bin/install -c libzmq.la '/usr/local/lib' libtool: install: /usr/bin/install -c .libs/libzmq.so.5.0.2 /usr/local/lib/libzmq.so.5.0.2 libtool: install: (cd /usr/local/lib && { ln -s -f libzmq.so.5.0.2 libzmq.so.5 || { rm -f libzmq.so.5 && ln -s libzmq.so.5.0.2 libzmq.so.5; }; }) libtool: install: (cd /usr/local/lib && { ln -s -f libzmq.so.5.0.2 libzmq.so || { rm -f libzmq.so && ln -s libzmq.so.5.0.2 libzmq.so; }; }) libtool: install: /usr/bin/install -c .libs/libzmq.lai /usr/local/lib/libzmq.la libtool: install: /usr/bin/install -c .libs/libzmq.a /usr/local/lib/libzmq.a libtool: install: chmod 644 /usr/local/lib/libzmq.a libtool: install: ranlib /usr/local/lib/libzmq.a libtool: finish: PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/yinzhengjie/softwares/jdk/bin:/yinzhengjie/softwares/zookeeper-3.4.13/bin:/root/bin:/sbin" ldconfig -n /usr/local/lib ---------------------------------------------------------------------- Libraries have been installed in: /usr/local/lib If you ever happen to want to link against installed libraries in a given directory, LIBDIR, you must either use libtool, and specify the full pathname of the library, or use the `-LLIBDIR' flag during linking and do at least one of the following: - add LIBDIR to the `LD_LIBRARY_PATH' environment variable during execution - add LIBDIR to the `LD_RUN_PATH' environment variable during linking - use the `-Wl,-rpath -Wl,LIBDIR' linker flag - have your system administrator add LIBDIR to `/etc/ld.so.conf' See any operating system documentation about shared libraries for more information, such as the ld(1) and ld.so(8) manual pages. ---------------------------------------------------------------------- test -z "/usr/local/bin" || /usr/bin/mkdir -p "/usr/local/bin" /bin/sh ./libtool --mode=install /usr/bin/install -c curve_keygen '/usr/local/bin' libtool: install: /usr/bin/install -c .libs/curve_keygen /usr/local/bin/curve_keygen test -z "/usr/local/include" || /usr/bin/mkdir -p "/usr/local/include" /usr/bin/install -c -m 644 include/zmq.h include/zmq_utils.h '/usr/local/include' test -z "/usr/local/lib/pkgconfig" || /usr/bin/mkdir -p "/usr/local/lib/pkgconfig" /usr/bin/install -c -m 644 src/libzmq.pc '/usr/local/lib/pkgconfig' make[2]: Leaving directory `/yinzhengjie/softwares/zeromq-4.1.6' make[1]: Leaving directory `/yinzhengjie/softwares/zeromq-4.1.6' [root@node101 zeromq-4.1.6]# echo $? 0 [root@node101 zeromq-4.1.6]#
3>JZMQ安装（https://github.com/nathanmarz/jzmq）
[root@node101 ~]# yum -y install git Loaded plugins: fastestmirror Loading mirror speeds from cached hostfile * base: mirrors.neusoft.edu.cn * extras: mirrors.cqu.edu.cn * updates: mirrors.neusoft.edu.cn Resolving Dependencies --> Running transaction check ---> Package git.x86_64 0:1.8.3.1-20.el7 will be installed --> Processing Dependency: perl-Git = 1.8.3.1-20.el7 for package: git-1.8.3.1-20.el7.x86_64 --> Processing Dependency: perl >= 5.008 for package: git-1.8.3.1-20.el7.x86_64 --> Processing Dependency: perl(warnings) for package: git-1.8.3.1-20.el7.x86_64 --> Processing Dependency: perl(vars) for package: git-1.8.3.1-20.el7.x86_64 --> Processing Dependency: perl(strict) for package: git-1.8.3.1-20.el7.x86_64 --> Processing Dependency: perl(lib) for package: git-1.8.3.1-20.el7.x86_64 --> Processing Dependency: perl(Term::ReadKey) for package: git-1.8.3.1-20.el7.x86_64 --> Processing Dependency: perl(Git) for package: git-1.8.3.1-20.el7.x86_64 --> Processing Dependency: perl(Getopt::Long) for package: git-1.8.3.1-20.el7.x86_64 --> Processing Dependency: perl(File::stat) for package: git-1.8.3.1-20.el7.x86_64 --> Processing Dependency: perl(File::Temp) for package: git-1.8.3.1-20.el7.x86_64 --> Processing Dependency: perl(File::Spec) for package: git-1.8.3.1-20.el7.x86_64 --> Processing Dependency: perl(File::Path) for package: git-1.8.3.1-20.el7.x86_64 --> Processing Dependency: perl(File::Find) for package: git-1.8.3.1-20.el7.x86_64 --> Processing Dependency: perl(File::Copy) for package: git-1.8.3.1-20.el7.x86_64 --> Processing Dependency: perl(File::Basename) for package: git-1.8.3.1-20.el7.x86_64 --> Processing Dependency: perl(Exporter) for package: git-1.8.3.1-20.el7.x86_64 --> Processing Dependency: perl(Error) for package: git-1.8.3.1-20.el7.x86_64 --> Processing Dependency: /usr/bin/perl for package: git-1.8.3.1-20.el7.x86_64 --> Running transaction check ---> Package perl.x86_64 4:5.16.3-294.el7_6 will be installed --> Processing Dependency: perl-libs = 4:5.16.3-294.el7_6 for package: 4:perl-5.16.3-294.el7_6.x86_64 --> Processing Dependency: perl(Socket) >= 1.3 for package: 4:perl-5.16.3-294.el7_6.x86_64 --> Processing Dependency: perl(Scalar::Util) >= 1.10 for package: 4:perl-5.16.3-294.el7_6.x86_64 --> Processing Dependency: perl-macros for package: 4:perl-5.16.3-294.el7_6.x86_64 --> Processing Dependency: perl-libs for package: 4:perl-5.16.3-294.el7_6.x86_64 --> Processing Dependency: perl(threads::shared) for package: 4:perl-5.16.3-294.el7_6.x86_64 --> Processing Dependency: perl(threads) for package: 4:perl-5.16.3-294.el7_6.x86_64 --> Processing Dependency: perl(constant) for package: 4:perl-5.16.3-294.el7_6.x86_64 --> Processing Dependency: perl(Time::Local) for package: 4:perl-5.16.3-294.el7_6.x86_64 --> Processing Dependency: perl(Time::HiRes) for package: 4:perl-5.16.3-294.el7_6.x86_64 --> Processing Dependency: perl(Storable) for package: 4:perl-5.16.3-294.el7_6.x86_64 --> Processing Dependency: perl(Socket) for package: 4:perl-5.16.3-294.el7_6.x86_64 --> Processing Dependency: perl(Scalar::Util) for package: 4:perl-5.16.3-294.el7_6.x86_64 --> Processing Dependency: perl(Pod::Simple::XHTML) for package: 4:perl-5.16.3-294.el7_6.x86_64 --> Processing Dependency: perl(Pod::Simple::Search) for package: 4:perl-5.16.3-294.el7_6.x86_64 --> Processing Dependency: perl(Filter::Util::Call) for package: 4:perl-5.16.3-294.el7_6.x86_64 --> Processing Dependency: perl(Carp) for package: 4:perl-5.16.3-294.el7_6.x86_64 --> Processing Dependency: libperl.so()(64bit) for package: 4:perl-5.16.3-294.el7_6.x86_64 ---> Package perl-Error.noarch 1:0.17020-2.el7 will be installed ---> Package perl-Exporter.noarch 0:5.68-3.el7 will be installed ---> Package perl-File-Path.noarch 0:2.09-2.el7 will be installed ---> Package perl-File-Temp.noarch 0:0.23.01-3.el7 will be installed ---> Package perl-Getopt-Long.noarch 0:2.40-3.el7 will be installed --> Processing Dependency: perl(Pod::Usage) >= 1.14 for package: perl-Getopt-Long-2.40-3.el7.noarch --> Processing Dependency: perl(Text::ParseWords) for package: perl-Getopt-Long-2.40-3.el7.noarch ---> Package perl-Git.noarch 0:1.8.3.1-20.el7 will be installed ---> Package perl-PathTools.x86_64 0:3.40-5.el7 will be installed ---> Package perl-TermReadKey.x86_64 0:2.30-20.el7 will be installed --> Running transaction check ---> Package perl-Carp.noarch 0:1.26-244.el7 will be installed ---> Package perl-Filter.x86_64 0:1.49-3.el7 will be installed ---> Package perl-Pod-Simple.noarch 1:3.28-4.el7 will be installed --> Processing Dependency: perl(Pod::Escapes) >= 1.04 for package: 1:perl-Pod-Simple-3.28-4.el7.noarch --> Processing Dependency: perl(Encode) for package: 1:perl-Pod-Simple-3.28-4.el7.noarch ---> Package perl-Pod-Usage.noarch 0:1.63-3.el7 will be installed --> Processing Dependency: perl(Pod::Text) >= 3.15 for package: perl-Pod-Usage-1.63-3.el7.noarch --> Processing Dependency: perl-Pod-Perldoc for package: perl-Pod-Usage-1.63-3.el7.noarch ---> Package perl-Scalar-List-Utils.x86_64 0:1.27-248.el7 will be installed ---> Package perl-Socket.x86_64 0:2.010-4.el7 will be installed ---> Package perl-Storable.x86_64 0:2.45-3.el7 will be installed ---> Package perl-Text-ParseWords.noarch 0:3.29-4.el7 will be installed ---> Package perl-Time-HiRes.x86_64 4:1.9725-3.el7 will be installed ---> Package perl-Time-Local.noarch 0:1.2300-2.el7 will be installed ---> Package perl-constant.noarch 0:1.27-2.el7 will be installed ---> Package perl-libs.x86_64 4:5.16.3-294.el7_6 will be installed ---> Package perl-macros.x86_64 4:5.16.3-294.el7_6 will be installed ---> Package perl-threads.x86_64 0:1.87-4.el7 will be installed ---> Package perl-threads-shared.x86_64 0:1.43-6.el7 will be installed --> Running transaction check ---> Package perl-Encode.x86_64 0:2.51-7.el7 will be installed ---> Package perl-Pod-Escapes.noarch 1:1.04-294.el7_6 will be installed ---> Package perl-Pod-Perldoc.noarch 0:3.20-4.el7 will be installed --> Processing Dependency: perl(parent) for package: perl-Pod-Perldoc-3.20-4.el7.noarch --> Processing Dependency: perl(HTTP::Tiny) for package: perl-Pod-Perldoc-3.20-4.el7.noarch ---> Package perl-podlators.noarch 0:2.5.1-3.el7 will be installed --> Running transaction check ---> Package perl-HTTP-Tiny.noarch 0:0.033-3.el7 will be installed ---> Package perl-parent.noarch 1:0.225-244.el7 will be installed --> Finished Dependency Resolution Dependencies Resolved =========================================================================================================================================================================================== Package Arch Version Repository Size =========================================================================================================================================================================================== Installing: git x86_64 1.8.3.1-20.el7 updates 4.4 M Installing for dependencies: perl x86_64 4:5.16.3-294.el7_6 updates 8.0 M perl-Carp noarch 1.26-244.el7 base 19 k perl-Encode x86_64 2.51-7.el7 base 1.5 M perl-Error noarch 1:0.17020-2.el7 base 32 k perl-Exporter noarch 5.68-3.el7 base 28 k perl-File-Path noarch 2.09-2.el7 base 26 k perl-File-Temp noarch 0.23.01-3.el7 base 56 k perl-Filter x86_64 1.49-3.el7 base 76 k perl-Getopt-Long noarch 2.40-3.el7 base 56 k perl-Git noarch 1.8.3.1-20.el7 updates 55 k perl-HTTP-Tiny noarch 0.033-3.el7 base 38 k perl-PathTools x86_64 3.40-5.el7 base 82 k perl-Pod-Escapes noarch 1:1.04-294.el7_6 updates 51 k perl-Pod-Perldoc noarch 3.20-4.el7 base 87 k perl-Pod-Simple noarch 1:3.28-4.el7 base 216 k perl-Pod-Usage noarch 1.63-3.el7 base 27 k perl-Scalar-List-Utils x86_64 1.27-248.el7 base 36 k perl-Socket x86_64 2.010-4.el7 base 49 k perl-Storable x86_64 2.45-3.el7 base 77 k perl-TermReadKey x86_64 2.30-20.el7 base 31 k perl-Text-ParseWords noarch 3.29-4.el7 base 14 k perl-Time-HiRes x86_64 4:1.9725-3.el7 base 45 k perl-Time-Local noarch 1.2300-2.el7 base 24 k perl-constant noarch 1.27-2.el7 base 19 k perl-libs x86_64 4:5.16.3-294.el7_6 updates 688 k perl-macros x86_64 4:5.16.3-294.el7_6 updates 44 k perl-parent noarch 1:0.225-244.el7 base 12 k perl-podlators noarch 2.5.1-3.el7 base 112 k perl-threads x86_64 1.87-4.el7 base 49 k perl-threads-shared x86_64 1.43-6.el7 base 39 k Transaction Summary =========================================================================================================================================================================================== Install 1 Package (+30 Dependent packages) Total download size: 16 M Installed size: 59 M Downloading packages: (1/31): perl-Carp-1.26-244.el7.noarch.rpm | 19 kB 00:00:00 (2/31): perl-Exporter-5.68-3.el7.noarch.rpm | 28 kB 00:00:00 (3/31): perl-Error-0.17020-2.el7.noarch.rpm | 32 kB 00:00:00 (4/31): perl-File-Path-2.09-2.el7.noarch.rpm | 26 kB 00:00:00 (5/31): perl-File-Temp-0.23.01-3.el7.noarch.rpm | 56 kB 00:00:00 (6/31): perl-Filter-1.49-3.el7.x86_64.rpm | 76 kB 00:00:00 (7/31): git-1.8.3.1-20.el7.x86_64.rpm | 4.4 MB 00:00:00 (8/31): perl-Getopt-Long-2.40-3.el7.noarch.rpm | 56 kB 00:00:00 (9/31): perl-Git-1.8.3.1-20.el7.noarch.rpm | 55 kB 00:00:00 (10/31): perl-HTTP-Tiny-0.033-3.el7.noarch.rpm | 38 kB 00:00:00 (11/31): perl-PathTools-3.40-5.el7.x86_64.rpm | 82 kB 00:00:00 (12/31): perl-Pod-Perldoc-3.20-4.el7.noarch.rpm | 87 kB 00:00:00 (13/31): perl-Pod-Usage-1.63-3.el7.noarch.rpm | 27 kB 00:00:00 (14/31): perl-Pod-Simple-3.28-4.el7.noarch.rpm | 216 kB 00:00:00 (15/31): perl-Scalar-List-Utils-1.27-248.el7.x86_64.rpm | 36 kB 00:00:00 (16/31): perl-Socket-2.010-4.el7.x86_64.rpm | 49 kB 00:00:00 (17/31): perl-Storable-2.45-3.el7.x86_64.rpm | 77 kB 00:00:00 (18/31): perl-TermReadKey-2.30-20.el7.x86_64.rpm | 31 kB 00:00:00 (19/31): perl-Text-ParseWords-3.29-4.el7.noarch.rpm | 14 kB 00:00:00 (20/31): perl-Pod-Escapes-1.04-294.el7_6.noarch.rpm | 51 kB 00:00:00 (21/31): perl-Time-HiRes-1.9725-3.el7.x86_64.rpm | 45 kB 00:00:00 (22/31): perl-Time-Local-1.2300-2.el7.noarch.rpm | 24 kB 00:00:00 (23/31): perl-constant-1.27-2.el7.noarch.rpm | 19 kB 00:00:00 (24/31): perl-macros-5.16.3-294.el7_6.x86_64.rpm | 44 kB 00:00:00 (25/31): perl-parent-0.225-244.el7.noarch.rpm | 12 kB 00:00:00 (26/31): perl-threads-1.87-4.el7.x86_64.rpm | 49 kB 00:00:00 (27/31): perl-podlators-2.5.1-3.el7.noarch.rpm | 112 kB 00:00:00 (28/31): perl-threads-shared-1.43-6.el7.x86_64.rpm | 39 kB 00:00:00 (29/31): perl-Encode-2.51-7.el7.x86_64.rpm | 1.5 MB 00:00:01 (30/31): perl-libs-5.16.3-294.el7_6.x86_64.rpm | 688 kB 00:00:00 (31/31): perl-5.16.3-294.el7_6.x86_64.rpm | 8.0 MB 00:00:03 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Total 4.4 MB/s | 16 MB 00:00:03 Running transaction check Running transaction test Transaction test succeeded Running transaction Installing : 1:perl-parent-0.225-244.el7.noarch 1/31 Installing : perl-HTTP-Tiny-0.033-3.el7.noarch 2/31 Installing : perl-podlators-2.5.1-3.el7.noarch 3/31 Installing : perl-Pod-Perldoc-3.20-4.el7.noarch 4/31 Installing : 1:perl-Pod-Escapes-1.04-294.el7_6.noarch 5/31 Installing : perl-Encode-2.51-7.el7.x86_64 6/31 Installing : perl-Text-ParseWords-3.29-4.el7.noarch 7/31 Installing : perl-Pod-Usage-1.63-3.el7.noarch 8/31 Installing : 4:perl-libs-5.16.3-294.el7_6.x86_64 9/31 Installing : 4:perl-macros-5.16.3-294.el7_6.x86_64 10/31 Installing : 4:perl-Time-HiRes-1.9725-3.el7.x86_64 11/31 Installing : perl-Exporter-5.68-3.el7.noarch 12/31 Installing : perl-constant-1.27-2.el7.noarch 13/31 Installing : perl-Time-Local-1.2300-2.el7.noarch 14/31 Installing : perl-Socket-2.010-4.el7.x86_64 15/31 Installing : perl-Carp-1.26-244.el7.noarch 16/31 Installing : perl-Storable-2.45-3.el7.x86_64 17/31 Installing : perl-PathTools-3.40-5.el7.x86_64 18/31 Installing : perl-Scalar-List-Utils-1.27-248.el7.x86_64 19/31 Installing : perl-File-Temp-0.23.01-3.el7.noarch 20/31 Installing : perl-File-Path-2.09-2.el7.noarch 21/31 Installing : perl-threads-shared-1.43-6.el7.x86_64 22/31 Installing : perl-threads-1.87-4.el7.x86_64 23/31 Installing : 1:perl-Pod-Simple-3.28-4.el7.noarch 24/31 Installing : perl-Filter-1.49-3.el7.x86_64 25/31 Installing : perl-Getopt-Long-2.40-3.el7.noarch 26/31 Installing : 4:perl-5.16.3-294.el7_6.x86_64 27/31 Installing : 1:perl-Error-0.17020-2.el7.noarch 28/31 Installing : perl-TermReadKey-2.30-20.el7.x86_64 29/31 Installing : perl-Git-1.8.3.1-20.el7.noarch 30/31 Installing : git-1.8.3.1-20.el7.x86_64 31/31 Verifying : perl-HTTP-Tiny-0.033-3.el7.noarch 1/31 Verifying : perl-threads-shared-1.43-6.el7.x86_64 2/31 Verifying : 4:perl-Time-HiRes-1.9725-3.el7.x86_64 3/31 Verifying : 1:perl-Pod-Escapes-1.04-294.el7_6.noarch 4/31 Verifying : perl-Exporter-5.68-3.el7.noarch 5/31 Verifying : perl-constant-1.27-2.el7.noarch 6/31 Verifying : perl-PathTools-3.40-5.el7.x86_64 7/31 Verifying : 1:perl-parent-0.225-244.el7.noarch 8/31 Verifying : perl-TermReadKey-2.30-20.el7.x86_64 9/31 Verifying : 4:perl-libs-5.16.3-294.el7_6.x86_64 10/31 Verifying : perl-File-Temp-0.23.01-3.el7.noarch 11/31 Verifying : perl-Git-1.8.3.1-20.el7.noarch 12/31 Verifying : perl-Time-Local-1.2300-2.el7.noarch 13/31 Verifying : 4:perl-macros-5.16.3-294.el7_6.x86_64 14/31 Verifying : perl-Socket-2.010-4.el7.x86_64 15/31 Verifying : perl-Carp-1.26-244.el7.noarch 16/31 Verifying : 1:perl-Error-0.17020-2.el7.noarch 17/31 Verifying : git-1.8.3.1-20.el7.x86_64 18/31 Verifying : perl-Storable-2.45-3.el7.x86_64 19/31 Verifying : perl-Scalar-List-Utils-1.27-248.el7.x86_64 20/31 Verifying : perl-Pod-Usage-1.63-3.el7.noarch 21/31 Verifying : perl-Encode-2.51-7.el7.x86_64 22/31 Verifying : perl-Pod-Perldoc-3.20-4.el7.noarch 23/31 Verifying : perl-podlators-2.5.1-3.el7.noarch 24/31 Verifying : perl-File-Path-2.09-2.el7.noarch 25/31 Verifying : perl-threads-1.87-4.el7.x86_64 26/31 Verifying : 1:perl-Pod-Simple-3.28-4.el7.noarch 27/31 Verifying : perl-Filter-1.49-3.el7.x86_64 28/31 Verifying : perl-Getopt-Long-2.40-3.el7.noarch 29/31 Verifying : perl-Text-ParseWords-3.29-4.el7.noarch 30/31 Verifying : 4:perl-5.16.3-294.el7_6.x86_64 31/31 Installed: git.x86_64 0:1.8.3.1-20.el7 Dependency Installed: perl.x86_64 4:5.16.3-294.el7_6 perl-Carp.noarch 0:1.26-244.el7 perl-Encode.x86_64 0:2.51-7.el7 perl-Error.noarch 1:0.17020-2.el7 perl-Exporter.noarch 0:5.68-3.el7 perl-File-Path.noarch 0:2.09-2.el7 perl-File-Temp.noarch 0:0.23.01-3.el7 perl-Filter.x86_64 0:1.49-3.el7 perl-Getopt-Long.noarch 0:2.40-3.el7 perl-Git.noarch 0:1.8.3.1-20.el7 perl-HTTP-Tiny.noarch 0:0.033-3.el7 perl-PathTools.x86_64 0:3.40-5.el7 perl-Pod-Escapes.noarch 1:1.04-294.el7_6 perl-Pod-Perldoc.noarch 0:3.20-4.el7 perl-Pod-Simple.noarch 1:3.28-4.el7 perl-Pod-Usage.noarch 0:1.63-3.el7 perl-Scalar-List-Utils.x86_64 0:1.27-248.el7 perl-Socket.x86_64 0:2.010-4.el7 perl-Storable.x86_64 0:2.45-3.el7 perl-TermReadKey.x86_64 0:2.30-20.el7 perl-Text-ParseWords.noarch 0:3.29-4.el7 perl-Time-HiRes.x86_64 4:1.9725-3.el7 perl-Time-Local.noarch 0:1.2300-2.el7 perl-constant.noarch 0:1.27-2.el7 perl-libs.x86_64 4:5.16.3-294.el7_6 perl-macros.x86_64 4:5.16.3-294.el7_6 perl-parent.noarch 1:0.225-244.el7 perl-podlators.noarch 0:2.5.1-3.el7 perl-threads.x86_64 0:1.87-4.el7 perl-threads-shared.x86_64 0:1.43-6.el7 Complete! [root@node101 ~]#
[root@node101 ~]# git clone https://github.com/nathanmarz/jzmq.git Cloning into 'jzmq'... remote: Enumerating objects: 611, done. remote: Total 611 (delta 0), reused 0 (delta 0), pack-reused 611 Receiving objects: 100% (611/611), 340.22 KiB | 80.00 KiB/s, done. Resolving deltas: 100% (258/258), done. [root@node101 ~]#
[root@node101 ~]# yum -y install libtool libuuid-devel uuid-devel Loaded plugins: fastestmirror Loading mirror speeds from cached hostfile * base: mirrors.neusoft.edu.cn * extras: mirrors.cqu.edu.cn * updates: mirrors.neusoft.edu.cn Package libtool-2.4.2-22.el7_3.x86_64 already installed and latest version Resolving Dependencies --> Running transaction check ---> Package libuuid-devel.x86_64 0:2.23.2-59.el7 will be installed --> Processing Dependency: libuuid = 2.23.2-59.el7 for package: libuuid-devel-2.23.2-59.el7.x86_64 ---> Package uuid-devel.x86_64 0:1.6.2-26.el7 will be installed --> Processing Dependency: uuid = 1.6.2-26.el7 for package: uuid-devel-1.6.2-26.el7.x86_64 --> Processing Dependency: libossp-uuid.so.16()(64bit) for package: uuid-devel-1.6.2-26.el7.x86_64 --> Running transaction check ---> Package libuuid.x86_64 0:2.23.2-26.el7 will be updated --> Processing Dependency: libuuid = 2.23.2-26.el7 for package: libmount-2.23.2-26.el7.x86_64 --> Processing Dependency: libuuid = 2.23.2-26.el7 for package: util-linux-2.23.2-26.el7.x86_64 --> Processing Dependency: libuuid = 2.23.2-26.el7 for package: libblkid-2.23.2-26.el7.x86_64 ---> Package libuuid.x86_64 0:2.23.2-59.el7 will be an update ---> Package uuid.x86_64 0:1.6.2-26.el7 will be installed --> Running transaction check ---> Package libblkid.x86_64 0:2.23.2-26.el7 will be updated ---> Package libblkid.x86_64 0:2.23.2-59.el7 will be an update ---> Package libmount.x86_64 0:2.23.2-26.el7 will be updated ---> Package libmount.x86_64 0:2.23.2-59.el7 will be an update ---> Package util-linux.x86_64 0:2.23.2-26.el7 will be updated ---> Package util-linux.x86_64 0:2.23.2-59.el7 will be an update --> Processing Dependency: libsmartcols = 2.23.2-59.el7 for package: util-linux-2.23.2-59.el7.x86_64 --> Processing Dependency: libsmartcols.so.1(SMARTCOLS_2.25)(64bit) for package: util-linux-2.23.2-59.el7.x86_64 --> Processing Dependency: libsmartcols.so.1()(64bit) for package: util-linux-2.23.2-59.el7.x86_64 --> Running transaction check ---> Package libsmartcols.x86_64 0:2.23.2-59.el7 will be installed --> Finished Dependency Resolution Dependencies Resolved =========================================================================================================================================================================================== Package Arch Version Repository Size =========================================================================================================================================================================================== Installing: libuuid-devel x86_64 2.23.2-59.el7 base 91 k uuid-devel x86_64 1.6.2-26.el7 base 24 k Installing for dependencies: libsmartcols x86_64 2.23.2-59.el7 base 140 k uuid x86_64 1.6.2-26.el7 base 55 k Updating for dependencies: libblkid x86_64 2.23.2-59.el7 base 181 k libmount x86_64 2.23.2-59.el7 base 182 k libuuid x86_64 2.23.2-59.el7 base 82 k util-linux x86_64 2.23.2-59.el7 base 2.0 M Transaction Summary =========================================================================================================================================================================================== Install 2 Packages (+2 Dependent packages) Upgrade ( 4 Dependent packages) Total download size: 2.7 M Downloading packages: Delta RPMs disabled because /usr/bin/applydeltarpm not installed. (1/8): libblkid-2.23.2-59.el7.x86_64.rpm | 181 kB 00:00:00 (2/8): libuuid-2.23.2-59.el7.x86_64.rpm | 82 kB 00:00:00 (3/8): libsmartcols-2.23.2-59.el7.x86_64.rpm | 140 kB 00:00:00 (4/8): libuuid-devel-2.23.2-59.el7.x86_64.rpm | 91 kB 00:00:00 (5/8): uuid-1.6.2-26.el7.x86_64.rpm | 55 kB 00:00:00 (6/8): uuid-devel-1.6.2-26.el7.x86_64.rpm | 24 kB 00:00:00 (7/8): util-linux-2.23.2-59.el7.x86_64.rpm | 2.0 MB 00:00:00 (8/8): libmount-2.23.2-59.el7.x86_64.rpm | 182 kB 00:00:00 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Total 3.2 MB/s | 2.7 MB 00:00:00 Running transaction check Running transaction test Transaction test succeeded Running transaction Updating : libuuid-2.23.2-59.el7.x86_64 1/12 Updating : libblkid-2.23.2-59.el7.x86_64 2/12 Updating : libmount-2.23.2-59.el7.x86_64 3/12 Installing : libsmartcols-2.23.2-59.el7.x86_64 4/12 Installing : uuid-1.6.2-26.el7.x86_64 5/12 Installing : uuid-devel-1.6.2-26.el7.x86_64 6/12 Updating : util-linux-2.23.2-59.el7.x86_64 7/12 Installing : libuuid-devel-2.23.2-59.el7.x86_64 8/12 Cleanup : util-linux-2.23.2-26.el7.x86_64 9/12 Cleanup : libmount-2.23.2-26.el7.x86_64 10/12 Cleanup : libblkid-2.23.2-26.el7.x86_64 11/12 Cleanup : libuuid-2.23.2-26.el7.x86_64 12/12 Verifying : libblkid-2.23.2-59.el7.x86_64 1/12 Verifying : libuuid-2.23.2-59.el7.x86_64 2/12 Verifying : libuuid-devel-2.23.2-59.el7.x86_64 3/12 Verifying : uuid-1.6.2-26.el7.x86_64 4/12 Verifying : uuid-devel-1.6.2-26.el7.x86_64 5/12 Verifying : libmount-2.23.2-59.el7.x86_64 6/12 Verifying : util-linux-2.23.2-59.el7.x86_64 7/12 Verifying : libsmartcols-2.23.2-59.el7.x86_64 8/12 Verifying : libmount-2.23.2-26.el7.x86_64 9/12 Verifying : libblkid-2.23.2-26.el7.x86_64 10/12 Verifying : util-linux-2.23.2-26.el7.x86_64 11/12 Verifying : libuuid-2.23.2-26.el7.x86_64 12/12 Installed: libuuid-devel.x86_64 0:2.23.2-59.el7 uuid-devel.x86_64 0:1.6.2-26.el7 Dependency Installed: libsmartcols.x86_64 0:2.23.2-59.el7 uuid.x86_64 0:1.6.2-26.el7 Dependency Updated: libblkid.x86_64 0:2.23.2-59.el7 libmount.x86_64 0:2.23.2-59.el7 libuuid.x86_64 0:2.23.2-59.el7 util-linux.x86_64 0:2.23.2-59.el7 Complete! [root@node101 ~]#
[root@node101 ~]# cd /yinzhengjie/softwares/jzmq/ [root@node101 jzmq]# [root@node101 jzmq]# ./autogen.sh autoreconf: Entering directory `.' autoreconf: configure.in: not using Gettext autoreconf: running: aclocal -I config --force -I config aclocal: warning: autoconf input should be named 'configure.ac', not 'configure.in' autoreconf: configure.in: tracing autoreconf: running: libtoolize --copy --force libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, `config'. libtoolize: copying file `config/ltmain.sh' libtoolize: putting macros in AC_CONFIG_MACRO_DIR, `config'. libtoolize: copying file `config/libtool.m4' libtoolize: copying file `config/ltoptions.m4' libtoolize: copying file `config/ltsugar.m4' libtoolize: copying file `config/ltversion.m4' libtoolize: copying file `config/lt~obsolete.m4' aclocal: warning: autoconf input should be named 'configure.ac', not 'configure.in' autoreconf: running: /usr/bin/autoconf --include=config --force autoreconf: running: /usr/bin/autoheader --include=config --force autoreconf: running: automake --add-missing --copy --force-missing automake: warning: autoconf input should be named 'configure.ac', not 'configure.in' configure.in:31: installing 'config/compile' configure.in:28: installing 'config/config.guess' configure.in:28: installing 'config/config.sub' configure.in:14: installing 'config/install-sh' configure.in:14: installing 'config/missing' Makefile.am: installing './INSTALL' automake: warning: autoconf input should be named 'configure.ac', not 'configure.in' src/Makefile.am: installing 'config/depcomp' autoreconf: Leaving directory `.' [root@node101 jzmq]# echo $? 0 [root@node101 jzmq]# [root@node101 jzmq]#
[root@node101 jzmq]# cat -n configure | grep yinzhengjie 15672 JAVA_HOME=/yinzhengjie/softwares/jdk [root@node101 jzmq]# [root@node101 jzmq]# ./configure checking for a BSD-compatible install... /usr/bin/install -c checking whether build environment is sane... yes checking for a thread-safe mkdir -p... /usr/bin/mkdir -p checking for gawk... gawk checking whether make sets $(MAKE)... yes checking whether make supports nested variables... yes checking whether UID '0' is supported by ustar format... yes checking whether GID '0' is supported by ustar format... yes checking how to create a ustar tar archive... gnutar checking build system type... x86_64-unknown-linux-gnu checking host system type... x86_64-unknown-linux-gnu checking how to print strings... printf checking for style of include used by make... GNU checking for gcc... gcc checking whether the C compiler works... yes checking for C compiler default output file name... a.out checking for suffix of executables... checking whether we are cross compiling... no checking for suffix of object files... o checking whether we are using the GNU C compiler... yes checking whether gcc accepts -g... yes checking for gcc option to accept ISO C89... none needed checking dependency style of gcc... gcc3 checking for a sed that does not truncate output... /usr/bin/sed checking for grep that handles long lines and -e... /usr/bin/grep checking for egrep... /usr/bin/grep -E checking for fgrep... /usr/bin/grep -F checking for ld used by gcc... /usr/bin/ld checking if the linker (/usr/bin/ld) is GNU ld... yes checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B checking the name lister (/usr/bin/nm -B) interface... BSD nm checking whether ln -s works... yes checking the maximum length of command line arguments... 1572864 checking whether the shell understands some XSI constructs... yes checking whether the shell understands "+="... yes checking how to convert x86_64-unknown-linux-gnu file names to x86_64-unknown-linux-gnu format... func_convert_file_noop checking how to convert x86_64-unknown-linux-gnu file names to toolchain format... func_convert_file_noop checking for /usr/bin/ld option to reload object files... -r checking for objdump... objdump checking how to recognize dependent libraries... pass_all checking for dlltool... no checking how to associate runtime and link libraries... printf %s\n checking for ar... ar checking for archiver @FILE support... @ checking for strip... strip checking for ranlib... ranlib checking command to parse /usr/bin/nm -B output from gcc object... ok checking for sysroot... no checking for mt... no checking if : is a manifest tool... no checking how to run the C preprocessor... gcc -E checking for ANSI C header files... yes checking for sys/types.h... yes checking for sys/stat.h... yes checking for stdlib.h... yes checking for string.h... yes checking for memory.h... yes checking for strings.h... yes checking for inttypes.h... yes checking for stdint.h... yes checking for unistd.h... yes checking for dlfcn.h... yes checking for objdir... .libs checking if gcc supports -fno-rtti -fno-exceptions... no checking for gcc option to produce PIC... -fPIC -DPIC checking if gcc PIC flag -fPIC -DPIC works... yes checking if gcc static flag -static works... no checking if gcc supports -c -o file.o... yes checking if gcc supports -c -o file.o... (cached) yes checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes checking whether -lc should be explicitly linked in... no checking dynamic linker characteristics... GNU/Linux ld.so checking how to hardcode library paths into programs... immediate checking whether stripping libraries is possible... yes checking if libtool supports shared libraries... yes checking whether to build shared libraries... yes checking whether to build static libraries... yes checking for gawk... (cached) gawk checking whether gcc and cc understand -c and -o together... yes checking for g++... g++ checking whether we are using the GNU C++ compiler... yes checking whether g++ accepts -g... yes checking dependency style of g++... gcc3 checking how to run the C++ preprocessor... g++ -E checking for ld used by g++... /usr/bin/ld -m elf_x86_64 checking if the linker (/usr/bin/ld -m elf_x86_64) is GNU ld... yes checking whether the g++ linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes checking for g++ option to produce PIC... -fPIC -DPIC checking if g++ PIC flag -fPIC -DPIC works... yes checking if g++ static flag -static works... no checking if g++ supports -c -o file.o... yes checking if g++ supports -c -o file.o... (cached) yes checking whether the g++ linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes checking dynamic linker characteristics... (cached) GNU/Linux ld.so checking how to hardcode library paths into programs... immediate checking for pkg-config... /usr/bin/pkg-config checking pkg-config is at least version 0.9.0... yes checking for ZeroMQ... no checking zmq.h usability... yes checking zmq.h presence... yes checking for zmq.h... yes checking for zmq_init in -lzmq... yes checking for javac... /yinzhengjie/softwares/jdk/bin/javac checking for javah... /yinzhengjie/softwares/jdk/bin/javah checking for jar... /yinzhengjie/softwares/jdk/bin/jar checking for jni.h in /yinzhengjie/softwares/jdk/include... yes checking that generated files are newer than configure... done configure: creating ./config.status config.status: creating Makefile config.status: creating src/Makefile config.status: creating perf/Makefile config.status: creating src/config.hpp config.status: executing depfiles commands config.status: executing libtool commands [root@node101 jzmq]# [root@node101 jzmq]# echo $? [root@node101 jzmq]# [root@node101 jzmq]#
[root@node101 jzmq]# touch src/classdist_noinst.stamp [root@node101 jzmq]# [root@node101 jzmq]# touch src/org/zeromq/ZMQ$Context.class [root@node101 jzmq]# [root@node101 jzmq]# pwd /yinzhengjie/softwares/jzmq [root@node101 jzmq]# [root@node101 jzmq]# cd src [root@node101 src]# javac -d . org/zeromq/*.java [root@node101 src]# [root@node101 src]#
[root@node101 src]# make -j 4 CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ make all-am make[1]: Entering directory `/yinzhengjie/softwares/jzmq/src' CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ make[1]: Leaving directory `/yinzhengjie/softwares/jzmq/src' [root@node101 src]# [root@node101 src]# echo $? 0 [root@node101 src]# [root@node101 src]#
[root@node101 src]# make install CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ make install-am make[1]: Entering directory `/yinzhengjie/softwares/jzmq/src' CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ make[2]: Entering directory `/yinzhengjie/softwares/jzmq/src' CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ CLASSPATH=.:./.${CLASSPATH:+":$CLASSPATH"} /yinzhengjie/softwares/jdk/bin/javah -jni -classpath . org.zeromq.ZMQ /usr/bin/mkdir -p '/usr/local/lib' /bin/sh ../libtool --mode=install /usr/bin/install -c libjzmq.la '/usr/local/lib' libtool: install: /usr/bin/install -c .libs/libjzmq.so.0.0.0 /usr/local/lib/libjzmq.so.0.0.0 libtool: install: (cd /usr/local/lib && { ln -s -f libjzmq.so.0.0.0 libjzmq.so.0 || { rm -f libjzmq.so.0 && ln -s libjzmq.so.0.0.0 libjzmq.so.0; }; }) libtool: install: (cd /usr/local/lib && { ln -s -f libjzmq.so.0.0.0 libjzmq.so || { rm -f libjzmq.so && ln -s libjzmq.so.0.0.0 libjzmq.so; }; }) libtool: install: /usr/bin/install -c .libs/libjzmq.lai /usr/local/lib/libjzmq.la libtool: install: /usr/bin/install -c .libs/libjzmq.a /usr/local/lib/libjzmq.a libtool: install: chmod 644 /usr/local/lib/libjzmq.a libtool: install: ranlib /usr/local/lib/libjzmq.a libtool: finish: PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/yinzhengjie/softwares/jdk/bin:/yinzhengjie/softwares/zookeeper-3.4.13/bin:/root/bin:/sbin" ldconfig -n /usr/local/lib ---------------------------------------------------------------------- Libraries have been installed in: /usr/local/lib If you ever happen to want to link against installed libraries in a given directory, LIBDIR, you must either use libtool, and specify the full pathname of the library, or use the `-LLIBDIR' flag during linking and do at least one of the following: - add LIBDIR to the `LD_LIBRARY_PATH' environment variable during execution - add LIBDIR to the `LD_RUN_PATH' environment variable during linking - use the ` ' linker flag - have your system administrator add LIBDIR to `/etc/ld.so.conf' See any operating system documentation about shared libraries for more information, such as the ld(1) and ld.so(8) manual pages. ---------------------------------------------------------------------- /usr/bin/mkdir -p '/usr/local/share/java' /usr/bin/install -c -m 644 zmq.jar '/usr/local/share/java' make[2]: Leaving directory `/yinzhengjie/softwares/jzmq/src' make[1]: Leaving directory `/yinzhengjie/softwares/jzmq/src' [root@node101 src]# echo $? 0 [root@node101 src]# [root@node101 src]#
4>.安装并配置storm环境变量（https://www.apache.org/dyn/closer.lua/storm/apache-storm-1.2.2/apache-storm-1.2.2.tar.gz）
[root@node101.yinzhengjie.org.cn ~/Downloads]# wget http://mirror.bit.edu.cn/apache/storm/apache-storm-1.2.2/apache-storm-1.2.2.tar.gz --2019-03-25 17:55:08-- http://mirror.bit.edu.cn/apache/storm/apache-storm-1.2.2/apache-storm-1.2.2.tar.gz Resolving mirror.bit.edu.cn (mirror.bit.edu.cn)... 202.204.80.77, 2001:da8:204:2001:250:56ff:fea1:22 Connecting to mirror.bit.edu.cn (mirror.bit.edu.cn)|202.204.80.77|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 168663748 (161M) [application/octet-stream] Saving to: ‘apache-storm-1.2.2.tar.gz’ 100%[=========================================================================================================================================================================>] 168,663,748 1.09MB/s in 1m 50s 2019-03-25 17:56:58 (1.47 MB/s) - ‘apache-storm-1.2.2.tar.gz’ saved [168663748/168663748] [root@node101.yinzhengjie.org.cn ~/Downloads]#
[root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# tar -zxf apache-storm-1.2.2.tar.gz -C /yinzhengjie/softwares/ [root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# ln -s /yinzhengjie/softwares/apache-storm-1.2.2/ /yinzhengjie/softwares/storm [root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# ll /yinzhengjie/softwares/storm/ total 120 drwxr-xr-x. 2 root root 4096 Mar 25 17:57 bin drwxr-xr-x. 2 root root 4096 Mar 25 17:58 conf drwxrwxrwx. 19 502 games 4096 May 18 2018 examples drwxr-xr-x. 23 root root 4096 Mar 25 17:58 external drwxrwxrwx. 2 502 games 4096 May 18 2018 extlib drwxrwxrwx. 2 502 games 4096 May 18 2018 extlib-daemon drwxr-xr-x. 2 root root 4096 Mar 25 17:58 lib -rwsrwsrwt. 1 502 games 32263 May 18 2018 LICENSE drwxr-xr-x. 2 root root 4096 Mar 25 17:58 log4j2 -rwsrwsrwt. 1 502 games 981 May 18 2018 NOTICE drwxr-xr-x. 6 root root 4096 Mar 25 17:57 public -rwsrwsrwt. 1 502 games 15343 May 18 2018 README.markdown -rwsrwsrwt. 1 502 games 6 May 18 2018 RELEASE -rwsrwsrwt. 1 502 games 23774 May 18 2018 SECURITY.md drwxr-xr-x. 2 root root 4096 Mar 25 17:58 toollib [root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]#
[root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# ll /yinzhengjie/softwares/storm/ total 120 drwxr-xr-x. 2 root root 4096 Mar 25 17:57 bin drwxr-xr-x. 2 root root 4096 Mar 25 17:58 conf drwxrwxrwx. 19 502 games 4096 May 18 2018 examples drwxr-xr-x. 23 root root 4096 Mar 25 17:58 external drwxrwxrwx. 2 502 games 4096 May 18 2018 extlib drwxrwxrwx. 2 502 games 4096 May 18 2018 extlib-daemon drwxr-xr-x. 2 root root 4096 Mar 25 17:58 lib -rwsrwsrwt. 1 502 games 32263 May 18 2018 LICENSE drwxr-xr-x. 2 root root 4096 Mar 25 17:58 log4j2 -rwsrwsrwt. 1 502 games 981 May 18 2018 NOTICE drwxr-xr-x. 6 root root 4096 Mar 25 17:57 public -rwsrwsrwt. 1 502 games 15343 May 18 2018 README.markdown -rwsrwsrwt. 1 502 games 6 May 18 2018 RELEASE -rwsrwsrwt. 1 502 games 23774 May 18 2018 SECURITY.md drwxr-xr-x. 2 root root 4096 Mar 25 17:58 toollib [root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# mkdir /yinzhengjie/softwares/storm/data [root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# ll /yinzhengjie/softwares/storm/ total 124 drwxr-xr-x. 2 root root 4096 Mar 25 17:57 bin drwxr-xr-x. 2 root root 4096 Mar 25 17:58 conf drwxr-xr-x. 2 root root 4096 Mar 25 18:01 data drwxrwxrwx. 19 502 games 4096 May 18 2018 examples drwxr-xr-x. 23 root root 4096 Mar 25 17:58 external drwxrwxrwx. 2 502 games 4096 May 18 2018 extlib drwxrwxrwx. 2 502 games 4096 May 18 2018 extlib-daemon drwxr-xr-x. 2 root root 4096 Mar 25 17:58 lib -rwsrwsrwt. 1 502 games 32263 May 18 2018 LICENSE drwxr-xr-x. 2 root root 4096 Mar 25 17:58 log4j2 -rwsrwsrwt. 1 502 games 981 May 18 2018 NOTICE drwxr-xr-x. 6 root root 4096 Mar 25 17:57 public -rwsrwsrwt. 1 502 games 15343 May 18 2018 README.markdown -rwsrwsrwt. 1 502 games 6 May 18 2018 RELEASE -rwsrwsrwt. 1 502 games 23774 May 18 2018 SECURITY.md drwxr-xr-x. 2 root root 4096 Mar 25 17:58 toollib [root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]#
[root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# cp /yinzhengjie/softwares/storm/conf/storm.yaml /yinzhengjie/softwares/storm/conf/storm.yaml-`date +%F` [root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# vi /yinzhengjie/softwares/storm/conf/storm.yaml [root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# cat /yinzhengjie/softwares/apache-storm-1.2.2/conf/storm.yaml | egrep -v "^#|^$" storm.zookeeper.servers: - "node101.yinzhengjie.org.cn" - "node102.yinzhengjie.org.cn" - "node103.yinzhengjie.org.cn" nimbus.seeds: ["node101.yinzhengjie.org.cn"] storm.local.dir: "/yinzhengjie/softwares/storm/data" supervisor.slots.ports: - 6700 - 6701 - 6702 - 6703 [root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]#
[root@node101.yinzhengjie.org.cn ~]# [root@node101.yinzhengjie.org.cn ~]# tail -12 /etc/profile #ADD JAVA_PATH JAVA_HOME=/yinzhengjie/softwares/jdk PATH=$PATH:$JAVA_HOME/bin #ADD ZOOKEEPER_PATH ZK_HOME=/yinzhengjie/softwares/zookeeper-3.4.13 PATH=$PATH:$ZK_HOME/bin #ADD STORM_PATH STORM_HOME=/yinzhengjie/softwares/storm PATH=$PATH:$STORM_HOME/bin [root@node101.yinzhengjie.org.cn ~]# [root@node101.yinzhengjie.org.cn ~]#
5>.启动Storm集群
[root@node101.yinzhengjie.org.cn ~]# storm nimbus & [1] 14382 [root@node101.yinzhengjie.org.cn ~]# [root@node101.yinzhengjie.org.cn ~]# echo $? 0 [root@node101.yinzhengjie.org.cn ~]# [root@node101.yinzhengjie.org.cn ~]# Running: java -server -Ddaemon.name=nimbus -Dstorm.options= -Dstorm.home=/yinzhengjie/softwares/apache-storm-1.2.2 -Dstorm.log.dir=/yinzhengjie/softwares/apache-storm-1.2.2/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /yinzhengjie/softwares/apache-storm-1.2.2/*:/yinzhengjie/softwares/apache-storm-1.2.2/lib/*:/yinzhengjie/softwares/apache-storm-1.2.2/extlib/*:/yinzhengjie/softwares/apache-storm-1.2.2/extlib-daemon/*:/yinzhengjie/softwares/storm/conf -Xmx1024m -Dlogfile.name=nimbus.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/yinzhengjie/softwares/apache-storm-1.2.2/log4j2/cluster.xml org.apache.storm.daemon.nimbus [root@node101.yinzhengjie.org.cn ~]# [root@node101.yinzhengjie.org.cn ~]#
[root@node102.yinzhengjie.org.cn ~]# [root@node102.yinzhengjie.org.cn ~]# storm nimbus & [1] 13515 [root@node102.yinzhengjie.org.cn ~]# [root@node102.yinzhengjie.org.cn ~]# echo $? 0 [root@node102.yinzhengjie.org.cn ~]# [root@node102.yinzhengjie.org.cn ~]# Running: java -server -Ddaemon.name=nimbus -Dstorm.options= -Dstorm.home=/yinzhengjie/softwares/apache-storm-1.2.2 -Dstorm.log.dir=/yinzhengjie/softwares/apache-storm-1.2.2/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /yinzhengjie/softwares/apache-storm-1.2.2/*:/yinzhengjie/softwares/apache-storm-1.2.2/lib/*:/yinzhengjie/softwares/apache-storm-1.2.2/extlib/*:/yinzhengjie/softwares/apache-storm-1.2.2/extlib-daemon/*:/yinzhengjie/softwares/storm/conf -Xmx1024m -Dlogfile.name=nimbus.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/yinzhengjie/softwares/apache-storm-1.2.2/log4j2/cluster.xml org.apache.storm.daemon.nimbus [root@node102.yinzhengjie.org.cn ~]# [root@node102.yinzhengjie.org.cn ~]#
[root@node103.yinzhengjie.org.cn ~]# [root@node103.yinzhengjie.org.cn ~]# storm nimbus & [1] 13525 [root@node103.yinzhengjie.org.cn ~]# [root@node103.yinzhengjie.org.cn ~]# echo $? 0 [root@node103.yinzhengjie.org.cn ~]# [root@node103.yinzhengjie.org.cn ~]# Running: java -server -Ddaemon.name=nimbus -Dstorm.options= -Dstorm.home=/yinzhengjie/softwares/apache-storm-1.2.2 -Dstorm.log.dir=/yinzhengjie/softwares/apache-storm-1.2.2/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /yinzhengjie/softwares/apache-storm-1.2.2/*:/yinzhengjie/softwares/apache-storm-1.2.2/lib/*:/yinzhengjie/softwares/apache-storm-1.2.2/extlib/*:/yinzhengjie/softwares/apache-storm-1.2.2/extlib-daemon/*:/yinzhengjie/softwares/storm/conf -Xmx1024m -Dlogfile.name=nimbus.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/yinzhengjie/softwares/apache-storm-1.2.2/log4j2/cluster.xml org.apache.storm.daemon.nimbus [root@node103.yinzhengjie.org.cn ~]# [root@node103.yinzhengjie.org.cn ~]#
[root@node101.yinzhengjie.org.cn ~]# [root@node101.yinzhengjie.org.cn ~]# storm supervisor & [2] 15116 [root@node101.yinzhengjie.org.cn ~]# [root@node101.yinzhengjie.org.cn ~]# echo $? 0 [root@node101.yinzhengjie.org.cn ~]# [root@node101.yinzhengjie.org.cn ~]# Running: java -server -Ddaemon.name=supervisor -Dstorm.options= -Dstorm.home=/yinzhengjie/softwares/apache-storm-1.2.2 -Dstorm.log.dir=/yinzhengjie/softwares/apache-storm-1.2.2/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /yinzhengjie/softwares/apache-storm-1.2.2/*:/yinzhengjie/softwares/apache-storm-1.2.2/lib/*:/yinzhengjie/softwares/apache-storm-1.2.2/extlib/*:/yinzhengjie/softwares/apache-storm-1.2.2/extlib-daemon/*:/yinzhengjie/softwares/storm/conf -Xmx256m -Dlogfile.name=supervisor.log -Dlog4j.configurationFile=/yinzhengjie/softwares/apache-storm-1.2.2/log4j2/cluster.xml org.apache.storm.daemon.supervisor.Supervisor [root@node101.yinzhengjie.org.cn ~]# [root@node101.yinzhengjie.org.cn ~]#
[root@node102.yinzhengjie.org.cn ~]# [root@node102.yinzhengjie.org.cn ~]# storm supervisor & [2] 13935 [root@node102.yinzhengjie.org.cn ~]# [root@node102.yinzhengjie.org.cn ~]# echo $? 0 [root@node102.yinzhengjie.org.cn ~]# [root@node102.yinzhengjie.org.cn ~]# Running: java -server -Ddaemon.name=supervisor -Dstorm.options= -Dstorm.home=/yinzhengjie/softwares/apache-storm-1.2.2 -Dstorm.log.dir=/yinzhengjie/softwares/apache-storm-1.2.2/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /yinzhengjie/softwares/apache-storm-1.2.2/*:/yinzhengjie/softwares/apache-storm-1.2.2/lib/*:/yinzhengjie/softwares/apache-storm-1.2.2/extlib/*:/yinzhengjie/softwares/apache-storm-1.2.2/extlib-daemon/*:/yinzhengjie/softwares/storm/conf -Xmx256m -Dlogfile.name=supervisor.log -Dlog4j.configurationFile=/yinzhengjie/softwares/apache-storm-1.2.2/log4j2/cluster.xml org.apache.storm.daemon.supervisor.Supervisor [root@node102.yinzhengjie.org.cn ~]# [root@node102.yinzhengjie.org.cn ~]#
[root@node103.yinzhengjie.org.cn ~]# [root@node103.yinzhengjie.org.cn ~]# storm supervisor & [2] 13926 [root@node103.yinzhengjie.org.cn ~]# [root@node103.yinzhengjie.org.cn ~]# echo $? 0 [root@node103.yinzhengjie.org.cn ~]# [root@node103.yinzhengjie.org.cn ~]# Running: java -server -Ddaemon.name=supervisor -Dstorm.options= -Dstorm.home=/yinzhengjie/softwares/apache-storm-1.2.2 -Dstorm.log.dir=/yinzhengjie/softwares/apache-storm-1.2.2/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /yinzhengjie/softwares/apache-storm-1.2.2/*:/yinzhengjie/softwares/apache-storm-1.2.2/lib/*:/yinzhengjie/softwares/apache-storm-1.2.2/extlib/*:/yinzhengjie/softwares/apache-storm-1.2.2/extlib-daemon/*:/yinzhengjie/softwares/storm/conf -Xmx256m -Dlogfile.name=supervisor.log -Dlog4j.configurationFile=/yinzhengjie/softwares/apache-storm-1.2.2/log4j2/cluster.xml org.apache.storm.daemon.supervisor.Supervisor [root@node103.yinzhengjie.org.cn ~]#
[root@node101.yinzhengjie.org.cn ~]# storm ui & [3] 15887 [root@node101.yinzhengjie.org.cn ~]# [root@node101.yinzhengjie.org.cn ~]# echo $? 0 [root@node101.yinzhengjie.org.cn ~]# [root@node101.yinzhengjie.org.cn ~]# Running: java -server -Ddaemon.name=ui -Dstorm.options= -Dstorm.home=/yinzhengjie/softwares/apache-storm-1.2.2 -Dstorm.log.dir=/yinzhengjie/softwares/apache-storm-1.2.2/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /yinzhengjie/softwares/apache-storm-1.2.2/*:/yinzhengjie/softwares/apache-storm-1.2.2/lib/*:/yinzhengjie/softwares/apache-storm-1.2.2/extlib/*:/yinzhengjie/softwares/apache-storm-1.2.2/extlib-daemon/*:/yinzhengjie/softwares/apache-storm-1.2.2:/yinzhengjie/softwares/storm/conf -Xmx768m -Dlogfile.name=ui.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/yinzhengjie/softwares/apache-storm-1.2.2/log4j2/cluster.xml org.apache.storm.ui.core [root@node101.yinzhengjie.org.cn ~]# [root@node101.yinzhengjie.org.cn ~]#
6>.访问WEB UI（http://node101.yinzhengjie.org.cn:8080/index.html）
7>.Storm日志信息查看
[root@node101.yinzhengjie.org.cn ~]# tail -100f /yinzhengjie/softwares/storm/logs/nimbus.log 2019-03-25 18:17:39.331 o.a.s.z.AclEnforcement main [INFO] SECURITY IS DISABLED NO FURTHER CHECKS... 2019-03-25 18:17:39.386 o.a.s.d.nimbus main [INFO] Starting Nimbus with conf {"topology.builtin.metrics.bucket.size.secs" 60, "nimbus.childopts" "-Xmx1024m", "ui.filter.params" nil, "storm.cluster.mode" "distributed", "storm.messaging.netty.client_worker_threads" 1, "logviewer.max.per.worker.logs.size.mb" 2048, "supervisor.run.worker.as.user" false, "topology.max.task.parallelism" nil, "topology.priority" 29, "zmq.threads" 1, "storm.group.mapping.service" "org.apache.storm.security.auth.ShellBasedGroupsMapping", "transactional.zookeeper.root" "/transactional", "topology.sleep.spout.wait.strategy.time.ms" 1, "ui.pagination" 20, "scheduler.display.resource" false, "topology.max.replication.wait.time.sec" 60, "drpc.invocations.port" 3773, "supervisor.localizer.cache.target.size.mb" 10240, "topology.multilang.serializer" "org.apache.storm.multilang.JsonSerializer", "storm.messaging.netty.server_worker_threads" 1, "nimbus.blobstore.class" "org.apache.storm.blobstore.LocalFsBlobStore", "resource.aware.scheduler.eviction.strategy" "org.apache.storm.scheduler.resource.strategies.eviction.DefaultEvictionStrategy", "topology.max.error.report.per.interval" 5, "storm.thrift.transport" "org.apache.storm.security.auth.SimpleTransportPlugin", "zmq.hwm" 0, "storm.group.mapping.service.params" nil, "worker.profiler.enabled" false, "storm.principal.tolocal" "org.apache.storm.security.auth.DefaultPrincipalToLocal", "supervisor.worker.shutdown.sleep.secs" 3, "pacemaker.host" "localhost", "storm.zookeeper.retry.times" 5, "ui.actions.enabled" true, "zmq.linger.millis" 5000, "supervisor.enable" true, "topology.stats.sample.rate" 0.05, "storm.nimbus.zookeeper.acls.fixup" true, "storm.messaging.netty.min_wait_ms" 100, "worker.log.level.reset.poll.secs" 30, "storm.zookeeper.port" 2181, "supervisor.heartbeat.frequency.secs" 5, "topology.enable.message.timeouts" true, "supervisor.cpu.capacity" 400.0, "drpc.worker.threads" 64, "supervisor.blobstore.download.thread.count" 5, "task.backpressure.poll.secs" 30, "drpc.queue.size" 128, "topology.backpressure.enable" false, "supervisor.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "storm.blobstore.inputstream.buffer.size.bytes" 65536, "topology.shellbolt.max.pending" 100, "drpc.https.keystore.password" "", "nimbus.code.sync.freq.secs" 120, "logviewer.port" 8000, "topology.scheduler.strategy" "org.apache.storm.scheduler.resource.strategies.scheduling.DefaultResourceAwareStrategy", "topology.executor.send.buffer.size" 1024, "resource.aware.scheduler.priority.strategy" "org.apache.storm.scheduler.resource.strategies.priority.DefaultSchedulingPriorityStrategy", "pacemaker.auth.method" "NONE", "storm.daemon.metrics.reporter.plugins" ["org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter"], "topology.worker.logwriter.childopts" "-Xmx64m", "topology.spout.wait.strategy" "org.apache.storm.spout.SleepSpoutWaitStrategy", "ui.host" "0.0.0.0", "storm.nimbus.retry.interval.millis" 2000, "nimbus.inbox.jar.expiration.secs" 3600, "dev.zookeeper.path" "/tmp/dev-storm-zookeeper", "topology.acker.executors" nil, "topology.fall.back.on.java.serialization" true, "topology.eventlogger.executors" 0, "supervisor.localizer.cleanup.interval.ms" 600000, "storm.zookeeper.servers" ["node101.yinzhengjie.org.cn" "node102.yinzhengjie.org.cn" "node103.yinzhengjie.org.cn"], "nimbus.thrift.threads" 64, "logviewer.cleanup.age.mins" 10080, "topology.worker.childopts" nil, "topology.classpath" nil, "supervisor.monitor.frequency.secs" 3, "nimbus.credential.renewers.freq.secs" 600, "backpressure.znode.timeout.secs" 30, "topology.skip.missing.kryo.registrations" false, "drpc.authorizer.acl.filename" "drpc-auth-acl.yaml", "pacemaker.kerberos.users" [], "storm.group.mapping.service.cache.duration.secs" 120, "topology.testing.always.try.serialize" false, "nimbus.monitor.freq.secs" 10, "storm.health.check.timeout.ms" 5000, "supervisor.supervisors" [], "topology.tasks" nil, "topology.bolts.outgoing.overflow.buffer.enable" false, "storm.messaging.netty.socket.backlog" 500, "topology.workers" 1, "pacemaker.base.threads" 10, "storm.local.dir" "/yinzhengjie/softwares/storm/data", "backpressure.znode.update.freq.secs" 15, "worker.childopts" "-Xmx%HEAP-MEM%m -XX:+PrintGCDetails -Xloggc:artifacts/gc.log -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1M -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=artifacts/heapdump", "storm.auth.simple-white-list.users" [], "topology.disruptor.batch.timeout.millis" 1, "topology.message.timeout.secs" 30, "topology.state.synchronization.timeout.secs" 60, "topology.tuple.serializer" "org.apache.storm.serialization.types.ListDelegateSerializer", "supervisor.supervisors.commands" [], "nimbus.blobstore.expiration.secs" 600, "logviewer.childopts" "-Xmx128m", "storm.nimbus.zookeeper.acls.check" true, "topology.environment" nil, "topology.debug" false, "topology.disruptor.batch.size" 100, "storm.disable.symlinks" false, "storm.messaging.netty.max_retries" 300, "ui.childopts" "-Xmx768m", "storm.network.topography.plugin" "org.apache.storm.networktopography.DefaultRackDNSToSwitchMapping", "storm.zookeeper.session.timeout" 20000, "drpc.childopts" "-Xmx768m", "drpc.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.connection.timeout" 15000, "storm.zookeeper.auth.user" nil, "storm.meta.serialization.delegate" "org.apache.storm.serialization.GzipThriftSerializationDelegate", "topology.max.spout.pending" nil, "storm.codedistributor.class" "org.apache.storm.codedistributor.LocalFileSystemCodeDistributor", "nimbus.supervisor.timeout.secs" 60, "nimbus.task.timeout.secs" 30, "drpc.port" 3772, "pacemaker.max.threads" 50, "storm.zookeeper.retry.intervalceiling.millis" 30000, "nimbus.thrift.port" 6627, "storm.auth.simple-acl.admins" [], "topology.component.cpu.pcore.percent" 10.0, "supervisor.memory.capacity.mb" 3072.0, "storm.nimbus.retry.times" 5, "supervisor.worker.start.timeout.secs" 120, "storm.zookeeper.retry.interval" 1000, "logs.users" nil, "storm.cluster.metrics.consumer.publish.interval.secs" 60, "worker.profiler.command" "flight.bash", "transactional.zookeeper.port" nil, "drpc.max_buffer_size" 1048576, "pacemaker.thread.timeout" 10, "task.credentials.poll.secs" 30, "drpc.https.keystore.type" "JKS", "topology.worker.receiver.thread.count" 1, "topology.state.checkpoint.interval.ms" 1000, "supervisor.slots.ports" [6700 6701 6702 6703], "topology.transfer.buffer.size" 1024, "storm.health.check.dir" "healthchecks", "topology.worker.shared.thread.pool.size" 4, "drpc.authorizer.acl.strict" false, "nimbus.file.copy.expiration.secs" 600, "worker.profiler.childopts" "-XX:+UnlockCommercialFeatures -XX:+FlightRecorder", "topology.executor.receive.buffer.size" 1024, "backpressure.disruptor.low.watermark" 0.4, "nimbus.task.launch.secs" 120, "storm.local.mode.zmq" false, "storm.messaging.netty.buffer_size" 5242880, "storm.cluster.state.store" "org.apache.storm.cluster_state.zookeeper_state_factory", "worker.heartbeat.frequency.secs" 1, "storm.log4j2.conf.dir" "log4j2", "ui.http.creds.plugin" "org.apache.storm.security.auth.DefaultHttpCredentialsPlugin", "storm.zookeeper.root" "/storm", "topology.tick.tuple.freq.secs" nil, "drpc.https.port" -1, "storm.workers.artifacts.dir" "workers-artifacts", "supervisor.blobstore.download.max_retries" 3, "task.refresh.poll.secs" 10, "storm.exhibitor.port" 8080, "task.heartbeat.frequency.secs" 3, "pacemaker.port" 6699, "storm.messaging.netty.max_wait_ms" 1000, "topology.component.resources.offheap.memory.mb" 0.0, "drpc.http.port" 3774, "topology.error.throttle.interval.secs" 10, "storm.messaging.transport" "org.apache.storm.messaging.netty.Context", "topology.disable.loadaware.messaging" false, "storm.messaging.netty.authentication" false, "topology.component.resources.onheap.memory.mb" 128.0, "topology.kryo.factory" "org.apache.storm.serialization.DefaultKryoFactory", "worker.gc.childopts" "", "nimbus.topology.validator" "org.apache.storm.nimbus.DefaultTopologyValidator", "nimbus.seeds" ["node101.yinzhengjie.org.cn"], "nimbus.queue.size" 100000, "nimbus.cleanup.inbox.freq.secs" 600, "storm.blobstore.replication.factor" 3, "worker.heap.memory.mb" 768, "logviewer.max.sum.worker.logs.size.mb" 4096, "pacemaker.childopts" "-Xmx1024m", "ui.users" nil, "transactional.zookeeper.servers" nil, "supervisor.worker.timeout.secs" 30, "storm.zookeeper.auth.password" nil, "storm.blobstore.acl.validation.enabled" false, "client.blobstore.class" "org.apache.storm.blobstore.NimbusBlobStore", "storm.thrift.socket.timeout.ms" 600000, "supervisor.childopts" "-Xmx256m", "topology.worker.max.heap.size.mb" 768.0, "ui.http.x-frame-options" "DENY", "backpressure.disruptor.high.watermark" 0.9, "ui.filter" nil, "ui.header.buffer.bytes" 4096, "topology.min.replication.count" 1, "topology.disruptor.wait.timeout.millis" 1000, "storm.nimbus.retry.intervalceiling.millis" 60000, "topology.trident.batch.emit.interval.millis" 500, "storm.auth.simple-acl.users" [], "drpc.invocations.threads" 64, "java.library.path" "/usr/local/lib:/opt/local/lib:/usr/lib", "ui.port" 8080, "storm.exhibitor.poll.uripath" "/exhibitor/v1/cluster/list", "storm.messaging.netty.transfer.batch.size" 262144, "logviewer.appender.name" "A1", "nimbus.thrift.max_buffer_size" 1048576, "storm.auth.simple-acl.users.commands" [], "drpc.request.timeout.secs" 600} 2019-03-25 18:17:39.387 o.a.s.n.NimbusInfo main [INFO] Nimbus figures out its name to node101.yinzhengjie.org.cn 2019-03-25 18:17:39.430 o.a.s.s.o.a.c.u.Compatibility main [INFO] Running in ZooKeeper 3.4.x compatibility mode 2019-03-25 18:17:39.451 o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl main [INFO] Starting 2019-03-25 18:17:39.460 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT 2019-03-25 18:17:39.460 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:host.name=node101.yinzhengjie.org.cn 2019-03-25 18:17:39.460 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:java.version=1.8.0_201 2019-03-25 18:17:39.460 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:java.vendor=Oracle Corporation 2019-03-25 18:17:39.460 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:java.home=/yinzhengjie/softwares/jdk1.8.0_201/jre 2019-03-25 18:17:39.460 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:java.class.path=/yinzhengjie/softwares/apache-storm-1.2.2/*:/yinzhengjie/softwares/apache-storm-1.2.2/lib/ring-cors-0.1.5.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/metrics-graphite-3.1.0.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/storm-rename-hack-1.2.2.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/kryo-3.0.3.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/asm-5.0.3.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/clojure-1.7.0.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/disruptor-3.3.2.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/minlog-1.3.0.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/objenesis-2.1.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/slf4j-api-1.7.21.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/storm-core-1.2.2.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/log4j-slf4j-impl-2.8.2.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/log4j-core-2.8.2.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/gmetric4j-1.0.7.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/metrics-core-3.1.0.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/metrics-ganglia-3.1.0.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/log4j-api-2.8.2.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/log4j-over-slf4j-1.6.6.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/reflectasm-1.10.1.jar:/yinzhengjie/softwares/apache-storm-1.2.2/extlib/*:/yinzhengjie/softwares/apache-storm-1.2.2/extlib-daemon/*:/yinzhengjie/softwares/storm/conf 2019-03-25 18:17:39.460 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib 2019-03-25 18:17:39.460 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:java.io.tmpdir=/tmp 2019-03-25 18:17:39.460 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:java.compiler=<NA> 2019-03-25 18:17:39.460 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:os.name=Linux 2019-03-25 18:17:39.460 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:os.arch=amd64 2019-03-25 18:17:39.460 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:os.version=3.10.0-957.el7.x86_64 2019-03-25 18:17:39.460 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:user.name=root 2019-03-25 18:17:39.460 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:user.home=/root 2019-03-25 18:17:39.460 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:user.dir=/root 2019-03-25 18:17:39.461 o.a.s.s.o.a.z.ZooKeeper main [INFO] Initiating client connection, connectString=node101.yinzhengjie.org.cn:2181,node102.yinzhengjie.org.cn:2181,node103.yinzhengjie.org.cn:2181/storm sessionTimeout=20000 watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@3913f206 2019-03-25 18:17:39.481 o.a.s.s.o.a.z.ClientCnxn main-SendThread(node103.yinzhengjie.org.cn:2181) [INFO] Opening socket connection to server node103.yinzhengjie.org.cn/172.30.1.103:2181. Will not attempt to authenticate using SASL (unknown error) 2019-03-25 18:17:39.509 o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl main [INFO] Default schema 2019-03-25 18:17:39.521 o.a.s.b.FileBlobStoreImpl main [INFO] Creating new blob store based in /yinzhengjie/softwares/storm/data/blobs 2019-03-25 18:17:39.527 o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl main [INFO] Starting 2019-03-25 18:17:39.530 o.a.s.s.o.a.z.ZooKeeper main [INFO] Initiating client connection, connectString=node101.yinzhengjie.org.cn:2181,node102.yinzhengjie.org.cn:2181,node103.yinzhengjie.org.cn:2181/storm sessionTimeout=20000 watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@9ab310b 2019-03-25 18:17:39.564 o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl main [INFO] Default schema 2019-03-25 18:17:39.565 o.a.s.d.nimbus main [INFO] Using default scheduler 2019-03-25 18:17:39.566 o.a.s.n.NimbusInfo main [INFO] Nimbus figures out its name to node101.yinzhengjie.org.cn 2019-03-25 18:17:39.621 o.a.s.n.NimbusInfo main [INFO] Nimbus figures out its name to node101.yinzhengjie.org.cn 2019-03-25 18:17:39.634 o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl main [INFO] Starting 2019-03-25 18:17:39.636 o.a.s.s.o.a.z.ClientCnxn main-SendThread(node101.yinzhengjie.org.cn:2181) [INFO] Opening socket connection to server node101.yinzhengjie.org.cn/172.30.1.101:2181. Will not attempt to authenticate using SASL (unknown error) 2019-03-25 18:17:39.656 o.a.s.s.o.a.z.ZooKeeper main [INFO] Initiating client connection, connectString=node101.yinzhengjie.org.cn:2181,node102.yinzhengjie.org.cn:2181,node103.yinzhengjie.org.cn:2181 sessionTimeout=20000 watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@164642a4 2019-03-25 18:17:39.660 o.a.s.s.o.a.z.ClientCnxn main-SendThread(node101.yinzhengjie.org.cn:2181) [INFO] Socket connection established to node101.yinzhengjie.org.cn/172.30.1.101:2181, initiating session 2019-03-25 18:17:39.667 o.a.s.s.o.a.z.ClientCnxn main-SendThread(node103.yinzhengjie.org.cn:2181) [INFO] Socket connection established to node103.yinzhengjie.org.cn/172.30.1.103:2181, initiating session 2019-03-25 18:17:39.676 o.a.s.s.o.a.z.ClientCnxn main-SendThread(node102.yinzhengjie.org.cn:2181) [INFO] Opening socket connection to server node102.yinzhengjie.org.cn/172.30.1.102:2181. Will not attempt to authenticate using SASL (unknown error) 2019-03-25 18:17:39.677 o.a.s.s.o.a.z.ClientCnxn main-SendThread(node102.yinzhengjie.org.cn:2181) [INFO] Socket connection established to node102.yinzhengjie.org.cn/172.30.1.102:2181, initiating session 2019-03-25 18:17:39.678 o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl main [INFO] Default schema 2019-03-25 18:17:39.725 o.a.s.s.o.a.z.ClientCnxn main-SendThread(node102.yinzhengjie.org.cn:2181) [INFO] Session establishment complete on server node102.yinzhengjie.org.cn/172.30.1.102:2181, sessionid = 0x6600008db4950000, negotiated timeout = 20000 2019-03-25 18:17:39.725 o.a.s.s.o.a.z.ClientCnxn main-SendThread(node103.yinzhengjie.org.cn:2181) [INFO] Session establishment complete on server node103.yinzhengjie.org.cn/172.30.1.103:2181, sessionid = 0x6700008dc8470000, negotiated timeout = 20000 2019-03-25 18:17:39.728 o.a.s.s.o.a.c.f.s.ConnectionStateManager main-EventThread [INFO] State change: CONNECTED 2019-03-25 18:17:39.729 o.a.s.s.o.a.z.ClientCnxn main-SendThread(node101.yinzhengjie.org.cn:2181) [INFO] Session establishment complete on server node101.yinzhengjie.org.cn/172.30.1.101:2181, sessionid = 0x6500008dcc720000, negotiated timeout = 20000 2019-03-25 18:17:39.730 o.a.s.s.o.a.c.f.s.ConnectionStateManager main-EventThread [INFO] State change: CONNECTED 2019-03-25 18:17:39.731 o.a.s.zookeeper main-EventThread [INFO] Zookeeper state update: :connected:none 2019-03-25 18:17:39.742 o.a.s.s.o.a.c.f.s.ConnectionStateManager main-EventThread [INFO] State change: CONNECTED 2019-03-25 18:17:39.742 o.a.s.zookeeper main-EventThread [INFO] Zookeeper state update: :connected:none 2019-03-25 18:17:39.776 o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl Curator-Framework-0 [INFO] backgroundOperationsLoop exiting 2019-03-25 18:17:39.780 o.a.s.s.o.a.z.ZooKeeper main [INFO] Session: 0x6600008db4950000 closed 2019-03-25 18:17:39.781 o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl main [INFO] Starting 2019-03-25 18:17:39.782 o.a.s.s.o.a.z.ClientCnxn main-EventThread [INFO] EventThread shut down 2019-03-25 18:17:39.782 o.a.s.s.o.a.z.ZooKeeper main [INFO] Initiating client connection, connectString=node101.yinzhengjie.org.cn:2181,node102.yinzhengjie.org.cn:2181,node103.yinzhengjie.org.cn:2181/storm sessionTimeout=20000 watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@3a36cd5 2019-03-25 18:17:39.796 o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl main [INFO] Default schema 2019-03-25 18:17:39.797 o.a.s.s.o.a.z.ClientCnxn main-SendThread(node102.yinzhengjie.org.cn:2181) [INFO] Opening socket connection to server node102.yinzhengjie.org.cn/172.30.1.102:2181. Will not attempt to authenticate using SASL (unknown error) 2019-03-25 18:17:39.798 o.a.s.s.o.a.z.ClientCnxn main-SendThread(node102.yinzhengjie.org.cn:2181) [INFO] Socket connection established to node102.yinzhengjie.org.cn/172.30.1.102:2181, initiating session 2019-03-25 18:17:39.799 o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl main [INFO] Starting 2019-03-25 18:17:39.800 o.a.s.s.o.a.z.ZooKeeper main [INFO] Initiating client connection, connectString=node101.yinzhengjie.org.cn:2181,node102.yinzhengjie.org.cn:2181,node103.yinzhengjie.org.cn:2181/storm sessionTimeout=20000 watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@733c464f 2019-03-25 18:17:39.802 o.a.s.s.o.a.z.ClientCnxn main-SendThread(node102.yinzhengjie.org.cn:2181) [INFO] Session establishment complete on server node102.yinzhengjie.org.cn/172.30.1.102:2181, sessionid = 0x6600008db4950001, negotiated timeout = 20000 2019-03-25 18:17:39.804 o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl main [INFO] Default schema 2019-03-25 18:17:39.807 o.a.s.s.o.a.z.ClientCnxn main-SendThread(node102.yinzhengjie.org.cn:2181) [INFO] Opening socket connection to server node102.yinzhengjie.org.cn/172.30.1.102:2181. Will not attempt to authenticate using SASL (unknown error) 2019-03-25 18:17:39.808 o.a.s.s.o.a.c.f.s.ConnectionStateManager main-EventThread [INFO] State change: CONNECTED 2019-03-25 18:17:39.808 o.a.s.s.o.a.z.ClientCnxn main-SendThread(node102.yinzhengjie.org.cn:2181) [INFO] Socket connection established to node102.yinzhengjie.org.cn/172.30.1.102:2181, initiating session 2019-03-25 18:17:39.812 o.a.s.s.o.a.z.ClientCnxn main-SendThread(node102.yinzhengjie.org.cn:2181) [INFO] Session establishment complete on server node102.yinzhengjie.org.cn/172.30.1.102:2181, sessionid = 0x6600008db4950002, negotiated timeout = 20000 2019-03-25 18:17:39.815 o.a.s.s.o.a.c.f.s.ConnectionStateManager main-EventThread [INFO] State change: CONNECTED 2019-03-25 18:17:39.895 o.a.s.zookeeper main [INFO] Queued up for leader lock. 2019-03-25 18:17:39.919 o.a.s.d.m.MetricsUtils main [INFO] Using statistics reporter plugin:org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter 2019-03-25 18:17:39.920 o.a.s.d.m.r.JmxPreparableReporter main [INFO] Preparing... 2019-03-25 18:17:39.928 o.a.s.s.o.a.c.u.ZKPaths Curator-Framework-0 [WARN] The version of ZooKeeper being used doesn't support Container nodes. CreateMode.PERSISTENT will be used instead. 2019-03-25 18:17:39.928 o.a.s.d.common main [INFO] Started statistics report plugin... 2019-03-25 18:17:39.975 o.a.s.z.Zookeeper main-EventThread [INFO] active-topology-blobs [] local-topology-blobs [] diff-topology-blobs [] 2019-03-25 18:17:39.975 o.a.s.z.Zookeeper main-EventThread [INFO] active-topology-dependencies [] local-blobs [] diff-topology-dependencies [] 2019-03-25 18:17:39.975 o.a.s.z.Zookeeper main-EventThread [INFO] Accepting leadership, all active topologies and corresponding dependencies found locally. 2019-03-25 18:17:39.978 o.a.s.d.nimbus main [INFO] Starting nimbus server for storm version '1.2.2' ^C [root@node101.yinzhengjie.org.cn ~]#
[root@node101.yinzhengjie.org.cn ~]# tail -100f /yinzhengjie/softwares/storm/logs/ui.log 2019-03-25 18:23:03.515 o.a.s.u.core main [INFO] Starting ui server for storm version '1.2.2' 2019-03-25 18:23:03.522 o.a.s.d.m.MetricsUtils main [INFO] Using statistics reporter plugin:org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter 2019-03-25 18:23:03.522 o.a.s.d.m.r.JmxPreparableReporter main [INFO] Preparing... 2019-03-25 18:23:03.527 o.a.s.d.common main [INFO] Started statistics report plugin... 2019-03-25 18:23:03.565 o.a.s.s.o.e.j.s.Server main [INFO] jetty-7.x.y-SNAPSHOT 2019-03-25 18:23:03.587 o.a.s.s.o.e.j.s.h.ContextHandler main [INFO] started o.a.s.s.o.e.j.s.ServletContextHandler{/,null} 2019-03-25 18:23:03.607 o.a.s.s.o.e.j.s.AbstractConnector main [INFO] Started SelectChannelConnector@0.0.0.0:8080 2019-03-25 18:23:57.615 o.a.s.u.core main [INFO] Starting ui server for storm version '1.2.2' 2019-03-25 18:23:57.617 o.a.s.d.m.MetricsUtils main [INFO] Using statistics reporter plugin:org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter 2019-03-25 18:23:57.618 o.a.s.d.m.r.JmxPreparableReporter main [INFO] Preparing... 2019-03-25 18:23:57.623 o.a.s.d.common main [INFO] Started statistics report plugin... 2019-03-25 18:23:57.666 o.a.s.s.o.e.j.s.Server main [INFO] jetty-7.x.y-SNAPSHOT 2019-03-25 18:23:57.688 o.a.s.s.o.e.j.s.h.ContextHandler main [INFO] started o.a.s.s.o.e.j.s.ServletContextHandler{/,null} 2019-03-25 18:23:57.707 o.a.s.s.o.e.j.s.AbstractConnector main [INFO] Started SelectChannelConnector@0.0.0.0:8080 2019-03-25 18:25:16.182 o.a.s.u.NimbusClient qtp1134011961-20 [INFO] Found leader nimbus : node101.yinzhengjie.org.cn:6627 2019-03-25 18:25:16.292 o.a.s.u.NimbusClient qtp1134011961-18 [INFO] Found leader nimbus : node101.yinzhengjie.org.cn:6627 2019-03-25 18:25:16.298 o.a.s.u.NimbusClient qtp1134011961-19 [INFO] Found leader nimbus : node101.yinzhengjie.org.cn:6627 2019-03-25 18:25:16.308 o.a.s.u.NimbusClient qtp1134011961-16 [INFO] Found leader nimbus : node101.yinzhengjie.org.cn:6627 2019-03-25 18:25:16.319 o.a.s.u.NimbusClient qtp1134011961-15 [INFO] Found leader nimbus : node101.yinzhengjie.org.cn:6627 ^C [root@node101.yinzhengjie.org.cn ~]#
[root@node101.yinzhengjie.org.cn ~]# tail -100f /yinzhengjie/softwares/storm/logs/supervisor.log 2019-03-25 18:20:54.728 o.a.s.s.o.a.c.u.Compatibility main [INFO] Running in ZooKeeper 3.4.x compatibility mode 2019-03-25 18:20:54.760 o.a.s.z.Zookeeper main [INFO] Staring ZK Curator 2019-03-25 18:20:54.761 o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl main [INFO] Starting 2019-03-25 18:20:54.766 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT 2019-03-25 18:20:54.766 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:host.name=node101.yinzhengjie.org.cn 2019-03-25 18:20:54.766 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:java.version=1.8.0_201 2019-03-25 18:20:54.766 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:java.vendor=Oracle Corporation 2019-03-25 18:20:54.766 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:java.home=/yinzhengjie/softwares/jdk1.8.0_201/jre 2019-03-25 18:20:54.766 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:java.class.path=/yinzhengjie/softwares/apache-storm-1.2.2/*:/yinzhengjie/softwares/apache-storm-1.2.2/lib/ring-cors-0.1.5.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/metrics-graphite-3.1.0.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/storm-rename-hack-1.2.2.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/kryo-3.0.3.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/asm-5.0.3.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/clojure-1.7.0.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/disruptor-3.3.2.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/minlog-1.3.0.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/objenesis-2.1.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/slf4j-api-1.7.21.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/storm-core-1.2.2.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/log4j-slf4j-impl-2.8.2.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/servlet-api-2.5.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/log4j-core-2.8.2.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/gmetric4j-1.0.7.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/metrics-core-3.1.0.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/metrics-ganglia-3.1.0.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/log4j-api-2.8.2.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/log4j-over-slf4j-1.6.6.jar:/yinzhengjie/softwares/apache-storm-1.2.2/lib/reflectasm-1.10.1.jar:/yinzhengjie/softwares/apache-storm-1.2.2/extlib/*:/yinzhengjie/softwares/apache-storm-1.2.2/extlib-daemon/*:/yinzhengjie/softwares/storm/conf 2019-03-25 18:20:54.766 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib 2019-03-25 18:20:54.767 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:java.io.tmpdir=/tmp 2019-03-25 18:20:54.767 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:java.compiler=<NA> 2019-03-25 18:20:54.767 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:os.name=Linux 2019-03-25 18:20:54.767 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:os.arch=amd64 2019-03-25 18:20:54.767 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:os.version=3.10.0-957.el7.x86_64 2019-03-25 18:20:54.767 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:user.name=root 2019-03-25 18:20:54.767 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:user.home=/root 2019-03-25 18:20:54.767 o.a.s.s.o.a.z.ZooKeeper main [INFO] Client environment:user.dir=/root 2019-03-25 18:20:54.768 o.a.s.s.o.a.z.ZooKeeper main [INFO] Initiating client connection, connectString=node101.yinzhengjie.org.cn:2181,node102.yinzhengjie.org.cn:2181,node103.yinzhengjie.org.cn:2181 sessionTimeout=20000 watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@6869a3b3 2019-03-25 18:20:54.783 o.a.s.s.o.a.z.ClientCnxn main-SendThread(node101.yinzhengjie.org.cn:2181) [INFO] Opening socket connection to server node101.yinzhengjie.org.cn/172.30.1.101:2181. Will not attempt to authenticate using SASL (unknown error) 2019-03-25 18:20:54.784 o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl main [INFO] Default schema 2019-03-25 18:20:54.842 o.a.s.s.o.a.z.ClientCnxn main-SendThread(node101.yinzhengjie.org.cn:2181) [INFO] Socket connection established to node101.yinzhengjie.org.cn/172.30.1.101:2181, initiating session 2019-03-25 18:20:54.860 o.a.s.s.o.a.z.ClientCnxn main-SendThread(node101.yinzhengjie.org.cn:2181) [INFO] Session establishment complete on server node101.yinzhengjie.org.cn/172.30.1.101:2181, sessionid = 0x6500008dcc720005, negotiated timeout = 20000 2019-03-25 18:20:54.882 o.a.s.s.o.a.c.f.s.ConnectionStateManager main-EventThread [INFO] State change: CONNECTED 2019-03-25 18:20:54.892 o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl Curator-Framework-0 [INFO] backgroundOperationsLoop exiting 2019-03-25 18:20:54.898 o.a.s.s.o.a.z.ZooKeeper main [INFO] Session: 0x6500008dcc720005 closed 2019-03-25 18:20:54.898 o.a.s.s.o.a.z.ClientCnxn main-EventThread [INFO] EventThread shut down 2019-03-25 18:20:54.899 o.a.s.z.Zookeeper main [INFO] Staring ZK Curator 2019-03-25 18:20:54.899 o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl main [INFO] Starting 2019-03-25 18:20:54.899 o.a.s.s.o.a.z.ZooKeeper main [INFO] Initiating client connection, connectString=node101.yinzhengjie.org.cn:2181,node102.yinzhengjie.org.cn:2181,node103.yinzhengjie.org.cn:2181/storm sessionTimeout=20000 watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@7df76d99 2019-03-25 18:20:54.900 o.a.s.s.o.a.z.ClientCnxn main-SendThread(node102.yinzhengjie.org.cn:2181) [INFO] Opening socket connection to server node102.yinzhengjie.org.cn/172.30.1.102:2181. Will not attempt to authenticate using SASL (unknown error) 2019-03-25 18:20:54.901 o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl main [INFO] Default schema 2019-03-25 18:20:54.901 o.a.s.s.o.a.z.ClientCnxn main-SendThread(node102.yinzhengjie.org.cn:2181) [INFO] Socket connection established to node102.yinzhengjie.org.cn/172.30.1.102:2181, initiating session 2019-03-25 18:20:54.904 o.a.s.s.o.a.z.ClientCnxn main-SendThread(node102.yinzhengjie.org.cn:2181) [INFO] Session establishment complete on server node102.yinzhengjie.org.cn/172.30.1.102:2181, sessionid = 0x6600008db4950005, negotiated timeout = 20000 2019-03-25 18:20:54.905 o.a.s.s.o.a.c.f.s.ConnectionStateManager main-EventThread [INFO] State change: CONNECTED 2019-03-25 18:20:54.921 o.a.s.l.Localizer main [INFO] Reconstruct localized resource: /yinzhengjie/softwares/storm/data/supervisor/usercache 2019-03-25 18:20:54.923 o.a.s.l.Localizer main [WARN] No left over resources found for any user during reconstructing of local resources at: /yinzhengjie/softwares/storm/data/supervisor/usercache 2019-03-25 18:20:54.928 o.a.s.d.s.Supervisor main [INFO] Starting supervisor for storm version '1.2.2'. 2019-03-25 18:20:54.929 o.a.s.d.s.Supervisor main [INFO] Starting Supervisor with conf {storm.messaging.netty.min_wait_ms=100, storm.zookeeper.auth.user=null, storm.messaging.netty.buffer_size=5242880, storm.exhibitor.port=8080, pacemaker.auth.method=NONE, ui.filter=null, worker.profiler.enabled=false, ui.http.creds.plugin=org.apache.storm.security.auth.DefaultHttpCredentialsPlugin, topology.bolts.outgoing.overflow.buffer.enable=false, supervisor.supervisors.commands=[], logviewer.cleanup.age.mins=10080, topology.tuple.serializer=org.apache.storm.serialization.types.ListDelegateSerializer, drpc.port=3772, topology.max.spout.pending=null, topology.transfer.buffer.size=1024, logviewer.port=8000, worker.childopts=-Xmx%HEAP-MEM%m -XX:+PrintGCDetails -Xloggc:artifacts/gc.log -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1M -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=artifacts/heapdump, topology.component.cpu.pcore.percent=10.0, storm.daemon.metrics.reporter.plugins=[org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter], drpc.childopts=-Xmx768m, nimbus.task.launch.secs=120, logviewer.childopts=-Xmx128m, storm.zookeeper.servers=[node101.yinzhengjie.org.cn, node102.yinzhengjie.org.cn, node103.yinzhengjie.org.cn], topology.disruptor.batch.timeout.millis=1, storm.messaging.transport=org.apache.storm.messaging.netty.Context, storm.messaging.netty.authentication=false, topology.kryo.factory=org.apache.storm.serialization.DefaultKryoFactory, worker.heap.memory.mb=768, storm.network.topography.plugin=org.apache.storm.networktopography.DefaultRackDNSToSwitchMapping, supervisor.slots.ports=[6700, 6701, 6702, 6703], resource.aware.scheduler.eviction.strategy=org.apache.storm.scheduler.resource.strategies.eviction.DefaultEvictionStrategy, topology.stats.sample.rate=0.05, storm.local.dir=/yinzhengjie/softwares/storm/data, pacemaker.host=localhost, storm.messaging.netty.max_retries=300, topology.testing.always.try.serialize=false, storm.principal.tolocal=org.apache.storm.security.auth.DefaultPrincipalToLocal, java.library.path=/usr/local/lib:/opt/local/lib:/usr/lib, worker.gc.childopts=, storm.group.mapping.service.cache.duration.secs=120, zmq.linger.millis=5000, topology.multilang.serializer=org.apache.storm.multilang.JsonSerializer, drpc.request.timeout.secs=600, zmq.threads=1, nimbus.blobstore.class=org.apache.storm.blobstore.LocalFsBlobStore, topology.state.synchronization.timeout.secs=60, topology.worker.shared.thread.pool.size=4, topology.executor.receive.buffer.size=1024, supervisor.monitor.frequency.secs=3, storm.nimbus.retry.times=5, transactional.zookeeper.port=null, storm.auth.simple-white-list.users=[], topology.scheduler.strategy=org.apache.storm.scheduler.resource.strategies.scheduling.DefaultResourceAwareStrategy, storm.zookeeper.port=2181, storm.zookeeper.retry.intervalceiling.millis=30000, storm.cluster.state.store=org.apache.storm.cluster_state.zookeeper_state_factory, nimbus.thrift.port=6627, nimbus.thrift.threads=64, supervisor.supervisors=[], backpressure.znode.timeout.secs=30, nimbus.seeds=[node101.yinzhengjie.org.cn], storm.cluster.metrics.consumer.publish.interval.secs=60, storm.auth.simple-acl.admins=[], topology.min.replication.count=1, ui.http.x-frame-options=DENY, nimbus.blobstore.expiration.secs=600, storm.group.mapping.service=org.apache.storm.security.auth.ShellBasedGroupsMapping, storm.nimbus.retry.interval.millis=2000, topology.max.task.parallelism=null, drpc.https.keystore.password=, supervisor.heartbeat.frequency.secs=5, nimbus.credential.renewers.freq.secs=600, storm.thrift.transport=org.apache.storm.security.auth.SimpleTransportPlugin, storm.auth.simple-acl.users=[], storm.zookeeper.auth.password=null, ui.port=8080, drpc.authorizer.acl.strict=false, topology.message.timeout.secs=30, topology.error.throttle.interval.secs=10, drpc.https.keystore.type=JKS, supervisor.memory.capacity.mb=3072.0, drpc.authorizer.acl.filename=drpc-auth-acl.yaml, topology.builtin.metrics.bucket.size.secs=60, storm.local.mode.zmq=false, ui.header.buffer.bytes=4096, topology.shellbolt.max.pending=100, drpc.max_buffer_size=1048576, backpressure.znode.update.freq.secs=15, storm.codedistributor.class=org.apache.storm.codedistributor.LocalFileSystemCodeDistributor, worker.profiler.childopts=-XX:+UnlockCommercialFeatures -XX:+FlightRecorder, nimbus.supervisor.timeout.secs=60, topology.worker.max.heap.size.mb=768.0, storm.zookeeper.root=/storm, topology.disable.loadaware.messaging=false, zmq.hwm=0, topology.sleep.spout.wait.strategy.time.ms=1, nimbus.topology.validator=org.apache.storm.nimbus.DefaultTopologyValidator, worker.heartbeat.frequency.secs=1, storm.messaging.netty.max_wait_ms=1000, topology.max.error.report.per.interval=5, nimbus.thrift.max_buffer_size=1048576, pacemaker.max.threads=50, ui.pagination=20, supervisor.blobstore.download.max_retries=3, topology.enable.message.timeouts=true, storm.messaging.netty.transfer.batch.size=262144, supervisor.run.worker.as.user=false, storm.messaging.netty.client_worker_threads=1, topology.tasks=null, storm.group.mapping.service.params=null, drpc.http.port=3774, transactional.zookeeper.root=/transactional, supervisor.blobstore.download.thread.count=5, pacemaker.kerberos.users=[], topology.spout.wait.strategy=org.apache.storm.spout.SleepSpoutWaitStrategy, storm.blobstore.inputstream.buffer.size.bytes=65536, supervisor.worker.timeout.secs=30, topology.worker.receiver.thread.count=1, logviewer.max.sum.worker.logs.size.mb=4096, nimbus.file.copy.expiration.secs=600, pacemaker.port=6699, topology.worker.logwriter.childopts=-Xmx64m, drpc.http.creds.plugin=org.apache.storm.security.auth.DefaultHttpCredentialsPlugin, storm.blobstore.acl.validation.enabled=false, ui.filter.params=null, topology.workers=1, topology.environment=null, drpc.invocations.port=3773, topology.disruptor.batch.size=100, nimbus.cleanup.inbox.freq.secs=600, client.blobstore.class=org.apache.storm.blobstore.NimbusBlobStore, topology.fall.back.on.java.serialization=true, storm.nimbus.retry.intervalceiling.millis=60000, storm.nimbus.zookeeper.acls.fixup=true, logviewer.appender.name=A1, ui.users=null, pacemaker.childopts=-Xmx1024m, storm.messaging.netty.server_worker_threads=1, scheduler.display.resource=false, storm.auth.simple-acl.users.commands=[], ui.actions.enabled=true, storm.thrift.socket.timeout.ms=600000, storm.zookeeper.connection.timeout=15000, topology.tick.tuple.freq.secs=null, nimbus.inbox.jar.expiration.secs=3600, topology.debug=false, storm.zookeeper.retry.interval=1000, worker.log.level.reset.poll.secs=30, storm.exhibitor.poll.uripath=/exhibitor/v1/cluster/list, storm.zookeeper.retry.times=5, nimbus.code.sync.freq.secs=120, topology.component.resources.offheap.memory.mb=0.0, topology.state.checkpoint.interval.ms=1000, topology.priority=29, supervisor.localizer.cleanup.interval.ms=600000, storm.health.check.dir=healthchecks, topology.disruptor.wait.timeout.millis=1000, supervisor.cpu.capacity=400.0, topology.classpath=null, storm.nimbus.zookeeper.acls.check=true, backpressure.disruptor.high.watermark=0.9, supervisor.localizer.cache.target.size.mb=10240, topology.worker.childopts=null, drpc.https.port=-1, topology.max.replication.wait.time.sec=60, topology.acker.executors=null, supervisor.worker.start.timeout.secs=120, supervisor.worker.shutdown.sleep.secs=3, logviewer.max.per.worker.logs.size.mb=2048, topology.trident.batch.emit.interval.millis=500, task.heartbeat.frequency.secs=3, supervisor.enable=true, supervisor.blobstore.class=org.apache.storm.blobstore.NimbusBlobStore, topology.backpressure.enable=false, drpc.worker.threads=64, resource.aware.scheduler.priority.strategy=org.apache.storm.scheduler.resource.strategies.priority.DefaultSchedulingPriorityStrategy, storm.messaging.netty.socket.backlog=500, nimbus.queue.size=100000, drpc.queue.size=128, topology.eventlogger.executors=0, pacemaker.base.threads=10, nimbus.childopts=-Xmx1024m, nimbus.monitor.freq.secs=10, topology.executor.send.buffer.size=1024, storm.disable.symlinks=false, transactional.zookeeper.servers=null, nimbus.task.timeout.secs=30, logs.users=null, ui.host=0.0.0.0, pacemaker.thread.timeout=10, storm.meta.serialization.delegate=org.apache.storm.serialization.GzipThriftSerializationDelegate, dev.zookeeper.path=/tmp/dev-storm-zookeeper, backpressure.disruptor.low.watermark=0.4, topology.skip.missing.kryo.registrations=false, drpc.invocations.threads=64, storm.zookeeper.session.timeout=20000, storm.workers.artifacts.dir=workers-artifacts, topology.component.resources.onheap.memory.mb=128.0, storm.log4j2.conf.dir=log4j2, task.backpressure.poll.secs=30, storm.cluster.mode=distributed, ui.childopts=-Xmx768m, task.refresh.poll.secs=10, supervisor.childopts=-Xmx256m, task.credentials.poll.secs=30, storm.health.check.timeout.ms=5000, storm.blobstore.replication.factor=3, worker.profiler.command=flight.bash} 2019-03-25 18:20:54.974 o.a.s.d.s.Slot main [WARN] SLOT node101.yinzhengjie.org.cn:6700 Starting in state EMPTY - assignment null 2019-03-25 18:20:54.974 o.a.s.d.s.Slot main [WARN] SLOT node101.yinzhengjie.org.cn:6701 Starting in state EMPTY - assignment null 2019-03-25 18:20:54.974 o.a.s.d.s.Slot main [WARN] SLOT node101.yinzhengjie.org.cn:6702 Starting in state EMPTY - assignment null 2019-03-25 18:20:54.975 o.a.s.d.s.Slot main [WARN] SLOT node101.yinzhengjie.org.cn:6703 Starting in state EMPTY - assignment null 2019-03-25 18:20:54.976 o.a.s.l.AsyncLocalizer main [INFO] Cleaning up unused topologies in /yinzhengjie/softwares/storm/data/supervisor/stormdist ^C [root@node101.yinzhengjie.org.cn ~]#
8>.启用logviewer，可以在web页面点击相应的端口号即可查看日志
[root@node101.yinzhengjie.org.cn ~]# [root@node101.yinzhengjie.org.cn ~]# storm logviewer & [4] 17928 [root@node101.yinzhengjie.org.cn ~]# [root@node101.yinzhengjie.org.cn ~]# echo $? 0 [root@node101.yinzhengjie.org.cn ~]# [root@node101.yinzhengjie.org.cn ~]# Running: java -server -Ddaemon.name=logviewer -Dstorm.options= -Dstorm.home=/yinzhengjie/softwares/apache-storm-1.2.2 -Dstorm.log.dir=/yinzhengjie/softwares/apache-storm-1.2.2/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /yinzhengjie/softwares/apache-storm-1.2.2/*:/yinzhengjie/softwares/apache-storm-1.2.2/lib/*:/yinzhengjie/softwares/apache-storm-1.2.2/extlib/*:/yinzhengjie/softwares/apache-storm-1.2.2/extlib-daemon/*:/yinzhengjie/softwares/apache-storm-1.2.2:/yinzhengjie/softwares/storm/conf -Xmx128m -Dlogfile.name=logviewer.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/yinzhengjie/softwares/apache-storm-1.2.2/log4j2/cluster.xml org.apache.storm.daemon.logviewer [root@node101.yinzhengjie.org.cn ~]# [root@node101.yinzhengjie.org.cn ~]# [root@node101.yinzhengjie.org.cn ~]# tail -100f /yinzhengjie/softwares/storm/logs/logviewer.log 2019-03-25 18:32:56.616 o.a.s.d.logviewer main [INFO] Starting logviewer server for storm version '1.2.2' 2019-03-25 18:32:56.661 o.a.s.s.o.e.j.s.Server main [INFO] jetty-7.x.y-SNAPSHOT 2019-03-25 18:32:56.683 o.a.s.s.o.e.j.s.h.ContextHandler main [INFO] started o.a.s.s.o.e.j.s.ServletContextHandler{/,null} 2019-03-25 18:32:56.708 o.a.s.s.o.e.j.s.AbstractConnector main [INFO] Started SelectChannelConnector@0.0.0.0:8000 2019-03-25 18:32:56.708 o.a.s.d.m.MetricsUtils main [INFO] Using statistics reporter plugin:org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter 2019-03-25 18:32:56.709 o.a.s.d.m.r.JmxPreparableReporter main [INFO] Preparing... 2019-03-25 18:32:56.714 o.a.s.d.common main [INFO] Started statistics report plugin... ^C [root@node101.yinzhengjie.org.cn ~]# [root@node101.yinzhengjie.org.cn ~]#
[root@node102.yinzhengjie.org.cn ~]# storm logviewer & [3] 16437 [root@node102.yinzhengjie.org.cn ~]# [root@node102.yinzhengjie.org.cn ~]# echo $? 0 [root@node102.yinzhengjie.org.cn ~]# [root@node102.yinzhengjie.org.cn ~]# Running: java -server -Ddaemon.name=logviewer -Dstorm.options= -Dstorm.home=/yinzhengjie/softwares/apache-storm-1.2.2 -Dstorm.log.dir=/yinzhengjie/softwares/apache-storm-1.2.2/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /yinzhengjie/softwares/apache-storm-1.2.2/*:/yinzhengjie/softwares/apache-storm-1.2.2/lib/*:/yinzhengjie/softwares/apache-storm-1.2.2/extlib/*:/yinzhengjie/softwares/apache-storm-1.2.2/extlib-daemon/*:/yinzhengjie/softwares/apache-storm-1.2.2:/yinzhengjie/softwares/storm/conf -Xmx128m -Dlogfile.name=logviewer.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/yinzhengjie/softwares/apache-storm-1.2.2/log4j2/cluster.xml org.apache.storm.daemon.logviewer [root@node102.yinzhengjie.org.cn ~]# [root@node102.yinzhengjie.org.cn ~]# tail -100f /yinzhengjie/softwares/storm/logs/logviewer.log 2019-03-25 18:32:45.280 o.a.s.d.logviewer main [INFO] Starting logviewer server for storm version '1.2.2' 2019-03-25 18:32:45.334 o.a.s.s.o.e.j.s.Server main [INFO] jetty-7.x.y-SNAPSHOT 2019-03-25 18:32:45.502 o.a.s.s.o.e.j.s.h.ContextHandler main [INFO] started o.a.s.s.o.e.j.s.ServletContextHandler{/,null} 2019-03-25 18:32:45.527 o.a.s.s.o.e.j.s.AbstractConnector main [INFO] Started SelectChannelConnector@0.0.0.0:8000 2019-03-25 18:32:45.527 o.a.s.d.m.MetricsUtils main [INFO] Using statistics reporter plugin:org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter 2019-03-25 18:32:45.528 o.a.s.d.m.r.JmxPreparableReporter main [INFO] Preparing... 2019-03-25 18:32:45.535 o.a.s.d.common main [INFO] Started statistics report plugin... ^C [root@node102.yinzhengjie.org.cn ~]# [root@node102.yinzhengjie.org.cn ~]#
[root@node103.yinzhengjie.org.cn ~]# [root@node103.yinzhengjie.org.cn ~]# storm logviewer & [3] 16393 [root@node103.yinzhengjie.org.cn ~]# [root@node103.yinzhengjie.org.cn ~]# echo $? 0 [root@node103.yinzhengjie.org.cn ~]# [root@node103.yinzhengjie.org.cn ~]# Running: java -server -Ddaemon.name=logviewer -Dstorm.options= -Dstorm.home=/yinzhengjie/softwares/apache-storm-1.2.2 -Dstorm.log.dir=/yinzhengjie/softwares/apache-storm-1.2.2/logs -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /yinzhengjie/softwares/apache-storm-1.2.2/*:/yinzhengjie/softwares/apache-storm-1.2.2/lib/*:/yinzhengjie/softwares/apache-storm-1.2.2/extlib/*:/yinzhengjie/softwares/apache-storm-1.2.2/extlib-daemon/*:/yinzhengjie/softwares/apache-storm-1.2.2:/yinzhengjie/softwares/storm/conf -Xmx128m -Dlogfile.name=logviewer.log -DLog4jContextSelector=org.apache.logging.log4j.core.async.AsyncLoggerContextSelector -Dlog4j.configurationFile=/yinzhengjie/softwares/apache-storm-1.2.2/log4j2/cluster.xml org.apache.storm.daemon.logviewer [root@node103.yinzhengjie.org.cn ~]# [root@node103.yinzhengjie.org.cn ~]# tail -100f /yinzhengjie/softwares/storm/logs/logviewer.log 2019-03-25 18:32:34.461 o.a.s.d.logviewer main [INFO] Starting logviewer server for storm version '1.2.2' 2019-03-25 18:32:34.512 o.a.s.s.o.e.j.s.Server main [INFO] jetty-7.x.y-SNAPSHOT 2019-03-25 18:32:34.538 o.a.s.s.o.e.j.s.h.ContextHandler main [INFO] started o.a.s.s.o.e.j.s.ServletContextHandler{/,null} 2019-03-25 18:32:34.698 o.a.s.s.o.e.j.s.AbstractConnector main [INFO] Started SelectChannelConnector@0.0.0.0:8000 2019-03-25 18:32:34.698 o.a.s.d.m.MetricsUtils main [INFO] Using statistics reporter plugin:org.apache.storm.daemon.metrics.reporters.JmxPreparableReporter 2019-03-25 18:32:34.699 o.a.s.d.m.r.JmxPreparableReporter main [INFO] Preparing... 2019-03-25 18:32:34.703 o.a.s.d.common main [INFO] Started statistics report plugin... ^C [root@node103.yinzhengjie.org.cn ~]# [root@node103.yinzhengjie.org.cn ~]# [root@node103.yinzhengjie.org.cn ~]#
五.Strom 命令行操作
1>.nimbus：启动nimbus守护进程 storm nimbus
2>.supervisor：启动supervisor守护进程 storm supervisor
3>.ui：启动UI守护进程。 storm ui
4>.list：列出正在运行的拓扑及其状态 storm list
5>.logviewer：Logviewer提供一个web接口查看Storm日志文件。 storm logviewer
6>.jar： storm jar 【jar路径】 【拓扑包名.拓扑类名】 【拓扑名称】
7>.kill：杀死名为Topology-name的拓扑 storm kill topology-name [-w wait-time-secs] -w：等待多久后杀死拓扑
8>.active：激活指定的拓扑spout。 storm activate topology-name
9>.deactivate：禁用指定的拓扑Spout。 storm deactivate topology-name
10>.help：打印一条帮助消息或者可用命令的列表。 storm help storm help <command>
本文来自博客园，作者：尹正杰，转载请注明原文链接：https://www.cnblogs.com/yinzhengjie/articles/10415472.html，个人微信: "JasonYin2020"（添加时请备注来源及意图备注，有偿付费）
当你的才华还撑不起你的野心的时候，你就应该静下心来学习。当你的能力还驾驭不了你的目标的时候，你就应该沉下心来历练。问问自己，想要怎样的人生。
