Storm集群参数调整

Supervisor 参数调整

  • 修改${STORM_HOME}conf/storm.yaml文件内容

supervisor变更参数

  • slots 配置:
    • 若storm host仅仅执行supervisor(不包含nimbus)时,slots数目 = (Memory GB - 1 )
    • 若同时包含了storm nimbus、ui、supervisor时,slots = (Memory GB - 1 )
supervisor.slots.ports
  • worker.childopts 配置:
worker.childopts: "-Xmx1g -Xms1g -server -XX:+UseCompressedOops -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSClassUnloadingEnabled -XX:+CMSScavengeBeforeRemark -XX:+DisableExplicitGC"

supervisor重启脚本

spid=`jps | grep supervisor | awk '{print $1}'`

if [ "x${spid}" != "x" ]
then
	kill ${spid}
	storm supervisor
fi

nimbus与ui 参数调整

  • worker.childopts影响storm ui页面展示信息,因此也调整和supervisor一致
worker.childopts: "-Xmx1g -Xms1g -server -XX:+UseCompressedOops -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSClassUnloadingEnabled -XX:+CMSScavengeBeforeRemark -XX:+DisableExplicitGC"

nimbus重启

npid=`jps | grep nimbus | awk '{print $1}'`

if [ "x${npid}" != "x" ]
then
	kill ${npid}
	storm nimbus
fi

ui重启

nimbus重启

upid=`jps | grep core | awk '{print $1}'`

if [ "x${upid}" != "x" ]
then
	kill ${upid}
	storm nimbus
fi
posted @ 2017-12-26 10:11  木易森林  阅读(1404)  评论(0编辑  收藏  举报