Tomcat反带和集群

 Nginx|Apache反带用户请求到Tomcat

  • LNMT:
client -->http --> nginx --> reverse_proxy --> http --> tomcat (http connector)

location ~* \.(jsp|do)$ {
proxy_pass http://web1.evescn.com:8080;
}

  

  • LAMT:
client --> http --> httpd --> reverse_proxy --> {http|ajp} --> tomcat {http connector|ajp connector}

  

反代模块:
    主:proxy_module
    子:proxy_module_http, proxy_module_ajp

  

proxy_module_http:
    <VirtualHost *:80>
        ServerName web1.evescn.com
        ProxyVia On
        ProxyRequests Off    # 开启反向代理时,需要关闭正向代理
        ProxyPreserveHost On # 直接反带用户请求的虚拟主机名
        <Proxy *>
            Require all granted
        </Proxy>
        ProxyPass / http://172.16.100.67:8080/
        ProxyPassReverse / http://172.16.100.67:8080/
        <Location />
            Require all granted
        </Location>
    </VirtualHost>

  

proxy_module_ajp:
    <VirtualHost *:80>
        ServerName web1.evescn.com
        ProxyVia On
        ProxyRequests Off
        ProxyPreserveHost On
        <Proxy *>
            Require all granted
        </Proxy>
        ProxyPass /status !
        ProxyPass / ajp://172.16.100.67:8009/
        ProxyPassReverse / ajp://172.16.100.67:8009/
        <Location />
            Require all granted
        </Location>
    </VirtualHost>

  

  • LNAMT:
client -->http --> nginx -->  httpd --> reverse_proxy --> {http|ajp} --> tomcat {http connector|ajp connector}

  

 Tomcat会话保持

session sticky
    source ip
    cookie
session cluster: 
session server
    kv: memcached, redis

  

 Tomcat集群

  • (1) LB tomcat
nginx tomcats (upsteam模块)
apache tomcats  
  • (2) LB tomcat cluster
  • (3) LB tomcat
session server
    memcached

  

  • apache: tomcats
(1) apache:
        mod_proxy
        mod_proxy_http
        mod_proxy_balancer

    tomcat:
        http connector
(2) apache: 
        mod_proxy
        mod_proxy_ajp
        mod_proxy_balancer	
    tomcat:
        ajp connector
(3) apache:
        mod_jk
    tomcat:
        ajp connector

  

  • 第一种方法的实现:
<proxy balancer://lbcluster1>
    BalancerMember http://172.16.100.68:8080 loadfactor=10 route=TomcatA
    BalancerMember http://172.16.100.69:8080 loadfactor=10 route=TomcatB
</proxy>

<VirtualHost *:80>
    ServerName web1.evescn.com
    ProxyVia On
    ProxyRequests Off
    ProxyPreserveHost On
    <Proxy *>
        Require all granted
    </Proxy>
    ProxyPass / balancer://lbcluster1/
    ProxyPassReverse / balancer://lbcluster1/
    <Location />
        Require all granted
    </Location>
</VirtualHost>

  如果需要会话绑定:

Header add Set-Cookie "ROUTEID=.%{BALANCER_WORKER_ROUTE}e; path=/" env=BALANCER_ROUTE_CHANGED
<proxy balancer://lbcluster1>
    BalancerMember http://172.16.100.68:8080 loadfactor=10 route=TomcatA
    BalancerMember http://172.16.100.69:8080 loadfactor=10 route=TomcatB
	ProxySet stickysession=ROUTEID
</proxy>

<VirtualHost *:80>
    ServerName web1.evescn.com
    ProxyVia On
    ProxyRequests Off
    ProxyPreserveHost On
    <Proxy *>
        Require all granted
    </Proxy>
    ProxyPass / balancer://lbcluster1/
    ProxyPassReverse / balancer://lbcluster1/
    <Location />
        Require all granted
    </Location>
</VirtualHost>

  

  • 第二种方法的实现:
#Header add Set-Cookie "ROUTEID=.%{BALANCER_WORKER_ROUTE}e; path=/" env=BALANCER_ROUTE_CHANGED
<proxy balancer://lbcluster1>
    BalancerMember ajp://172.16.100.68:8009 loadfactor=10 route=TomcatA
    BalancerMember ajp://172.16.100.69:8009 loadfactor=10 route=TomcatB
    ProxySet stickysession=ROUTEID
</proxy>

<VirtualHost *:80>
    ServerName web1.evescn.com
    ProxyVia On
    ProxyRequests Off
    ProxyPreserveHost On
    <Proxy *>
        Require all granted
    </Proxy>
    ProxyPass / balancer://lbcluster1/
    ProxyPassReverse / balancer://lbcluster1/
    <Location />
        Require all granted
    </Location>
</VirtualHost>

  

  • 补充:mod_proxy_balancer模块内置的manager:
<Location /balancer-manager>
	SetHandler balancer-manager
	Proxypass !
	Order Deny,Allow
	Allow from all
</Location>	

  

  • 第三种方式:
mod_jk:额外编译安装

  

(1) 反向代理
	模块配置文件:mod_jk.conf 
		LoadModule  jk_module  modules/mod_jk.so
		JkWorkersFile  /etc/httpd/conf.d/workers.properties
		JkLogFile  logs/mod_jk.log
		JkLogLevel  debug
		JkMount  /*  TomcatA
		JkMount  /status/  stat1

	workers配置文件:workers.properties
		worker.list=TomcatA,stat1
		worker.TomcatA.port=8009
		worker.TomcatA.host=172.16.100.68
		worker.TomcatA.type=ajp13
		worker.TomcatA.lbfactor=1
		worker.stat1.type = status

	注意:status的访问要做访问控制;

  

(2) 负载均衡
	模块配置文件:mod_jk.conf
		LoadModule  jk_module  modules/mod_jk.so
		JkWorkersFile  /etc/httpd/conf.d/workers.properties
		JkLogFile  logs/mod_jk.log
		JkLogLevel  debug
		JkMount  /*  lbcluster1
		JkMount  /status/  stat1

	workers配置文件:workers.properties
		worker.list = lbcluster1,stat1
		worker.TomcatA.type = ajp13
		worker.TomcatA.host = 172.16.100.68
		worker.TomcatA.port = 8009
		worker.TomcatA.lbfactor = 1
		worker.TomcatB.type = ajp13
		worker.TomcatB.host = 172.16.100.69
		worker.TomcatB.port = 8009
		worker.TomcatB.lbfactor = 1
		worker.lbcluster1.type = lb
		worker.lbcluster1.sticky_session = 0
		worker.lbcluster1.balance_workers = TomcatA, TomcatB
		worker.stat1.type = status	

  

  • Session Cluster:
session manager:会话管理器

    StandardManager
    PersistentManager:
    FileStore
    JDBC
    DeltaManager
    BackupManager

  

构建步骤:
(1) 各节点配置使用deltamaanager:
    <Cluster className="org.apache.catalina.ha.tcp.SimpleTcpCluster"
                 channelSendOptions="8">

          <Manager className="org.apache.catalina.ha.session.DeltaManager"
                   expireSessionsOnShutdown="false"
                   notifyListenersOnReplication="true"/>

          <Channel className="org.apache.catalina.tribes.group.GroupChannel">
            <Membership className="org.apache.catalina.tribes.membership.McastService"
                        address="228.0.1.7"
                        port="45564"
                        frequency="500"
                        dropTime="3000"/>
            <Receiver className="org.apache.catalina.tribes.transport.nio.NioReceiver"
                      address="auto"
                      port="4000"
                      autoBind="100"
                      selectorTimeout="5000"
                      maxThreads="6"/>

            <Sender className="org.apache.catalina.tribes.transport.ReplicationTransmitter">
              <Transport className="org.apache.catalina.tribes.transport.nio.PooledParallelSender"/>
            </Sender>
            <Interceptor className="org.apache.catalina.tribes.group.interceptors.TcpFailureDetector"/>
            <Interceptor className="org.apache.catalina.tribes.group.interceptors.MessageDispatch15Interceptor"/>
          </Channel>

          <Valve className="org.apache.catalina.ha.tcp.ReplicationValve"
                 filter=""/>
          <Valve className="org.apache.catalina.ha.session.JvmRouteBinderValve"/>

          <Deployer className="org.apache.catalina.ha.deploy.FarmWarDeployer"
                    tempDir="/tmp/war-temp/"
                    deployDir="/tmp/war-deploy/"
                    watchDir="/tmp/war-listen/"
                    watchEnabled="false"/>

          <ClusterListener className="org.apache.catalina.ha.session.ClusterSessionListener"/>
    </Cluster>

(2) 为需要使用session cluster的webapps开启session distribution的功能:
   	WEB-INF/web.xml中添加
   		<distributable/>

  

 

posted @ 2018-04-20 17:44  evescn  阅读(240)  评论(0编辑  收藏  举报