实战-nginx和tomcat实现动静分离（包含镜像分层构建）

harbor地址：

    harbor.wyh.net

master地址：

    192.168.213.11

node地址：

    192.168.213.21

    192.168.213.22

 

创建tomcat的docker文件并上传到harbor（分层构建镜像，不同的Dockerfile放在不同的目录下）：

 

系统镜像构建：

cat <<EOF >Dockerfile
#自定义Centos 基础镜像
FROM centos:7.9.2009
MAINTAINER 956860991@qq.com
ADD filebeat-7.12.1-x86_64.rpm /tmp
RUN yum install -y /tmp/filebeat-7.12.1-x86_64.rpm vim wget tree  lrzsz gcc gcc-c++ automake pcre pcre-devel zlib zlib-devel openssl openssl-devel iproute net-tools iotop &&  rm -rf /etc/localtime /tmp/filebeat-7.12.1-x86_64.rpm && ln -snf /usr/share/zoneinfo/Asia/Shanghai /etc/localtime  && useradd nginx -u 2088
EOF

#构建镜像的脚本

cat <<EOF >build-command.sh
#!/bin/bash
#docker build -t  harbor.wyh.net/test-sy/wyh-centos-base:7.9.2009 .
#docker push harbor.wyh.net/test-sy/wyh-centos-base:7.9.2009
/usr/local/bin/nerdctl build -t harbor.wyh.net/test-sy/wyh-centos-base:7.9.2009 .
/usr/local/bin/nerdctl push harbor.wyh.net/test-sy/wyh-centos-base:7.9.2009
EOF

chmod +x build-command.sh
bash build-command.sh

 

构建jdk镜像（提前下载好jdk的安装包到服务器上）：

#根据刚刚构建好的centos镜像来构建jdk镜像
cat <<EOF >Dockerfile
FROM harbor.wyh.net/test-sy/wyh-centos-base:7.9.2009
#FROM centos:7.9.2009
MAINTAINER 956860991@qq.com
ADD jdk-8u212-linux-x64.tar.gz /usr/local/src/
RUN ln -sv /usr/local/src/jdk1.8.0_212 /usr/local/jdk
ADD profile /etc/profile
ENV JAVA_HOME /usr/local/jdk
ENV JRE_HOME $JAVA_HOME/jre
ENV CLASSPATH $JAVA_HOME/lib/:$JRE_HOME/lib/
ENV PATH $PATH:$JAVA_HOME/bin
EOF

 

#构建镜像的脚本

cat <<EOF >build-command.sh
#!/bin/bash
#docker build -t harbor.wyh.net/test-sy/jdk-base:v8.212  .
#sleep 1
#docker push  harbor.wyh.net/test-sy/jdk-base:v8.212
nerdctl build -t  harbor.wyh.net/test-sy/jdk-base:v8.212  .  
nerdctl push  harbor.wyh.net/test-sy/jdk-base:v8.212
EOF
 
chmod +x build-command.sh
bash build-command.sh

 

构建tomcat镜像（提前下载好tomcat安装包到服务器上）：

#根据刚刚构建好的jdk镜像来构建tomcat镜像
cat <<EOF >Dockerfile
#Tomcat 8.5.43基础镜像
FROM harbor.wyh.net/test-sy/jdk-base:v8.212
MAINTAINER 956860991@qq.com
RUN mkdir /apps /data/tomcat/webapps /data/tomcat/logs -pv
ADD apache-tomcat-8.5.43.tar.gz  /apps
RUN useradd tomcat -u 2050 && ln -sv /apps/apache-tomcat-8.5.43 /apps/tomcat && chown -R tomcat.tomcat /apps /data -R
EOF

 

#构建镜像的脚本

cat <<EOF >build-command.sh
#!/bin/bash
#docker build -t harbor.wyh.net/test-sy/tomcat-base:v8.5.43  .
#sleep 3
#docker push  harbor.wyh.net/test-sy/tomcat-base:v8.5.43
nerdctl  build -t harbor.wyh.net/test-sy/tomcat-base:v8.5.43  .  
nerdctl  push harbor.wyh.net/test-sy/tomcat-base:v8.5.43
EOF
 
chmod +x build-command.sh
bash build-command.sh

 

构建应用镜像（提前准备些index页面或测试程序）：

#使用刚刚构建好的tomcat基础镜像
cat <<EOF >Dockerfile
#tomcat web1
FROM harbor.wyh.net/test-sy/tomcat-base:v8.5.43
ADD catalina.sh /apps/tomcat/bin/catalina.sh
ADD server.xml /apps/tomcat/conf/server.xml
#ADD myapp/* /data/tomcat/webapps/myapp/
ADD app1.tar.gz /data/tomcat/webapps/myapp/
ADD run_tomcat.sh /apps/tomcat/bin/run_tomcat.sh
#ADD filebeat.yml /etc/filebeat/filebeat.yml
RUN chown  -R nginx.nginx /data/ /apps/
#ADD filebeat-7.5.1-x86_64.rpm /tmp/
#RUN cd /tmp && yum localinstall -y filebeat-7.5.1-amd64.deb
EXPOSE 8080 8443
CMD ["/apps/tomcat/bin/run_tomcat.sh"]
EOF

 

#CMD指定的脚本

cat <<EOF >run_tomcat.sh
#!/bin/bash
#echo "nameserver 223.6.6.6" > /etc/resolv.conf
#echo "192.168.7.248 k8s-vip.example.com" >> /etc/hosts
#/usr/share/filebeat/bin/filebeat -e -c /etc/filebeat/filebeat.yml -path.home /usr/share/filebeat -path.config /etc/filebeat -path.data /var/lib/filebeat -path.logs /var/log/filebeat &
su - nginx -c "/apps/tomcat/bin/catalina.sh start"
tail -f /etc/hosts
EOF

 

#构建镜像的脚本

cat <<EOF >build-command.sh
#!/bin/bash
TAG=\$1
#docker build -t  harbor.wyh.net/test-sy/tomcat-app1:\${TAG} .
#sleep 3
#docker push  harbor.wyh.net/test-sy/tomcat-app1:\${TAG}
nerdctl build -t  harbor.wyh.net/test-sy/tomcat-app1:\${TAG} .
nerdctl push  harbor.wyh.net/test-sy/tomcat-app1:\${TAG}
EOF
 
chmod +x build-command.sh
bash build-command.sh v20220816

 

创建nginx的基础镜像并上传到harbor（根据刚刚生成的centos镜像制作，提前上传好nginx安装包）：

#使用构建好的centos基础镜像
cat <<EOF >Dockerfile
#Nginx Base Image
FROM harbor.wyh.net/test-sy/wyh-centos-base:7.9.2009
MAINTAINER  956860991@qq.com
RUN yum install -y vim wget tree  lrzsz gcc gcc-c++ automake pcre pcre-devel zlib zlib-devel openssl openssl-devel iproute net-tools iotop
ADD nginx-1.22.0.tar.gz /usr/local/src/
RUN cd /usr/local/src/nginx-1.22.0 && ./configure  && make && make install && ln -sv  /usr/local/nginx/sbin/nginx /usr/sbin/nginx  &&rm -rf /usr/local/src/nginx-1.22.0.tar.gz
EOF

 

#构建镜像的脚本

cat <<EOF >build-command.sh
#!/bin/bash
#docker build -t harbor.wyh.net/test-sy/nginx-base:v1.18.0  .
#sleep 1
#docker push  harbor.wyh.net/test-sy/nginx-base:v1.18.0
nerdctl build -t  harbor.wyh.net/test-sy/nginx-base:v1.22.0  .
nerdctl push harbor.wyh.net/test-sy/nginx-base:v1.22.0
EOF
 
chmod +x build-command.sh
bash build-command.sh

 

构建nginx实际环境（使用刚刚构建的基础镜像）：

#使用刚刚构建好的nginx基础镜像
cat <<EOF >Dockerfile
#Nginx 1.22.0
FROM harbor.wyh.net/test-sy/nginx-base:v1.22.0
##修改修改nginx.conf文件代理tomcat的service
ADD nginx.conf /usr/local/nginx/conf/nginx.conf
ADD app1.tar.gz  /usr/local/nginx/html/webapp/
ADD index.html  /usr/local/nginx/html/index.html
#静态资源挂载路径
RUN mkdir -p /usr/local/nginx/html/webapp/static /usr/local/nginx/html/webapp/images
EXPOSE 80 443
CMD ["nginx"]
EOF

 

#构建镜像的脚本

cat <<EOF >build-command.sh
#!/bin/bash
TAG=\$1
#docker build -t harbor.wyh.net/test-sy/nginx-web1:\${TAG} .
#echo "镜像构建完成，即将上传到harbor"
#sleep 1
#docker push harbor.wyh.net/test-sy/nginx-web1:\${TAG}
#echo "镜像上传到harbor完成"
nerdctl build -t harbor.wyh.net/test-sy/nginx-web1:\${TAG} .
nerdctl push harbor.wyh.net/test-sy/nginx-web1:\${TAG}
EOF
 
chmod +x build-command.sh
bash build-command.sh v20220816

 

在Kubernetes上跑服务：

在nfs服务器创建目录：

mkdir -p /data/kubernetes/wyh/{images,static}

 

使用yaml文件运行tomcat：

cat <<EOF >tomcat-app1.yaml
kind: Deployment
#apiVersion: extensions/v1beta1
apiVersion: apps/v1
metadata:
  labels:
    app: wyh-tomcat-app1-deployment-label
  name: wyh-tomcat-app1-deployment
  namespace: wyh-ns
spec:
  replicas: 1
  selector:
    matchLabels:
      app: wyh-tomcat-app1-selector
  template:
    metadata:
      labels:
        app: wyh-tomcat-app1-selector
    spec:
      containers:
      - name: wyh-tomcat-app1-container
        image: harbor.wyh.net/test-sy/tomcat-app1:v20220816
        #command: ["/apps/tomcat/bin/run_tomcat.sh"]
        imagePullPolicy: IfNotPresent
        #imagePullPolicy: Always
        ports:
        - containerPort: 8080
          protocol: TCP
          name: http
        env:
        - name: "password"
          value: "123456"
        - name: "age"
          value: "18"
        #resources:
        #  limits:
        #    cpu: 1
        #    memory: "512Mi"
        #  requests:
        #    cpu: 500m
        #    memory: "512Mi"
        volumeMounts:
        - name: wyh-images
          mountPath: /usr/local/nginx/html/webapp/images
          readOnly: false
        - name: wyh-static
          mountPath: /usr/local/nginx/html/webapp/static
          readOnly: false
      volumes:
      - name: wyh-images
        nfs:
          server: 192.168.213.21
          path: /data/kubernetes/wyh/images
      - name: wyh-static
        nfs:
          server: 192.168.213.21
          path: /data/kubernetes/wyh/static
#      nodeSelector:
#        project: wyh
#        app: tomcat
---
kind: Service
apiVersion: v1
metadata:
  labels:
    app: wyh-tomcat-app1-service-label
  name: wyh-tomcat-app1-service
  namespace: wyh-ns
spec:
  type: NodePort
  ports:
  - name: http
    port: 80
    protocol: TCP
    targetPort: 8080
    nodePort: 30092
  selector:
    app: wyh-tomcat-app1-selector
EOF
 
kubectl apply -f tomcat-app1.yaml

 

使用yaml文件运行nginx：

cat <<EOF >nginx-app1.yaml
kind: Deployment
apiVersion: apps/v1
metadata:
  labels:
    app: wyh-nginx-deployment-label
  name: wyh-nginx-deployment
  namespace: wyh-ns
spec:
  replicas: 1
  selector:
    matchLabels:
      app: wyh-nginx-selector
  template:
    metadata:
      labels:
        app: wyh-nginx-selector
    spec:
      containers:
      - name: wyh-nginx-container
        image: harbor.wyh.net/test-sy/nginx-web1:v20220817
        #command: ["/apps/tomcat/bin/run_tomcat.sh"]
        #imagePullPolicy: IfNotPresent
        imagePullPolicy: IfNotPresent
        ports:
        - containerPort: 80
          protocol: TCP
          name: http
        - containerPort: 443
          protocol: TCP
          name: https
        env:
        - name: "password"
          value: "123456"
        - name: "age"
          value: "20"
        resources:
          limits:
            cpu: 500m
            memory: 512Mi
          requests:
            cpu: 500m
            memory: 256Mi
 
 
        volumeMounts:
        - name: wyh-images
          mountPath: /usr/local/nginx/html/webapp/images
          readOnly: false
        - name: wyh-static
          mountPath: /usr/local/nginx/html/webapp/static
          readOnly: false
      volumes:
      - name: wyh-images
        nfs:
          server: 192.168.213.21
          path: /data/kubernetes/wyh/images
      - name: wyh-static
        nfs:
          server: 192.168.213.21
          path: /data/kubernetes/wyh/static
      #nodeSelector:
      #  group: wyh
---
kind: Service
apiVersion: v1
metadata:
  labels:
    app: wyh-nginx-service-label
  name: wyh-nginx-service
  namespace: wyh-ns
spec:
  type: NodePort
  ports:
  - name: http
    port: 80
    protocol: TCP
    targetPort: 80
    nodePort: 30090
  - name: https
    port: 443
    protocol: TCP
    targetPort: 443
    nodePort: 30091
  selector:
    app: wyh-nginx-selector
EOF
 
kubectl apply -f tomcat-app1.yaml

 

测试访问nginx资源（http://192.168.213.21:30090/webapp/）

 

测试访问tomcat资源（http://192.168.213.21:30090/myapp/）

 

测试成功！！！！！！！！！！！！！！！！！！