Ubuntu环境搭建Kubernetes集群

目录

• 一 基于kubeadm搭建Kubernetes集群
  • 1 所有节点需要配置的操作
    • 1.1 关闭防火墙
    • 1.2 关闭selinux
    • 1.3 禁用swap
    • 1.4 修改主机名和/etc/hosts文件
    • 1.5 重启主机
    • 1.6 开启路由转发
    • 1.7 设置仓库为阿里云仓库
    • 1.8 配置Docker的阿里云apt安装源，并安装
    • 1.9 在每个节点上安装docker-ce-18.06.0并设置开机自启动
    • 1.10 启用bridge-nf-call-iptables和bridge-nf-call-ip6tables
    • 1.11 配置kubernetes的阿里云apt安装源
    • 1.12 在每个节点上安装kubeadm，kubelet，kubectl并设置kubelet开机自启动
  • 2 Master节点：
    • 2.1 导入kube-apiserver,kube-proxy等kubernetes1.12.1版本的docker镜像
    • 2.2 初始化master
    • 2.3 Master节点配置root用户管理集群
      • 2.3.1 使用root用户运行kubernetes
      • 2.3.2 安装flannel
      • 2.3.3 查看集群状态
  • 3 Node节点：
    • 3.1 导入kube-proxy,pause和flannel，kubernetes1.12.1版本的docker镜像
    • 3.2 加入master节点：
    • 3.3 在Master上查看集群状态
  • 4 基于kubeadm搭建Kubernetes集群支持Swap分区

一 基于kubeadm搭建Kubernetes集群

1 所有节点需要配置的操作

1.1 关闭防火墙

# ufw disable

1.2 关闭selinux

## 某些ubuntu版本，没有安装selinux，则可以不用配置
# sed -i 's/enforcing/disabled/' /etc/selinux/config

1.3 禁用swap

# swapoff -a
# vim /etc/fstab
		# 将与swap有关的配置注释，重启系统即可

1.4 修改主机名和/etc/hosts文件

# hostnamectl set-hostname {k8s-m|k8s-node1|k8s-node2}
# vim /etc/hosts
10.120.10.190   k8s-m
10.120.10.191   k8s-node1
10.120.10.192   k8s-node2

1.5 重启主机

# reboot

1.6 开启路由转发

# echo "net.ipv4.ip_forward = 1">>/etc/sysctl.conf
# sysctl -p

1.7 设置仓库为阿里云仓库

# vim /etc/apt/sources.list
--------------------------------------------
# deb cdrom:[Ubuntu 16.04 LTS _Xenial Xerus_ - Release amd64 (20160420.1)]/ xenial main restricted
deb-src http://archive.ubuntu.com/ubuntu xenial main restricted 
#Added by software-properties
deb http://mirrors.aliyun.com/ubuntu/ xenial main restricted
deb-src http://mirrors.aliyun.com/ubuntu/ xenial main restricted multiverse universe 
#Added by software-properties
deb http://mirrors.aliyun.com/ubuntu/ xenial-updates main restricted
deb-src http://mirrors.aliyun.com/ubuntu/ xenial-updates main restricted multiverse universe 
#Added by software-properties
deb http://mirrors.aliyun.com/ubuntu/ xenial universe
deb http://mirrors.aliyun.com/ubuntu/ xenial-updates universe
deb http://mirrors.aliyun.com/ubuntu/ xenial multiverse
deb http://mirrors.aliyun.com/ubuntu/ xenial-updates multiverse
deb http://mirrors.aliyun.com/ubuntu/ xenial-backports main restricted universe multiverse
deb-src http://mirrors.aliyun.com/ubuntu/ xenial-backports main restricted universe multiverse 
#Added by software-properties
deb http://archive.canonical.com/ubuntu xenial partner
deb-src http://archive.canonical.com/ubuntu xenial partner
deb http://mirrors.aliyun.com/ubuntu/ xenial-security main restricted
deb-src http://mirrors.aliyun.com/ubuntu/ xenial-security main restricted multiverse universe 
#Added by software-properties
deb http://mirrors.aliyun.com/ubuntu/ xenial-security universe
deb http://mirrors.aliyun.com/ubuntu/ xenial-security multiverse

# apt update

1.8 配置Docker的阿里云apt安装源，并安装

# apt-get -y install apt-transport-https ca-certificates curl software-properties-common
# curl -fsSL http://mirrors.aliyun.com/docker-ce/linux/ubuntu/gpg | sudo apt-key add -
# add-apt-repository "deb [arch=amd64] http://mirrors.aliyun.com/docker-ce/linux/ubuntu $(lsb_release -cs) stable"
# apt update

1.9 在每个节点上安装docker-ce-18.06.0并设置开机自启动

# apt-get install docker-ce=18.06.0~ce~3-0~ubuntu
# docker -v
# systemctl start docker
# systemctl enable docker
# systemctl status docker

1.10 启用bridge-nf-call-iptables和bridge-nf-call-ip6tables

# echo 'net.bridge.bridge-nf-call-iptables = 1'>>/etc/sysctl.conf
# echo 'net.bridge.bridge-nf-call-ip6tables = 1'>>/etc/sysctl.conf
# sysctl -p

1.11 配置kubernetes的阿里云apt安装源

# curl https://mirrors.aliyun.com/kubernetes/apt/doc/apt-key.gpg | apt-key add -
# vim /etc/apt/sources.list.d/kubernetes.list
deb https://mirrors.aliyun.com/kubernetes/apt/ kubernetes-xenial main
# apt update

1.12 在每个节点上安装kubeadm，kubelet，kubectl并设置kubelet开机自启动

# apt install kubelet=1.12.1-00 kubeadm=1.12.1-00 kubectl=1.12.1-00
# kubeadm version
# systemctl enable kubelet

2 Master节点：

2.1 导入kube-apiserver,kube-proxy等kubernetes1.12.1版本的docker镜像

## 镜像请从共享服务器下载：(\\10.120.1.100\安装软件\Kubernetes-1.12.1\kubernetes-1.12.1镜像\ "安装集群所需镜像")
# docker load < coredns.tar
# docker tag be0e8485fd78 k8s.gcr.io/coredns:1.2.2
# docker load < etcd-amd64.tar
# docker tag dcf9f4b0065d k8s.gcr.io/etcd:3.2.24
# docker load < pause.tar
# docker tag 97bc1dcec76a k8s.gcr.io/pause:3.1
# docker load < kube-apiserver-amd64.tar
# docker tag dcb029b5e3ad k8s.gcr.io/kube-apiserver:v1.12.1
# docker load < kube-controller-manager-amd64.tar
# docker tag aa2dd57c7329 k8s.gcr.io/kube-controller-manager:v1.12.1
# docker load < kube-proxy-amd64.tar
# docker tag 68987659c19a k8s.gcr.io/kube-proxy:v1.12.1
# docker load < kube-scheduler-amd64.tar
# docker tag af194c06e677 k8s.gcr.io/kube-scheduler:v1.12.1
# docker load < flannel.tar
# docker tag f0fad859c909 quay.io/coreos/flannel:v0.10.0-amd64

2.2 初始化master

# kubeadm init --kubernetes-version=1.12.1 --pod-network-cidr=10.244.0.0/16 --apiserver-advertise-address=10.120.10.190
## 上述步骤运行成功后，会输出以下内容：

Your Kubernetes master has initialized successfully!

To start using your cluster, you need to run the following as a regular user:

  mkdir -p $HOME/.kube
  sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
  sudo chown $(id -u):$(id -g) $HOME/.kube/config

You should now deploy a pod network to the cluster.
Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
  https://kubernetes.io/docs/concepts/cluster-administration/addons/

You can now join any number of machines by running the following on each node
as root:

  kubeadm join 10.120.10.190:6443 --token d4557c.fh4vjxkiyoj2zt5y --discovery-token-ca-cert-hash sha256:b17d4618ab1149934f69582c727f58e53cd51f89dd9844fd3f7b776a0e3d389a

2.3 Master节点配置root用户管理集群

2.3.1 使用root用户运行kubernetes

# mkdir -p $HOME/.kube
# sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

2.3.2 安装flannel

# kubectl apply -f https://raw.githubusercontent.com/coreos/flannel/master/Documentation/kube-flannel.yml

2.3.3 查看集群状态

# kubectl get nodes

3 Node节点：

3.1 导入kube-proxy,pause和flannel，kubernetes1.12.1版本的docker镜像

## 镜像请从共享服务器下载：(\\10.120.1.100\安装软件\Kubernetes-1.12.1\kubernetes-1.12.1镜像\ "安装集群所需镜像")
# docker load < kube-proxy-amd64.tar
# docker tag 68987659c19a k8s.gcr.io/kube-proxy:v1.12.1
# docker load < pause.tar
# docker tag 97bc1dcec76a k8s.gcr.io/pause:3.1
# docker load < flannel.tar
# docker tag f0fad859c909 quay.io/coreos/flannel:v0.10.0-amd64

3.2 加入master节点：

kubeadm join 10.120.10.190:6443 --token s5gi75.o950l49ripas5e0y --discovery-token-ca-cert-hash sha256:b17d4618ab1149934f69582c727f58e53cd51f89dd9844fd3f7b776a0e3d389a

3.3 在Master上查看集群状态

# kubectl get nodes

4 基于kubeadm搭建Kubernetes集群支持Swap分区

• 其余安装参照上面流程

特别注意流程，请参照下面介绍

• Master节点（新增/修改）：

# vim /etc/default/kubelet
KUBELET_EXTRA_ARGS="--fail-swap-on=false"
# kubeadm init --kubernetes-version=1.12.1 --pod-network-cidr=10.244.0.0/16 --apiserver-advertise-address=10.120.10.190 --ignore-preflight-errors=Swap

• Node节点（新增/修改）：

# vim /etc/default/kubelet
KUBELET_EXTRA_ARGS="--fail-swap-on=false"
# kubeadm join 10.120.10.190:6443 --token s5gi75.o950l49ripas5e0y --discovery-token-ca-cert-hash sha256:b17d4618ab1149934f69582c727f58e53cd51f89dd9844fd3f7b776a0e3d389a --ignore-preflight-errors=Swap