Gitlab_ansible_jenkins三剑客③Ansible的安装及使用
一台服务器可能会安装不同的python应用，不同的应用可能使用的模块版本不同，如果都安装在同样的环境下容易冲突，为了避免冲突，引入virtualenv 这个包管理工具进行环境的隔离
使用pip安装之前需要配置代理(没有使用代理的不用配置)
# 因为有代理，需要设置
export http_proxy=http://10.11.0.148:808
export https_proxy=http://10.11.0.148:808
export ftp_proxy=http://10.11.0.148:808
ansible的环境安装
# root用户下安装依赖
[root@node1 ~]# yum install -y git nss curl
下载安装包：
[root@node1 ~]# wget http://www.python.org/ftp/python/3.6.5/Python-3.6.5.tar.xz
[root@node1 ~]# tar xf Python-3.6.5.tar.xz
[root@node1 ~]# cd Python-3.6.5
[root@node1 Python-3.6.5]# ./configure --prefix=/usr/local/ --with-ensurepip=install --enable-shared LDFLAGS="-Wl,-rpath /usr/local/lib"
[root@node1 Python-3.6.5]# make && make altinstal
将默认的pip替换为pip3.6
[root@node1 Python-3.6.5]# which pip3.6
/usr/local/bin/pip3.6
[root@node1 Python-3.6.5]# ln -s /usr/local/bin/pip3.6 /usr/local/bin/pip
# 安装 virtualenv
[root@node1 Python-3.6.5]# /usr/local/bin/pip3.6 install virtualenv
# 创建运行ansible的用户并进入该用户
[root@node1 Python-3.6.5]# useradd deploy
[root@node1 Python-3.6.5]# su - deploy
[deploy@node1 ~]$
# 创建 python3.6环境下的env环境
[deploy@node1 ~]$ virtualenv -p /usr/local/bin/python3.6 .py3-a2.5-env
[deploy@node1 ~]$ cd /home/deploy/.py3-a2.5-env/
# 安装ansible
[deploy@node1 .py3-a2.5-env]$ export http_proxy=http://10.11.0.148:808
[deploy@node1 .py3-a2.5-env]$ export https_proxy=http://10.11.0.148:808
[deploy@node1 .py3-a2.5-env]$ export ftp_proxy=http://10.11.0.148:808
# 克隆ansible仓库
[deploy@node1 .py3-a2.5-env]$ git clone https://github.com/ansible/ansible.git
# 加载py3-a2.5-env环境
[deploy@node1 .py3-a2.5-env]$ source /home/deploy/.py3-a2.5-env/bin/activate
(.py3-a2.5-env) [deploy@node1 .py3-a2.5-env]$
# 安装依赖包
(.py3-a2.5-env) [deploy@node1 .py3-a2.5-env]$ pip install paramiko PyYAML jinja2
# 切换ansible到2.5版本
(.py3-a2.5-env) [deploy@node1 ~]$ pwd
/home/deploy
(.py3-a2.5-env) [deploy@node1 ~]$ cd .py3-a2.5-env/
(.py3-a2.5-env) [deploy@node1 .py3-a2.5-env]$ ls
ansible bin include lib
(.py3-a2.5-env) [deploy@node1 .py3-a2.5-env]$ cd ansible/
(.py3-a2.5-env) [deploy@node1 ansible]$ git checkout stable-2.5
Branch stable-2.5 set up to track remote branch stable-2.5 from origin.
Switched to a new branch 'stable-2.5'
(.py3-a2.5-env) [deploy@node1 ansible]$ pwd
/home/deploy/.py3-a2.5-env/ansible
# 在子虚拟环境下加载ansible
.py3-a2.5-env) [deploy@node1 ansible]$ source /home/deploy/.py3-a2.5-env/ansible/hacking/env-setup –q
# 验证环境
(.py3-a2.5-env) [deploy@node1 ansible]$ ansible --version
可以看到 python3.6的环境成功安装了ansible2.5，至此独立的ansible环境就搭建好了
ansible的常用方法
配置ansible和目标主机环境
ansible主机:
node1: 10.11.0.210
目标主机：
node2: 10.11.0.212（test.example.com）
# 添加hosts解析
[root@node1 ~]# cat /etc/hosts
10.11.0.212 test.example.com
切换到 deploy用户的ansible环境中
[root@node1 ~]# su - deploy
Last login: Wed Mar 13 20:42:04 CST 2019 on pts/2
[deploy@node1 ~]$ source .py3-a2.5-env/bin/activate
(.py3-a2.5-env) [deploy@node1 ~]$ source .py3-a2.5-env/ansible/hacking/env-setup -q
# 看环境是否正常
(.py3-a2.5-env) [deploy@node1 ~]$ ansible-playbook --version
ansible-playbook 2.5.15 (stable-2.5 5cbf1bfa03) last updated 2019/03/13 20:44:34 (GMT +800)
config file = None
configured module search path = ['/home/deploy/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
ansible python module location = /home/deploy/.py3-a2.5-env/ansible/lib/ansible
executable location = /home/deploy/.py3-a2.5-env/ansible/bin/ansible-playbook
python version = 3.6.5 (default, Mar 13 2019, 20:08:53) [GCC 4.8.5 20150623 (Red Hat 4.8.5-28)]
# 搭建playbooks框架
(.py3-a2.5-env) [deploy@node1 ~]$
(.py3-a2.5-env) [deploy@node1 ~]$ mkdir test_playbooks
(.py3-a2.5-env) [deploy@node1 ~]$ cd test_playbooks/
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ mkdir inventory
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ mkdir roles
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ cd inventory
(.py3-a2.5-env) [deploy@node1 inventory]$ vim testenv
(.py3-a2.5-env) [deploy@node1 inventory]$ cat testenv
[testservers]
test.example.com
[testserers:vars]
server_name=test.example.com
user=root
output=/root/test.txt
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ tree .
.
├── deploy.yml
├── inventory
│ └── testenv
└── roles
└── testbox
└── tasks
└── main.yml
4 directories, 3 files
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ ssh-keygen -t rsa
Generating public/private rsa key pair.
Enter file in which to save the key (/home/deploy/.ssh/id_rsa):
Created directory '/home/deploy/.ssh'.
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in /home/deploy/.ssh/id_rsa.
Your public key has been saved in /home/deploy/.ssh/id_rsa.pub.
The key fingerprint is:
SHA256:OezEOxKL6z0hf/XMYZ2cvnLp55kGasvDJdj3OqV74N4 deploy@node1
The key's randomart image is:
+---[RSA 2048]----+
| |
| |
| |
| o . |
| . S o o o |
| ...= +.oo==. |
| .oo.+..=*o*. |
| oo....==+=++|
| .o .o .o+BOE.|
+----[SHA256]-----+
# 建立ansible和目标机器的免秘钥认证
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ ssh-copy-id -i /home/deploy/.ssh/id_rsa.pub root@test.example.com
/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/home/deploy/.ssh/id_rsa.pub"
The authenticity of host 'test.example.com (10.11.0.212)' can't be established.
ECDSA key fingerprint is SHA256:Q2YUBNf0DmqBgD9wso2dXiVhKZmJjwBnW08ul4o05ag.
ECDSA key fingerprint is MD5:e8:26:81:0d:0a:2e:62:33:d9:9f:dc:a1:a3:9c:6e:83.
Are you sure you want to continue connecting (yes/no)? yes
/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
root@test.example.com's password:
Number of key(s) added: 1
Now try logging into the machine, with: "ssh 'root@test.example.com'"
and check to make sure that only the key(s) you wanted were added.
# 验证能否免密码登录远程主机
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ ssh root@test.example.com
Last login: Fri Mar 8 19:22:58 2019 from 10.11.0.148
[root@node02 ~]# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP group default qlen 1000
link/ether 00:0c:29:2c:b7:df brd ff:ff:ff:ff:ff:ff
inet 10.11.0.212/8 brd 10.255.255.255 scope global noprefixroute eth0
valid_lft forever preferred_lft forever
inet6 fe80::2734:eea:a47a:b02/64 scope link noprefixroute
valid_lft forever preferred_lft forever
# 定义相关的变量和脚本
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ tree
.
├── deploy.yml
├── inventory
│ └── testenv
└── roles
└── testbox
└── tasks
└── main.yml
4 directories, 3 files
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ pwd
/home/deploy/test_playbooks
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ tree
.
├── deploy.yml
├── inventory
│ └── testenv
└── roles
└── testbox
└── tasks
└── main.yml
4 directories, 3 files
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ cat roles/testbox/tasks/main.yml
- name: Print server name and username to remote testbox
shell: "echo 'Currently {{ user }} is logining {{ server_name }}' > {{ output }}"
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ cat inventory/testenv
[testservers]
test.example.com
[testservers:vars]
server_name=test.example.com
user=root
output=/root/test.txt
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ cat deploy.yml
- hosts: "testservers"
gather_facts: true
remote_user: root
roles:
- testbox
(.py3-a2.5-env) [deploy@node1 test_playbooks]$
# 执行playbook
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ ansible-playbook -i inventory/testenv ./deploy.yml
PLAY [testservers] **************************************************************************************************************************************************************
TASK [Gathering Facts] **********************************************************************************************************************************************************
ok: [test.example.com]
TASK [testbox : Print server name and username to remote testbox] ***************************************************************************************************************
changed: [test.example.com]
PLAY RECAP **********************************************************************************************************************************************************************
test.example.com : ok=2 changed=1 unreachable=0 failed=0
(.py3-a2.5-env) [deploy@node1 test_playbooks]$
# 登录远程主机验证是否正确执行
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ ssh root@test.example.com
Last login: Thu Mar 14 20:07:01 2019 from node1
[root@node02 ~]# ls
anaconda-ks.cfg test.txt
[root@node02 ~]# cat test.txt
Currently root is logining test.example.com
实战操作
# 进入ansible环境
[root@node1 ~]# su - deploy
Last login: Thu Mar 14 19:17:02 CST 2019 on pts/0
[deploy@node1 ~]$ source .py3-a2.5-env/bin/activate
(.py3-a2.5-env) [deploy@node1 ~]$ source .py3-a2.5-env/ansible/hacking/env-setup -q
(.py3-a2.5-env) [deploy@node1 ~]$ ansible-playbook --version
ansible-playbook 2.5.15 (stable-2.5 5cbf1bfa03) last updated 2019/03/13 20:44:34 (GMT +800)
config file = None
configured module search path = ['/home/deploy/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
ansible python module location = /home/deploy/.py3-a2.5-env/ansible/lib/ansible
executable location = /home/deploy/.py3-a2.5-env/ansible/bin/ansible-playbook
python version = 3.6.5 (default, Mar 13 2019, 20:08:53) [GCC 4.8.5 20150623 (Red Hat 4.8.5-28)]
# 远程主机的操作
(.py3-a2.5-env) [deploy@node1 ~]$ ssh root@test.example.com
Last login: Mon Mar 18 19:41:46 2019 from 10.11.0.148
[root@node02 ~]# useradd foo
[root@node02 ~]# useradd deploy
[root@node02 ~]# mkdir /etc/nginx
[root@node02 ~]# rpm -Uvh http://nginx.org/packages/centos/7/noarch/RPMS/nginx-release-centos-7-0.el7.ngx.noarch.rpm
1.创建文件的操作
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ cat roles/testbox/tasks/main.yml
- name: Print server name and username to remote testbox
shell: "echo 'Currently {{ user }} is logining {{ server_name }}' > {{ output }}"
- name: create a file
file: 'path=/root/foo.txt state=touch mode=0755 owner=foo group=foo'
# 看到可以成功执行
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ ansible-playbook -i inventory/testenv ./deploy.yml
PLAY [testservers] **********************************************************************************************************************************************************************************************
TASK [Gathering Facts] ******************************************************************************************************************************************************************************************
ok: [test.example.com]
TASK [testbox : Print server name and username to remote testbox] ***********************************************************************************************************************************************
changed: [test.example.com]
TASK [testbox : create a file] **********************************************************************************************************************************************************************************
changed: [test.example.com]
PLAY RECAP ******************************************************************************************************************************************************************************************************
test.example.com : ok=3 changed=2 unreachable=0 failed=0
2.copy/stat和debug模块的使用
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ mkdir roles/testbox/files
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ vim roles/testbox/files/foo.sh
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ cat roles/testbox/files/foo.sh
echo "this is a test script"
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ vim roles/testbox/tasks/main.yml
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ cat roles/testbox/tasks/main.yml
- name: Print server name and username to remote testbox
shell: "echo 'Currently {{ user }} is logining {{ server_name }}' > {{ output }}"
- name: create a file
file: 'path=/root/foo.txt state=touch mode=0755 owner=foo group=foo'
- name: copy a file
copy: 'remote_src=no src=roles/testbox/files/foo.sh dest=/root/foo.sh mode=0644 force=yes'
- name: check if foo.sh exists
stat: 'path=/root/foo.sh'
register: script_stat
- debug: msg="foo.sh exists" # 如果文件存在则输出消息
when: script_stat.stat.exists
# 执行测试
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ ansible-playbook -i inventory/testenv ./deploy.yml
PLAY [testservers] **********************************************************************************************************************************************************************************************
TASK [Gathering Facts] ******************************************************************************************************************************************************************************************
ok: [test.example.com]
TASK [testbox : Print server name and username to remote testbox] ***********************************************************************************************************************************************
changed: [test.example.com]
TASK [testbox : create a file] **********************************************************************************************************************************************************************************
changed: [test.example.com]
TASK [testbox : copy a file] ************************************************************************************************************************************************************************************
ok: [test.example.com]
TASK [testbox : check if foo.sh exists] *************************************************************************************************************************************************************************
ok: [test.example.com]
TASK [testbox : debug] ******************************************************************************************************************************************************************************************
ok: [test.example.com] => {
"msg": "foo.sh exists"
}
PLAY RECAP ******************************************************************************************************************************************************************************************************
test.example.com : ok=6 changed=2 unreachable=0 failed=0
3.执行脚本
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ cat roles/testbox/tasks/main.yml
- name: Print server name and username to remote testbox
shell: "echo 'Currently {{ user }} is logining {{ server_name }}' > {{ output }}"
- name: create a file
file: 'path=/root/foo.txt state=touch mode=0755 owner=foo group=foo'
- name: copy a file
copy: 'remote_src=no src=roles/testbox/files/foo.sh dest=/root/foo.sh mode=0644 force=yes'
- name: check if foo.sh exists
stat: 'path=/root/foo.sh'
register: script_stat
- debug: msg="foo.sh exists"
when: script_stat.stat.exists
- name: run the script
command: 'sh /root/foo.sh'
4.变量和jija模板的使用
# a.编辑变量
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ cat inventory/testenv
[testservers]
test.example.com
[testservers:vars]
server_name=test.example.com
user=root
output=/root/test.txt
server_name=test.example.com
port=80
user=deploy
worker_processes=4
max_open_file=65505
root=/www
# b.编辑nginx的jija模板
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ mkdir roles/testbox/templates
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ cat roles/testbox/templates/nginx.conf.j2
# For more infomation on configuration, see:
user {{ user }};
worker_processes {{ worker_processes }};
error_log /var/log/nginx/error.log;
pid /var/run/nginx.pid;
worker_rlimit_nofile 65535;
events {
worker_connections {{ max_open_file }};
}
http {
include /etc/nginx/mime.types;
default_type application/octet-stream;
log_format main '$remote_addr - $remote_user [$time_local] "$request" '
'$status $body_bytes_sent "$http_referer" '
'"$http_user_agent" "$http_x_forwarded_for"';
access_log /var/log/nginx/access.log main;
sendfile on;
#tcp_nodelay on;
#keepalive_timeout 0;
keepalive_timeout 65;
gzip on;
#include vhost.d/*.conf;
server {
listen {{ port }} default_server;
server_name {{ server_name }};
#charset koi8-r;
#access_log logs/host.access.log main;
location / {
root {{ root }};
index index.html index.htm;
}
#error_page 404 /404.html;
# redirect server error pages to the static page /50x.html
#
error_page 500 502 503 504 /50x.html;
location = /50x.html {
root html;
}
}
}
# 执行测试
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ ansible-playbook -i inventory/testenv ./deploy.yml
PLAY [testservers] **********************************************************************************************************************************************************************************************
TASK [Gathering Facts] ******************************************************************************************************************************************************************************************
ok: [test.example.com]
TASK [testbox : Print server name and username to remote testbox] ***********************************************************************************************************************************************
changed: [test.example.com]
TASK [testbox : create a file] **********************************************************************************************************************************************************************************
changed: [test.example.com]
TASK [testbox : copy a file] ************************************************************************************************************************************************************************************
ok: [test.example.com]
TASK [testbox : check if foo.sh exists] *************************************************************************************************************************************************************************
ok: [test.example.com]
TASK [testbox : debug] ******************************************************************************************************************************************************************************************
ok: [test.example.com] => {
"msg": "foo.sh exists"
}
TASK [testbox : run the script] *********************************************************************************************************************************************************************************
changed: [test.example.com]
TASK [testbox : write the nginx config file] ********************************************************************************************************************************************************************
changed: [test.example.com]
TASK [testbox : ensure nginx is at the latest version] **********************************************************************************************************************************************************
ok: [test.example.com]
TASK [testbox : start nginx service] ****************************************************************************************************************************************************************************
changed: [test.example.com]
PLAY RECAP ******************************************************************************************************************************************************************************************************
test.example.com : ok=10 changed=5 unreachable=0 failed=0
# 验证，远程nginx服务是否正常启动
(.py3-a2.5-env) [deploy@node1 test_playbooks]$ ssh root@test.example.com "ps -ef|grep nginx"
root 15637 1 0 20:36 ? 00:00:00 nginx: master process /usr/sbin/nginx -c /etc/nginx/nginx.conf
deploy 15638 15637 0 20:36 ? 00:00:00 nginx: worker process
deploy 15639 15637 0 20:36 ? 00:00:00 nginx: worker process
deploy 15640 15637 0 20:36 ? 00:00:00 nginx: worker process
deploy 15641 15637 0 20:36 ? 00:00:00 nginx: worker process
root 15687 15685 0 20:48 ? 00:00:00 bash -c ps -ef|grep nginx
root 15695 15687 0 20:48 ? 00:00:00 grep nginx
