安装ceph集群_3节点
环境准备 入门级别
网络：
192.168.61.141 20.168.61.141 ceph01
192.168.61.142 20.168.61.142 ceph02
192.168.61.143 20.168.61.143 ceph03
双网卡 192.168.61.0本地网络（可以上网） 20.168.59.0集群通讯网络（默认不上网）
存储：
sda:100g sdb:20g sdc:20g sdd:20g（sda系统盘、其他为数据盘）
计算：
2c4g 2核4g
操作系统：
centos7.9 最小化安装，虚拟机
ceph源：
阿里源 ceph.repo
在 ceph01 节点上执行
设置主机名
# hostnamectl set-hostname ceph01
在 ceph02 节点上执行
设置主机名
# hostnamectl set-hostname ceph02
在 ceph03 节点上执行
设置主机名
# hostnamectl set-hostname ceph03
在ceph01、ceph02、ceph03上都执行
# vim /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 192.168.61.141 ceph01 192.168.61.142 ceph02 192.168.61.143 ceph03
关闭 NetworkMnanager
[root@ceph01 ~]# systemctl stop NetworkManager && systemctl disable NetworkManager Removed symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service. Removed symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service. Removed symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service.
关闭防火墙：
[root@ceph01 ~]# systemctl stop firewalld && systemctl disable firewalld Removed symlink /etc/systemd/system/multi-user.target.wants/firewalld.service. Removed symlink /etc/systemd/system/dbus-org.fedoraproject.FirewallD1.service.
关闭 selinux
[root@ceph01 ~]# sed -i 's/SELINUX=enforcing/SELINUX=disabled/g' /etc/selinux/config [root@ceph01 ~]# setenforce 0 [root@ceph01 ~]# cat /etc/selinux/config # This file controls the state of SELinux on the system. # SELINUX= can take one of these three values: # enforcing - SELinux security policy is enforced. # permissive - SELinux prints warnings instead of enforcing. # disabled - No SELinux policy is loaded. SELINUX=disabled # SELINUXTYPE= can take one of three values: # targeted - Targeted processes are protected, # minimum - Modification of targeted policy. Only selected processes are protected. # mls - Multi Level Security protection. SELINUXTYPE=targeted
设置 vim /etc/security/limits.conf 末尾添加
# End of file * hard nofile 655360 * soft nofile 655360 * hard nproc 655360 * soft nproc 655360 * soft core 655360 * hard core 655360
设置 vim /etc/security/limits.d/20-nproc.conf 修改
# Default limit for number of user's processes to prevent # accidental fork bombs. # See rhbz #432903 for reasoning. * soft nproc unlimited root soft nproc unlimited
2.2 NTP 客户端配置
在 ceph 所有节点（ceph01、ceph02、ceph03）上执行
a、统一时区，在所有节点上执行
[root@ceph01 ~]# ln -sf /usr/share/zoneinfo/Asia/Shanghai /etc/localtime
b、安装 chrony，默认已安装
[root@ceph03 ~]# yum -y install chrony 已加载插件：fastestmirror Loading mirror speeds from cached hostfile * base: mirrors.tuna.tsinghua.edu.cn * extras: mirrors.aliyun.com * updates: mirrors.aliyun.com 正在解决依赖关系 --> 正在检查事务 ---> 软件包 chrony.x86_64.0.3.4-1.el7 将被 安装 --> 正在处理依赖关系 libseccomp.so.2()(64bit)，它被软件包 chrony-3.4-1.el7.x86_64 需要 --> 正在检查事务 ---> 软件包 libseccomp.x86_64.0.2.3.1-4.el7 将被 安装 --> 解决依赖关系完成 依赖关系解决 ================================================================================================================ Package 架构 版本 源 大小 ================================================================================================================ 正在安装: chrony x86_64 3.4-1.el7 base 251 k 为依赖而安装: libseccomp x86_64 2.3.1-4.el7 base 56 k 事务概要 ================================================================================================================ 安装 1 软件包 (+1 依赖软件包) 总下载量：307 k 安装大小：788 k Downloading packages: (1/2): chrony-3.4-1.el7.x86_64.rpm | 251 kB 00:00:00 (2/2): libseccomp-2.3.1-4.el7.x86_64.rpm | 56 kB 00:00:00 ---------------------------------------------------------------------------------------------------------------- 总计 562 kB/s | 307 kB 00:00:00 Running transaction check Running transaction test Transaction test succeeded Running transaction 正在安装 : libseccomp-2.3.1-4.el7.x86_64 1/2 正在安装 : chrony-3.4-1.el7.x86_64 2/2 验证中 : libseccomp-2.3.1-4.el7.x86_64 1/2 验证中 : chrony-3.4-1.el7.x86_64 2/2 已安装: chrony.x86_64 0:3.4-1.el7 作为依赖被安装: libseccomp.x86_64 0:2.3.1-4.el7 完毕！
然后，修改配置vim /etc/chrony.conf 中服务器为 ceph01，即
# Use public servers from the pool.ntp.org project. # Please consider joining the pool (http://www.pool.ntp.org/join.html). #server 0.centos.pool.ntp.org iburst #server 1.centos.pool.ntp.org iburst #server 2.centos.pool.ntp.org iburst #server 3.centos.pool.ntp.org iburst server ceph01 iburst # Record the rate at which the system clock gains/losses time. driftfile /var/lib/chrony/drift
设置开机自启动
[root@ceph01 ~]# systemctl enable chronyd && systemctl restart chronyd [root@ceph01 ~]# systemctl status chronyd ● chronyd.service - NTP client/server Loaded: loaded (/usr/lib/systemd/system/chronyd.service; enabled; vendor preset: enabled) Active: active (running) since 二 2023-04-18 15:34:50 CST; 33s ago Docs: man:chronyd(8) man:chrony.conf(5) Process: 1555 ExecStartPost=/usr/libexec/chrony-helper update-daemon (code=exited, status=0/SUCCESS) Process: 1551 ExecStart=/usr/sbin/chronyd $OPTIONS (code=exited, status=0/SUCCESS) Main PID: 1553 (chronyd) CGroup: /system.slice/chronyd.service └─1553 /usr/sbin/chronyd 4月 18 15:34:50 ceph01 systemd[1]: Starting NTP client/server... 4月 18 15:34:50 ceph01 chronyd[1553]: chronyd version 3.4 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDR...EBUG) 4月 18 15:34:50 ceph01 systemd[1]: Started NTP client/server. Hint: Some lines were ellipsized, use -l to show in full.
验证时间同步：
[root@ceph01 ~]# chronyc sources -v 210 Number of sources = 1 .-- Source mode '^' = server, '=' = peer, '#' = local clock. / .- Source state '*' = current synced, '+' = combined , '-' = not combined, | / '?' = unreachable, 'x' = time may be in error, '~' = time too variable. || .- xxxx [ yyyy ] +/- zzzz || Reachability register (octal) -. | xxxx = adjusted offset, || Log2(Polling interval) --. | | yyyy = measured offset, || \ | | zzzz = estimated error. || | | \ MS Name/IP address Stratum Poll Reach LastRx Last sample =============================================================================== ^? ceph01 0 7 0 - +0ns[ +0ns] +/- 0ns
[root@ceph01 ~]# date 查看各个的时间
2023年 04月 18日 星期二 15:43:38 CST
测试网络连通性
[root@ceph01 network-scripts]# ping 192.168.61.141 -c 4 PING 192.168.61.141 (192.168.61.141) 56(84) bytes of data. 64 bytes from 192.168.61.141: icmp_seq=1 ttl=64 time=0.011 ms 64 bytes from 192.168.61.141: icmp_seq=2 ttl=64 time=0.030 ms 64 bytes from 192.168.61.141: icmp_seq=3 ttl=64 time=0.026 ms 64 bytes from 192.168.61.141: icmp_seq=4 ttl=64 time=0.036 ms --- 192.168.61.141 ping statistics --- 4 packets transmitted, 4 received, 0% packet loss, time 2999ms rtt min/avg/max/mdev = 0.011/0.025/0.036/0.011 ms [root@ceph01 network-scripts]# ping 192.168.61.142 -c 4 PING 192.168.61.142 (192.168.61.142) 56(84) bytes of data. 64 bytes from 192.168.61.142: icmp_seq=1 ttl=64 time=0.374 ms 64 bytes from 192.168.61.142: icmp_seq=2 ttl=64 time=0.769 ms 64 bytes from 192.168.61.142: icmp_seq=3 ttl=64 time=0.435 ms 64 bytes from 192.168.61.142: icmp_seq=4 ttl=64 time=0.617 ms --- 192.168.61.142 ping statistics --- 4 packets transmitted, 4 received, 0% packet loss, time 3001ms rtt min/avg/max/mdev = 0.374/0.548/0.769/0.158 ms [root@ceph01 network-scripts]# ping 192.168.61.143 -c 4 PING 192.168.61.143 (192.168.61.143) 56(84) bytes of data. 64 bytes from 192.168.61.143: icmp_seq=1 ttl=64 time=0.261 ms 64 bytes from 192.168.61.143: icmp_seq=2 ttl=64 time=0.364 ms 64 bytes from 192.168.61.143: icmp_seq=3 ttl=64 time=0.417 ms 64 bytes from 192.168.61.143: icmp_seq=4 ttl=64 time=0.300 ms --- 192.168.61.143 ping statistics --- 4 packets transmitted, 4 received, 0% packet loss, time 3000ms rtt min/avg/max/mdev = 0.261/0.335/0.417/0.062 ms
[root@ceph01 network-scripts]# ping 20.168.61.141 -c 4 PING 20.168.61.141 (20.168.61.141) 56(84) bytes of data. 64 bytes from 20.168.61.141: icmp_seq=1 ttl=64 time=0.017 ms 64 bytes from 20.168.61.141: icmp_seq=2 ttl=64 time=0.023 ms 64 bytes from 20.168.61.141: icmp_seq=3 ttl=64 time=0.023 ms 64 bytes from 20.168.61.141: icmp_seq=4 ttl=64 time=0.028 ms --- 20.168.61.141 ping statistics --- 4 packets transmitted, 4 received, 0% packet loss, time 2999ms rtt min/avg/max/mdev = 0.017/0.022/0.028/0.007 ms [root@ceph01 network-scripts]# ping 20.168.61.142 -c 4 PING 20.168.61.142 (20.168.61.142) 56(84) bytes of data. 64 bytes from 20.168.61.142: icmp_seq=1 ttl=64 time=0.472 ms 64 bytes from 20.168.61.142: icmp_seq=2 ttl=64 time=0.468 ms 64 bytes from 20.168.61.142: icmp_seq=3 ttl=64 time=0.516 ms 64 bytes from 20.168.61.142: icmp_seq=4 ttl=64 time=0.851 ms --- 20.168.61.142 ping statistics --- 4 packets transmitted, 4 received, 0% packet loss, time 2999ms rtt min/avg/max/mdev = 0.468/0.576/0.851/0.162 ms [root@ceph01 network-scripts]# ping 20.168.61.143 -c 4 PING 20.168.61.143 (20.168.61.143) 56(84) bytes of data. 64 bytes from 20.168.61.143: icmp_seq=1 ttl=64 time=0.529 ms 64 bytes from 20.168.61.143: icmp_seq=2 ttl=64 time=0.479 ms 64 bytes from 20.168.61.143: icmp_seq=3 ttl=64 time=0.340 ms 64 bytes from 20.168.61.143: icmp_seq=4 ttl=64 time=0.360 ms --- 20.168.61.143 ping statistics --- 4 packets transmitted, 4 received, 0% packet loss, time 3000ms rtt min/avg/max/mdev = 0.340/0.427/0.529/0.079 ms
2.3 配置 SSH 免密登录
1、在 ceph01 节点生成公钥，然后发放到所有的主机/客户机节点上，即包括 ceph02、ceph03
[root@ceph01 ~]# ssh-keygen -t rsa Generating public/private rsa key pair. Enter file in which to save the key (/root/.ssh/id_rsa): Created directory '/root/.ssh'. Enter passphrase (empty for no passphrase): Enter same passphrase again: Your identification has been saved in /root/.ssh/id_rsa. Your public key has been saved in /root/.ssh/id_rsa.pub. The key fingerprint is: SHA256:ahZPmLmvJH6c0vGI0rZScKe8khkRTrX7A4vWz+IfjUo root@ceph01 The key's randomart image is: +---[RSA 2048]----+ | .. | | o . | | o .. | | + ...+ | | =oo= S | | .o++.O | | o*E=@=o | | .*oBO*+. | | *=*=.. | +----[SHA256]-----+ [root@ceph01 ~]#
/*
说明：按回车键，即默认设置完成
*/
发放公钥到所有主机上，输入目标主机密码完成。
[root@ceph01 ~]# ssh-copy-id ceph01 /usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/root/.ssh/id_rsa.pub" The authenticity of host 'ceph01 (192.168.61.141)' can't be established. ECDSA key fingerprint is SHA256:yspZjLwkmFLbbZTdb5GHAR9MdeCU6fjNRBL4rk9kTeE. ECDSA key fingerprint is MD5:bb:47:ed:50:aa:82:2e:1a:41:af:78:dd:08:89:ad:1c. Are you sure you want to continue connecting (yes/no)? yes /usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed /usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys root@ceph01's password: Number of key(s) added: 1 Now try logging into the machine, with: "ssh 'ceph01'" and check to make sure that only the key(s) you wanted were added. [root@ceph01 ~]# ssh-copy-id ceph02 /usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/root/.ssh/id_rsa.pub" The authenticity of host 'ceph02 (192.168.61.142)' can't be established. ECDSA key fingerprint is SHA256:l0JfWfo+m8fM9aeVsA8/DMKfoyohQH0wtqRjZiImgek. ECDSA key fingerprint is MD5:34:a7:27:49:b8:7e:5e:dd:47:29:c0:28:74:74:bc:e2. Are you sure you want to continue connecting (yes/no)? yes /usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed /usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys root@ceph02's password: Number of key(s) added: 1 Now try logging into the machine, with: "ssh 'ceph02'" and check to make sure that only the key(s) you wanted were added. [root@ceph01 ~]# ssh-copy-id ceph03 /usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/root/.ssh/id_rsa.pub" The authenticity of host 'ceph03 (192.168.61.143)' can't be established. ECDSA key fingerprint is SHA256:hVuyU0DGx8SXkN1rwV2rre3w+A73p4isbiifiXi9Gu8. ECDSA key fingerprint is MD5:0f:da:65:ba:52:6a:14:4f:02:52:73:76:eb:f4:44:c7. Are you sure you want to continue connecting (yes/no)? yes /usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed /usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys root@ceph03's password: Number of key(s) added: 1 Now try logging into the machine, with: "ssh 'ceph03'" and check to make sure that only the key(s) you wanted were added. [root@ceph01 ~]#
验证从 ceph01 访问所有主机是否可以免密登录
[root@ceph01 ~]# ssh ceph01 Last login: Tue Apr 18 15:15:28 2023 from 192.168.61.1 [root@ceph01 ~]# exit 登出 Connection to ceph01 closed. [root@ceph01 ~]# ssh ceph02 Last login: Tue Apr 18 15:15:29 2023 from 192.168.61.1 [root@ceph02 ~]# exit 登出 Connection to ceph02 closed. [root@ceph01 ~]# ssh ceph03 Last login: Tue Apr 18 15:15:32 2023 from 192.168.61.1 [root@ceph03 ~]# exit 登出 Connection to ceph03 closed.
2.4 安装 Ceph 软件包
如果已经制作离线 yum 源，则直接安装即可；如果要使用外部互联网 yum 源，需要设置 ceph 源（此处列出阿里云源），配置如下
在ceph01、 ceph02、ceph03 上执行
[root@ceph01 yum.repos.d]# cd /etc/yum.repos.d/
[root@ceph01 yum.repos.d]# mkdir bak
[root@ceph01 yum.repos.d]# mv *.repo bak/
[root@ceph01 yum.repos.d]# wget http://mirrors.aliyun.com/repo/Centos-7.repo -O /etc/yum.repos.d/CentOS-Base.repo
--2023-04-18 16:08:01-- http://mirrors.aliyun.com/repo/Centos-7.repo
正在解析主机 mirrors.aliyun.com (mirrors.aliyun.com)... 157.119.175.231, 157.119.175.225, 157.119.175.224, ...
正在连接 mirrors.aliyun.com (mirrors.aliyun.com)|157.119.175.231|:80... 已连接。
已发出 HTTP 请求，正在等待回应... 200 OK
长度：2523 (2.5K) [application/octet-stream]
正在保存至: “/etc/yum.repos.d/CentOS-Base.repo”
100%[======================================================================>] 2,523 --.-K/s 用时 0.005s
2023-04-18 16:08:01 (450 KB/s) - 已保存 “/etc/yum.repos.d/CentOS-Base.repo” [2523/2523])
[root@ceph01 yum.repos.d]# wget http://mirrors.aliyun.com/repo/epel-7.repo -P /etc/yum.repos.d/
--2023-04-18 16:08:19-- http://mirrors.aliyun.com/repo/epel-7.repo
正在解析主机 mirrors.aliyun.com (mirrors.aliyun.com)... 157.119.175.229, 157.119.175.225, 157.119.175.226, ...
正在连接 mirrors.aliyun.com (mirrors.aliyun.com)|157.119.175.229|:80... 已连接。
已发出 HTTP 请求，正在等待回应... 200 OK
长度：664 [application/octet-stream]
正在保存至: “/etc/yum.repos.d/epel-7.repo”
100%[======================================================================>] 664 --.-K/s 用时 0s
2023-04-18 16:08:19 (217 MB/s) - 已保存 “/etc/yum.repos.d/epel-7.repo” [664/664])
[root@ceph01 yum.repos.d]# yum clean all
已加载插件：fastestmirror
正在清理软件源： base epel extras updates
Cleaning up list of fastest mirrors
Other repos take up 8.9 M of disk space (use --verbose for details)
[root@ceph01 yum.repos.d]# yum makecache
已加载插件：fastestmirror
Determining fastest mirrors
* base: mirrors.aliyun.com
* extras: mirrors.aliyun.com
* updates: mirrors.aliyun.com
base | 3.6 kB 00:00:00
epel | 4.7 kB 00:00:00
extras | 2.9 kB 00:00:00
updates | 2.9 kB 00:00:00
(1/16): base/7/x86_64/group_gz | 153 kB 00:00:00
(2/16): base/7/x86_64/primary_db | 6.1 MB 00:00:23
(3/16): epel/x86_64/group_gz | 99 kB 00:00:00
(4/16): base/7/x86_64/filelists_db | 7.2 MB 00:00:28
(5/16): epel/x86_64/updateinfo | 1.0 MB 00:00:04
(6/16): epel/x86_64/prestodelta | 1.0 kB 00:00:00
(7/16): base/7/x86_64/other_db | 2.6 MB 00:00:10
(8/16): epel/x86_64/primary_db | 7.0 MB 00:00:28
(9/16): extras/7/x86_64/primary_db | 249 kB 00:00:01
(10/16): extras/7/x86_64/filelists_db | 276 kB 00:00:01
(11/16): extras/7/x86_64/other_db | 149 kB 00:00:00
(12/16): epel/x86_64/other_db | 3.4 MB 00:00:12
(13/16): epel/x86_64/filelists_db | 12 MB 00:00:46
(14/16): updates/7/x86_64/filelists_db | 11 MB 00:00:44
(15/16): updates/7/x86_64/other_db | 1.3 MB 00:00:05
(16/16): updates/7/x86_64/primary_db | 20 MB 00:01:22
元数据缓存已建立
[root@ceph01 yum.repos.d]#
[root@ceph01 ~]# vim /etc/yum.repos.d/ceph.repo
[ceph]
name=Ceph packages for $basearch
baseurl=http://mirrors.aliyun.com/ceph/rpm-nautilus/el7/x86_64
enabled=1
gpgcheck=0
[ceph-noarch]
name=Ceph noarch packages
baseurl=http://mirrors.aliyun.com/ceph/rpm-nautilus/el7/noarch
enabled=1
gpgcheck=0
[ceph-source]
name=Ceph source packages
baseurl=http://mirrors.aliyun.com/ceph/rpm-nautilus/el7/SRPMS
enabled=1
gpgcheck=0
[root@ceph01 yum.repos.d]# ls
bak CentOS-Base.repo ceph.repo epel-7.repo
在 ceph01 上这装 ceph-deploy
[root@ceph01 ~]# yum -y install ceph-deploy ceph ceph-mds ceph-radosgw 已加载插件：fastestmirror Loading mirror speeds from cached hostfile * base: mirrors.aliyun.com * extras: mirrors.aliyun.com * updates: mirrors.aliyun.com ceph | 1.5 kB 00:00:00 ceph-noarch | 1.5 kB 00:00:00 ceph-source | 1.5 kB 00:00:00 正在解决依赖关系 --> 正在检查事务 ---> 软件包 ceph.x86_64.2.14.2.22-0.el7 将被 安装 --> 正在处理依赖关系 ceph-osd = 2:14.2.22-0.el7，它被软件包 2:ceph-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 ceph-mon = 2:14.2.22-0.el7，它被软件包 2:ceph-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 ceph-mgr = 2:14.2.22-0.el7，它被软件包 2:ceph-14.2.22-0.el7.x86_64 需要 ---> 软件包 ceph-deploy.noarch.0.2.0.1-0 将被 安装 ---> 软件包 ceph-mds.x86_64.2.14.2.22-0.el7 将被 安装 --> 正在处理依赖关系 ceph-base = 2:14.2.22-0.el7，它被软件包 2:ceph-mds-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 librdmacm.so.1()(64bit)，它被软件包 2:ceph-mds-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 libibverbs.so.1()(64bit)，它被软件包 2:ceph-mds-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 libtcmalloc.so.4()(64bit)，它被软件包 2:ceph-mds-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 libceph-common.so.0()(64bit)，它被软件包 2:ceph-mds-14.2.22-0.el7.x86_64 需要 ---> 软件包 ceph-radosgw.x86_64.2.14.2.22-0.el7 将被 安装 --> 正在处理依赖关系 ceph-selinux = 2:14.2.22-0.el7，它被软件包 2:ceph-radosgw-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 librgw2 = 2:14.2.22-0.el7，它被软件包 2:ceph-radosgw-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 mailcap，它被软件包 2:ceph-radosgw-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 librabbitmq.so.4()(64bit)，它被软件包 2:ceph-radosgw-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 liboath.so.0()(64bit)，它被软件包 2:ceph-radosgw-14.2.22-0.el7.x86_64 需要 --> 正在检查事务 ---> 软件包 ceph-base.x86_64.2.14.2.22-0.el7 将被 安装 --> 正在处理依赖关系 ceph-common = 2:14.2.22-0.el7，它被软件包 2:ceph-base-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 librbd1 = 2:14.2.22-0.el7，它被软件包 2:ceph-base-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 libcephfs2 = 2:14.2.22-0.el7，它被软件包 2:ceph-base-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-setuptools，它被软件包 2:ceph-base-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 psmisc，它被软件包 2:ceph-base-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 cryptsetup，它被软件包 2:ceph-base-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 libleveldb.so.1()(64bit)，它被软件包 2:ceph-base-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 liblttng-ust.so.0()(64bit)，它被软件包 2:ceph-base-14.2.22-0.el7.x86_64 需要 ---> 软件包 ceph-mgr.x86_64.2.14.2.22-0.el7 将被 安装 --> 正在处理依赖关系 python-cherrypy，它被软件包 2:ceph-mgr-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-werkzeug，它被软件包 2:ceph-mgr-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-six，它被软件包 2:ceph-mgr-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-pecan，它被软件包 2:ceph-mgr-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-bcrypt，它被软件包 2:ceph-mgr-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 pyOpenSSL，它被软件包 2:ceph-mgr-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-requests，它被软件包 2:ceph-mgr-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-enum34，它被软件包 2:ceph-mgr-14.2.22-0.el7.x86_64 需要 ---> 软件包 ceph-mon.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 ceph-osd.x86_64.2.14.2.22-0.el7 将被 安装 --> 正在处理依赖关系 libstoragemgmt，它被软件包 2:ceph-osd-14.2.22-0.el7.x86_64 需要 ---> 软件包 ceph-selinux.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 gperftools-libs.x86_64.0.2.6.1-1.el7 将被 安装 ---> 软件包 libibverbs.x86_64.0.22.4-6.el7_9 将被 安装 --> 正在处理依赖关系 rdma-core(x86-64) = 22.4-6.el7_9，它被软件包 libibverbs-22.4-6.el7_9.x86_64 需要 ---> 软件包 liboath.x86_64.0.2.6.2-1.el7 将被 安装 ---> 软件包 librabbitmq.x86_64.0.0.8.0-3.el7 将被 安装 ---> 软件包 librados2.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 librdmacm.x86_64.0.22.4-6.el7_9 将被 安装 ---> 软件包 librgw2.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 mailcap.noarch.0.2.1.41-2.el7 将被 安装 --> 正在检查事务 ---> 软件包 ceph-common.x86_64.2.14.2.22-0.el7 将被 安装 --> 正在处理依赖关系 python-ceph-argparse = 2:14.2.22-0.el7，它被软件包 2:ceph-common-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-rados = 2:14.2.22-0.el7，它被软件包 2:ceph-common-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-rbd = 2:14.2.22-0.el7，它被软件包 2:ceph-common-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-rgw = 2:14.2.22-0.el7，它被软件包 2:ceph-common-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 libradosstriper1 = 2:14.2.22-0.el7，它被软件包 2:ceph-common-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-cephfs = 2:14.2.22-0.el7，它被软件包 2:ceph-common-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-prettytable，它被软件包 2:ceph-common-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 libbabeltrace-ctf.so.1()(64bit)，它被软件包 2:ceph-common-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 librdkafka.so.1()(64bit)，它被软件包 2:ceph-common-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 libbabeltrace.so.1()(64bit)，它被软件包 2:ceph-common-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 libradosstriper.so.1()(64bit)，它被软件包 2:ceph-common-14.2.22-0.el7.x86_64 需要 ---> 软件包 cryptsetup.x86_64.0.2.0.3-6.el7 将被 安装 ---> 软件包 leveldb.x86_64.0.1.12.0-11.el7 将被 安装 ---> 软件包 libcephfs2.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 librbd1.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 libstoragemgmt.x86_64.0.1.8.1-2.el7_9 将被 安装 --> 正在处理依赖关系 libstoragemgmt-python，它被软件包 libstoragemgmt-1.8.1-2.el7_9.x86_64 需要 --> 正在处理依赖关系 libyajl.so.2()(64bit)，它被软件包 libstoragemgmt-1.8.1-2.el7_9.x86_64 需要 --> 正在处理依赖关系 libconfig.so.9()(64bit)，它被软件包 libstoragemgmt-1.8.1-2.el7_9.x86_64 需要 ---> 软件包 lttng-ust.x86_64.0.2.4.1-4.el7 将被 安装 --> 正在处理依赖关系 liburcu-bp.so.1()(64bit)，它被软件包 lttng-ust-2.4.1-4.el7.x86_64 需要 --> 正在处理依赖关系 liburcu-cds.so.1()(64bit)，它被软件包 lttng-ust-2.4.1-4.el7.x86_64 需要 ---> 软件包 psmisc.x86_64.0.22.20-17.el7 将被 安装 ---> 软件包 pyOpenSSL.x86_64.0.0.13.1-4.el7 将被 安装 ---> 软件包 python-cherrypy.noarch.0.3.2.2-4.el7 将被 安装 ---> 软件包 python-enum34.noarch.0.1.0.4-1.el7 将被 安装 ---> 软件包 python-pecan.noarch.0.0.4.5-2.el7 将被 安装 --> 正在处理依赖关系 python-mako >= 0.4.0，它被软件包 python-pecan-0.4.5-2.el7.noarch 需要 --> 正在处理依赖关系 python-simplegeneric >= 0.8，它被软件包 python-pecan-0.4.5-2.el7.noarch 需要 --> 正在处理依赖关系 python-webob >= 1.2，它被软件包 python-pecan-0.4.5-2.el7.noarch 需要 --> 正在处理依赖关系 python-webtest >= 1.3.1，它被软件包 python-pecan-0.4.5-2.el7.noarch 需要 --> 正在处理依赖关系 python-singledispatch，它被软件包 python-pecan-0.4.5-2.el7.noarch 需要 ---> 软件包 python-requests.noarch.0.2.6.0-10.el7 将被 安装 --> 正在处理依赖关系 python-urllib3 >= 1.10.2-1，它被软件包 python-requests-2.6.0-10.el7.noarch 需要 --> 正在处理依赖关系 python-chardet >= 2.2.1-1，它被软件包 python-requests-2.6.0-10.el7.noarch 需要 ---> 软件包 python-setuptools.noarch.0.0.9.8-7.el7 将被 安装 --> 正在处理依赖关系 python-backports-ssl_match_hostname，它被软件包 python-setuptools-0.9.8-7.el7.noarch 需要 ---> 软件包 python-six.noarch.0.1.9.0-2.el7 将被 安装 ---> 软件包 python-werkzeug.noarch.0.0.9.1-2.el7 将被 安装 ---> 软件包 python2-bcrypt.x86_64.0.3.1.6-2.el7 将被 安装 --> 正在处理依赖关系 python-cffi，它被软件包 python2-bcrypt-3.1.6-2.el7.x86_64 需要 --> 正在处理依赖关系 python2-six，它被软件包 python2-bcrypt-3.1.6-2.el7.x86_64 需要 ---> 软件包 rdma-core.x86_64.0.22.4-6.el7_9 将被 安装 --> 正在检查事务 ---> 软件包 libbabeltrace.x86_64.0.1.2.4-3.el7 将被 安装 ---> 软件包 libconfig.x86_64.0.1.4.9-5.el7 将被 安装 ---> 软件包 libradosstriper1.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 librdkafka.x86_64.0.0.11.5-1.el7 将被 安装 ---> 软件包 libstoragemgmt-python.noarch.0.1.8.1-2.el7_9 将被 安装 --> 正在处理依赖关系 libstoragemgmt-python-clibs，它被软件包 libstoragemgmt-python-1.8.1-2.el7_9.noarch 需要 ---> 软件包 python-backports-ssl_match_hostname.noarch.0.3.5.0.1-1.el7 将被 安装 --> 正在处理依赖关系 python-ipaddress，它被软件包 python-backports-ssl_match_hostname-3.5.0.1-1.el7.noarch 需要 --> 正在处理依赖关系 python-backports，它被软件包 python-backports-ssl_match_hostname-3.5.0.1-1.el7.noarch 需要 ---> 软件包 python-ceph-argparse.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 python-cephfs.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 python-cffi.x86_64.0.1.6.0-5.el7 将被 安装 --> 正在处理依赖关系 python-pycparser，它被软件包 python-cffi-1.6.0-5.el7.x86_64 需要 ---> 软件包 python-chardet.noarch.0.2.2.1-3.el7 将被 安装 ---> 软件包 python-mako.noarch.0.0.8.1-2.el7 将被 安装 --> 正在处理依赖关系 python-markupsafe，它被软件包 python-mako-0.8.1-2.el7.noarch 需要 --> 正在处理依赖关系 python-beaker，它被软件包 python-mako-0.8.1-2.el7.noarch 需要 ---> 软件包 python-prettytable.noarch.0.0.7.2-3.el7 将被 安装 ---> 软件包 python-rados.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 python-rbd.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 python-rgw.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 python-simplegeneric.noarch.0.0.8-7.el7 将被 安装 ---> 软件包 python-singledispatch.noarch.0.3.4.0.2-2.el7 将被 安装 ---> 软件包 python-urllib3.noarch.0.1.10.2-7.el7 将被 安装 ---> 软件包 python-webob.noarch.0.1.2.3-7.el7 将被 安装 ---> 软件包 python-webtest.noarch.0.1.3.4-6.el7 将被 安装 ---> 软件包 python2-six.noarch.0.1.9.0-0.el7 将被 安装 ---> 软件包 userspace-rcu.x86_64.0.0.7.16-1.el7 将被 安装 ---> 软件包 yajl.x86_64.0.2.0.4-4.el7 将被 安装 --> 正在检查事务 ---> 软件包 libstoragemgmt-python-clibs.x86_64.0.1.8.1-2.el7_9 将被 安装 ---> 软件包 python-backports.x86_64.0.1.0-8.el7 将被 安装 ---> 软件包 python-beaker.noarch.0.1.5.4-10.el7 将被 安装 --> 正在处理依赖关系 python-paste，它被软件包 python-beaker-1.5.4-10.el7.noarch 需要 ---> 软件包 python-ipaddress.noarch.0.1.0.16-2.el7 将被 安装 ---> 软件包 python-markupsafe.x86_64.0.0.11-10.el7 将被 安装 ---> 软件包 python-pycparser.noarch.0.2.14-1.el7 将被 安装 --> 正在处理依赖关系 python-ply，它被软件包 python-pycparser-2.14-1.el7.noarch 需要 --> 正在检查事务 ---> 软件包 python-paste.noarch.0.1.7.5.1-9.20111221hg1498.el7 将被 安装 --> 正在处理依赖关系 python-tempita，它被软件包 python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 需要 ---> 软件包 python-ply.noarch.0.3.4-11.el7 将被 安装 --> 正在检查事务 ---> 软件包 python-tempita.noarch.0.0.5.1-6.el7 将被 安装 --> 解决依赖关系完成 依赖关系解决 ================================================================================================================ Package 架构 版本 源 大小 ================================================================================================================ 正在安装: ceph x86_64 2:14.2.22-0.el7 ceph 3.0 k ceph-deploy noarch 2.0.1-0 ceph-noarch 286 k ceph-mds x86_64 2:14.2.22-0.el7 ceph 1.9 M ceph-radosgw x86_64 2:14.2.22-0.el7 ceph 5.9 M 为依赖而安装: ceph-base x86_64 2:14.2.22-0.el7 ceph 5.5 M ceph-common x86_64 2:14.2.22-0.el7 ceph 19 M ceph-mgr x86_64 2:14.2.22-0.el7 ceph 1.8 M ceph-mon x86_64 2:14.2.22-0.el7 ceph 4.3 M ceph-osd x86_64 2:14.2.22-0.el7 ceph 16 M ceph-selinux x86_64 2:14.2.22-0.el7 ceph 21 k cryptsetup x86_64 2.0.3-6.el7 base 154 k gperftools-libs x86_64 2.6.1-1.el7 base 272 k leveldb x86_64 1.12.0-11.el7 epel 161 k libbabeltrace x86_64 1.2.4-3.el7 epel 147 k libcephfs2 x86_64 2:14.2.22-0.el7 ceph 502 k libconfig x86_64 1.4.9-5.el7 base 59 k libibverbs x86_64 22.4-6.el7_9 updates 269 k liboath x86_64 2.6.2-1.el7 epel 51 k librabbitmq x86_64 0.8.0-3.el7 base 37 k librados2 x86_64 2:14.2.22-0.el7 ceph 3.4 M libradosstriper1 x86_64 2:14.2.22-0.el7 ceph 366 k librbd1 x86_64 2:14.2.22-0.el7 ceph 1.7 M librdkafka x86_64 0.11.5-1.el7 epel 368 k librdmacm x86_64 22.4-6.el7_9 updates 64 k librgw2 x86_64 2:14.2.22-0.el7 ceph 5.2 M libstoragemgmt x86_64 1.8.1-2.el7_9 updates 243 k libstoragemgmt-python noarch 1.8.1-2.el7_9 updates 167 k libstoragemgmt-python-clibs x86_64 1.8.1-2.el7_9 updates 19 k lttng-ust x86_64 2.4.1-4.el7 epel 176 k mailcap noarch 2.1.41-2.el7 base 31 k psmisc x86_64 22.20-17.el7 base 141 k pyOpenSSL x86_64 0.13.1-4.el7 base 135 k python-backports x86_64 1.0-8.el7 base 5.8 k python-backports-ssl_match_hostname noarch 3.5.0.1-1.el7 base 13 k python-beaker noarch 1.5.4-10.el7 base 80 k python-ceph-argparse x86_64 2:14.2.22-0.el7 ceph 36 k python-cephfs x86_64 2:14.2.22-0.el7 ceph 114 k python-cffi x86_64 1.6.0-5.el7 base 218 k python-chardet noarch 2.2.1-3.el7 base 227 k python-cherrypy noarch 3.2.2-4.el7 base 422 k python-enum34 noarch 1.0.4-1.el7 base 52 k python-ipaddress noarch 1.0.16-2.el7 base 34 k python-mako noarch 0.8.1-2.el7 base 307 k python-markupsafe x86_64 0.11-10.el7 base 25 k python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k python-pecan noarch 0.4.5-2.el7 epel 255 k python-ply noarch 3.4-11.el7 base 123 k python-prettytable noarch 0.7.2-3.el7 base 37 k python-pycparser noarch 2.14-1.el7 base 104 k python-rados x86_64 2:14.2.22-0.el7 ceph 201 k python-rbd x86_64 2:14.2.22-0.el7 ceph 195 k python-requests noarch 2.6.0-10.el7 base 95 k python-rgw x86_64 2:14.2.22-0.el7 ceph 78 k python-setuptools noarch 0.9.8-7.el7 base 397 k python-simplegeneric noarch 0.8-7.el7 epel 12 k python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k python-six noarch 1.9.0-2.el7 base 29 k python-tempita noarch 0.5.1-6.el7 base 33 k python-urllib3 noarch 1.10.2-7.el7 base 103 k python-webob noarch 1.2.3-7.el7 base 202 k python-webtest noarch 1.3.4-6.el7 base 102 k python-werkzeug noarch 0.9.1-2.el7 extras 562 k python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k python2-six noarch 1.9.0-0.el7 epel 2.9 k rdma-core x86_64 22.4-6.el7_9 updates 51 k userspace-rcu x86_64 0.7.16-1.el7 epel 73 k yajl x86_64 2.0.4-4.el7 base 39 k 事务概要 ================================================================================================================ 安装 4 软件包 (+63 依赖软件包) 总下载量：74 M 安装大小：240 M Downloading packages: (1/67): ceph-14.2.22-0.el7.x86_64.rpm | 3.0 kB 00:00:00 (2/67): ceph-deploy-2.0.1-0.noarch.rpm | 286 kB 00:00:01 (3/67): ceph-base-14.2.22-0.el7.x86_64.rpm | 5.5 MB 00:00:21 (4/67): ceph-mds-14.2.22-0.el7.x86_64.rpm | 1.9 MB 00:00:07 (5/67): ceph-mgr-14.2.22-0.el7.x86_64.rpm | 1.8 MB 00:00:07 (6/67): ceph-mon-14.2.22-0.el7.x86_64.rpm | 4.3 MB 00:00:17 (7/67): ceph-common-14.2.22-0.el7.x86_64.rpm | 19 MB 00:01:18 (8/67): ceph-radosgw-14.2.22-0.el7.x86_64.rpm | 5.9 MB 00:00:25 (9/67): ceph-selinux-14.2.22-0.el7.x86_64.rpm | 21 kB 00:00:00 (10/67): libbabeltrace-1.2.4-3.el7.x86_64.rpm | 147 kB 00:00:00 (11/67): cryptsetup-2.0.3-6.el7.x86_64.rpm | 154 kB 00:00:00 (12/67): leveldb-1.12.0-11.el7.x86_64.rpm | 161 kB 00:00:00 (13/67): libconfig-1.4.9-5.el7.x86_64.rpm | 59 kB 00:00:00 (14/67): gperftools-libs-2.6.1-1.el7.x86_64.rpm | 272 kB 00:00:01 (15/67): liboath-2.6.2-1.el7.x86_64.rpm | 51 kB 00:00:00 (16/67): librabbitmq-0.8.0-3.el7.x86_64.rpm | 37 kB 00:00:00 (17/67): libibverbs-22.4-6.el7_9.x86_64.rpm | 269 kB 00:00:01 (18/67): libcephfs2-14.2.22-0.el7.x86_64.rpm | 502 kB 00:00:02 (19/67): librados2-14.2.22-0.el7.x86_64.rpm | 3.4 MB 00:00:16 (20/67): libradosstriper1-14.2.22-0.el7.x86_64.rpm | 366 kB 00:00:01 (21/67): librdmacm-22.4-6.el7_9.x86_64.rpm | 64 kB 00:00:00 (22/67): librdkafka-0.11.5-1.el7.x86_64.rpm | 368 kB 00:00:02 (23/67): ceph-osd-14.2.22-0.el7.x86_64.rpm | 16 MB 00:01:13 (24/67): libstoragemgmt-python-1.8.1-2.el7_9.noarch.rpm | 167 kB 00:00:00 (25/67): libstoragemgmt-python-clibs-1.8.1-2.el7_9.x86_64.rpm | 19 kB 00:00:00 (26/67): mailcap-2.1.41-2.el7.noarch.rpm | 31 kB 00:00:00 (27/67): libstoragemgmt-1.8.1-2.el7_9.x86_64.rpm | 243 kB 00:00:01 (28/67): lttng-ust-2.4.1-4.el7.x86_64.rpm | 176 kB 00:00:00 (29/67): psmisc-22.20-17.el7.x86_64.rpm | 141 kB 00:00:00 (30/67): python-backports-1.0-8.el7.x86_64.rpm | 5.8 kB 00:00:00 (31/67): pyOpenSSL-0.13.1-4.el7.x86_64.rpm | 135 kB 00:00:00 (32/67): python-backports-ssl_match_hostname-3.5.0.1-1.el7.noarch.rpm | 13 kB 00:00:00 (33/67): python-beaker-1.5.4-10.el7.noarch.rpm | 80 kB 00:00:00 (34/67): librbd1-14.2.22-0.el7.x86_64.rpm | 1.7 MB 00:00:08 (35/67): python-ceph-argparse-14.2.22-0.el7.x86_64.rpm | 36 kB 00:00:00 (36/67): python-cephfs-14.2.22-0.el7.x86_64.rpm | 114 kB 00:00:00 (37/67): python-cffi-1.6.0-5.el7.x86_64.rpm | 218 kB 00:00:01 (38/67): python-chardet-2.2.1-3.el7.noarch.rpm | 227 kB 00:00:01 (39/67): python-enum34-1.0.4-1.el7.noarch.rpm | 52 kB 00:00:00 (40/67): python-ipaddress-1.0.16-2.el7.noarch.rpm | 34 kB 00:00:00 (41/67): python-mako-0.8.1-2.el7.noarch.rpm | 307 kB 00:00:01 (42/67): python-cherrypy-3.2.2-4.el7.noarch.rpm | 422 kB 00:00:02 (43/67): python-markupsafe-0.11-10.el7.x86_64.rpm | 25 kB 00:00:00 (44/67): python-ply-3.4-11.el7.noarch.rpm | 123 kB 00:00:00 (45/67): python-prettytable-0.7.2-3.el7.noarch.rpm | 37 kB 00:00:00 (46/67): python-pycparser-2.14-1.el7.noarch.rpm | 104 kB 00:00:00 (47/67): python-pecan-0.4.5-2.el7.noarch.rpm | 255 kB 00:00:01 (48/67): python-rados-14.2.22-0.el7.x86_64.rpm | 201 kB 00:00:01 (49/67): python-requests-2.6.0-10.el7.noarch.rpm | 95 kB 00:00:00 (50/67): python-rbd-14.2.22-0.el7.x86_64.rpm | 195 kB 00:00:01 (51/67): python-simplegeneric-0.8-7.el7.noarch.rpm | 12 kB 00:00:00 (52/67): python-rgw-14.2.22-0.el7.x86_64.rpm | 78 kB 00:00:00 (53/67): python-singledispatch-3.4.0.2-2.el7.noarch.rpm | 18 kB 00:00:00 (54/67): python-paste-1.7.5.1-9.20111221hg1498.el7.noarch.rpm | 866 kB 00:00:04 (55/67): python-six-1.9.0-2.el7.noarch.rpm | 29 kB 00:00:00 (56/67): python-tempita-0.5.1-6.el7.noarch.rpm | 33 kB 00:00:00 (57/67): python-urllib3-1.10.2-7.el7.noarch.rpm | 103 kB 00:00:00 (58/67): python-setuptools-0.9.8-7.el7.noarch.rpm | 397 kB 00:00:02 (59/67): python2-bcrypt-3.1.6-2.el7.x86_64.rpm | 39 kB 00:00:00 (60/67): python2-six-1.9.0-0.el7.noarch.rpm | 2.9 kB 00:00:00 (61/67): python-webtest-1.3.4-6.el7.noarch.rpm | 102 kB 00:00:00 (62/67): rdma-core-22.4-6.el7_9.x86_64.rpm | 51 kB 00:00:00 (63/67): python-webob-1.2.3-7.el7.noarch.rpm | 202 kB 00:00:01 (64/67): yajl-2.0.4-4.el7.x86_64.rpm | 39 kB 00:00:00 (65/67): userspace-rcu-0.7.16-1.el7.x86_64.rpm | 73 kB 00:00:00 (66/67): python-werkzeug-0.9.1-2.el7.noarch.rpm | 562 kB 00:00:02 (67/67): librgw2-14.2.22-0.el7.x86_64.rpm | 5.2 MB 00:00:25 ---------------------------------------------------------------------------------------------------------------- 总计 489 kB/s | 74 MB 00:02:34 Running transaction check Running transaction test Transaction test succeeded Running transaction 正在安装 : gperftools-libs-2.6.1-1.el7.x86_64 1/67 正在安装 : python-six-1.9.0-2.el7.noarch 2/67 正在安装 : leveldb-1.12.0-11.el7.x86_64 3/67 正在安装 : liboath-2.6.2-1.el7.x86_64 4/67 正在安装 : librabbitmq-0.8.0-3.el7.x86_64 5/67 正在安装 : 2:python-ceph-argparse-14.2.22-0.el7.x86_64 6/67 正在安装 : python-ipaddress-1.0.16-2.el7.noarch 7/67 正在安装 : python-webob-1.2.3-7.el7.noarch 8/67 正在安装 : pyOpenSSL-0.13.1-4.el7.x86_64 9/67 正在安装 : yajl-2.0.4-4.el7.x86_64 10/67 正在安装 : rdma-core-22.4-6.el7_9.x86_64 11/67 正在安装 : libibverbs-22.4-6.el7_9.x86_64 12/67 正在安装 : librdmacm-22.4-6.el7_9.x86_64 13/67 正在安装 : python-webtest-1.3.4-6.el7.noarch 14/67 正在安装 : python2-six-1.9.0-0.el7.noarch 15/67 正在安装 : python-singledispatch-3.4.0.2-2.el7.noarch 16/67 正在安装 : psmisc-22.20-17.el7.x86_64 17/67 正在安装 : python-tempita-0.5.1-6.el7.noarch 18/67 正在安装 : python-cherrypy-3.2.2-4.el7.noarch 19/67 正在安装 : cryptsetup-2.0.3-6.el7.x86_64 20/67 正在安装 : python-prettytable-0.7.2-3.el7.noarch 21/67 正在安装 : python-chardet-2.2.1-3.el7.noarch 22/67 正在安装 : python-backports-1.0-8.el7.x86_64 23/67 正在安装 : python-backports-ssl_match_hostname-3.5.0.1-1.el7.noarch 24/67 正在安装 : python-setuptools-0.9.8-7.el7.noarch 25/67 正在安装 : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 26/67 正在安装 : python-beaker-1.5.4-10.el7.noarch 27/67 正在安装 : python-urllib3-1.10.2-7.el7.noarch 28/67 正在安装 : python-requests-2.6.0-10.el7.noarch 29/67 正在安装 : libconfig-1.4.9-5.el7.x86_64 30/67 正在安装 : libstoragemgmt-python-1.8.1-2.el7_9.noarch 31/67 正在安装 : libstoragemgmt-1.8.1-2.el7_9.x86_64 32/67 正在安装 : libstoragemgmt-python-clibs-1.8.1-2.el7_9.x86_64 33/67 正在安装 : librdkafka-0.11.5-1.el7.x86_64 34/67 正在安装 : python-ply-3.4-11.el7.noarch 35/67 正在安装 : python-pycparser-2.14-1.el7.noarch 36/67 正在安装 : python-cffi-1.6.0-5.el7.x86_64 37/67 正在安装 : python2-bcrypt-3.1.6-2.el7.x86_64 38/67 正在安装 : python-markupsafe-0.11-10.el7.x86_64 39/67 正在安装 : python-mako-0.8.1-2.el7.noarch 40/67 正在安装 : userspace-rcu-0.7.16-1.el7.x86_64 41/67 正在安装 : lttng-ust-2.4.1-4.el7.x86_64 42/67 正在安装 : 2:librados2-14.2.22-0.el7.x86_64 43/67 正在安装 : 2:python-rados-14.2.22-0.el7.x86_64 44/67 正在安装 : 2:librbd1-14.2.22-0.el7.x86_64 45/67 正在安装 : 2:libcephfs2-14.2.22-0.el7.x86_64 46/67 正在安装 : 2:librgw2-14.2.22-0.el7.x86_64 47/67 正在安装 : 2:python-rgw-14.2.22-0.el7.x86_64 48/67 正在安装 : 2:python-cephfs-14.2.22-0.el7.x86_64 49/67 正在安装 : 2:python-rbd-14.2.22-0.el7.x86_64 50/67 正在安装 : 2:libradosstriper1-14.2.22-0.el7.x86_64 51/67 正在安装 : libbabeltrace-1.2.4-3.el7.x86_64 52/67 正在安装 : 2:ceph-common-14.2.22-0.el7.x86_64 53/67 正在安装 : 2:ceph-base-14.2.22-0.el7.x86_64 54/67 正在安装 : 2:ceph-selinux-14.2.22-0.el7.x86_64 55/67 正在安装 : 2:ceph-mds-14.2.22-0.el7.x86_64 56/67 正在安装 : 2:ceph-mon-14.2.22-0.el7.x86_64 57/67 正在安装 : 2:ceph-osd-14.2.22-0.el7.x86_64 58/67 正在安装 : python-simplegeneric-0.8-7.el7.noarch 59/67 正在安装 : python-pecan-0.4.5-2.el7.noarch 60/67 正在安装 : python-enum34-1.0.4-1.el7.noarch 61/67 正在安装 : python-werkzeug-0.9.1-2.el7.noarch 62/67 正在安装 : 2:ceph-mgr-14.2.22-0.el7.x86_64 63/67 正在安装 : mailcap-2.1.41-2.el7.noarch 64/67 正在安装 : 2:ceph-radosgw-14.2.22-0.el7.x86_64 65/67 正在安装 : 2:ceph-14.2.22-0.el7.x86_64 66/67 正在安装 : ceph-deploy-2.0.1-0.noarch 67/67 验证中 : libstoragemgmt-1.8.1-2.el7_9.x86_64 1/67 验证中 : 2:librbd1-14.2.22-0.el7.x86_64 2/67 验证中 : liboath-2.6.2-1.el7.x86_64 3/67 验证中 : python-backports-ssl_match_hostname-3.5.0.1-1.el7.noarch 4/67 验证中 : python2-six-1.9.0-0.el7.noarch 5/67 验证中 : mailcap-2.1.41-2.el7.noarch 6/67 验证中 : python-werkzeug-0.9.1-2.el7.noarch 7/67 验证中 : 2:libcephfs2-14.2.22-0.el7.x86_64 8/67 验证中 : 2:librados2-14.2.22-0.el7.x86_64 9/67 验证中 : python2-bcrypt-3.1.6-2.el7.x86_64 10/67 验证中 : python-enum34-1.0.4-1.el7.noarch 11/67 验证中 : libstoragemgmt-python-1.8.1-2.el7_9.noarch 12/67 验证中 : gperftools-libs-2.6.1-1.el7.x86_64 13/67 验证中 : libibverbs-22.4-6.el7_9.x86_64 14/67 验证中 : rdma-core-22.4-6.el7_9.x86_64 15/67 验证中 : python-simplegeneric-0.8-7.el7.noarch 16/67 验证中 : yajl-2.0.4-4.el7.x86_64 17/67 验证中 : python-setuptools-0.9.8-7.el7.noarch 18/67 验证中 : 2:python-rbd-14.2.22-0.el7.x86_64 19/67 验证中 : 2:python-cephfs-14.2.22-0.el7.x86_64 20/67 验证中 : libbabeltrace-1.2.4-3.el7.x86_64 21/67 验证中 : 2:ceph-mds-14.2.22-0.el7.x86_64 22/67 验证中 : python-mako-0.8.1-2.el7.noarch 23/67 验证中 : 2:ceph-radosgw-14.2.22-0.el7.x86_64 24/67 验证中 : 2:ceph-selinux-14.2.22-0.el7.x86_64 25/67 验证中 : 2:ceph-mon-14.2.22-0.el7.x86_64 26/67 验证中 : userspace-rcu-0.7.16-1.el7.x86_64 27/67 验证中 : 2:ceph-common-14.2.22-0.el7.x86_64 28/67 验证中 : python-pecan-0.4.5-2.el7.noarch 29/67 验证中 : python-six-1.9.0-2.el7.noarch 30/67 验证中 : 2:ceph-osd-14.2.22-0.el7.x86_64 31/67 验证中 : 2:librgw2-14.2.22-0.el7.x86_64 32/67 验证中 : python-singledispatch-3.4.0.2-2.el7.noarch 33/67 验证中 : python-markupsafe-0.11-10.el7.x86_64 34/67 验证中 : pyOpenSSL-0.13.1-4.el7.x86_64 35/67 验证中 : python-ply-3.4-11.el7.noarch 36/67 验证中 : librdkafka-0.11.5-1.el7.x86_64 37/67 验证中 : libconfig-1.4.9-5.el7.x86_64 38/67 验证中 : python-urllib3-1.10.2-7.el7.noarch 39/67 验证中 : leveldb-1.12.0-11.el7.x86_64 40/67 验证中 : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 41/67 验证中 : lttng-ust-2.4.1-4.el7.x86_64 42/67 验证中 : python-backports-1.0-8.el7.x86_64 43/67 验证中 : python-cffi-1.6.0-5.el7.x86_64 44/67 验证中 : python-webob-1.2.3-7.el7.noarch 45/67 验证中 : ceph-deploy-2.0.1-0.noarch 46/67 验证中 : 2:ceph-base-14.2.22-0.el7.x86_64 47/67 验证中 : 2:ceph-mgr-14.2.22-0.el7.x86_64 48/67 验证中 : librdmacm-22.4-6.el7_9.x86_64 49/67 验证中 : python-chardet-2.2.1-3.el7.noarch 50/67 验证中 : python-pycparser-2.14-1.el7.noarch 51/67 验证中 : python-prettytable-0.7.2-3.el7.noarch 52/67 验证中 : cryptsetup-2.0.3-6.el7.x86_64 53/67 验证中 : 2:python-rados-14.2.22-0.el7.x86_64 54/67 验证中 : python-requests-2.6.0-10.el7.noarch 55/67 验证中 : python-cherrypy-3.2.2-4.el7.noarch 56/67 验证中 : python-beaker-1.5.4-10.el7.noarch 57/67 验证中 : python-tempita-0.5.1-6.el7.noarch 58/67 验证中 : librabbitmq-0.8.0-3.el7.x86_64 59/67 验证中 : python-ipaddress-1.0.16-2.el7.noarch 60/67 验证中 : libstoragemgmt-python-clibs-1.8.1-2.el7_9.x86_64 61/67 验证中 : python-webtest-1.3.4-6.el7.noarch 62/67 验证中 : 2:libradosstriper1-14.2.22-0.el7.x86_64 63/67 验证中 : 2:ceph-14.2.22-0.el7.x86_64 64/67 验证中 : psmisc-22.20-17.el7.x86_64 65/67 验证中 : 2:python-rgw-14.2.22-0.el7.x86_64 66/67 验证中 : 2:python-ceph-argparse-14.2.22-0.el7.x86_64 67/67 已安装: ceph.x86_64 2:14.2.22-0.el7 ceph-deploy.noarch 0:2.0.1-0 ceph-mds.x86_64 2:14.2.22-0.el7 ceph-radosgw.x86_64 2:14.2.22-0.el7 作为依赖被安装: ceph-base.x86_64 2:14.2.22-0.el7 ceph-common.x86_64 2:14.2.22-0.el7 ceph-mgr.x86_64 2:14.2.22-0.el7 ceph-mon.x86_64 2:14.2.22-0.el7 ceph-osd.x86_64 2:14.2.22-0.el7 ceph-selinux.x86_64 2:14.2.22-0.el7 cryptsetup.x86_64 0:2.0.3-6.el7 gperftools-libs.x86_64 0:2.6.1-1.el7 leveldb.x86_64 0:1.12.0-11.el7 libbabeltrace.x86_64 0:1.2.4-3.el7 libcephfs2.x86_64 2:14.2.22-0.el7 libconfig.x86_64 0:1.4.9-5.el7 libibverbs.x86_64 0:22.4-6.el7_9 liboath.x86_64 0:2.6.2-1.el7 librabbitmq.x86_64 0:0.8.0-3.el7 librados2.x86_64 2:14.2.22-0.el7 libradosstriper1.x86_64 2:14.2.22-0.el7 librbd1.x86_64 2:14.2.22-0.el7 librdkafka.x86_64 0:0.11.5-1.el7 librdmacm.x86_64 0:22.4-6.el7_9 librgw2.x86_64 2:14.2.22-0.el7 libstoragemgmt.x86_64 0:1.8.1-2.el7_9 libstoragemgmt-python.noarch 0:1.8.1-2.el7_9 libstoragemgmt-python-clibs.x86_64 0:1.8.1-2.el7_9 lttng-ust.x86_64 0:2.4.1-4.el7 mailcap.noarch 0:2.1.41-2.el7 psmisc.x86_64 0:22.20-17.el7 pyOpenSSL.x86_64 0:0.13.1-4.el7 python-backports.x86_64 0:1.0-8.el7 python-backports-ssl_match_hostname.noarch 0:3.5.0.1-1.el7 python-beaker.noarch 0:1.5.4-10.el7 python-ceph-argparse.x86_64 2:14.2.22-0.el7 python-cephfs.x86_64 2:14.2.22-0.el7 python-cffi.x86_64 0:1.6.0-5.el7 python-chardet.noarch 0:2.2.1-3.el7 python-cherrypy.noarch 0:3.2.2-4.el7 python-enum34.noarch 0:1.0.4-1.el7 python-ipaddress.noarch 0:1.0.16-2.el7 python-mako.noarch 0:0.8.1-2.el7 python-markupsafe.x86_64 0:0.11-10.el7 python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 python-pecan.noarch 0:0.4.5-2.el7 python-ply.noarch 0:3.4-11.el7 python-prettytable.noarch 0:0.7.2-3.el7 python-pycparser.noarch 0:2.14-1.el7 python-rados.x86_64 2:14.2.22-0.el7 python-rbd.x86_64 2:14.2.22-0.el7 python-requests.noarch 0:2.6.0-10.el7 python-rgw.x86_64 2:14.2.22-0.el7 python-setuptools.noarch 0:0.9.8-7.el7 python-simplegeneric.noarch 0:0.8-7.el7 python-singledispatch.noarch 0:3.4.0.2-2.el7 python-six.noarch 0:1.9.0-2.el7 python-tempita.noarch 0:0.5.1-6.el7 python-urllib3.noarch 0:1.10.2-7.el7 python-webob.noarch 0:1.2.3-7.el7 python-webtest.noarch 0:1.3.4-6.el7 python-werkzeug.noarch 0:0.9.1-2.el7 python2-bcrypt.x86_64 0:3.1.6-2.el7 python2-six.noarch 0:1.9.0-0.el7 rdma-core.x86_64 0:22.4-6.el7_9 userspace-rcu.x86_64 0:0.7.16-1.el7 yajl.x86_64 0:2.0.4-4.el7 完毕！
/*
说明：ceph-deploy 是 ceph 软件定义存储系统的一部分，用来方便地配置和管理 Ceph 存储集群。
*/
在 ceph02、ceph03 上这装 ceph
[root@ceph02 yum.repos.d]# yum -y install ceph ceph-mds ceph-radosgw 已加载插件：fastestmirror Loading mirror speeds from cached hostfile * base: mirrors.aliyun.com * extras: mirrors.aliyun.com * updates: mirrors.aliyun.com ceph | 1.5 kB 00:00:00 ceph-noarch | 1.5 kB 00:00:00 ceph-source | 1.5 kB 00:00:00 (1/3): ceph-source/primary | 6.2 kB 00:00:00 (2/3): ceph-noarch/primary | 18 kB 00:00:00 (3/3): ceph/primary | 137 kB 00:00:00 ceph 1050/1050 ceph-noarch 184/184 ceph-source 42/42 正在解决依赖关系 --> 正在检查事务 ---> 软件包 ceph.x86_64.2.14.2.22-0.el7 将被 安装 --> 正在处理依赖关系 ceph-osd = 2:14.2.22-0.el7，它被软件包 2:ceph-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 ceph-mon = 2:14.2.22-0.el7，它被软件包 2:ceph-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 ceph-mgr = 2:14.2.22-0.el7，它被软件包 2:ceph-14.2.22-0.el7.x86_64 需要 ---> 软件包 ceph-mds.x86_64.2.14.2.22-0.el7 将被 安装 --> 正在处理依赖关系 ceph-base = 2:14.2.22-0.el7，它被软件包 2:ceph-mds-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 librdmacm.so.1()(64bit)，它被软件包 2:ceph-mds-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 libibverbs.so.1()(64bit)，它被软件包 2:ceph-mds-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 libtcmalloc.so.4()(64bit)，它被软件包 2:ceph-mds-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 libceph-common.so.0()(64bit)，它被软件包 2:ceph-mds-14.2.22-0.el7.x86_64 需要 ---> 软件包 ceph-radosgw.x86_64.2.14.2.22-0.el7 将被 安装 --> 正在处理依赖关系 ceph-selinux = 2:14.2.22-0.el7，它被软件包 2:ceph-radosgw-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 librgw2 = 2:14.2.22-0.el7，它被软件包 2:ceph-radosgw-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 mailcap，它被软件包 2:ceph-radosgw-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 librabbitmq.so.4()(64bit)，它被软件包 2:ceph-radosgw-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 liboath.so.0()(64bit)，它被软件包 2:ceph-radosgw-14.2.22-0.el7.x86_64 需要 --> 正在检查事务 ---> 软件包 ceph-base.x86_64.2.14.2.22-0.el7 将被 安装 --> 正在处理依赖关系 ceph-common = 2:14.2.22-0.el7，它被软件包 2:ceph-base-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 librbd1 = 2:14.2.22-0.el7，它被软件包 2:ceph-base-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 libcephfs2 = 2:14.2.22-0.el7，它被软件包 2:ceph-base-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-setuptools，它被软件包 2:ceph-base-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 psmisc，它被软件包 2:ceph-base-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 cryptsetup，它被软件包 2:ceph-base-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 libleveldb.so.1()(64bit)，它被软件包 2:ceph-base-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 liblttng-ust.so.0()(64bit)，它被软件包 2:ceph-base-14.2.22-0.el7.x86_64 需要 ---> 软件包 ceph-mgr.x86_64.2.14.2.22-0.el7 将被 安装 --> 正在处理依赖关系 python-cherrypy，它被软件包 2:ceph-mgr-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-werkzeug，它被软件包 2:ceph-mgr-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-six，它被软件包 2:ceph-mgr-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-pecan，它被软件包 2:ceph-mgr-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-bcrypt，它被软件包 2:ceph-mgr-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 pyOpenSSL，它被软件包 2:ceph-mgr-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-requests，它被软件包 2:ceph-mgr-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-enum34，它被软件包 2:ceph-mgr-14.2.22-0.el7.x86_64 需要 ---> 软件包 ceph-mon.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 ceph-osd.x86_64.2.14.2.22-0.el7 将被 安装 --> 正在处理依赖关系 libstoragemgmt，它被软件包 2:ceph-osd-14.2.22-0.el7.x86_64 需要 ---> 软件包 ceph-selinux.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 gperftools-libs.x86_64.0.2.6.1-1.el7 将被 安装 ---> 软件包 libibverbs.x86_64.0.22.4-6.el7_9 将被 安装 --> 正在处理依赖关系 rdma-core(x86-64) = 22.4-6.el7_9，它被软件包 libibverbs-22.4-6.el7_9.x86_64 需要 ---> 软件包 liboath.x86_64.0.2.6.2-1.el7 将被 安装 ---> 软件包 librabbitmq.x86_64.0.0.8.0-3.el7 将被 安装 ---> 软件包 librados2.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 librdmacm.x86_64.0.22.4-6.el7_9 将被 安装 ---> 软件包 librgw2.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 mailcap.noarch.0.2.1.41-2.el7 将被 安装 --> 正在检查事务 ---> 软件包 ceph-common.x86_64.2.14.2.22-0.el7 将被 安装 --> 正在处理依赖关系 python-ceph-argparse = 2:14.2.22-0.el7，它被软件包 2:ceph-common-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-rados = 2:14.2.22-0.el7，它被软件包 2:ceph-common-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-rbd = 2:14.2.22-0.el7，它被软件包 2:ceph-common-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-rgw = 2:14.2.22-0.el7，它被软件包 2:ceph-common-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 libradosstriper1 = 2:14.2.22-0.el7，它被软件包 2:ceph-common-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-cephfs = 2:14.2.22-0.el7，它被软件包 2:ceph-common-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 python-prettytable，它被软件包 2:ceph-common-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 libbabeltrace-ctf.so.1()(64bit)，它被软件包 2:ceph-common-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 librdkafka.so.1()(64bit)，它被软件包 2:ceph-common-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 libbabeltrace.so.1()(64bit)，它被软件包 2:ceph-common-14.2.22-0.el7.x86_64 需要 --> 正在处理依赖关系 libradosstriper.so.1()(64bit)，它被软件包 2:ceph-common-14.2.22-0.el7.x86_64 需要 ---> 软件包 cryptsetup.x86_64.0.2.0.3-6.el7 将被 安装 ---> 软件包 leveldb.x86_64.0.1.12.0-11.el7 将被 安装 ---> 软件包 libcephfs2.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 librbd1.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 libstoragemgmt.x86_64.0.1.8.1-2.el7_9 将被 安装 --> 正在处理依赖关系 libstoragemgmt-python，它被软件包 libstoragemgmt-1.8.1-2.el7_9.x86_64 需要 --> 正在处理依赖关系 libyajl.so.2()(64bit)，它被软件包 libstoragemgmt-1.8.1-2.el7_9.x86_64 需要 --> 正在处理依赖关系 libconfig.so.9()(64bit)，它被软件包 libstoragemgmt-1.8.1-2.el7_9.x86_64 需要 ---> 软件包 lttng-ust.x86_64.0.2.4.1-4.el7 将被 安装 --> 正在处理依赖关系 liburcu-bp.so.1()(64bit)，它被软件包 lttng-ust-2.4.1-4.el7.x86_64 需要 --> 正在处理依赖关系 liburcu-cds.so.1()(64bit)，它被软件包 lttng-ust-2.4.1-4.el7.x86_64 需要 ---> 软件包 psmisc.x86_64.0.22.20-17.el7 将被 安装 ---> 软件包 pyOpenSSL.x86_64.0.0.13.1-4.el7 将被 安装 ---> 软件包 python-cherrypy.noarch.0.3.2.2-4.el7 将被 安装 ---> 软件包 python-enum34.noarch.0.1.0.4-1.el7 将被 安装 ---> 软件包 python-pecan.noarch.0.0.4.5-2.el7 将被 安装 --> 正在处理依赖关系 python-mako >= 0.4.0，它被软件包 python-pecan-0.4.5-2.el7.noarch 需要 --> 正在处理依赖关系 python-simplegeneric >= 0.8，它被软件包 python-pecan-0.4.5-2.el7.noarch 需要 --> 正在处理依赖关系 python-webob >= 1.2，它被软件包 python-pecan-0.4.5-2.el7.noarch 需要 --> 正在处理依赖关系 python-webtest >= 1.3.1，它被软件包 python-pecan-0.4.5-2.el7.noarch 需要 --> 正在处理依赖关系 python-singledispatch，它被软件包 python-pecan-0.4.5-2.el7.noarch 需要 ---> 软件包 python-requests.noarch.0.2.6.0-10.el7 将被 安装 --> 正在处理依赖关系 python-urllib3 >= 1.10.2-1，它被软件包 python-requests-2.6.0-10.el7.noarch 需要 --> 正在处理依赖关系 python-chardet >= 2.2.1-1，它被软件包 python-requests-2.6.0-10.el7.noarch 需要 ---> 软件包 python-setuptools.noarch.0.0.9.8-7.el7 将被 安装 --> 正在处理依赖关系 python-backports-ssl_match_hostname，它被软件包 python-setuptools-0.9.8-7.el7.noarch 需要 ---> 软件包 python-six.noarch.0.1.9.0-2.el7 将被 安装 ---> 软件包 python-werkzeug.noarch.0.0.9.1-2.el7 将被 安装 ---> 软件包 python2-bcrypt.x86_64.0.3.1.6-2.el7 将被 安装 --> 正在处理依赖关系 python-cffi，它被软件包 python2-bcrypt-3.1.6-2.el7.x86_64 需要 --> 正在处理依赖关系 python2-six，它被软件包 python2-bcrypt-3.1.6-2.el7.x86_64 需要 ---> 软件包 rdma-core.x86_64.0.22.4-6.el7_9 将被 安装 --> 正在检查事务 ---> 软件包 libbabeltrace.x86_64.0.1.2.4-3.el7 将被 安装 ---> 软件包 libconfig.x86_64.0.1.4.9-5.el7 将被 安装 ---> 软件包 libradosstriper1.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 librdkafka.x86_64.0.0.11.5-1.el7 将被 安装 ---> 软件包 libstoragemgmt-python.noarch.0.1.8.1-2.el7_9 将被 安装 --> 正在处理依赖关系 libstoragemgmt-python-clibs，它被软件包 libstoragemgmt-python-1.8.1-2.el7_9.noarch 需要 ---> 软件包 python-backports-ssl_match_hostname.noarch.0.3.5.0.1-1.el7 将被 安装 --> 正在处理依赖关系 python-ipaddress，它被软件包 python-backports-ssl_match_hostname-3.5.0.1-1.el7.noarch 需要 --> 正在处理依赖关系 python-backports，它被软件包 python-backports-ssl_match_hostname-3.5.0.1-1.el7.noarch 需要 ---> 软件包 python-ceph-argparse.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 python-cephfs.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 python-cffi.x86_64.0.1.6.0-5.el7 将被 安装 --> 正在处理依赖关系 python-pycparser，它被软件包 python-cffi-1.6.0-5.el7.x86_64 需要 ---> 软件包 python-chardet.noarch.0.2.2.1-3.el7 将被 安装 ---> 软件包 python-mako.noarch.0.0.8.1-2.el7 将被 安装 --> 正在处理依赖关系 python-markupsafe，它被软件包 python-mako-0.8.1-2.el7.noarch 需要 --> 正在处理依赖关系 python-beaker，它被软件包 python-mako-0.8.1-2.el7.noarch 需要 ---> 软件包 python-prettytable.noarch.0.0.7.2-3.el7 将被 安装 ---> 软件包 python-rados.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 python-rbd.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 python-rgw.x86_64.2.14.2.22-0.el7 将被 安装 ---> 软件包 python-simplegeneric.noarch.0.0.8-7.el7 将被 安装 ---> 软件包 python-singledispatch.noarch.0.3.4.0.2-2.el7 将被 安装 ---> 软件包 python-urllib3.noarch.0.1.10.2-7.el7 将被 安装 ---> 软件包 python-webob.noarch.0.1.2.3-7.el7 将被 安装 ---> 软件包 python-webtest.noarch.0.1.3.4-6.el7 将被 安装 ---> 软件包 python2-six.noarch.0.1.9.0-0.el7 将被 安装 ---> 软件包 userspace-rcu.x86_64.0.0.7.16-1.el7 将被 安装 ---> 软件包 yajl.x86_64.0.2.0.4-4.el7 将被 安装 --> 正在检查事务 ---> 软件包 libstoragemgmt-python-clibs.x86_64.0.1.8.1-2.el7_9 将被 安装 ---> 软件包 python-backports.x86_64.0.1.0-8.el7 将被 安装 ---> 软件包 python-beaker.noarch.0.1.5.4-10.el7 将被 安装 --> 正在处理依赖关系 python-paste，它被软件包 python-beaker-1.5.4-10.el7.noarch 需要 ---> 软件包 python-ipaddress.noarch.0.1.0.16-2.el7 将被 安装 ---> 软件包 python-markupsafe.x86_64.0.0.11-10.el7 将被 安装 ---> 软件包 python-pycparser.noarch.0.2.14-1.el7 将被 安装 --> 正在处理依赖关系 python-ply，它被软件包 python-pycparser-2.14-1.el7.noarch 需要 --> 正在检查事务 ---> 软件包 python-paste.noarch.0.1.7.5.1-9.20111221hg1498.el7 将被 安装 --> 正在处理依赖关系 python-tempita，它被软件包 python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 需要 ---> 软件包 python-ply.noarch.0.3.4-11.el7 将被 安装 --> 正在检查事务 ---> 软件包 python-tempita.noarch.0.0.5.1-6.el7 将被 安装 --> 解决依赖关系完成 依赖关系解决 ================================================================================================================ Package 架构 版本 源 大小 ================================================================================================================ 正在安装: ceph x86_64 2:14.2.22-0.el7 ceph 3.0 k ceph-mds x86_64 2:14.2.22-0.el7 ceph 1.9 M ceph-radosgw x86_64 2:14.2.22-0.el7 ceph 5.9 M 为依赖而安装: ceph-base x86_64 2:14.2.22-0.el7 ceph 5.5 M ceph-common x86_64 2:14.2.22-0.el7 ceph 19 M ceph-mgr x86_64 2:14.2.22-0.el7 ceph 1.8 M ceph-mon x86_64 2:14.2.22-0.el7 ceph 4.3 M ceph-osd x86_64 2:14.2.22-0.el7 ceph 16 M ceph-selinux x86_64 2:14.2.22-0.el7 ceph 21 k cryptsetup x86_64 2.0.3-6.el7 base 154 k gperftools-libs x86_64 2.6.1-1.el7 base 272 k leveldb x86_64 1.12.0-11.el7 epel 161 k libbabeltrace x86_64 1.2.4-3.el7 epel 147 k libcephfs2 x86_64 2:14.2.22-0.el7 ceph 502 k libconfig x86_64 1.4.9-5.el7 base 59 k libibverbs x86_64 22.4-6.el7_9 updates 269 k liboath x86_64 2.6.2-1.el7 epel 51 k librabbitmq x86_64 0.8.0-3.el7 base 37 k librados2 x86_64 2:14.2.22-0.el7 ceph 3.4 M libradosstriper1 x86_64 2:14.2.22-0.el7 ceph 366 k librbd1 x86_64 2:14.2.22-0.el7 ceph 1.7 M librdkafka x86_64 0.11.5-1.el7 epel 368 k librdmacm x86_64 22.4-6.el7_9 updates 64 k librgw2 x86_64 2:14.2.22-0.el7 ceph 5.2 M libstoragemgmt x86_64 1.8.1-2.el7_9 updates 243 k libstoragemgmt-python noarch 1.8.1-2.el7_9 updates 167 k libstoragemgmt-python-clibs x86_64 1.8.1-2.el7_9 updates 19 k lttng-ust x86_64 2.4.1-4.el7 epel 176 k mailcap noarch 2.1.41-2.el7 base 31 k psmisc x86_64 22.20-17.el7 base 141 k pyOpenSSL x86_64 0.13.1-4.el7 base 135 k python-backports x86_64 1.0-8.el7 base 5.8 k python-backports-ssl_match_hostname noarch 3.5.0.1-1.el7 base 13 k python-beaker noarch 1.5.4-10.el7 base 80 k python-ceph-argparse x86_64 2:14.2.22-0.el7 ceph 36 k python-cephfs x86_64 2:14.2.22-0.el7 ceph 114 k python-cffi x86_64 1.6.0-5.el7 base 218 k python-chardet noarch 2.2.1-3.el7 base 227 k python-cherrypy noarch 3.2.2-4.el7 base 422 k python-enum34 noarch 1.0.4-1.el7 base 52 k python-ipaddress noarch 1.0.16-2.el7 base 34 k python-mako noarch 0.8.1-2.el7 base 307 k python-markupsafe x86_64 0.11-10.el7 base 25 k python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k python-pecan noarch 0.4.5-2.el7 epel 255 k python-ply noarch 3.4-11.el7 base 123 k python-prettytable noarch 0.7.2-3.el7 base 37 k python-pycparser noarch 2.14-1.el7 base 104 k python-rados x86_64 2:14.2.22-0.el7 ceph 201 k python-rbd x86_64 2:14.2.22-0.el7 ceph 195 k python-requests noarch 2.6.0-10.el7 base 95 k python-rgw x86_64 2:14.2.22-0.el7 ceph 78 k python-setuptools noarch 0.9.8-7.el7 base 397 k python-simplegeneric noarch 0.8-7.el7 epel 12 k python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k python-six noarch 1.9.0-2.el7 base 29 k python-tempita noarch 0.5.1-6.el7 base 33 k python-urllib3 noarch 1.10.2-7.el7 base 103 k python-webob noarch 1.2.3-7.el7 base 202 k python-webtest noarch 1.3.4-6.el7 base 102 k python-werkzeug noarch 0.9.1-2.el7 extras 562 k python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k python2-six noarch 1.9.0-0.el7 epel 2.9 k rdma-core x86_64 22.4-6.el7_9 updates 51 k userspace-rcu x86_64 0.7.16-1.el7 epel 73 k yajl x86_64 2.0.4-4.el7 base 39 k 事务概要 ================================================================================================================ 安装 3 软件包 (+63 依赖软件包) 总下载量：73 M 安装大小：239 M Downloading packages: (1/66): ceph-14.2.22-0.el7.x86_64.rpm | 3.0 kB 00:00:00 (2/66): ceph-base-14.2.22-0.el7.x86_64.rpm | 5.5 MB 00:00:22 (3/66): ceph-mds-14.2.22-0.el7.x86_64.rpm | 1.9 MB 00:00:07 (4/66): ceph-mgr-14.2.22-0.el7.x86_64.rpm | 1.8 MB 00:00:07 (5/66): ceph-mon-14.2.22-0.el7.x86_64.rpm | 4.3 MB 00:00:18 (6/66): ceph-common-14.2.22-0.el7.x86_64.rpm | 19 MB 00:01:20 (7/66): ceph-radosgw-14.2.22-0.el7.x86_64.rpm | 5.9 MB 00:00:29 (8/66): ceph-selinux-14.2.22-0.el7.x86_64.rpm | 21 kB 00:00:00 (9/66): libbabeltrace-1.2.4-3.el7.x86_64.rpm | 147 kB 00:00:00 (10/66): cryptsetup-2.0.3-6.el7.x86_64.rpm | 154 kB 00:00:00 (11/66): leveldb-1.12.0-11.el7.x86_64.rpm | 161 kB 00:00:00 (12/66): libconfig-1.4.9-5.el7.x86_64.rpm | 59 kB 00:00:00 (13/66): gperftools-libs-2.6.1-1.el7.x86_64.rpm | 272 kB 00:00:01 (14/66): liboath-2.6.2-1.el7.x86_64.rpm | 51 kB 00:00:00 (15/66): librabbitmq-0.8.0-3.el7.x86_64.rpm | 37 kB 00:00:00 (16/66): libibverbs-22.4-6.el7_9.x86_64.rpm | 269 kB 00:00:01 (17/66): libcephfs2-14.2.22-0.el7.x86_64.rpm | 502 kB 00:00:02 (18/66): librados2-14.2.22-0.el7.x86_64.rpm | 3.4 MB 00:00:16 (19/66): libradosstriper1-14.2.22-0.el7.x86_64.rpm | 366 kB 00:00:01 (20/66): librdmacm-22.4-6.el7_9.x86_64.rpm | 64 kB 00:00:00 (21/66): librdkafka-0.11.5-1.el7.x86_64.rpm | 368 kB 00:00:01 (22/66): ceph-osd-14.2.22-0.el7.x86_64.rpm | 16 MB 00:01:16 (23/66): libstoragemgmt-python-1.8.1-2.el7_9.noarch.rpm | 167 kB 00:00:00 (24/66): libstoragemgmt-python-clibs-1.8.1-2.el7_9.x86_64.rpm | 19 kB 00:00:00 (25/66): libstoragemgmt-1.8.1-2.el7_9.x86_64.rpm | 243 kB 00:00:01 (26/66): mailcap-2.1.41-2.el7.noarch.rpm | 31 kB 00:00:00 (27/66): lttng-ust-2.4.1-4.el7.x86_64.rpm | 176 kB 00:00:00 (28/66): pyOpenSSL-0.13.1-4.el7.x86_64.rpm | 135 kB 00:00:00 (29/66): psmisc-22.20-17.el7.x86_64.rpm | 141 kB 00:00:00 (30/66): python-backports-1.0-8.el7.x86_64.rpm | 5.8 kB 00:00:00 (31/66): python-backports-ssl_match_hostname-3.5.0.1-1.el7.noarch.rpm | 13 kB 00:00:00 (32/66): python-beaker-1.5.4-10.el7.noarch.rpm | 80 kB 00:00:00 (33/66): librbd1-14.2.22-0.el7.x86_64.rpm | 1.7 MB 00:00:07 (34/66): python-ceph-argparse-14.2.22-0.el7.x86_64.rpm | 36 kB 00:00:00 (35/66): python-cephfs-14.2.22-0.el7.x86_64.rpm | 114 kB 00:00:00 (36/66): python-cffi-1.6.0-5.el7.x86_64.rpm | 218 kB 00:00:00 (37/66): python-chardet-2.2.1-3.el7.noarch.rpm | 227 kB 00:00:00 (38/66): python-enum34-1.0.4-1.el7.noarch.rpm | 52 kB 00:00:00 (39/66): python-ipaddress-1.0.16-2.el7.noarch.rpm | 34 kB 00:00:00 (40/66): python-mako-0.8.1-2.el7.noarch.rpm | 307 kB 00:00:01 (41/66): python-cherrypy-3.2.2-4.el7.noarch.rpm | 422 kB 00:00:01 (42/66): python-markupsafe-0.11-10.el7.x86_64.rpm | 25 kB 00:00:00 (43/66): python-ply-3.4-11.el7.noarch.rpm | 123 kB 00:00:00 (44/66): python-prettytable-0.7.2-3.el7.noarch.rpm | 37 kB 00:00:00 (45/66): python-pycparser-2.14-1.el7.noarch.rpm | 104 kB 00:00:00 (46/66): python-pecan-0.4.5-2.el7.noarch.rpm | 255 kB 00:00:01 (47/66): python-rados-14.2.22-0.el7.x86_64.rpm | 201 kB 00:00:00 (48/66): python-requests-2.6.0-10.el7.noarch.rpm | 95 kB 00:00:00 (49/66): python-rbd-14.2.22-0.el7.x86_64.rpm | 195 kB 00:00:00 (50/66): python-simplegeneric-0.8-7.el7.noarch.rpm | 12 kB 00:00:00 (51/66): python-singledispatch-3.4.0.2-2.el7.noarch.rpm | 18 kB 00:00:00 (52/66): python-rgw-14.2.22-0.el7.x86_64.rpm | 78 kB 00:00:00 (53/66): python-paste-1.7.5.1-9.20111221hg1498.el7.noarch.rpm | 866 kB 00:00:03 (54/66): python-six-1.9.0-2.el7.noarch.rpm | 29 kB 00:00:00 (55/66): python-tempita-0.5.1-6.el7.noarch.rpm | 33 kB 00:00:00 (56/66): python-setuptools-0.9.8-7.el7.noarch.rpm | 397 kB 00:00:01 (57/66): python-urllib3-1.10.2-7.el7.noarch.rpm | 103 kB 00:00:00 (58/66): python-webtest-1.3.4-6.el7.noarch.rpm | 102 kB 00:00:00 (59/66): python2-six-1.9.0-0.el7.noarch.rpm | 2.9 kB 00:00:00 (60/66): python-webob-1.2.3-7.el7.noarch.rpm | 202 kB 00:00:00 (61/66): rdma-core-22.4-6.el7_9.x86_64.rpm | 51 kB 00:00:00 (62/66): yajl-2.0.4-4.el7.x86_64.rpm | 39 kB 00:00:00 (63/66): userspace-rcu-0.7.16-1.el7.x86_64.rpm | 73 kB 00:00:00 (64/66): python2-bcrypt-3.1.6-2.el7.x86_64.rpm | 39 kB 00:00:02 (65/66): python-werkzeug-0.9.1-2.el7.noarch.rpm | 562 kB 00:00:04 (66/66): librgw2-14.2.22-0.el7.x86_64.rpm | 5.2 MB 00:00:20 ---------------------------------------------------------------------------------------------------------------- 总计 487 kB/s | 73 MB 00:02:34 Running transaction check Running transaction test Transaction test succeeded Running transaction 正在安装 : gperftools-libs-2.6.1-1.el7.x86_64 1/66 正在安装 : python-six-1.9.0-2.el7.noarch 2/66 正在安装 : leveldb-1.12.0-11.el7.x86_64 3/66 正在安装 : liboath-2.6.2-1.el7.x86_64 4/66 正在安装 : librabbitmq-0.8.0-3.el7.x86_64 5/66 正在安装 : 2:python-ceph-argparse-14.2.22-0.el7.x86_64 6/66 正在安装 : python-ipaddress-1.0.16-2.el7.noarch 7/66 正在安装 : python-webob-1.2.3-7.el7.noarch 8/66 正在安装 : pyOpenSSL-0.13.1-4.el7.x86_64 9/66 正在安装 : yajl-2.0.4-4.el7.x86_64 10/66 正在安装 : rdma-core-22.4-6.el7_9.x86_64 11/66 正在安装 : libibverbs-22.4-6.el7_9.x86_64 12/66 正在安装 : librdmacm-22.4-6.el7_9.x86_64 13/66 正在安装 : python-webtest-1.3.4-6.el7.noarch 14/66 正在安装 : python2-six-1.9.0-0.el7.noarch 15/66 正在安装 : python-singledispatch-3.4.0.2-2.el7.noarch 16/66 正在安装 : psmisc-22.20-17.el7.x86_64 17/66 正在安装 : python-tempita-0.5.1-6.el7.noarch 18/66 正在安装 : python-cherrypy-3.2.2-4.el7.noarch 19/66 正在安装 : cryptsetup-2.0.3-6.el7.x86_64 20/66 正在安装 : python-prettytable-0.7.2-3.el7.noarch 21/66 正在安装 : python-chardet-2.2.1-3.el7.noarch 22/66 正在安装 : python-backports-1.0-8.el7.x86_64 23/66 正在安装 : python-backports-ssl_match_hostname-3.5.0.1-1.el7.noarch 24/66 正在安装 : python-setuptools-0.9.8-7.el7.noarch 25/66 正在安装 : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 26/66 正在安装 : python-beaker-1.5.4-10.el7.noarch 27/66 正在安装 : python-urllib3-1.10.2-7.el7.noarch 28/66 正在安装 : python-requests-2.6.0-10.el7.noarch 29/66 正在安装 : libconfig-1.4.9-5.el7.x86_64 30/66 正在安装 : libstoragemgmt-python-1.8.1-2.el7_9.noarch 31/66 正在安装 : libstoragemgmt-1.8.1-2.el7_9.x86_64 32/66 正在安装 : libstoragemgmt-python-clibs-1.8.1-2.el7_9.x86_64 33/66 正在安装 : librdkafka-0.11.5-1.el7.x86_64 34/66 正在安装 : python-ply-3.4-11.el7.noarch 35/66 正在安装 : python-pycparser-2.14-1.el7.noarch 36/66 正在安装 : python-cffi-1.6.0-5.el7.x86_64 37/66 正在安装 : python2-bcrypt-3.1.6-2.el7.x86_64 38/66 正在安装 : python-markupsafe-0.11-10.el7.x86_64 39/66 正在安装 : python-mako-0.8.1-2.el7.noarch 40/66 正在安装 : userspace-rcu-0.7.16-1.el7.x86_64 41/66 正在安装 : lttng-ust-2.4.1-4.el7.x86_64 42/66 正在安装 : 2:librados2-14.2.22-0.el7.x86_64 43/66 正在安装 : 2:python-rados-14.2.22-0.el7.x86_64 44/66 正在安装 : 2:librbd1-14.2.22-0.el7.x86_64 45/66 正在安装 : 2:libcephfs2-14.2.22-0.el7.x86_64 46/66 正在安装 : 2:librgw2-14.2.22-0.el7.x86_64 47/66 正在安装 : 2:python-rgw-14.2.22-0.el7.x86_64 48/66 正在安装 : 2:python-cephfs-14.2.22-0.el7.x86_64 49/66 正在安装 : 2:python-rbd-14.2.22-0.el7.x86_64 50/66 正在安装 : 2:libradosstriper1-14.2.22-0.el7.x86_64 51/66 正在安装 : libbabeltrace-1.2.4-3.el7.x86_64 52/66 正在安装 : 2:ceph-common-14.2.22-0.el7.x86_64 53/66 正在安装 : 2:ceph-base-14.2.22-0.el7.x86_64 54/66 正在安装 : 2:ceph-selinux-14.2.22-0.el7.x86_64 55/66 正在安装 : 2:ceph-mds-14.2.22-0.el7.x86_64 56/66 正在安装 : 2:ceph-mon-14.2.22-0.el7.x86_64 57/66 正在安装 : 2:ceph-osd-14.2.22-0.el7.x86_64 58/66 正在安装 : python-simplegeneric-0.8-7.el7.noarch 59/66 正在安装 : python-pecan-0.4.5-2.el7.noarch 60/66 正在安装 : python-enum34-1.0.4-1.el7.noarch 61/66 正在安装 : python-werkzeug-0.9.1-2.el7.noarch 62/66 正在安装 : 2:ceph-mgr-14.2.22-0.el7.x86_64 63/66 正在安装 : mailcap-2.1.41-2.el7.noarch 64/66 正在安装 : 2:ceph-radosgw-14.2.22-0.el7.x86_64 65/66 正在安装 : 2:ceph-14.2.22-0.el7.x86_64 66/66 验证中 : libstoragemgmt-1.8.1-2.el7_9.x86_64 1/66 验证中 : 2:librbd1-14.2.22-0.el7.x86_64 2/66 验证中 : liboath-2.6.2-1.el7.x86_64 3/66 验证中 : python-backports-ssl_match_hostname-3.5.0.1-1.el7.noarch 4/66 验证中 : python2-six-1.9.0-0.el7.noarch 5/66 验证中 : mailcap-2.1.41-2.el7.noarch 6/66 验证中 : python-werkzeug-0.9.1-2.el7.noarch 7/66 验证中 : 2:libcephfs2-14.2.22-0.el7.x86_64 8/66 验证中 : 2:librados2-14.2.22-0.el7.x86_64 9/66 验证中 : python2-bcrypt-3.1.6-2.el7.x86_64 10/66 验证中 : python-enum34-1.0.4-1.el7.noarch 11/66 验证中 : libstoragemgmt-python-1.8.1-2.el7_9.noarch 12/66 验证中 : librabbitmq-0.8.0-3.el7.x86_64 13/66 验证中 : libibverbs-22.4-6.el7_9.x86_64 14/66 验证中 : rdma-core-22.4-6.el7_9.x86_64 15/66 验证中 : python-simplegeneric-0.8-7.el7.noarch 16/66 验证中 : yajl-2.0.4-4.el7.x86_64 17/66 验证中 : python-setuptools-0.9.8-7.el7.noarch 18/66 验证中 : 2:python-rbd-14.2.22-0.el7.x86_64 19/66 验证中 : 2:python-cephfs-14.2.22-0.el7.x86_64 20/66 验证中 : libbabeltrace-1.2.4-3.el7.x86_64 21/66 验证中 : 2:ceph-mds-14.2.22-0.el7.x86_64 22/66 验证中 : python-mako-0.8.1-2.el7.noarch 23/66 验证中 : 2:ceph-radosgw-14.2.22-0.el7.x86_64 24/66 验证中 : 2:ceph-selinux-14.2.22-0.el7.x86_64 25/66 验证中 : 2:ceph-mon-14.2.22-0.el7.x86_64 26/66 验证中 : userspace-rcu-0.7.16-1.el7.x86_64 27/66 验证中 : 2:ceph-common-14.2.22-0.el7.x86_64 28/66 验证中 : python-pecan-0.4.5-2.el7.noarch 29/66 验证中 : python-six-1.9.0-2.el7.noarch 30/66 验证中 : 2:ceph-osd-14.2.22-0.el7.x86_64 31/66 验证中 : 2:librgw2-14.2.22-0.el7.x86_64 32/66 验证中 : python-singledispatch-3.4.0.2-2.el7.noarch 33/66 验证中 : python-markupsafe-0.11-10.el7.x86_64 34/66 验证中 : pyOpenSSL-0.13.1-4.el7.x86_64 35/66 验证中 : python-ply-3.4-11.el7.noarch 36/66 验证中 : librdkafka-0.11.5-1.el7.x86_64 37/66 验证中 : libconfig-1.4.9-5.el7.x86_64 38/66 验证中 : python-urllib3-1.10.2-7.el7.noarch 39/66 验证中 : leveldb-1.12.0-11.el7.x86_64 40/66 验证中 : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 41/66 验证中 : lttng-ust-2.4.1-4.el7.x86_64 42/66 验证中 : python-backports-1.0-8.el7.x86_64 43/66 验证中 : python-cffi-1.6.0-5.el7.x86_64 44/66 验证中 : python-webob-1.2.3-7.el7.noarch 45/66 验证中 : 2:ceph-base-14.2.22-0.el7.x86_64 46/66 验证中 : 2:ceph-mgr-14.2.22-0.el7.x86_64 47/66 验证中 : librdmacm-22.4-6.el7_9.x86_64 48/66 验证中 : python-chardet-2.2.1-3.el7.noarch 49/66 验证中 : python-pycparser-2.14-1.el7.noarch 50/66 验证中 : python-prettytable-0.7.2-3.el7.noarch 51/66 验证中 : cryptsetup-2.0.3-6.el7.x86_64 52/66 验证中 : 2:python-rados-14.2.22-0.el7.x86_64 53/66 验证中 : python-requests-2.6.0-10.el7.noarch 54/66 验证中 : python-cherrypy-3.2.2-4.el7.noarch 55/66 验证中 : python-beaker-1.5.4-10.el7.noarch 56/66 验证中 : python-tempita-0.5.1-6.el7.noarch 57/66 验证中 : gperftools-libs-2.6.1-1.el7.x86_64 58/66 验证中 : python-ipaddress-1.0.16-2.el7.noarch 59/66 验证中 : libstoragemgmt-python-clibs-1.8.1-2.el7_9.x86_64 60/66 验证中 : python-webtest-1.3.4-6.el7.noarch 61/66 验证中 : 2:libradosstriper1-14.2.22-0.el7.x86_64 62/66 验证中 : 2:ceph-14.2.22-0.el7.x86_64 63/66 验证中 : psmisc-22.20-17.el7.x86_64 64/66 验证中 : 2:python-rgw-14.2.22-0.el7.x86_64 65/66 验证中 : 2:python-ceph-argparse-14.2.22-0.el7.x86_64 66/66 已安装: ceph.x86_64 2:14.2.22-0.el7 ceph-mds.x86_64 2:14.2.22-0.el7 ceph-radosgw.x86_64 2:14.2.22-0.el7 作为依赖被安装: ceph-base.x86_64 2:14.2.22-0.el7 ceph-common.x86_64 2:14.2.22-0.el7 ceph-mgr.x86_64 2:14.2.22-0.el7 ceph-mon.x86_64 2:14.2.22-0.el7 ceph-osd.x86_64 2:14.2.22-0.el7 ceph-selinux.x86_64 2:14.2.22-0.el7 cryptsetup.x86_64 0:2.0.3-6.el7 gperftools-libs.x86_64 0:2.6.1-1.el7 leveldb.x86_64 0:1.12.0-11.el7 libbabeltrace.x86_64 0:1.2.4-3.el7 libcephfs2.x86_64 2:14.2.22-0.el7 libconfig.x86_64 0:1.4.9-5.el7 libibverbs.x86_64 0:22.4-6.el7_9 liboath.x86_64 0:2.6.2-1.el7 librabbitmq.x86_64 0:0.8.0-3.el7 librados2.x86_64 2:14.2.22-0.el7 libradosstriper1.x86_64 2:14.2.22-0.el7 librbd1.x86_64 2:14.2.22-0.el7 librdkafka.x86_64 0:0.11.5-1.el7 librdmacm.x86_64 0:22.4-6.el7_9 librgw2.x86_64 2:14.2.22-0.el7 libstoragemgmt.x86_64 0:1.8.1-2.el7_9 libstoragemgmt-python.noarch 0:1.8.1-2.el7_9 libstoragemgmt-python-clibs.x86_64 0:1.8.1-2.el7_9 lttng-ust.x86_64 0:2.4.1-4.el7 mailcap.noarch 0:2.1.41-2.el7 psmisc.x86_64 0:22.20-17.el7 pyOpenSSL.x86_64 0:0.13.1-4.el7 python-backports.x86_64 0:1.0-8.el7 python-backports-ssl_match_hostname.noarch 0:3.5.0.1-1.el7 python-beaker.noarch 0:1.5.4-10.el7 python-ceph-argparse.x86_64 2:14.2.22-0.el7 python-cephfs.x86_64 2:14.2.22-0.el7 python-cffi.x86_64 0:1.6.0-5.el7 python-chardet.noarch 0:2.2.1-3.el7 python-cherrypy.noarch 0:3.2.2-4.el7 python-enum34.noarch 0:1.0.4-1.el7 python-ipaddress.noarch 0:1.0.16-2.el7 python-mako.noarch 0:0.8.1-2.el7 python-markupsafe.x86_64 0:0.11-10.el7 python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 python-pecan.noarch 0:0.4.5-2.el7 python-ply.noarch 0:3.4-11.el7 python-prettytable.noarch 0:0.7.2-3.el7 python-pycparser.noarch 0:2.14-1.el7 python-rados.x86_64 2:14.2.22-0.el7 python-rbd.x86_64 2:14.2.22-0.el7 python-requests.noarch 0:2.6.0-10.el7 python-rgw.x86_64 2:14.2.22-0.el7 python-setuptools.noarch 0:0.9.8-7.el7 python-simplegeneric.noarch 0:0.8-7.el7 python-singledispatch.noarch 0:3.4.0.2-2.el7 python-six.noarch 0:1.9.0-2.el7 python-tempita.noarch 0:0.5.1-6.el7 python-urllib3.noarch 0:1.10.2-7.el7 python-webob.noarch 0:1.2.3-7.el7 python-webtest.noarch 0:1.3.4-6.el7 python-werkzeug.noarch 0:0.9.1-2.el7 python2-bcrypt.x86_64 0:3.1.6-2.el7 python2-six.noarch 0:1.9.0-0.el7 rdma-core.x86_64 0:22.4-6.el7_9 userspace-rcu.x86_64 0:0.7.16-1.el7 yajl.x86_64 0:2.0.4-4.el7 完毕！ [root@ceph02 yum.repos.d]# cd
2.5 初始化配置 mon
# 新建 Ceph 集群，并生成集群配置文件和密钥文件（在 ceph01 上执行）
[root@ceph01 ~]# mkdir /etc/ceph-cluster && cd /etc/ceph-cluster [root@ceph01 ceph-cluster]# ceph-deploy new ceph01 ceph02 ceph03 [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (2.0.1): /usr/bin/ceph-deploy new ceph01 ceph02 ceph03 [ceph_deploy.cli][INFO ] ceph-deploy options: [ceph_deploy.cli][INFO ] username : None [ceph_deploy.cli][INFO ] func : <function new at 0x7fe709f70de8> [ceph_deploy.cli][INFO ] verbose : False [ceph_deploy.cli][INFO ] overwrite_conf : False [ceph_deploy.cli][INFO ] quiet : False [ceph_deploy.cli][INFO ] cd_conf : <ceph_deploy.conf.cephdeploy.Conf instance at 0x7fe7098f4290> [ceph_deploy.cli][INFO ] cluster : ceph [ceph_deploy.cli][INFO ] ssh_copykey : True [ceph_deploy.cli][INFO ] mon : ['ceph01', 'ceph02', 'ceph03'] [ceph_deploy.cli][INFO ] public_network : None [ceph_deploy.cli][INFO ] ceph_conf : None [ceph_deploy.cli][INFO ] cluster_network : None [ceph_deploy.cli][INFO ] default_release : False [ceph_deploy.cli][INFO ] fsid : None [ceph_deploy.new][DEBUG ] Creating new cluster named ceph [ceph_deploy.new][INFO ] making sure passwordless SSH succeeds [ceph01][DEBUG ] connected to host: ceph01 [ceph01][DEBUG ] detect platform information from remote host [ceph01][DEBUG ] detect machine type [ceph01][DEBUG ] find the location of an executable [ceph01][INFO ] Running command: /usr/sbin/ip link show [ceph01][INFO ] Running command: /usr/sbin/ip addr show [ceph01][DEBUG ] IP addresses found: [u'192.168.61.141'] [ceph_deploy.new][DEBUG ] Resolving host ceph01 [ceph_deploy.new][DEBUG ] Monitor ceph01 at 192.168.61.141 [ceph_deploy.new][INFO ] making sure passwordless SSH succeeds [ceph02][DEBUG ] connected to host: ceph01 [ceph02][INFO ] Running command: ssh -CT -o BatchMode=yes ceph02 [ceph02][DEBUG ] connected to host: ceph02 [ceph02][DEBUG ] detect platform information from remote host [ceph02][DEBUG ] detect machine type [ceph02][DEBUG ] find the location of an executable [ceph02][INFO ] Running command: /usr/sbin/ip link show [ceph02][INFO ] Running command: /usr/sbin/ip addr show [ceph02][DEBUG ] IP addresses found: [u'192.168.61.142'] [ceph_deploy.new][DEBUG ] Resolving host ceph02 [ceph_deploy.new][DEBUG ] Monitor ceph02 at 192.168.61.142 [ceph_deploy.new][INFO ] making sure passwordless SSH succeeds [ceph03][DEBUG ] connected to host: ceph01 [ceph03][INFO ] Running command: ssh -CT -o BatchMode=yes ceph03 [ceph03][DEBUG ] connected to host: ceph03 [ceph03][DEBUG ] detect platform information from remote host [ceph03][DEBUG ] detect machine type [ceph03][DEBUG ] find the location of an executable [ceph03][INFO ] Running command: /usr/sbin/ip link show [ceph03][INFO ] Running command: /usr/sbin/ip addr show [ceph03][DEBUG ] IP addresses found: [u'192.168.61.143'] [ceph_deploy.new][DEBUG ] Resolving host ceph03 [ceph_deploy.new][DEBUG ] Monitor ceph03 at 192.168.61.143 [ceph_deploy.new][DEBUG ] Monitor initial members are ['ceph01', 'ceph02', 'ceph03'] [ceph_deploy.new][DEBUG ] Monitor addrs are ['192.168.61.141', '192.168.61.142', '192.168.61.143'] [ceph_deploy.new][DEBUG ] Creating a random mon key... [ceph_deploy.new][DEBUG ] Writing monitor keyring to ceph.mon.keyring... [ceph_deploy.new][DEBUG ] Writing initial config to ceph.conf... [root@ceph01 ceph-cluster]# ls ceph.conf ceph-deploy-ceph.log ceph.mon.keyring #自动生成配置文件并编辑
修改vim /etc/ceph-cluster/ceph.conf，继续添加如下内容：
[global] fsid = 09b34112-76a2-40d4-b931-2bb376fc7ce1 mon_initial_members = ceph01, ceph02, ceph03 mon_host = 192.168.61.141,192.168.61.142,192.168.61.143 auth_cluster_required = cephx auth_service_required = cephx auth_client_required = cephx #新增配置 auth_allow_insecure_global_id_reclaim = false public_network = 192.168.61.0/24 #本地地址 cluster_network = 20.168.61.0/24 #集群地址
mon_clock_drift_allowed = 1.0 #允许的时间偏差
初始化 mon 节点（在 ceph01 上执行）
[root@ceph01 network-scripts]# cd /etc/ceph-cluster [root@ceph01 ceph-cluster]# ls ceph.conf ceph-deploy-ceph.log ceph.mon.keyring [root@ceph01 ceph-cluster]# ceph-deploy mon create-initial [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (2.0.1): /usr/bin/ceph-deploy mon create-initial [ceph_deploy.cli][INFO ] ceph-deploy options: [ceph_deploy.cli][INFO ] username : None [ceph_deploy.cli][INFO ] verbose : False [ceph_deploy.cli][INFO ] overwrite_conf : False [ceph_deploy.cli][INFO ] subcommand : create-initial [ceph_deploy.cli][INFO ] quiet : False [ceph_deploy.cli][INFO ] cd_conf : <ceph_deploy.conf.cephdeploy.Conf instance at 0x7fb155e83d40> [ceph_deploy.cli][INFO ] cluster : ceph [ceph_deploy.cli][INFO ] func : <function mon at 0x7fb1560f5410> [ceph_deploy.cli][INFO ] ceph_conf : None [ceph_deploy.cli][INFO ] default_release : False [ceph_deploy.cli][INFO ] keyrings : None [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts ceph01 ceph02 ceph03 [ceph_deploy.mon][DEBUG ] detecting platform for host ceph01 ... [ceph01][DEBUG ] connected to host: ceph01 [ceph01][DEBUG ] detect platform information from remote host [ceph01][DEBUG ] detect machine type [ceph01][DEBUG ] find the location of an executable [ceph_deploy.mon][INFO ] distro info: CentOS Linux 7.9.2009 Core [ceph01][DEBUG ] determining if provided host has same hostname in remote [ceph01][DEBUG ] get remote short hostname [ceph01][DEBUG ] deploying mon to ceph01 [ceph01][DEBUG ] get remote short hostname [ceph01][DEBUG ] remote hostname: ceph01 [ceph01][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [ceph01][DEBUG ] create the mon path if it does not exist [ceph01][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-ceph01/done [ceph01][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-ceph01/done [ceph01][INFO ] creating keyring file: /var/lib/ceph/tmp/ceph-ceph01.mon.keyring [ceph01][DEBUG ] create the monitor keyring file [ceph01][INFO ] Running command: ceph-mon --cluster ceph --mkfs -i ceph01 --keyring /var/lib/ceph/tmp/ceph-ceph01.mon.keyring --setuser 167 --setgroup 167 [ceph01][INFO ] unlinking keyring file /var/lib/ceph/tmp/ceph-ceph01.mon.keyring [ceph01][DEBUG ] create a done file to avoid re-doing the mon deployment [ceph01][DEBUG ] create the init path if it does not exist [ceph01][INFO ] Running command: systemctl enable ceph.target [ceph01][INFO ] Running command: systemctl enable ceph-mon@ceph01 [ceph01][WARNIN] Created symlink from /etc/systemd/system/ceph-mon.target.wants/ceph-mon@ceph01.service to /usr/lib/systemd/system/ceph-mon@.service. [ceph01][INFO ] Running command: systemctl start ceph-mon@ceph01 [ceph01][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph01.asok mon_status [ceph01][DEBUG ] ******************************************************************************** [ceph01][DEBUG ] status for monitor: mon.ceph01 [ceph01][DEBUG ] { [ceph01][DEBUG ] "election_epoch": 0, [ceph01][DEBUG ] "extra_probe_peers": [ [ceph01][DEBUG ] { [ceph01][DEBUG ] "addrvec": [ [ceph01][DEBUG ] { [ceph01][DEBUG ] "addr": "192.168.61.142:3300", [ceph01][DEBUG ] "nonce": 0, [ceph01][DEBUG ] "type": "v2" [ceph01][DEBUG ] }, [ceph01][DEBUG ] { [ceph01][DEBUG ] "addr": "192.168.61.142:6789", [ceph01][DEBUG ] "nonce": 0, [ceph01][DEBUG ] "type": "v1" [ceph01][DEBUG ] } [ceph01][DEBUG ] ] [ceph01][DEBUG ] }, [ceph01][DEBUG ] { [ceph01][DEBUG ] "addrvec": [ [ceph01][DEBUG ] { [ceph01][DEBUG ] "addr": "192.168.61.143:3300", [ceph01][DEBUG ] "nonce": 0, [ceph01][DEBUG ] "type": "v2" [ceph01][DEBUG ] }, [ceph01][DEBUG ] { [ceph01][DEBUG ] "addr": "192.168.61.143:6789", [ceph01][DEBUG ] "nonce": 0, [ceph01][DEBUG ] "type": "v1" [ceph01][DEBUG ] } [ceph01][DEBUG ] ] [ceph01][DEBUG ] } [ceph01][DEBUG ] ], [ceph01][DEBUG ] "feature_map": { [ceph01][DEBUG ] "mon": [ [ceph01][DEBUG ] { [ceph01][DEBUG ] "features": "0x3ffddff8ffecffff", [ceph01][DEBUG ] "num": 1, [ceph01][DEBUG ] "release": "luminous" [ceph01][DEBUG ] } [ceph01][DEBUG ] ] [ceph01][DEBUG ] }, [ceph01][DEBUG ] "features": { [ceph01][DEBUG ] "quorum_con": "0", [ceph01][DEBUG ] "quorum_mon": [], [ceph01][DEBUG ] "required_con": "0", [ceph01][DEBUG ] "required_mon": [] [ceph01][DEBUG ] }, [ceph01][DEBUG ] "monmap": { [ceph01][DEBUG ] "created": "2023-04-18 16:32:50.935816", [ceph01][DEBUG ] "epoch": 0, [ceph01][DEBUG ] "features": { [ceph01][DEBUG ] "optional": [], [ceph01][DEBUG ] "persistent": [] [ceph01][DEBUG ] }, [ceph01][DEBUG ] "fsid": "09b34112-76a2-40d4-b931-2bb376fc7ce1", [ceph01][DEBUG ] "min_mon_release": 0, [ceph01][DEBUG ] "min_mon_release_name": "unknown", [ceph01][DEBUG ] "modified": "2023-04-18 16:32:50.935816", [ceph01][DEBUG ] "mons": [ [ceph01][DEBUG ] { [ceph01][DEBUG ] "addr": "192.168.61.141:6789/0", [ceph01][DEBUG ] "name": "ceph01", [ceph01][DEBUG ] "public_addr": "192.168.61.141:6789/0", [ceph01][DEBUG ] "public_addrs": { [ceph01][DEBUG ] "addrvec": [ [ceph01][DEBUG ] { [ceph01][DEBUG ] "addr": "192.168.61.141:3300", [ceph01][DEBUG ] "nonce": 0, [ceph01][DEBUG ] "type": "v2" [ceph01][DEBUG ] }, [ceph01][DEBUG ] { [ceph01][DEBUG ] "addr": "192.168.61.141:6789", [ceph01][DEBUG ] "nonce": 0, [ceph01][DEBUG ] "type": "v1" [ceph01][DEBUG ] } [ceph01][DEBUG ] ] [ceph01][DEBUG ] }, [ceph01][DEBUG ] "rank": 0 [ceph01][DEBUG ] }, [ceph01][DEBUG ] { [ceph01][DEBUG ] "addr": "0.0.0.0:0/1", [ceph01][DEBUG ] "name": "ceph02", [ceph01][DEBUG ] "public_addr": "0.0.0.0:0/1", [ceph01][DEBUG ] "public_addrs": { [ceph01][DEBUG ] "addrvec": [ [ceph01][DEBUG ] { [ceph01][DEBUG ] "addr": "0.0.0.0:0", [ceph01][DEBUG ] "nonce": 1, [ceph01][DEBUG ] "type": "v1" [ceph01][DEBUG ] } [ceph01][DEBUG ] ] [ceph01][DEBUG ] }, [ceph01][DEBUG ] "rank": 1 [ceph01][DEBUG ] }, [ceph01][DEBUG ] { [ceph01][DEBUG ] "addr": "0.0.0.0:0/2", [ceph01][DEBUG ] "name": "ceph03", [ceph01][DEBUG ] "public_addr": "0.0.0.0:0/2", [ceph01][DEBUG ] "public_addrs": { [ceph01][DEBUG ] "addrvec": [ [ceph01][DEBUG ] { [ceph01][DEBUG ] "addr": "0.0.0.0:0", [ceph01][DEBUG ] "nonce": 2, [ceph01][DEBUG ] "type": "v1" [ceph01][DEBUG ] } [ceph01][DEBUG ] ] [ceph01][DEBUG ] }, [ceph01][DEBUG ] "rank": 2 [ceph01][DEBUG ] } [ceph01][DEBUG ] ] [ceph01][DEBUG ] }, [ceph01][DEBUG ] "name": "ceph01", [ceph01][DEBUG ] "outside_quorum": [ [ceph01][DEBUG ] "ceph01" [ceph01][DEBUG ] ], [ceph01][DEBUG ] "quorum": [], [ceph01][DEBUG ] "rank": 0, [ceph01][DEBUG ] "state": "probing", [ceph01][DEBUG ] "sync_provider": [] [ceph01][DEBUG ] } [ceph01][DEBUG ] ******************************************************************************** [ceph01][INFO ] monitor: mon.ceph01 is running [ceph01][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph01.asok mon_status [ceph_deploy.mon][DEBUG ] detecting platform for host ceph02 ... [ceph02][DEBUG ] connected to host: ceph02 [ceph02][DEBUG ] detect platform information from remote host [ceph02][DEBUG ] detect machine type [ceph02][DEBUG ] find the location of an executable [ceph_deploy.mon][INFO ] distro info: CentOS Linux 7.9.2009 Core [ceph02][DEBUG ] determining if provided host has same hostname in remote [ceph02][DEBUG ] get remote short hostname [ceph02][DEBUG ] deploying mon to ceph02 [ceph02][DEBUG ] get remote short hostname [ceph02][DEBUG ] remote hostname: ceph02 [ceph02][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [ceph02][DEBUG ] create the mon path if it does not exist [ceph02][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-ceph02/done [ceph02][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-ceph02/done [ceph02][INFO ] creating keyring file: /var/lib/ceph/tmp/ceph-ceph02.mon.keyring [ceph02][DEBUG ] create the monitor keyring file [ceph02][INFO ] Running command: ceph-mon --cluster ceph --mkfs -i ceph02 --keyring /var/lib/ceph/tmp/ceph-ceph02.mon.keyring --setuser 167 --setgroup 167 [ceph02][INFO ] unlinking keyring file /var/lib/ceph/tmp/ceph-ceph02.mon.keyring [ceph02][DEBUG ] create a done file to avoid re-doing the mon deployment [ceph02][DEBUG ] create the init path if it does not exist [ceph02][INFO ] Running command: systemctl enable ceph.target [ceph02][INFO ] Running command: systemctl enable ceph-mon@ceph02 [ceph02][WARNIN] Created symlink from /etc/systemd/system/ceph-mon.target.wants/ceph-mon@ceph02.service to /usr/lib/systemd/system/ceph-mon@.service. [ceph02][INFO ] Running command: systemctl start ceph-mon@ceph02 [ceph02][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph02.asok mon_status [ceph02][DEBUG ] ******************************************************************************** [ceph02][DEBUG ] status for monitor: mon.ceph02 [ceph02][DEBUG ] { [ceph02][DEBUG ] "election_epoch": 0, [ceph02][DEBUG ] "extra_probe_peers": [ [ceph02][DEBUG ] { [ceph02][DEBUG ] "addrvec": [ [ceph02][DEBUG ] { [ceph02][DEBUG ] "addr": "192.168.61.141:3300", [ceph02][DEBUG ] "nonce": 0, [ceph02][DEBUG ] "type": "v2" [ceph02][DEBUG ] }, [ceph02][DEBUG ] { [ceph02][DEBUG ] "addr": "192.168.61.141:6789", [ceph02][DEBUG ] "nonce": 0, [ceph02][DEBUG ] "type": "v1" [ceph02][DEBUG ] } [ceph02][DEBUG ] ] [ceph02][DEBUG ] }, [ceph02][DEBUG ] { [ceph02][DEBUG ] "addrvec": [ [ceph02][DEBUG ] { [ceph02][DEBUG ] "addr": "192.168.61.143:3300", [ceph02][DEBUG ] "nonce": 0, [ceph02][DEBUG ] "type": "v2" [ceph02][DEBUG ] }, [ceph02][DEBUG ] { [ceph02][DEBUG ] "addr": "192.168.61.143:6789", [ceph02][DEBUG ] "nonce": 0, [ceph02][DEBUG ] "type": "v1" [ceph02][DEBUG ] } [ceph02][DEBUG ] ] [ceph02][DEBUG ] } [ceph02][DEBUG ] ], [ceph02][DEBUG ] "feature_map": { [ceph02][DEBUG ] "mon": [ [ceph02][DEBUG ] { [ceph02][DEBUG ] "features": "0x3ffddff8ffecffff", [ceph02][DEBUG ] "num": 1, [ceph02][DEBUG ] "release": "luminous" [ceph02][DEBUG ] } [ceph02][DEBUG ] ] [ceph02][DEBUG ] }, [ceph02][DEBUG ] "features": { [ceph02][DEBUG ] "quorum_con": "0", [ceph02][DEBUG ] "quorum_mon": [], [ceph02][DEBUG ] "required_con": "0", [ceph02][DEBUG ] "required_mon": [] [ceph02][DEBUG ] }, [ceph02][DEBUG ] "monmap": { [ceph02][DEBUG ] "created": "2023-04-18 16:32:53.936225", [ceph02][DEBUG ] "epoch": 0, [ceph02][DEBUG ] "features": { [ceph02][DEBUG ] "optional": [], [ceph02][DEBUG ] "persistent": [] [ceph02][DEBUG ] }, [ceph02][DEBUG ] "fsid": "09b34112-76a2-40d4-b931-2bb376fc7ce1", [ceph02][DEBUG ] "min_mon_release": 0, [ceph02][DEBUG ] "min_mon_release_name": "unknown", [ceph02][DEBUG ] "modified": "2023-04-18 16:32:53.936225", [ceph02][DEBUG ] "mons": [ [ceph02][DEBUG ] { [ceph02][DEBUG ] "addr": "192.168.61.142:6789/0", [ceph02][DEBUG ] "name": "ceph02", [ceph02][DEBUG ] "public_addr": "192.168.61.142:6789/0", [ceph02][DEBUG ] "public_addrs": { [ceph02][DEBUG ] "addrvec": [ [ceph02][DEBUG ] { [ceph02][DEBUG ] "addr": "192.168.61.142:3300", [ceph02][DEBUG ] "nonce": 0, [ceph02][DEBUG ] "type": "v2" [ceph02][DEBUG ] }, [ceph02][DEBUG ] { [ceph02][DEBUG ] "addr": "192.168.61.142:6789", [ceph02][DEBUG ] "nonce": 0, [ceph02][DEBUG ] "type": "v1" [ceph02][DEBUG ] } [ceph02][DEBUG ] ] [ceph02][DEBUG ] }, [ceph02][DEBUG ] "rank": 0 [ceph02][DEBUG ] }, [ceph02][DEBUG ] { [ceph02][DEBUG ] "addr": "0.0.0.0:0/1", [ceph02][DEBUG ] "name": "ceph01", [ceph02][DEBUG ] "public_addr": "0.0.0.0:0/1", [ceph02][DEBUG ] "public_addrs": { [ceph02][DEBUG ] "addrvec": [ [ceph02][DEBUG ] { [ceph02][DEBUG ] "addr": "0.0.0.0:0", [ceph02][DEBUG ] "nonce": 1, [ceph02][DEBUG ] "type": "v1" [ceph02][DEBUG ] } [ceph02][DEBUG ] ] [ceph02][DEBUG ] }, [ceph02][DEBUG ] "rank": 1 [ceph02][DEBUG ] }, [ceph02][DEBUG ] { [ceph02][DEBUG ] "addr": "0.0.0.0:0/2", [ceph02][DEBUG ] "name": "ceph03", [ceph02][DEBUG ] "public_addr": "0.0.0.0:0/2", [ceph02][DEBUG ] "public_addrs": { [ceph02][DEBUG ] "addrvec": [ [ceph02][DEBUG ] { [ceph02][DEBUG ] "addr": "0.0.0.0:0", [ceph02][DEBUG ] "nonce": 2, [ceph02][DEBUG ] "type": "v1" [ceph02][DEBUG ] } [ceph02][DEBUG ] ] [ceph02][DEBUG ] }, [ceph02][DEBUG ] "rank": 2 [ceph02][DEBUG ] } [ceph02][DEBUG ] ] [ceph02][DEBUG ] }, [ceph02][DEBUG ] "name": "ceph02", [ceph02][DEBUG ] "outside_quorum": [ [ceph02][DEBUG ] "ceph02" [ceph02][DEBUG ] ], [ceph02][DEBUG ] "quorum": [], [ceph02][DEBUG ] "rank": 0, [ceph02][DEBUG ] "state": "probing", [ceph02][DEBUG ] "sync_provider": [] [ceph02][DEBUG ] } [ceph02][DEBUG ] ******************************************************************************** [ceph02][INFO ] monitor: mon.ceph02 is running [ceph02][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph02.asok mon_status [ceph_deploy.mon][DEBUG ] detecting platform for host ceph03 ... [ceph03][DEBUG ] connected to host: ceph03 [ceph03][DEBUG ] detect platform information from remote host [ceph03][DEBUG ] detect machine type [ceph03][DEBUG ] find the location of an executable [ceph_deploy.mon][INFO ] distro info: CentOS Linux 7.9.2009 Core [ceph03][DEBUG ] determining if provided host has same hostname in remote [ceph03][DEBUG ] get remote short hostname [ceph03][DEBUG ] deploying mon to ceph03 [ceph03][DEBUG ] get remote short hostname [ceph03][DEBUG ] remote hostname: ceph03 [ceph03][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [ceph03][DEBUG ] create the mon path if it does not exist [ceph03][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-ceph03/done [ceph03][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-ceph03/done [ceph03][INFO ] creating keyring file: /var/lib/ceph/tmp/ceph-ceph03.mon.keyring [ceph03][DEBUG ] create the monitor keyring file [ceph03][INFO ] Running command: ceph-mon --cluster ceph --mkfs -i ceph03 --keyring /var/lib/ceph/tmp/ceph-ceph03.mon.keyring --setuser 167 --setgroup 167 [ceph03][INFO ] unlinking keyring file /var/lib/ceph/tmp/ceph-ceph03.mon.keyring [ceph03][DEBUG ] create a done file to avoid re-doing the mon deployment [ceph03][DEBUG ] create the init path if it does not exist [ceph03][INFO ] Running command: systemctl enable ceph.target [ceph03][INFO ] Running command: systemctl enable ceph-mon@ceph03 [ceph03][WARNIN] Created symlink from /etc/systemd/system/ceph-mon.target.wants/ceph-mon@ceph03.service to /usr/lib/systemd/system/ceph-mon@.service. [ceph03][INFO ] Running command: systemctl start ceph-mon@ceph03 [ceph03][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph03.asok mon_status [ceph03][DEBUG ] ******************************************************************************** [ceph03][DEBUG ] status for monitor: mon.ceph03 [ceph03][DEBUG ] { [ceph03][DEBUG ] "election_epoch": 1, [ceph03][DEBUG ] "extra_probe_peers": [ [ceph03][DEBUG ] { [ceph03][DEBUG ] "addrvec": [ [ceph03][DEBUG ] { [ceph03][DEBUG ] "addr": "192.168.61.141:3300", [ceph03][DEBUG ] "nonce": 0, [ceph03][DEBUG ] "type": "v2" [ceph03][DEBUG ] }, [ceph03][DEBUG ] { [ceph03][DEBUG ] "addr": "192.168.61.141:6789", [ceph03][DEBUG ] "nonce": 0, [ceph03][DEBUG ] "type": "v1" [ceph03][DEBUG ] } [ceph03][DEBUG ] ] [ceph03][DEBUG ] }, [ceph03][DEBUG ] { [ceph03][DEBUG ] "addrvec": [ [ceph03][DEBUG ] { [ceph03][DEBUG ] "addr": "192.168.61.142:3300", [ceph03][DEBUG ] "nonce": 0, [ceph03][DEBUG ] "type": "v2" [ceph03][DEBUG ] }, [ceph03][DEBUG ] { [ceph03][DEBUG ] "addr": "192.168.61.142:6789", [ceph03][DEBUG ] "nonce": 0, [ceph03][DEBUG ] "type": "v1" [ceph03][DEBUG ] } [ceph03][DEBUG ] ] [ceph03][DEBUG ] } [ceph03][DEBUG ] ], [ceph03][DEBUG ] "feature_map": { [ceph03][DEBUG ] "mon": [ [ceph03][DEBUG ] { [ceph03][DEBUG ] "features": "0x3ffddff8ffecffff", [ceph03][DEBUG ] "num": 1, [ceph03][DEBUG ] "release": "luminous" [ceph03][DEBUG ] } [ceph03][DEBUG ] ] [ceph03][DEBUG ] }, [ceph03][DEBUG ] "features": { [ceph03][DEBUG ] "quorum_con": "0", [ceph03][DEBUG ] "quorum_mon": [], [ceph03][DEBUG ] "required_con": "0", [ceph03][DEBUG ] "required_mon": [] [ceph03][DEBUG ] }, [ceph03][DEBUG ] "monmap": { [ceph03][DEBUG ] "created": "2023-04-18 16:32:58.251320", [ceph03][DEBUG ] "epoch": 0, [ceph03][DEBUG ] "features": { [ceph03][DEBUG ] "optional": [], [ceph03][DEBUG ] "persistent": [] [ceph03][DEBUG ] }, [ceph03][DEBUG ] "fsid": "09b34112-76a2-40d4-b931-2bb376fc7ce1", [ceph03][DEBUG ] "min_mon_release": 0, [ceph03][DEBUG ] "min_mon_release_name": "unknown", [ceph03][DEBUG ] "modified": "2023-04-18 16:32:58.251320", [ceph03][DEBUG ] "mons": [ [ceph03][DEBUG ] { [ceph03][DEBUG ] "addr": "192.168.61.142:6789/0", [ceph03][DEBUG ] "name": "ceph02", [ceph03][DEBUG ] "public_addr": "192.168.61.142:6789/0", [ceph03][DEBUG ] "public_addrs": { [ceph03][DEBUG ] "addrvec": [ [ceph03][DEBUG ] { [ceph03][DEBUG ] "addr": "192.168.61.142:3300", [ceph03][DEBUG ] "nonce": 0, [ceph03][DEBUG ] "type": "v2" [ceph03][DEBUG ] }, [ceph03][DEBUG ] { [ceph03][DEBUG ] "addr": "192.168.61.142:6789", [ceph03][DEBUG ] "nonce": 0, [ceph03][DEBUG ] "type": "v1" [ceph03][DEBUG ] } [ceph03][DEBUG ] ] [ceph03][DEBUG ] }, [ceph03][DEBUG ] "rank": 0 [ceph03][DEBUG ] }, [ceph03][DEBUG ] { [ceph03][DEBUG ] "addr": "192.168.61.143:6789/0", [ceph03][DEBUG ] "name": "ceph03", [ceph03][DEBUG ] "public_addr": "192.168.61.143:6789/0", [ceph03][DEBUG ] "public_addrs": { [ceph03][DEBUG ] "addrvec": [ [ceph03][DEBUG ] { [ceph03][DEBUG ] "addr": "192.168.61.143:3300", [ceph03][DEBUG ] "nonce": 0, [ceph03][DEBUG ] "type": "v2" [ceph03][DEBUG ] }, [ceph03][DEBUG ] { [ceph03][DEBUG ] "addr": "192.168.61.143:6789", [ceph03][DEBUG ] "nonce": 0, [ceph03][DEBUG ] "type": "v1" [ceph03][DEBUG ] } [ceph03][DEBUG ] ] [ceph03][DEBUG ] }, [ceph03][DEBUG ] "rank": 1 [ceph03][DEBUG ] }, [ceph03][DEBUG ] { [ceph03][DEBUG ] "addr": "0.0.0.0:0/1", [ceph03][DEBUG ] "name": "ceph01", [ceph03][DEBUG ] "public_addr": "0.0.0.0:0/1", [ceph03][DEBUG ] "public_addrs": { [ceph03][DEBUG ] "addrvec": [ [ceph03][DEBUG ] { [ceph03][DEBUG ] "addr": "0.0.0.0:0", [ceph03][DEBUG ] "nonce": 1, [ceph03][DEBUG ] "type": "v1" [ceph03][DEBUG ] } [ceph03][DEBUG ] ] [ceph03][DEBUG ] }, [ceph03][DEBUG ] "rank": 2 [ceph03][DEBUG ] } [ceph03][DEBUG ] ] [ceph03][DEBUG ] }, [ceph03][DEBUG ] "name": "ceph03", [ceph03][DEBUG ] "outside_quorum": [], [ceph03][DEBUG ] "quorum": [], [ceph03][DEBUG ] "rank": 1, [ceph03][DEBUG ] "state": "electing", [ceph03][DEBUG ] "sync_provider": [] [ceph03][DEBUG ] } [ceph03][DEBUG ] ******************************************************************************** [ceph03][INFO ] monitor: mon.ceph03 is running [ceph03][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph03.asok mon_status [ceph_deploy.mon][INFO ] processing monitor mon.ceph01 [ceph01][DEBUG ] connected to host: ceph01 [ceph01][DEBUG ] detect platform information from remote host [ceph01][DEBUG ] detect machine type [ceph01][DEBUG ] find the location of an executable [ceph01][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph01.asok mon_status [ceph_deploy.mon][WARNIN] mon.ceph01 monitor is not yet in quorum, tries left: 5 [ceph_deploy.mon][WARNIN] waiting 5 seconds before retrying [ceph01][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph01.asok mon_status [ceph_deploy.mon][WARNIN] mon.ceph01 monitor is not yet in quorum, tries left: 4 [ceph_deploy.mon][WARNIN] waiting 10 seconds before retrying [ceph01][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph01.asok mon_status [ceph_deploy.mon][INFO ] mon.ceph01 monitor has reached quorum! [ceph_deploy.mon][INFO ] processing monitor mon.ceph02 [ceph02][DEBUG ] connected to host: ceph02 [ceph02][DEBUG ] detect platform information from remote host [ceph02][DEBUG ] detect machine type [ceph02][DEBUG ] find the location of an executable [ceph02][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph02.asok mon_status [ceph_deploy.mon][INFO ] mon.ceph02 monitor has reached quorum! [ceph_deploy.mon][INFO ] processing monitor mon.ceph03 [ceph03][DEBUG ] connected to host: ceph03 [ceph03][DEBUG ] detect platform information from remote host [ceph03][DEBUG ] detect machine type [ceph03][DEBUG ] find the location of an executable [ceph03][INFO ] Running command: ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph03.asok mon_status [ceph_deploy.mon][INFO ] mon.ceph03 monitor has reached quorum! [ceph_deploy.mon][INFO ] all initial monitors are running and have formed quorum [ceph_deploy.mon][INFO ] Running gatherkeys... [ceph_deploy.gatherkeys][INFO ] Storing keys in temp directory /tmp/tmpvhYUnj [ceph01][DEBUG ] connected to host: ceph01 [ceph01][DEBUG ] detect platform information from remote host [ceph01][DEBUG ] detect machine type [ceph01][DEBUG ] get remote short hostname [ceph01][DEBUG ] fetch remote file [ceph01][INFO ] Running command: /usr/bin/ceph --connect-timeout=25 --cluster=ceph --admin-daemon=/var/run/ceph/ceph-mon.ceph01.asok mon_status [ceph01][INFO ] Running command: /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-ceph01/keyring auth get client.admin [ceph01][INFO ] Running command: /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-ceph01/keyring auth get client.bootstrap-mds [ceph01][INFO ] Running command: /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-ceph01/keyring auth get client.bootstrap-mgr [ceph01][INFO ] Running command: /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-ceph01/keyring auth get client.bootstrap-osd [ceph01][INFO ] Running command: /usr/bin/ceph --connect-timeout=25 --cluster=ceph --name mon. --keyring=/var/lib/ceph/mon/ceph-ceph01/keyring auth get client.bootstrap-rgw [ceph_deploy.gatherkeys][INFO ] Storing ceph.client.admin.keyring [ceph_deploy.gatherkeys][INFO ] Storing ceph.bootstrap-mds.keyring [ceph_deploy.gatherkeys][INFO ] Storing ceph.bootstrap-mgr.keyring [ceph_deploy.gatherkeys][INFO ] keyring 'ceph.mon.keyring' already exists [ceph_deploy.gatherkeys][INFO ] Storing ceph.bootstrap-osd.keyring [ceph_deploy.gatherkeys][INFO ] Storing ceph.bootstrap-rgw.keyring [ceph_deploy.gatherkeys][INFO ] Destroy temp directory /tmp/tmpvhYUnj [root@ceph01 ceph-cluster]#
将 keyring 同步到各节点，以便其它节点可以执行 ceph 集群管理命令（在 ceph01 上执行）
[root@ceph01 ceph-cluster]# ceph-deploy --overwrite-conf admin ceph01 ceph02 ceph03 [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (2.0.1): /usr/bin/ceph-deploy --overwrite-conf admin ceph01 ceph02 ceph03 [ceph_deploy.cli][INFO ] ceph-deploy options: [ceph_deploy.cli][INFO ] username : None [ceph_deploy.cli][INFO ] verbose : False [ceph_deploy.cli][INFO ] overwrite_conf : True [ceph_deploy.cli][INFO ] quiet : False [ceph_deploy.cli][INFO ] cd_conf : <ceph_deploy.conf.cephdeploy.Conf instance at 0x7f04dbbe1290> [ceph_deploy.cli][INFO ] cluster : ceph [ceph_deploy.cli][INFO ] client : ['ceph01', 'ceph02', 'ceph03'] [ceph_deploy.cli][INFO ] func : <function admin at 0x7f04dc483230> [ceph_deploy.cli][INFO ] ceph_conf : None [ceph_deploy.cli][INFO ] default_release : False [ceph_deploy.admin][DEBUG ] Pushing admin keys and conf to ceph01 [ceph01][DEBUG ] connected to host: ceph01 [ceph01][DEBUG ] detect platform information from remote host [ceph01][DEBUG ] detect machine type [ceph01][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [ceph_deploy.admin][DEBUG ] Pushing admin keys and conf to ceph02 [ceph02][DEBUG ] connected to host: ceph02 [ceph02][DEBUG ] detect platform information from remote host [ceph02][DEBUG ] detect machine type [ceph02][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [ceph_deploy.admin][DEBUG ] Pushing admin keys and conf to ceph03 [ceph03][DEBUG ] connected to host: ceph03 [ceph03][DEBUG ] detect platform information from remote host [ceph03][DEBUG ] detect machine type [ceph03][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [root@ceph01 ceph-cluster]#
验证
[root@ceph01 ceph-cluster]# ceph -s cluster: id: 8dd1d22b-6a47-44f2-909f-0390b46d4b05 health: HEALTH_OK services: mon: 3 daemons, quorum ceph01,ceph02,ceph03 (age 32m) mgr: no daemons active osd: 0 osds: 0 up, 0 in data: pools: 0 pools, 0 pgs objects: 0 objects, 0 B usage: 0 B used, 0 B / 0 B avail pgs:
/*
说明：如果提示：clock skew detected on mon.xxxx，则需要修改配置
mon_clock_drift_allowed = 1.0
/
2.6 初始化配置 mgr
在 ceph01 节点上执行
[root@ceph01 ceph-cluster]# cd /etc/ceph-cluster
[root@ceph01 ceph-cluster]# ceph-deploy --overwrite-conf admin ceph01 ceph02 ceph03 [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (2.0.1): /usr/bin/ceph-deploy --overwrite-conf admin ceph01 ceph02 ceph03 [ceph_deploy.cli][INFO ] ceph-deploy options: [ceph_deploy.cli][INFO ] username : None [ceph_deploy.cli][INFO ] verbose : False [ceph_deploy.cli][INFO ] overwrite_conf : True [ceph_deploy.cli][INFO ] quiet : False [ceph_deploy.cli][INFO ] cd_conf : <ceph_deploy.conf.cephdeploy.Conf instance at 0x7eff08352248> [ceph_deploy.cli][INFO ] cluster : ceph [ceph_deploy.cli][INFO ] client : ['ceph01', 'ceph02', 'ceph03'] [ceph_deploy.cli][INFO ] func : <function admin at 0x7eff08bf4230> [ceph_deploy.cli][INFO ] ceph_conf : None [ceph_deploy.cli][INFO ] default_release : False [ceph_deploy.admin][DEBUG ] Pushing admin keys and conf to ceph01 [ceph01][DEBUG ] connected to host: ceph01 [ceph01][DEBUG ] detect platform information from remote host [ceph01][DEBUG ] detect machine type [ceph01][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [ceph_deploy.admin][DEBUG ] Pushing admin keys and conf to ceph02 [ceph02][DEBUG ] connected to host: ceph02 [ceph02][DEBUG ] detect platform information from remote host [ceph02][DEBUG ] detect machine type [ceph02][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [ceph_deploy.admin][DEBUG ] Pushing admin keys and conf to ceph03 [ceph03][DEBUG ] connected to host: ceph03 [ceph03][DEBUG ] detect platform information from remote host [ceph03][DEBUG ] detect machine type [ceph03][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [root@ceph01 ceph-cluster]# ceph-deploy mgr create ceph01 ceph02 ceph03 [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (2.0.1): /usr/bin/ceph-deploy mgr create ceph01 ceph02 ceph03 [ceph_deploy.cli][INFO ] ceph-deploy options: [ceph_deploy.cli][INFO ] username : None [ceph_deploy.cli][INFO ] verbose : False [ceph_deploy.cli][INFO ] mgr : [('ceph01', 'ceph01'), ('ceph02', 'ceph02'), ('ceph03', 'ceph03')] [ceph_deploy.cli][INFO ] overwrite_conf : False [ceph_deploy.cli][INFO ] subcommand : create [ceph_deploy.cli][INFO ] quiet : False [ceph_deploy.cli][INFO ] cd_conf : <ceph_deploy.conf.cephdeploy.Conf instance at 0x7f190d6c95a8> [ceph_deploy.cli][INFO ] cluster : ceph [ceph_deploy.cli][INFO ] func : <function mgr at 0x7f190d68d140> [ceph_deploy.cli][INFO ] ceph_conf : None [ceph_deploy.cli][INFO ] default_release : False [ceph_deploy.mgr][DEBUG ] Deploying mgr, cluster ceph hosts ceph01:ceph01 ceph02:ceph02 ceph03:ceph03 [ceph01][DEBUG ] connected to host: ceph01 [ceph01][DEBUG ] detect platform information from remote host [ceph01][DEBUG ] detect machine type [ceph_deploy.mgr][INFO ] Distro info: CentOS Linux 7.9.2009 Core [ceph_deploy.mgr][DEBUG ] remote host will use systemd [ceph_deploy.mgr][DEBUG ] deploying mgr bootstrap to ceph01 [ceph01][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [ceph01][DEBUG ] create path recursively if it doesn't exist [ceph01][INFO ] Running command: ceph --cluster ceph --name client.bootstrap-mgr --keyring /var/lib/ceph/bootstrap-mgr/ceph.keyring auth get-or-create mgr.ceph01 mon allow profile mgr osd allow * mds allow * -o /var/lib/ceph/mgr/ceph-ceph01/keyring [ceph01][INFO ] Running command: systemctl enable ceph-mgr@ceph01 [ceph01][INFO ] Running command: systemctl start ceph-mgr@ceph01 [ceph01][INFO ] Running command: systemctl enable ceph.target [ceph02][DEBUG ] connected to host: ceph02 [ceph02][DEBUG ] detect platform information from remote host [ceph02][DEBUG ] detect machine type [ceph_deploy.mgr][INFO ] Distro info: CentOS Linux 7.9.2009 Core [ceph_deploy.mgr][DEBUG ] remote host will use systemd [ceph_deploy.mgr][DEBUG ] deploying mgr bootstrap to ceph02 [ceph02][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [ceph02][WARNIN] mgr keyring does not exist yet, creating one [ceph02][DEBUG ] create a keyring file [ceph02][DEBUG ] create path recursively if it doesn't exist [ceph02][INFO ] Running command: ceph --cluster ceph --name client.bootstrap-mgr --keyring /var/lib/ceph/bootstrap-mgr/ceph.keyring auth get-or-create mgr.ceph02 mon allow profile mgr osd allow * mds allow * -o /var/lib/ceph/mgr/ceph-ceph02/keyring [ceph02][INFO ] Running command: systemctl enable ceph-mgr@ceph02 [ceph02][WARNIN] Created symlink from /etc/systemd/system/ceph-mgr.target.wants/ceph-mgr@ceph02.service to /usr/lib/systemd/system/ceph-mgr@.service. [ceph02][INFO ] Running command: systemctl start ceph-mgr@ceph02 [ceph02][INFO ] Running command: systemctl enable ceph.target [ceph03][DEBUG ] connected to host: ceph03 [ceph03][DEBUG ] detect platform information from remote host [ceph03][DEBUG ] detect machine type [ceph_deploy.mgr][INFO ] Distro info: CentOS Linux 7.9.2009 Core [ceph_deploy.mgr][DEBUG ] remote host will use systemd [ceph_deploy.mgr][DEBUG ] deploying mgr bootstrap to ceph03 [ceph03][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [ceph03][WARNIN] mgr keyring does not exist yet, creating one [ceph03][DEBUG ] create a keyring file [ceph03][DEBUG ] create path recursively if it doesn't exist [ceph03][INFO ] Running command: ceph --cluster ceph --name client.bootstrap-mgr --keyring /var/lib/ceph/bootstrap-mgr/ceph.keyring auth get-or-create mgr.ceph03 mon allow profile mgr osd allow * mds allow * -o /var/lib/ceph/mgr/ceph-ceph03/keyring [ceph03][INFO ] Running command: systemctl enable ceph-mgr@ceph03 [ceph03][WARNIN] Created symlink from /etc/systemd/system/ceph-mgr.target.wants/ceph-mgr@ceph03.service to /usr/lib/systemd/system/ceph-mgr@.service. [ceph03][INFO ] Running command: systemctl start ceph-mgr@ceph03 [ceph03][INFO ] Running command: systemctl enable ceph.target
ceph-mgr 进程是主备模式，同一时刻只有一个节点工作，其他节点处于 standby
验证 MGR 是否部署成功
[root@ceph01 ceph-cluster]# ceph -s cluster: id: 8dd1d22b-6a47-44f2-909f-0390b46d4b05 health: HEALTH_WARN OSD count 0 < osd_pool_default_size 3 services: mon: 3 daemons, quorum ceph01,ceph02,ceph03 (age 34m) mgr: ceph01(active, since 28s), standbys: ceph02, ceph03 osd: 0 osds: 0 up, 0 in data: pools: 0 pools, 0 pgs objects: 0 objects, 0 B usage: 0 B used, 0 B / 0 B avail pgs:
2.7 初始化配置 osd
划分用于 OSD 的日志分区和元数据分区，此处实验环境，故设置较小，按照规划每个节点有 3 个 OSD。
只需要在 ceph01 节点上完成如下命令执行即可
lvcreate -L 5G -n lvwal01 myvg
lvcreate -L 20G -n lvbdb01 myvg
lvcreate -L 5G -n lvwal02 myvg
lvcreate -L 20G -n lvbdb02 myvg
lvcreate -L 5G -n lvwal03 myvg
lvcreate -L 20G -n lvbdb03 myvg
ceph-deploy osd create ceph01 --data /dev/sdb --block-wal myvg/lvwal01 --block-db myvg/lvbdb01 --bluestore
ceph-deploy osd create ceph01 --data /dev/sdc --block-wal myvg/lvwal02 --block-db myvg/lvbdb02 --bluestore
ceph-deploy osd create ceph01 --data /dev/sdd --block-wal myvg/lvwal03 --block-db myvg/lvbdb03 --bluestore
#再次查看集群状态 health: HEALTH_OK
[root@ceph01 ceph-cluster]# ceph -s cluster: id: 09b34112-76a2-40d4-b931-2bb376fc7ce1 health: HEALTH_OK services: mon: 3 daemons, quorum ceph01,ceph02,ceph03 (age 50m) mgr: ceph01(active, since 13m), standbys: ceph03, ceph02 osd: 3 osds: 3 up (since 38m), 3 in (since 38m) data: pools: 0 pools, 0 pgs objects: 0 objects, 0 B usage: 63 GiB used, 297 GiB / 360 GiB avail pgs: [root@ceph01 ceph-cluster]#
#有报错。忽略 跳过待中横线的 待验证
ceph-deploy osd create ceph02 --data /dev/sdb --block-wal myvg/lvwal01 --block-db myvg/lvbdb01 --bluestore
ceph-deploy osd create ceph02 --data /dev/sdc --block-wal myvg/lvwal02 --block-db myvg/lvbdb02 --bluestore
ceph-deploy osd create ceph02 --data /dev/sdd --block-wal myvg/lvwal03 --block-db myvg/lvbdb03 --bluestore
#有报错。忽略
ceph-deploy osd create ceph03 --data /dev/sdc --block-wal myvg/lvwal02 --block-db myvg/lvbdb02 --bluestore
ceph-deploy osd create ceph03 --data /dev/sdb --block-wal myvg/lvwal01 --block-db myvg/lvbdb01 --bluestore
ceph-deploy osd create ceph03 --data /dev/sdd --block-wal myvg/lvwal03 --block-db myvg/lvbdb03 --bluestore
/*
生产环境 Wal 和 db 分区大小建议
按 4TB 一个 OSD，1TB 需要 40GB 的空间存放 DB，4TB 需要大于 160GB 的 SSD 存放 DB
SSD 空间足够时，单个 WAL 分区分 60GB、单个 DB 分区分 180GB。
如果 SSD 空间不够时，WAL 分区分 40GB、单个 DB 分区分 60GB
https://access.redhat.com/documentation/en-us/red_hat_ceph_storage/4/html/administration_guide/osd-bluestore
*/
2.8 初始化 osd 异常处理
初始化 osd 失败时，按照删除 osd 逻辑进行处理（初始化异常时，仅需要从执行 g-h 两步）
a、先确认好要删除的 osd，比如此处要删除 osd.0来 bilibili 关注：itcooking
7
[root@ceph01 ceph-cluster]# ceph osd tree
ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF
-1 0 root default
-3 0 host ceph01
0 0 osd.0 down 0 1.00000
b、将 osd.0 踢出集群
[root@ceph01 ceph-cluster]# ceph osd out 0
c、待集群重新平衡后，停止对应的 osd 进程，需要在目标 osd 主机上执行
# systemctl stop ceph-osd@0
d、从 crush 中移除，然后再用 ceph osd tree 查看，会发现 osd.0 不在 osd tree 中了
[root@ceph01 ceph-cluster]# ceph osd crush remove osd.0
[root@ceph01 ceph-cluster]# ceph osd tree
e、删除节点以及节点认证信息
# ceph osd rm osd.0
# ceph auth del osd.0
f、此时删除成功但是原来的数据和日志目录还在，也就是说数据还在
# lsblk
# 删除对应分区(如果是 lvm，需要 lvremove 命令删除 vg)
需要将 lvm 状态改为 inactive
# lvchange -an /dev/ceph-a4a91457-db04-4afc-a938-b195a0c4a0c7/osd-block-8c82a7e1-5205-4472-a0f1-77f0d44485e0
使用 lvremove 移除对应 lv
# lvremove /dev/ceph-a4a91457-db04-4afc-a938-b195a0c4a0c7/osd-block-8c82a7e1-5205-4472-a0f1-77f0d44485e0
g、清除磁盘分区信息
# ceph-deploy disk zap ceph01 /dev/sdc
h、重新初始化 osd
# ceph-deploy osd create ceph01 --data /dev/sdc --block-wal vg00/lvwal02 --block-db vg00/lvbdb02 --bluestore
Ceph Dashboard介绍
Ceph 的监控可视化界面方案很多----grafana、Kraken。但是从Luminous开始，Ceph 提供了原生的Dashboard功能，通过Dashboard可以获取Ceph集群的各种基本状态信息。
mimic版 (nautilus版) dashboard 安装。如果是 (nautilus版) 需要安装 ceph-mgr-dashboard
配置Ceph Dashboard
1、在每个mgr节点安装
2、开启mgr功能
3、生成并安装自签名的证书
4、创建一个dashboard登录用户名密码
5、查看服务访问方式
提醒：目前 mgr 功能模块可能还存在选举问题，如果多mgr 节点都开启，可能会出现web页面取不到数据，建议只开启一个mgr节点服务，然后关闭其他节点mgr服务。
Ceph 的监控可视化界面方案很多----grafana、Kraken。但是从Luminous开始，Ceph 提供了原生的Dashboard功能，通过Dashboard可以获取Ceph集群的各种基本状态信息。
mimic版 (nautilus版) dashboard 安装。如果是 (nautilus版) 需要安装 ceph-mgr-dashboard
配置Ceph Dashboard
1、在每个mgr节点安装
[root@ceph01 ceph-cluster]# yum -y install ceph-mgr-dashboard 已加载插件：fastestmirror Loading mirror speeds from cached hostfile * base: mirrors.aliyun.com * extras: mirrors.aliyun.com * updates: mirrors.aliyun.com base | 3.6 kB 00:00:00 ceph | 1.5 kB 00:00:00 ceph-noarch | 1.5 kB 00:00:00 ceph-source | 1.5 kB 00:00:00 epel | 4.7 kB 00:00:00 extras | 2.9 kB 00:00:00 updates | 2.9 kB 00:00:00 (1/10): ceph-noarch/primary | 18 kB 00:00:00 (2/10): ceph-source/primary | 6.2 kB 00:00:00 (3/10): base/7/x86_64/group_gz | 153 kB 00:00:00 (4/10): ceph/primary | 137 kB 00:00:00 (5/10): epel/x86_64/group_gz | 99 kB 00:00:00 (6/10): extras/7/x86_64/primary_db | 249 kB 00:00:00 (7/10): epel/x86_64/updateinfo | 1.0 MB 00:00:00 (8/10): base/7/x86_64/primary_db | 6.1 MB 00:00:04 (9/10): epel/x86_64/primary_db | 7.0 MB 00:00:05 (10/10): updates/7/x86_64/primary_db | 20 MB 00:00:14 ceph 1050/1050 ceph-noarch 184/184 ceph-source 42/42 正在解决依赖关系 --> 正在检查事务 ---> 软件包 ceph-mgr-dashboard.noarch.2.14.2.22-0.el7 将被 安装 --> 正在处理依赖关系 ceph-grafana-dashboards = 2:14.2.22-0.el7，它被软件包 2:ceph-mgr-dashboard-14.2.22-0.el7.noarch 需要 --> 正在处理依赖关系 python-jwt，它被软件包 2:ceph-mgr-dashboard-14.2.22-0.el7.noarch 需要 --> 正在处理依赖关系 python-routes，它被软件包 2:ceph-mgr-dashboard-14.2.22-0.el7.noarch 需要 --> 正在检查事务 ---> 软件包 ceph-grafana-dashboards.noarch.2.14.2.22-0.el7 将被 安装 ---> 软件包 python-jwt.noarch.0.1.5.3-1.el7 将被 安装 --> 正在处理依赖关系 python-cryptography，它被软件包 python-jwt-1.5.3-1.el7.noarch 需要 ---> 软件包 python-routes.noarch.0.1.13-2.el7 将被 安装 --> 正在处理依赖关系 python-repoze-lru，它被软件包 python-routes-1.13-2.el7.noarch 需要 --> 正在检查事务 ---> 软件包 python-repoze-lru.noarch.0.0.4-3.el7 将被 安装 ---> 软件包 python2-cryptography.x86_64.0.1.7.2-2.el7 将被 安装 --> 正在处理依赖关系 python-pyasn1 >= 0.1.8，它被软件包 python2-cryptography-1.7.2-2.el7.x86_64 需要 --> 正在处理依赖关系 python-idna >= 2.0，它被软件包 python2-cryptography-1.7.2-2.el7.x86_64 需要 --> 正在检查事务 ---> 软件包 python-idna.noarch.0.2.4-1.el7 将被 安装 ---> 软件包 python2-pyasn1.noarch.0.0.1.9-7.el7 将被 安装 --> 解决依赖关系完成 依赖关系解决 ============================================================================================================================== Package 架构 版本 源 大小 ============================================================================================================================== 正在安装: ceph-mgr-dashboard noarch 2:14.2.22-0.el7 ceph-noarch 4.0 M 为依赖而安装: ceph-grafana-dashboards noarch 2:14.2.22-0.el7 ceph-noarch 21 k python-idna noarch 2.4-1.el7 base 94 k python-jwt noarch 1.5.3-1.el7 base 36 k python-repoze-lru noarch 0.4-3.el7 epel 13 k python-routes noarch 1.13-2.el7 epel 640 k python2-cryptography x86_64 1.7.2-2.el7 base 502 k python2-pyasn1 noarch 0.1.9-7.el7 base 100 k 事务概要 ============================================================================================================================== 安装 1 软件包 (+7 依赖软件包) 总下载量：5.3 M 安装大小：23 M Downloading packages: (1/8): ceph-grafana-dashboards-14.2.22-0.el7.noarch.rpm | 21 kB 00:00:00 (2/8): python-idna-2.4-1.el7.noarch.rpm | 94 kB 00:00:00 (3/8): python-jwt-1.5.3-1.el7.noarch.rpm | 36 kB 00:00:00 (4/8): python-repoze-lru-0.4-3.el7.noarch.rpm | 13 kB 00:00:00 (5/8): python2-pyasn1-0.1.9-7.el7.noarch.rpm | 100 kB 00:00:00 (6/8): python-routes-1.13-2.el7.noarch.rpm | 640 kB 00:00:00 (7/8): python2-cryptography-1.7.2-2.el7.x86_64.rpm | 502 kB 00:00:00 (8/8): ceph-mgr-dashboard-14.2.22-0.el7.noarch.rpm | 4.0 MB 00:00:02 ------------------------------------------------------------------------------------------------------------------------------ 总计 2.6 MB/s | 5.3 MB 00:00:02 Running transaction check Running transaction test Transaction test succeeded Running transaction 正在安装 : 2:ceph-grafana-dashboards-14.2.22-0.el7.noarch 1/8 正在安装 : python2-pyasn1-0.1.9-7.el7.noarch 2/8 正在安装 : python-repoze-lru-0.4-3.el7.noarch 3/8 正在安装 : python-routes-1.13-2.el7.noarch 4/8 正在安装 : python-idna-2.4-1.el7.noarch 5/8 正在安装 : python2-cryptography-1.7.2-2.el7.x86_64 6/8 正在安装 : python-jwt-1.5.3-1.el7.noarch 7/8 正在安装 : 2:ceph-mgr-dashboard-14.2.22-0.el7.noarch 8/8 验证中 : python-idna-2.4-1.el7.noarch 1/8 验证中 : python2-cryptography-1.7.2-2.el7.x86_64 2/8 验证中 : python-jwt-1.5.3-1.el7.noarch 3/8 验证中 : python-repoze-lru-0.4-3.el7.noarch 4/8 验证中 : 2:ceph-mgr-dashboard-14.2.22-0.el7.noarch 5/8 验证中 : python2-pyasn1-0.1.9-7.el7.noarch 6/8 验证中 : 2:ceph-grafana-dashboards-14.2.22-0.el7.noarch 7/8 验证中 : python-routes-1.13-2.el7.noarch 8/8 已安装: ceph-mgr-dashboard.noarch 2:14.2.22-0.el7 作为依赖被安装: ceph-grafana-dashboards.noarch 2:14.2.22-0.el7 python-idna.noarch 0:2.4-1.el7 python-jwt.noarch 0:1.5.3-1.el7 python-repoze-lru.noarch 0:0.4-3.el7 python-routes.noarch 0:1.13-2.el7 python2-cryptography.x86_64 0:1.7.2-2.el7 python2-pyasn1.noarch 0:0.1.9-7.el7 完毕！
[root@ceph01 ceph-cluster]# ceph mgr module enable dashboard module 'dashboard' is already enabled
[root@ceph01 ceph-cluster]# ceph dashboard create-self-signed-cert
Self-signed certificate created
[root@ceph01 ceph-cluster]# echo password > dashboard-passwd [root@ceph01 ceph-cluster]# ceph dashboard set-login-credentials admin -i dashboard-passwd ****************************************************************** *** WARNING: this command is deprecated. *** *** Please use the ac-user-* related commands to manage users. *** ****************************************************************** Username and password updated
[root@ceph01 ceph-cluster]# ceph mgr services { "dashboard": "https://ceph01:8443/" }
到此ceph集群基本就安装完成了，希望对你有帮助
#报错查看 待验证
[root@cephnode01 ~]# ceph -s
cluster:
id: 24b31689-d39b-4a1a-97a5-20c8b81607f3
health: HEALTH_ERR
Module 'dashboard' has failed: IOError("Port 8443 not free on 'cephnode03'",)
#这行为报错信息
services:
mon: 3 daemons, quorum cephnode01,cephnode02,cephnode03 (age 2m)
mgr: cephnode01(active, since 29s), standbys: cephnode03, cephnode02
mds: 3 up:standby
osd: 9 osds: 9 up (since 2m), 9 in (since 7d)
rgw: 1 daemon active (cephnode01)
data:
pools: 8 pools, 640 pgs
objects: 1.53k objects, 9.9 GiB
usage: 39 GiB used, 561 GiB / 600 GiB avail
pgs: 640 active+clean
#报错意思是cephnode03节点上的8443端口被占用导致dashboard模块失败 查看配置
[root@cephnode01 ~]# ceph config dump
WHO MASK LEVEL OPTION VALUE RO
mgr advanced mgr/dashboard/server_addr 10.0.0.108 *
mgr advanced mgr/dashboard/server_port 7000 *
[root@cephnode01 ~]# ceph mgr services
{
"dashboard": "https://cephnode03:8443/"
}
#注意ceph -s显示当前活跃的mgr是cephnode01
#尝试把dashboard修改到cephnode01节点上
ceph config set mgr mgr/dashboard/server_addr ceph01
ceph mgr module disable dashboard
ceph mgr module enable dashboard --force
#查看现在的状态，集群恢复正常
[root@cephnode01 ~]# ceph config dump
WHO MASK LEVEL OPTION VALUE RO
mgr advanced mgr/dashboard/server_addr cephnode01 *
mgr advanced mgr/dashboard/server_port 7000 *
[root@cephnode01 ~]# ceph mgr services
{
"dashboard": "https://cephnode01:8443/"
}
[root@cephnode01 ~]# ceph -s
cluster:
id: 24b31689-d39b-4a1a-97a5-20c8b81607f3
health: HEALTH_OK
services:
mon: 3 daemons, quorum cephnode01,cephnode02,cephnode03 (age 72m)
mgr: cephnode01(active, since 69m), standbys: cephnode02, cephnode03
mds: 3 up:standby
osd: 9 osds: 9 up (since 72m), 9 in (since 7d)
rgw: 1 daemon active (cephnode01)
data:
pools: 8 pools, 640 pgs
objects: 1.65k objects, 10 GiB
usage: 40 GiB used, 560 GiB / 600 GiB avail
pgs: 640 active+clean
修改默认配置命令
#指定集群dashboard的访问端口
ceph config-key set mgr/dashboard/server_port 7000
#指定集群 dashboard的访问IP
ceph config-key set mgr/dashboard/server_addr $IP
开启Object Gateway管理功能
有坑未解决
#1、创建rgw用户
radosgw-admin user create --uid=user01 --display-name=user01
radosgw-admin user info --uid=user01
"user": "user01",
"access_key": "QJ5763QEN0B26I7RA0PM",
"secret_key": "NmWIxRrht8n6il9qUMT53m2RDYfXfZibdD2tUKJw"
#2、提供Dashboard证书
ceph dashboard set-rgw-api-access-key QJ5763QEN0B26I7RA0PM
ceph dashboard set-rgw-api-secret-key NmWIxRrht8n6il9qUMT53m2RDYfXfZibdD2tUKJw
#3、配置rgw主机名和端口
ceph dashboard set-rgw-api-host 192.168.0.6
ceph dashboard set-rgw-api-port 7480
4、刷新web页面
