Solaris 11中配置基于link的IPMP
http://blog.itpub.net/29960937/viewspace-1347901/
Tips: Record and feedback errors you have encountered.
Welcome to umap from10.204.205.253,杩炴帴鍫″瀿鎴愬姛!
Trying 10.204.197.128 ...
Last login: Tue May 14 10:30:13 2019 from 10.204.205.5
Authorized users only. All activity may be monitored and reported Aug 2018
You have new mail.
-bash-4.4$
-bash-4.4$ uname
SunOS
-bash-4.4$ su -
Password:
Authorized users only. All activity may be monitored and reported Aug 2018
You have new mail.
root@lnltedmr-tds:~# ipmpstat
usage: ipmpstat [-n] [-o <field> [-P]] -a|-g|-i|-p|-t
output modes: -a display IPMP data address information
-g display IPMP group information
-i display IPMP-related IP interface information
-p display IPMP probe information
-t display IPMP target information
options: -n display IP addresses numerically
-o display only the specified fields, in order
-P display using parsable output mode
root@lnltedmr-tds:~# ipmpstat -p
ipmpstat: probe-based failure detection is disabled
root@lnltedmr-tds:~# Linu
root@lnltedmr-tds:~#
root@lnltedmr-tds:~#
root@lnltedmr-tds:~# netadm enable -p ncp DefaultFixed
-p: illegal option -- p
usage: enable <enm-name>
Enable the specified ENM.
root@lnltedmr-tds:~# netadm list
root@lnltedmr-tds:~# netadm list
root@lnltedmr-tds:~# ipmpstat -p
ipmpstat: probe-based failure detection is disabled
root@lnltedmr-tds:~# ipmpstat -g
root@lnltedmr-tds:~# ipadm create-ipmp ipmp1
root@lnltedmr-tds:~# ipmpstat -g
GROUP GROUPNAME STATE FDT INTERFACES
ipmp1 ipmp1 failed -- --
root@lnltedmr-tds:~# ipadm create-ip net2
root@lnltedmr-tds:~# ipmpstat -g
GROUP GROUPNAME STATE FDT INTERFACES
ipmp1 ipmp1 failed -- --
root@lnltedmr-tds:~# ipadm add-ipmp -i net2 ipmp1
root@lnltedmr-tds:~# ipmpstat -g
GROUP GROUPNAME STATE FDT INTERFACES
ipmp1 ipmp1 failed -- [net2]
root@lnltedmr-tds:~# ifconfig -a
lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232 index 1
inet 127.0.0.1 netmask ff000000
net0: flags=100001000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,PHYSRUNNING> mtu 1500 index 3
inet 10.204.197.128 netmask ffffff00 broadcast 10.204.197.255
ether 0:10:e0:3d:24:88
net2: flags=11000803<UP,BROADCAST,MULTICAST,IPv4,FAILED> mtu 1500 index 6
inet 0.0.0.0 netmask ff000000
groupname ipmp1
ether 0:10:e0:3d:24:8a
sp-phys0: flags=100001000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,PHYSRUNNING> mtu 1500 index 4
inet 169.254.182.77 netmask ffffff00 broadcast 169.254.182.255
ether 2:21:28:57:47:17
ipmp1: flags=8011000802<BROADCAST,MULTICAST,IPv4,FAILED,IPMP> mtu 1500 index 5
inet 0.0.0.0 netmask 0
groupname ipmp1
lo0: flags=2002000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv6,VIRTUAL> mtu 8252 index 1
inet6 ::1/128
net0: flags=120002004841<UP,RUNNING,MULTICAST,DHCP,IPv6,PHYSRUNNING> mtu 1500 index 3
inet6 fe80::210:e0ff:fe3d:2488/10
ether 0:10:e0:3d:24:88
net2: flags=20012000801<UP,MULTICAST,IPv6,FAILED> mtu 1500 index 6
inet6 ::/0
groupname ipmp1
ether 0:10:e0:3d:24:8a
sp-phys0: flags=120002000840<RUNNING,MULTICAST,IPv6,PHYSRUNNING> mtu 1500 index 4
inet6 ::/0
ether 2:21:28:57:47:17
ipmp1: flags=28012000800<MULTICAST,IPv6,FAILED,IPMP> mtu 1500 index 5
inet6 ::/0
groupname ipmp1
root@lnltedmr-tds:~# ipmpstat -i
INTERFACE ACTIVE GROUP FLAGS LINK PROBE STATE
net2 no ipmp1 ------- down disabled failed
root@lnltedmr-tds:~#
在远程不好搞。得去机房了。
IPMP(IP Multipathing)是Solaris操作系统中重要特性，它将几个网络接口绑定在一起作为一个IPMP组，做到网络接口的冗余。即使其中的一个网络接口发生故障，IPMP上的业务IP不会丢失，会failover到其他接口上，避免了单点故障。IPMP可用于Oracle的RAC的公用网络或私有网络上。
基于link的IPMP(Link Based IPMP)
在Solaris中mpathd守护进程负责探测网络接口的故障与修复，它所用的参数配置文件为/etc/default/mpathd。IPMP根据mpathd探测网络接口故障的方法不同，可分为基于link的IPMP和基于probe的IPMP。
基于link的IPMP具有以下特点
–mpathd利用网络接口驱动程序进行探测(需要接口硬件支持)
–不需要额外的测试IP地址，节省IP资源
–默认可用(如果接口硬件支持)
在配置IPMP时，有两种模式：Active-Active模式和Active-Standby模式。在Active-Active模式中所有网络接口都要在线处于active状态；在Active-Standby模式中，至少有一个网络接口在线处于active状态，其他网络接口处于standby状态。查看IPMP组中各个网络接口的状态信息可用ipmpstat命令。
# ipmpstat
usage: ipmpstat [-n] [-o [-P]] -a|-g|-i|-p|-t
output modes: -a display IPMP data address information
-g display IPMP group information
-i display IPMP-related IP interface information
-p display IPMP probe information
-t display IPMP target information
options: -n display IP addresses numerically
-o display only the specified fields, in order
-P display using parsable output mode
在Solaris 11上配置Link Based IPMP示例
1. 设置NCP (network configuration profile) 为DefaultFixed.
# netadm enable -p ncp DefaultFixed 查看ncp是否为DefaultFixed. # netadm list TYPE PROFILE STATE ncp DefaultFixed online ncp Automatic disabled loc Automatic offline loc NoNet offline loc DefaultFixed online
2. 设置IPMP的transitive-probing属性为false
#svccfg -s svc:/network/ipmp setprop config/transitive-probing=false
#svcadm refresh svc:/network/ipmp:default
查看transitive-probing属性
# svccfg -s svc:/network/ipmp listprop config/transitive-probing
config/transitive-probing boolean false
# ipmpstat -p
ipmpstat: probe-based failure detection is disabled
3. Active-Active模式 (以4个网络接口为例)
创建IPMP组ipmp1
# ipadm create-ipmp ipmp1
创建网络接口net2, net3, net9和net10
#ipadm create-ip net2
#ipadm create-ip net3
#ipadm create-ip net9
#ipadm create-ip net10
添加网络接口到ipmp1组中
# ipadm add-ipmp -i net2 -i net3 -i net9 -i net10 ipmp1
查看ipmp1信息
# ipmpstat -g
GROUP GROUPNAME STATE FDT INTERFACES
ipmp1 ipmp1 ok -- net10 net9 net3 net2
# ipmpstat -i
INTERFACE ACTIVE GROUP FLAGS LINK PROBE STATE
net10 yes ipmp1 ------- up disabled ok
net9 yes ipmp1 ------- up disabled ok
net3 yes ipmp1 ------- up disabled ok
net2 yes ipmp1 --mbM-- up disabled ok
为ipmp1设置IP地址
# ipadm create-addr -T static -a 192.168.57.142/24 ipmp1/v4
# ipmpstat -a
ADDRESS STATE GROUP INBOUND OUTBOUND
192.168.57.142 up ipmp1 net2 net10 net9 net3 net2
查看ipmp1的IP地址
# ipadm show-addr
ADDROBJ TYPE STATE ADDR
lo0/v4 static ok 127.0.0.1/8
ipmp1/v4 static ok 192.168.57.144/24
4. Active-Standby模式
继续上面的例子，把net9和net10转换为standby
# ipadm set-ifprop -p standby=on -m ip net9
# ipadm set-ifprop -p standby=on -m ip net10
# ipmpstat -i
INTERFACE ACTIVE GROUP FLAGS LINK PROBE STATE
net10 no ipmp1 is----- up disabled ok
net9 no ipmp1 is----- up disabled ok
net3 yes ipmp1 ------- up disabled ok
net2 yes ipmp1 --mbM-- up disabled ok
从ifconfig命令输出中可以看到net9和net10有STANDBY标志，处于inactive状态。
# ifconfig -a inet
ipmp1: flags=108001000843<up,broadcast,running,multicast,ipv4,ipmp,physrunning> mtu 1500 index 9
inet 192.168.57.142 netmask ffffff00 broadcast 192.168.57.255
groupname ipmp1
net2: flags=100001000843<up,broadcast,running,multicast,ipv4,physrunning> mtu 1500 index 10
inet 0.0.0.0 netmask ff000000 broadcast 0.255.255.255
groupname ipmp1
net3: flags=100001000843<up,broadcast,running,multicast,ipv4,physrunning> mtu 1500 index 11
inet 0.0.0.0 netmask ff000000 broadcast 0.255.255.255
groupname ipmp1
net9: flags=100061000843<up,broadcast,running,multicast,ipv4,standby,inactive,physrunning> mtu 1500 index 12
inet 0.0.0.0 netmask ff000000
groupname ipmp1
net10: flags=100061000843<up,broadcast,running,multicast,ipv4,standby,inactive,physrunning> mtu 1500 index 8
inet 0.0.0.0 netmask ff000000
groupname ipmp1
官网原版：
Commonly Used Network Administration Commands
https://docs.oracle.com/cd/E37838_01/html/E61478/index.html
About IPMP Administration
https://docs.oracle.com/cd/E37838_01/html/E60991/gfkcy.html#scrolltoc
Administering IPMP
https://docs.oracle.com/cd/E37838_01/html/E60991/gdysw.html#scrolltoc
How to Configure an Active-Standby IPMP Group
https://docs.oracle.com/cd/E37838_01/html/E60991/gfyeh.html#scrolltoc
Example 15 Configuring an Active-Standby IPMP Group
This example shows how to create an active-standby IPMP configuration.
$ ipadm create-ipmp ipmp0 $ ipadm create-ip net0 $ ipadm create-ip net1 $ ipadm create-ip net2 $ ipadm add-ipmp -i net0 -i net1 -i net2 ipmp0 $ ipadm create-addr -a 192.0.2.5/24 ipmp0 ipadm: ipmp0/v4 $ ipadm create-addr -a 192.0.2.10/24 ipmp0 ipadm: ipmp0/v4a $ ipadm create-addr -a 192.0.2.15/27 net0 ipadm: net0/v4 $ ipadm create-addr -a 192.0.2.20/27 net1 ipadm: net1/v4 $ ipadm create-addr -a 192.0.2.25/27 net2 ipadm: net2/v4 $ ipadm set-ifprop -p standby=on -m ip net2 $ ipmpstat -g GROUP GROUPNAME STATE FDT INTERFACES ipmp0 ipmp0 ok 10.00s net0 net1 (net2) $ ipmpstat -t INTERFACE MODE TESTADDR TARGETS net0 routes 192.0.2.15/27 192.0.2.2/27 net1 routes 192.0.2.20/27 192.0.2.2/17 net2 routes 192.0.2.25/27 192.0.2.5/27
