HP EVA4400多路径的问题
请教:
环境描述:HPC管理接点HP DL360G6 (OS:redhat as 5.4 x64 )HBA:HP A8003A(FC2242SR)
通过两个san交换模块(HP C7000),连接HP EVA 4400.HP EVA4400划分两个lun,系统内发现生成8个/dev/sd[a-h]的鬼盘,安装HPDMmultipath-4.4.0.tar.gz之后,8 个/dev/sd[a-h]的鬼盘依旧存在,多出了/dev/dm-0和/dev/dm-1.针对/dev/dm-0和/dev/dm-1进行分区 (fdisk),生成/dev/dm-0p1和/dev/dm-1p1,再进行格式化(mkfs.ext3)提示/dev/dm-0p1和/dev /dm-1p1不存在,不能格式化.进入/dev发现确实没有/dev/dm-0p1和/dev/dm-1p1.跟800工程师沟通之后说是要用/dev /mapper下的两个文件.安装顺利进行.但我总觉得不对.按照以前应该是鬼盘消失,生成/dev/sda和/dev/sdb两个盘.请高手指教!
昵称: xuzhi_boss 时间: 2010-08-25 16:24:00
在linux下安装HP多路软件步骤（Device Mapper Multipath Enablement Kit for HP StorageWorks Disk Arrays）
各位兄弟，因为本人早就开始接触到HP EVA4400的存储，但是一直都是在windows或者VMware下解决多路径的问题。今天刚好在Redhat Enterprise Linux 5.5解决，顺便也写成文档，免得自己老了，记不了。这里要感谢一下广军，感谢他对我的信任和支持。以下是客户的环境：
服务器：4台HP DL580G7服务器
OS： Redhat Enterprise Linux 5.5
存储： EVA4400
步骤一、确认信息
1、 确认HBA卡驱动是否正常，系统是否能识别到。注意：有部份博科的HBA卡是不能直连的，只能通过光纤交换机才能连接的。可以使用lspci命令查看。（别的牌子没有测试过还不知道）。
2、 确认HBA卡的驱动是否加载到内核里面，可以使用lsmod命令查看。
3、 确保系统已经安装已下的rpm包：
可以使用rpm –qa|grep device* 查看是否安装
For RHEL 4 Update 7:
• device-mapper-1.02.25-2.el4 or later
• device-mapper-multipath-0.4.5-31.el4 or later
• For RHEL 4 Update 8:
• device-mapper-1.02.28-2.el4 or later
• device-mapper-multipath-0.4.5-35.el4 or later
• For RHEL 5 Update 2:
• device-mapper-1.02.24-1.el5 or later
• device-mapper-multipath-0.4.7-17.el5 or later
• For RHEL 5 Update 3:
• device-mapper-1.02.28-2.el5 or later
• device-mapper-multipath-0.4.7-23.el5 or later
• For RHEL 5 Update 4:
• device-mapper-multipath-0.4.7-30.el5 or later
• device-mapper-1.02.32-1.el5 or later
• For RHEL 5 Update 5:
• device-mapper-multipath-0.4.7-34.el5 or later
• device-mapper-1.02.39-1.el5 or later
• For SLES 10 SP2:
• device-mapper-1.02.13-6.14 or later
• device-mapper-devel-1.02.13-6.14 or later
• multipath-tools-0.4.7-34.43 or later
• For SLES 10 SP3:
• device-mapper-1.02.13-6.14 or later
• device-mapper-devel-1.02.13-6.14 or later
• multipath-tools-0.4.7-34.50.10 or later
• For SLES 11:
• device-mapper-1.02.27-8.6 or later
• multipath-tools-0.4.8-40.4.1 or later
步骤二、安装HPDM Multipath Enablement
在HP的官网上有很多版本，可以根据自己需要下载（http://h20000.www2.hp.com/bizsup ... 5&swEnvOID=4004）
下载完成后，进入文件目标，例如：/tmp
# cd /tmp
# tar -zxvf HPDMmultipath-<version>.tar.gz
# cd HPDMmultipath-<version>
# ./INSTALL
这样HPDM Multipath Enablement就安装完成了。
之后再运行（也可以重启）：
# /etc/init.d/multipathd restart
步骤三、配置
1、运行# multipath -ll 查看wwid号，需要记录下来（红色字体为WWID号）。
# multipath -ll
mapper0(3600508b40006ea6e0001a000002a0000) dm-2 HP,HSV210
[size=500G][features=1 queue_if_no_path][hwhandler=0]
\_ round-robin 0 [prio=100][active]
\_ 0:0:2:1 sdc 8:32 [active][ready]
\_ 0:0:3:1 sdd 8:48 [active][ready]
\_ round-robin 0 [prio=20][enabled]
\_ 0:0:0:1 sda 8:0 [active][ready]
\_ 0:0:1:1 sdb 8:16 [active][ready]
2、配置/etc/multipath.conf
运行：vi /etc/multipath.conf
将本机硬盘从多路径中去掉
blacklist {
devnode "^sda"
}
添加多路径映射设备，其中别名alias可以自己起。
multipaths {
multipath {
wwid 3600508b4001013f70001900004230000
alias mapper0
path_grouping_policy multibus
path_checker tur
path_selector "round-robin 0"
}
multipath {
wwid 3600508b4001013f70001900004320000
alias mapper1
path_grouping_policy multibus
path_checker tur
path_selector "round-robin 0"
}
}
3、根据存储的型号选择device
For MSA2012fc/MSA2212fc/MSA2012i
device
{
vendor "HP"
product "MSA2[02]12fc|MSA2012i"
getuid_callout "/sbin/scsi_id -g -u -s /block/%n"
hardware_handler "0"
path_selector "round-robin 0"
path_grouping_policy multibus
failback immediate
rr_weight uniform
no_path_retry 18
rr_min_io 100
path_checker tur
}
For EVA4x00/EVA6x00/EVA8x00
device
{
vendor "HP”
product "HSV2[01]0|HSV300|HSV4[05]0"
getuid_callout "/sbin/scsi_id -g -u -s /block/%n"
prio_callout "/sbin/mpath_prio_alua /dev/%n"
hardware_handler "0"
path_selector "round-robin 0"
path_grouping_policy group_by_prio
failback immediate
rr_weight uniform
no_path_retry 18
rr_min_io 100
path_checker tur
}
For HP P2000 FC / P2000 FC/iSCSI
device
{
vendor
product
path_grouping_policy
getuid_callout
path_checker
path_selector
prio_callout
rr_weight
failback
hardware_handler
no_path_retry
rr_min_io "HP"
"P2000 G3 FC|P2000G3 FC/iSCSI"
group_by_prio
"/sbin/scsi_id -g -u -s /block/%n"
tur
"round-robin 0"
"/sbin/mpath_prio_alua /dev/%n"
uniform
immediate
"0"
18
100
}
For MSA2012sa/MSA2312sa/MSA2324sa
device
{
vendor "HP"
product "MSA2012sa|MSA2312sa|MSA2324sa"
getuid_callout "/sbin/hp_scsi_id -g -u -n -s /block/%n"
prio_callout "/sbin/mpath_prio_alua /dev/%n"
hardware_handler "0"
path_selector "round-robin 0"
path_grouping_policy group_by_prio
failback immediate
rr_weight uniform
no_path_retry 18
rr_min_io 100
path_checker tur
}
For XP
device
{
vendor "HP"
product "OPEN-.*"
getuid_callout "/sbin/scsi_id -g -u -s /block/%n"
hardware_handler "0"
path_selector "round-robin 0"
path_grouping_policy multibus
failback immediate
rr_weight uniform
no_path_retry 18
rr_min_io 1000
path_checker tur
}
For MSA2312fc/MSA2324fc/MSA2312i/MSA2324i
device
{
vendor "HP"
product "MSA2312fc|MSA2324fc|MSA2312i|MSA2324i"
getuid_callout "/sbin/scsi_id -g -u -s /block/%n"
hardware_handler "0"
path_selector "round-robin 0"
prio_callout "/sbin/mpath_prio_alua /dev/%n"
path_grouping_policy group_by_prio
failback immediate
rr_weight uniform
no_path_retry 18
rr_min_io 100
path_checker tur
}
配置完成后，重启服务器或者/etc/init.d/multipathd restart
步骤四：查看结果
# multipath -ll
mapper0 (3600508b4001013f70001900004320000) dm-1 COMPAQ,HSV111 (C)COMPAQ
[size=1.3T][features=1 queue_if_no_path][hwhandler=0]
\_ round-robin 0 [prio=60][active]
\_ 3:0:0:2 sdc 8:32 [active][ready]
\_ 3:0:1:2 sde 8:64 [active][ready]
mapper0(3600508b4001013f70001900004230000) dm-0 COMPAQ,HSV111 (C)COMPAQ
[size=500G][features=1 queue_if_no_path][hwhandler=0]
\_ round-robin 0 [prio=60][active]
\_ 3:0:0:1 sdb 8:16 [active][ready]
\_ 3:0:1:1 sdd 8:48 [active][ready]
说明设备已经配置完毕，可以看到，我们将4个设备聚合成了两个设备，分别是mapper1和mapper0。这两个设备的位置在/dev/mapper 下。之后在使用fdisk /dev/mapper/mapper0 进行分区。分区后记得重启。重启完成后在/dev/mapper/下有生成mapper0p1之类的文件，进行格式化，就可以啦！
多路径软件做路径管理并不一定将底层设备屏蔽，dmmp就是其中一种，emc的powerpath也是这样的 各位兄弟，因为本人早就开始接触到HP EVA4400的存储，但是一直都是在windows或者VMware下解决多路径的问题。今天刚好在Redhat Enterprise Linux 5.5解决，顺便也写成文档，免得自己老了，记不了。这里要感谢一下广军，感谢他对我的信任和支持。以下是客户的环境：
服务器：4台HP DL580G7服务器
OS： Redhat Enterprise Linux 5.5
存储： EVA4400
步骤一、确认信息
1、 确认HBA卡驱动是否正常，系统是否能识别到。注意：有部份博科的HBA卡是不能直连的，只能通过光纤交换机才能连接的。可以使用lspci命令查看。（别的牌子没有测试过还不知道）。
2、 确认HBA卡的驱动是否加载到内核里面，可以使用lsmod命令查看。
3、 确保系统已经安装已下的rpm包：
可以使用rpm –qa|grep device* 查看是否安装
For RHEL 4 Update 7:
• device-mapper-1.02.25-2.el4 or later
• device-mapper-multipath-0.4.5-31.el4 or later
• For RHEL 4 Update 8:
• device-mapper-1.02.28-2.el4 or later
• device-mapper-multipath-0.4.5-35.el4 or later
• For RHEL 5 Update 2:
• device-mapper-1.02.24-1.el5 or later
• device-mapper-multipath-0.4.7-17.el5 or later
• For RHEL 5 Update 3:
• device-mapper-1.02.28-2.el5 or later
• device-mapper-multipath-0.4.7-23.el5 or later
• For RHEL 5 Update 4:
• device-mapper-multipath-0.4.7-30.el5 or later
• device-mapper-1.02.32-1.el5 or later
• For RHEL 5 Update 5:
• device-mapper-multipath-0.4.7-34.el5 or later
• device-mapper-1.02.39-1.el5 or later
• For SLES 10 SP2:
• device-mapper-1.02.13-6.14 or later
• device-mapper-devel-1.02.13-6.14 or later
• multipath-tools-0.4.7-34.43 or later
• For SLES 10 SP3:
• device-mapper-1.02.13-6.14 or later
• device-mapper-devel-1.02.13-6.14 or later
• multipath-tools-0.4.7-34.50.10 or later
• For SLES 11:
• device-mapper-1.02.27-8.6 or later
• multipath-tools-0.4.8-40.4.1 or later
步骤二、安装HPDM Multipath Enablement
在HP的官网上有很多版本，可以根据自己需要下载（http://h20000.www2.hp.com/bizsup ... 5&swEnvOID=4004）
下载完成后，进入文件目标，例如：/tmp
# cd /tmp
# tar -zxvf HPDMmultipath-<version>.tar.gz
# cd HPDMmultipath-<version>
# ./INSTALL
这样HPDM Multipath Enablement就安装完成了。
之后再运行（也可以重启）：
# /etc/init.d/multipathd restart
步骤三、配置
1、运行# multipath -ll 查看wwid号，需要记录下来（红色字体为WWID号）。
# multipath -ll
mapper0(3600508b40006ea6e0001a000002a0000) dm-2 HP,HSV210
[size=500G][features=1 queue_if_no_path][hwhandler=0]
\_ round-robin 0 [prio=100][active]
\_ 0:0:2:1 sdc 8:32 [active][ready]
\_ 0:0:3:1 sdd 8:48 [active][ready]
\_ round-robin 0 [prio=20][enabled]
\_ 0:0:0:1 sda 8:0 [active][ready]
\_ 0:0:1:1 sdb 8:16 [active][ready]
2、配置/etc/multipath.conf
运行：vi /etc/multipath.conf
将本机硬盘从多路径中去掉
blacklist {
devnode "^sda"
}
添加多路径映射设备，其中别名alias可以自己起。
multipaths {
multipath {
wwid 3600508b4001013f70001900004230000
alias mapper0
path_grouping_policy multibus
path_checker tur
path_selector "round-robin 0"
}
multipath {
wwid 3600508b4001013f70001900004320000
alias mapper1
path_grouping_policy multibus
path_checker tur
path_selector "round-robin 0"
}
}
3、根据存储的型号选择device
For MSA2012fc/MSA2212fc/MSA2012i
device
{
vendor "HP"
product "MSA2[02]12fc|MSA2012i"
getuid_callout "/sbin/scsi_id -g -u -s /block/%n"
hardware_handler "0"
path_selector "round-robin 0"
path_grouping_policy multibus
failback immediate
rr_weight uniform
no_path_retry 18
rr_min_io 100
path_checker tur
}
For EVA4x00/EVA6x00/EVA8x00
device
{
vendor "HP”
product "HSV2[01]0|HSV300|HSV4[05]0"
getuid_callout "/sbin/scsi_id -g -u -s /block/%n"
prio_callout "/sbin/mpath_prio_alua /dev/%n"
hardware_handler "0"
path_selector "round-robin 0"
path_grouping_policy group_by_prio
failback immediate
rr_weight uniform
no_path_retry 18
rr_min_io 100
path_checker tur
}
For HP P2000 FC / P2000 FC/iSCSI
device
{
vendor
product
path_grouping_policy
getuid_callout
path_checker
path_selector
prio_callout
rr_weight
failback
hardware_handler
no_path_retry
rr_min_io "HP"
"P2000 G3 FC|P2000G3 FC/iSCSI"
group_by_prio
"/sbin/scsi_id -g -u -s /block/%n"
tur
"round-robin 0"
"/sbin/mpath_prio_alua /dev/%n"
uniform
immediate
"0"
18
100
}
For MSA2012sa/MSA2312sa/MSA2324sa
device
{
vendor "HP"
product "MSA2012sa|MSA2312sa|MSA2324sa"
getuid_callout "/sbin/hp_scsi_id -g -u -n -s /block/%n"
prio_callout "/sbin/mpath_prio_alua /dev/%n"
hardware_handler "0"
path_selector "round-robin 0"
path_grouping_policy group_by_prio
failback immediate
rr_weight uniform
no_path_retry 18
rr_min_io 100
path_checker tur
}
For XP
device
{
vendor "HP"
product "OPEN-.*"
getuid_callout "/sbin/scsi_id -g -u -s /block/%n"
hardware_handler "0"
path_selector "round-robin 0"
path_grouping_policy multibus
failback immediate
rr_weight uniform
no_path_retry 18
rr_min_io 1000
path_checker tur
}
For MSA2312fc/MSA2324fc/MSA2312i/MSA2324i
device
{
vendor "HP"
product "MSA2312fc|MSA2324fc|MSA2312i|MSA2324i"
getuid_callout "/sbin/scsi_id -g -u -s /block/%n"
hardware_handler "0"
path_selector "round-robin 0"
prio_callout "/sbin/mpath_prio_alua /dev/%n"
path_grouping_policy group_by_prio
failback immediate
rr_weight uniform
no_path_retry 18
rr_min_io 100
path_checker tur
}
配置完成后，重启服务器或者/etc/init.d/multipathd restart
步骤四：查看结果
# multipath -ll
mapper0 (3600508b4001013f70001900004320000) dm-1 COMPAQ,HSV111 (C)COMPAQ
[size=1.3T][features=1 queue_if_no_path][hwhandler=0]
\_ round-robin 0 [prio=60][active]
\_ 3:0:0:2 sdc 8:32 [active][ready]
\_ 3:0:1:2 sde 8:64 [active][ready]
mapper0(3600508b4001013f70001900004230000) dm-0 COMPAQ,HSV111 (C)COMPAQ
[size=500G][features=1 queue_if_no_path][hwhandler=0]
\_ round-robin 0 [prio=60][active]
\_ 3:0:0:1 sdb 8:16 [active][ready]
\_ 3:0:1:1 sdd 8:48 [active][ready]
说明设备已经配置完毕，可以看到，我们将4个设备聚合成了两个设备，分别是mapper1和mapper0。这两个设备的位置在/dev/mapper 下。之后在使用fdisk /dev/mapper/mapper0 进行分区。分区后记得重启。重启完成后在/dev/mapper/下有生成mapper0p1之类的文件，进行格式化，就可以啦！
昵称: arachne 时间: 2010-09-01 14:01:00
昵称: newjava 时间: 2010-09-07 17:15:00
multipath -l2 可以查看多路径通道聚合信息散人总结：其实装好了HPDMmultipath-4.4.1.tar.gz之后，基本不需要对/etc/multipath.conf配置，正常情况下就能看到/dev/mapper/下有生成mpath0之类的文件，并通过fdisk /dev/mapper/mpath0进行格式化即可。当然，在multipath中修改alias可以生成人性化的设备名。
