天高地厚

  博客园  :: 首页  :: 新随笔  :: 联系 :: 订阅 订阅  :: 管理

GPFS在Linux下安装过程简述

Posted on 2013-01-30 17:29  天高地厚-GNU  阅读(1528)  评论(0编辑  收藏  举报

1.安装GPFS包

#rpm –ivh *.rpm
(gpfs.base-3.1.0-1.x86_64,gpfs.docs-3.1.0-1.noarch,gpfs.gpl-3.1.0-1.noarch,gpfs.msg.en_US-3.1.0-1.noarch)
2. 安装GPFS升级包

rpm –Uvh *.rpm
(gpfs.base-3.1.0-8.x86_64,gpfs.docs-3.1.0-8.noarch,gpfs.gpl-3.1.0-8.noarch,gpfs.msg.en_US-3.1.0-8.noarch)

3. 编译

#cd /usr/lpp/mmfs/src/config
#cp site.mcr.proto site.mcr
#vi site.mcr
参考 README 修改site.mcr
#cd /usr/lpp/mmfs/src
#export SHARKCLONEROOT=/usr/lpp/mmfs/src
#make Autoconfig
#make InstallImages
#cd /usr/lpp/mmfs/bin

/* Copy bin files to all the other nodes */

4. 系统优化:

mmchconfig pagepool=1000M (4M-1/2内存总量)
mmchconfig maxFilesToCache =1700(default,1-100000)
maxStatCache (4 × maxFilesToCache )
Aggregate network interfaces
Swap space (2 x total of mem)

updatedb considerations (skip gpfs) important

Suggested starting points are:
mmchconfig prefetchThreads=18
mmchconfig worker1Threads=24

Verify /proc/sys/net/ipv4/tcp_window_scaling is enabled. It should be by default.

Tune the TCP window settings by adding these lines to the /etc/sysctl.conf file:
# increase Linux TCP buffer limits
net.core.rmem_max = 8388608
net.core.wmem_max = 8388608
# increase default and maximum Linux TCP buffer sizes
net.ipv4.tcp_rmem = 4096 262144 8388608
net.ipv4.tcp_wmem = 4096 262144 8388608
# increase max backlog to avoid dropped packets
net.core.netdev_max_backlog=2500 

A. Issue the sysctl -p /etc/sysctl.conf command to set the kernel settings.
B. Issue the mmstartup -a command to restart GPFS


5 .创建GPFS集群

#/usr/lpp/mmfs/bin/mmcrcluster -t lc -p io1 -s io2 -n
/tmp/gpfs.nodes -r /usr/bin/ssh -R /usr/bin/scp
List the GPFS cluster details using:
#/usr/lpp/mmfs/bin/mmlscluster

6. 启动 GPFS
mmstartup -a

7. 磁盘定义
cat /tmp/gpfs.disks
/dev/sda:io1::dataAndMetadata:-1
/dev/sdb:io2::dataAndMetadata:-1
....
#cp /tmp/gpfs.disks /tmp/gpfs.disks.bak
#/usr/lpp/mmfs/bin/mmcrnsd -F /dump/gpfs.disks -v yes
#mmlsnsd

8.创建GPFS文件系统
# mmcrfs /gpfs1 gpfs1 -F /tmp/gpfs.disks1 -A yes

9.增加GPFS客户端
#mmaddnode -N node1
#mmaddnode -N node2