codis 部署和测试
git clone https://github.com/CodisLabs/codis.git
1:下载go环境 官网：https://golang.org/doc/install
wget https://storage.googleapis.com/golang/go1.6.2.linux-amd64.tar.gz
tar -C /usr/local -xzf go1.6.2.linux-amd64.tar.gz
cd /usr/local/go
cat >> /etc/profile <<EOF
export GOROOT=/usr/local/go
export GOPATH=/workspace/golang
export PATH=\$PATH:\$GOROOT/bin:\$GOPATH/bin
export CODIS_HOME=$GOPATH/src/github.com/CodisLabs/codis
export GO15VENDOREXPERIMENT=0
EOF
source /etc/profile
2:下载安装codis 官网：https://github.com/CodisLabs/codis/blob/master/doc/tutorial_zh.md 根据官网推荐采用这种方式，而不是git clone ...codis
go get -u -d github.com/CodisLabs/codis
go get github.com/tools/godep
cd $GOPATH/src/github.com/CodisLabs/codis
make
make gotest
#mkdir -p /usr/local/codis/{logs,conf,scripts}
#mkdir -p /data/codis_server/{logs,conf,data}
cd $GOPATH/src/github.com/CodisLabs/codis/bin
3:安装zookeeper
wget http://mirror.bit.edu.cn/apache/zookeeper/zookeeper-3.4.6/zookeeper-3.4.6.tar.gz -P /opt
tar -C /opt -xvf /opt/zookeeper-3.4.6.tar.gz
cd /opt/zookeeper-3.4.6/conf
cp zoo_sample.cfg zoo.cfg
/opt/zookeeper-3.4.6/bin/zkServer.sh start
read -p "请输入zookeeper的地址: " zookeeper-ip
sed -i 's/192\.168\.0\.123/$zookeeper-ip/g' config.ini
###assets //dashboard的静态文件目录
###codis-config codis命令式配置管理组件
###codis-proxy codis 代理也就是核心组件
###codis-server codis基于redis2.8.21定制版redis
mkdir /workspace/golang/src/github.com/CodisLabs/codis/wk
cp /workspace/golang/src/github.com/CodisLabs/codis/config.ini /workspace/golang/src/github.com/CodisLabs/codis/wk/
4:启动 dashboard（codis-config上操作）
cd $CODIS_HOME && ./bin/codis-config -c $CODIS_HOME/wk/config.ini dashboard &
可以从浏览器打开http://192.168.16.239:18087/admin/
5:初始化 slot,该命令会在zookeeper上创建slot相关信息
cd $CODIS_HOME && ./bin/codis-config -c $CODIS_HOME/wk/config.ini slot init &
6:启动 Codis Redis , 和官方的Redis Server参数一样（codis-server上操作）
cp extern/redis-2.8.21/redis.conf wk/
cd $CODIS_HOME && ./codis-server ../extern/redis-2.8.21/redis.conf (端口6379)作为16.241的6380的master
./codis-server ../extern/redis-2.8.21/redis6380.conf （端口6380)作为16.241的6379的slave
7:添加 Redis Server Group , 每一个 Server Group 作为一个 Redis 服务器组存在, 只允许有一个 master,
可以有多个 slave, group id 仅支持大于等于1的整数（codis-config上操作）
./codis-config -c ../wk/config.ini server add 1 192.168.16.239:6379 master
./codis-config -c ../wk/config.ini server add 1 192.168.16.241:6380 slave
./codis-config -c ../wk/config.ini server add 2 192.168.16.241:6379 master
./codis-config -c ../wk/config.ini server add 2 192.168.16.239:6380 slave
8: 启动241上面的redis服务，作为slave
/codis-server ../extern/redis-2.8.21/redis.conf 作为16.239的6380 的master
/codis-server ../extern/redis-2.8.21/redis6380.conf 作为16.239的6379 的slave
****************注意，不需要从redis.conf 去配置slave，必须用codis-server 去启动redis***************
[root@shell bin]# 2016/04/28 14:16:48 dashboard.go:160: [INFO] dashboard listening on addr: :18087
2016/04/28 14:16:49 dashboard.go:234: [PANIC] create zk node failed
[error]: dashboard already exists: {"addr": "192.168.16.239:18087", "pid": 2280}
[stack]:
3 /workspace/golang/src/github.com/CodisLabs/codis/cmd/cconfig/dashboard.go:234
main.runDashboard
2 /workspace/golang/src/github.com/CodisLabs/codis/cmd/cconfig/dashboard.go:54
main.cmdDashboard
1 /workspace/golang/src/github.com/CodisLabs/codis/cmd/cconfig/main.go:85
main.runCommand
0 /workspace/golang/src/github.com/CodisLabs/codis/cmd/cconfig/main.go:152
main.main
... ...
解决：
./zkCli.sh
[zk: localhost:2181(CONNECTED) 11] rmr /zk/codis
原因：
2016/04/28 14:52:44 dashboard.go:143: [INFO] dashboard node created: /zk/codis/db_wk/dashboard, {"addr": "192.168.16.239:18087", "pid": 8578}
2016/04/28 14:52:44 dashboard.go:144: [WARN] ********** Attention **********
2016/04/28 14:52:44 dashboard.go:145: [WARN] You should use `kill {pid}` rather than `kill -9 {pid}` to stop me,
2016/04/28 14:52:44 dashboard.go:146: [WARN] or the node resisted on zk will not be cleaned when I'm quiting and you must remove it manually
9:设置 server group 服务的 slot 范围
Codis 采用 Pre-sharding 的技术来实现数据的分片, 默认分成 1024 个 slots (0-1023), 对于每个key来说, 通过以下公式确定所属的
Slot Id : SlotId = crc32(key) % 1024 每一个 slot 都会有一个且必须有一个特定的 server group id 来表示这个 slot 的数据由哪个 server group 来提供
[root@shell bin]# ./codis-config -c ../wk/config.ini slot -h
usage:
codis-config slot init [-f]
codis-config slot info <slot_id>
codis-config slot set <slot_id> <group_id> <status>
codis-config slot range-set <slot_from> <slot_to> <group_id> <status>
codis-config slot migrate <slot_from> <slot_to> <group_id> [--delay=<delay_time_in_ms>]
codis-config slot rebalance [--delay=<delay_time_in_ms>]
[root@shell bin]# ./codis-config -c ../wk/config.ini slot range-set 0 511 1 online
{
"msg": "OK",
"ret": 0
}
到浏览器上看看效果
或者
[root@shell bin]# ./codis-config -c ../wk/config.ini slot info 1
{
"group_id": 1,
"id": 1,
"product_name": "wk",
"state": {
"last_op_ts": "0",
"migrate_status": {
"from": -1,
"to": -1
},
"status": "online"
}
10：启动 codis-proxy
[root@shell bin]# ./codis-proxy -c ../wk/config.ini -L ./log/proxy.log --cpu=4 --addr=0.0.0.0:19000 --http-addr=0.0.0.0:11000 &
_____ ____ ____/ / (_) _____
/ ___/ / __ \ / __ / / / / ___/
/ /__ / /_/ / / /_/ / / / (__ )
\___/ \____/ \__,_/ /_/ /____/
在241上启动第二个代理服务器
./codis-proxy -c ../wk/config.ini -L ./log/proxy.log --cpu=4 --addr=0.0.0.0:19000 --http-addr=0.0.0.0:11000 &
在浏览器上看到proxy_2是offile状态，如果用命令去启动proxy_2 online状态，则提示下面错误，需要去启动dashboard,我们直接在界面上启动为online状态
[root@zabbix bin]# ./codis-config -c ../wk/config.ini proxy online proxy_2
2016/05/03 13:43:12 utils.go:49: [ERROR] can't connect to dashboard, please check 'dashboard_addr' is corrent in config file
[stack]:
