使用fastdfs搭建文件服务器

一：安装tracker

    1. 拷贝安装目录下各个.gz文件到/usr/local/src下，解压各个install lib，例如tar zxvf xxx.tar.gz

    2. 先安装libfastcommon，（需要先安装 yum install gcc,gcc-c++,perl）

    cd libfastcommon
    ./make.sh
    ./make.sh install

    3. 安装FastDFS

    cd FastDFS
    ./make.sh
    ./make.sh install

    4. 修改tracker.conf和client.conf
    cd /etc/fdfs
    cp client.conf.sample client.conf
    cp tracker.conf.sample tracker.conf

    //创建目录
    mkdir -p /opt/fdfs/tracker

    vi tracker.conf
    修改项：
    base_path=/opt/fdfs/tracker

    vi client.conf
    修改项：
    base_path=/opt/fdfs/tracker
    tracker_server=tracker的ip:22122

    5. 拷贝命令到指定目录
    cp /usr/bin/fdfs_trackerd /usr/local/bin
    cp /usr/bin/fdfs_monitor /usr/local/bin
    cp /usr/bin/fdfs_upload_file /usr/local/bin
    cp /usr/bin/fdfs_test /usr/local/bin

    6. 连接目录

    ln -s /usr/include/fastcommon /usr/local/include/fastcommon 
    ln -s /usr/include/fastdfs /usr/local/include/fastdfs 
    ln -s /usr/lib64/libfastcommon.so /usr/local/lib/libfastcommon.so
    ln -s /usr/lib64/libfdfsclient.so /usr/local/lib/libfdfsclient.so

    6：启动tracker
    fdfs_trackerd /etc/fdfs/tracker.conf start
/usr/bin/restart.sh /usr/local/bin/fdfs_trackerd /etc/fdfs/tracker.conf
    7：查看启动状态

    //查看是否对应端口22122是否开始监听
     netstat -unltp | grep fdfs

    查看日志：cat  /opt/fdfs/tracker/logs/trackerd.log 

                 or 

              tail -f /opt/fdfs/tracker/logs/trackerd.log 


    8：对应的storage启动完成后，可以查看链接状态

        fdfs_monitor /etc/fdfs/client.conf
fdfs_monitor /home/fastdfs/fastdfs-5.05/conf/client.conf


    9：tracker上安装nginx
        1)：确保依赖安装
        yum install –y openssl-devel pcre-devel zlib-devel
        yum install gd-devel
        
        2)
        ./configure \
    --prefix=/usr \
    --sbin-path=/usr/sbin/nginx \
    --conf-path=/etc/nginx/nginx.conf \
    --error-log-path=/media/disk1/nginx/logs/error.log \
    --pid-path=/var/run/nginx/nginx.pid \
    --lock-path=/var/lock/nginx.lock \
    --user=nginx \
    --group=nginx \
    --with-pcre=/usr/local/src/pcre-8.35 \
    --with-http_ssl_module \
    --with-http_flv_module \
    --with-http_gzip_static_module \
    --http-log-path=/media/disk1/nginx/logs/access.log \
    --http-client-body-temp-path=/media/disk1/nginx/client \
    --http-proxy-temp-path=/media/disk1/nginx/proxy \
    --http-fastcgi-temp-path=/media/disk1/nginx/fcgi \
    --with-http_stub_status_module \
    --with-http_stub_status_module \
    --with-poll_module \
    --with-http_image_filter_module \
    --with-http_realip_module \
    --add-module=/usr/local/src/ngx_cache_purge-2.3 \
    --with-cc-opt=-Wno-error 
    
        3)make

        4)make install
        
    10：设置启动文件和nginx配置文件
    请参考安装目录下的tracker下的nginx和nginx.conf
    创建缓存目录：mkdir /media/disk1/nginx/proxy_temp
                  mkdir /media/disk1/nginx/proxy_cache
    
    修改对应的ip后分别拷贝到/etc/init.d/、/etc/nginx/
    cp /usr/sbin/nginx /etc/init.d/
         cd /usr/sbin/
         ./nginx
         
     11: 查看启动进程

    ps aux | grep nginx

    cat /media/disk1/nginx/logs/access.log

    cat /media/disk1/nginx/logs/error.log


如不清楚log位置可在nginx.conf 配置中查看。
    
    如果提示错误，可能缺少依赖的软件包，需先安装依赖包，再次运行./configure
    nginx以及nginx cache purge插件模块安装完成，安装目录/usr/local/nginx
    
    
可以使用fdfs_monitor来删除。命令行如下：
/usr/bin/fdfs_monitor <config_filename> delete <group_name> <storage_id>
例如：
/usr/bin/fdfs_monitor /etc/fdfs/client.conf delete group1 192.168.0.100
注意：如果被删除的storage server的状态是ACTIVE，也就是该storage server还在线上服务的情况下，是无法删除掉的。
         storage_id参数：如果使用默认的ip方式，填写storage server IP地址，否则使用对应的server id。

    
    
-------------------------------------------------------------------------------
一：安装storage

    /**** ！！若storage和tracker在同一台服务器上，1-3步跳过 */
    
    1. 拷贝安装目录下各个.gz文件到/usr/local/src下，解压各个install lib，例如tar zxvf xxx.tar.gz

    2. 先安装libfastcommon，（需要先安装 yum install gcc,gcc-c++,perl）

    cd libfastcommon
    ./make.sh
    ./make.sh install

    3. 安装FastDFS

    cd FastDFS
    ./make.sh
    ./make.sh install

    4. 修改storage.conf
    cd /etc/fdfs
    cp storage.conf.sample storage.conf

    //创建目录
    mkdir -p /opt/fdfs/storage
    mkdir -p /data/fdfs

    vi storage.conf

    修改项：
    base_path=/opt/fdfs/storage
    group_name=group1
    store_path0=/data/fdfs
    tracker_server=tracker服务器ip:22122
    http.server_port=8080

    5. 拷贝命令到指定目录
    cp /usr/bin/fdfs_storaged /usr/local/bin
    cp /usr/bin/fdfs_monitor /usr/local/bin


    6. 连接目录

    ln -s /usr/include/fastcommon /usr/local/include/fastcommon 
    ln -s /usr/include/fastdfs /usr/local/include/fastdfs 
    ln -s /usr/lib64/libfastcommon.so /usr/local/lib/libfastcommon.so
    ln -s /usr/lib64/libfdfsclient.so /usr/local/lib/libfdfsclient.so

    6：启动storage

    fdfs_storaged /etc/fdfs/storage.conf start
    fdfs_storaged /home/fastdfs/fastdfs-5.05/conf/storage.conf

    重启
    /usr/bin/restart.sh /usr/local/bin/fdfs_storaged /etc/fdfs/storage.conf
    7：查看启动状态

    netstat -unltp | grep fdfs

        查看log： cat /opt/fdfs/stroage/logs/storaged.log  

              or

        tail -f /opt/fdfs/stroage/logs/storage.log


    8: 监控storage状态
    
    //查看storage状态
    fdfs_monitor /etc/fdfs/storage.conf
    fdfs_monitor /home/fastdfs/fdfs_conf/storage.conf
二：storage上安装nginx


    1：确保依赖安装
    yum install –y openssl-devel pcre-devel zlib-devel

    2：解压/usr/local/src下的相关压缩包

    3：编译和安装nginx

    创建用户和响应的目录和文件，请参考nginx的安装文档

    cd /usr/local/src/nginx-1.8.0

----整段运行------
    ./configure \
    --prefix=/usr \
    --sbin-path=/usr/sbin/nginx \
    --conf-path=/etc/nginx/nginx.conf \
    --error-log-path=/media/disk1/nginx/logs/error.log \
    --pid-path=/var/run/nginx/nginx.pid \
    --lock-path=/var/lock/nginx.lock \
    --user=nginx \
    --group=nginx \
    --with-pcre=/usr/local/src/pcre-8.35 \
    --with-http_ssl_module \
    --with-http_flv_module \
    --with-http_gzip_static_module \
    --http-log-path=/media/disk1/nginx/logs/access.log \
    --http-client-body-temp-path=/media/disk1/nginx/client \
    --http-proxy-temp-path=/media/disk1/nginx/proxy \
    --http-fastcgi-temp-path=/media/disk1/nginx/fcgi \
    --with-http_stub_status_module \
    --with-poll_module \
    --with-http_realip_module \
    --add-module=/usr/local/src/ngx_cache_purge-2.3 \
    --add-module=/usr/local/src/fastdfs-nginx-module/src \
    --with-cc-opt=-Wno-error 

安装：
    make

    make install


    4: 配置mod_fastdfs.conf

        cp /usr/local/src/fastdfs-nginx-module/src/mod_fastdfs.conf /etc/fdfs/

    修改/etc/fdfs/mod_fastdfs.conf配置项
    base_path=/data/fdfs
    tracker_server=tracker服务器io:22122#修改为tracker server信息
    url_have_group_name= true #改为true
    store_path0=/data/fdfs #改为数据存储路径，和storage.conf一样
        group_name=group1
        group_count = 2

    并且在文件末尾加上以下信息：

    [group1]
    group_name=group1
    storage_server_port=23000
    store_path_count=1
    store_path0=/data/fdfs


    5:ln -s /data/fdfs/data /data/fdfs/data/M00
ln -s /opt/file/fdfs/data /opt/file/fdfs/data/M01

    6：拷贝http.conf和mime.type

        cp /usr/local/src/FastDFS/conf/http.conf /etc/fdfs/
        cp /usr/local/src/FastDFS/conf/mime.types /etc/fdfs/

    7：设置启动文件和nginx配置文件

    请参考安装目录下的storage下的nginx和nginx.conf
    
    location ~/group[1-3]/M00 {
        root /home/fastdfs/data;
        ngx_fastdfs_module;
    }
    
    修改对应的ip后分别拷贝到/etc/init.d/、/etc/nginx/
        cp /usr/sbin/nginx /etc/init.d/

        如果忘记copy 会报错：[emerg]: getpwnam(“nginx”) failed  ，原因没有注册用户

         chmod u+x nginx

    8: 启动nginx
         cd /usr/sbin/
         ./nginx
         
        #service nginx start

    9: 查看启动进程

        ps aux | grep nginx

        cat /media/disk1/nginx/logs/access.log

        cat /media/disk1/nginx/logs/error.log


如不清楚log位置可在nginx.conf 配置中查看。        
        
        
安装tracker 和 storage之后，测试 上传文件：

上传：
/usr/local/bin/fdfs_upload_file /etc/fdfs/client.conf /usr/local/a.txt
测试：
/usr/local/bin/fdfs_test /etc/fdfs/client.conf upload /usr/local/a.txt

返回路径
fdfs_upload_file /home/fastdfs/fastdfs-5.05/conf/client.conf  /home/fastdfs_file/data/fdfs_trackerd.pid
/home/fastdfs/fastdfs-5.05/conf/tracker.conf

然后在浏览器访问：
http://10.74.11.118:8080/group1/M00/00/00/CkoLdlpYL1eAfvQXAAAAD14pc-g996.txt

至此安装测试部分结束.
-------------------------------------------------------------------------------------

安装过程常见问题解决办法：

读取不了的原因可能是防火墙没关，把防火墙关掉：service iptables stop

stroage server保存路径：/data/fdfs

storage 非active状态的解决办法：

#从集群中删除
fdfs_monitor /etc/fdfs/client.conf delete group1 10.74.11.118