minio开发需注意的事项(springboot)

spring-cloud-admin-minio

minio 分布式部署

1 准备 4 台服务器

节点	应用目录	文件存储目录	脚本目录	日志存储目录
192.168.0.100	/usr/local/minio/bin	/usr/local/minio/upload	/usr/local/minio/run	/usr/local/minio/log
192.168.0.101	/usr/local/minio/bin	/usr/local/minio/upload	/usr/local/minio/run	/usr/local/minio/log
192.168.0.102	/usr/local/minio/bin	/usr/local/minio/upload	/usr/local/minio/run	/usr/local/minio/log
192.168.0.103	/usr/local/minio/bin	/usr/local/minio/upload	/usr/local/minio/run	/usr/local/minio/log

注: 在服务器数量少于 4 台的情况下，可以做伪集群部署，此时只需要修改端口号即可:

192.168.0.100:9000
192.168.0.100:9001
192.168.0.100:9002
192.168.0.100:9003

2 创建目录

4 台服务器都执行以下命令:

# mkdir -p /usr/local/minio/{bin,upload,run,log}

3 下载 minio

把下载的 minio 分别存放到 4 台服务器的 /usr/local/minio/bin 目录。

4 创建启动脚本

4 台服务器都执行以下命令:

# vim /usr/local/minio/run/minio-run.sh

5 编辑启动脚本

5.1 节点 192.168.0.100 的脚本内容

#!/bin/bash
export MINIO_ROOT_USER=admin
export MINIO_ROOT_PASSWORD=password
/usr/local/minio/bin/minio server --address "192.168.0.100:9000" --console-address ":7000" \
http://192.168.0.100:9000/usr/local/minio/upload \
http://192.168.0.101:9000/usr/local/minio/upload \
http://192.168.0.102:9000/usr/local/minio/upload \
http://192.168.0.103:9000/usr/local/minio/upload \
> /usr/local/minio/log/run.log

5.2 节点 192.168.0.101 的脚本内容

#!/bin/bash
export MINIO_ROOT_USER=admin
export MINIO_ROOT_PASSWORD=password
/usr/local/minio/bin/minio server --address "192.168.0.101:9000" --console-address ":7000" \
http://192.168.0.100:9000/usr/local/minio/upload \
http://192.168.0.101:9000/usr/local/minio/upload \
http://192.168.0.102:9000/usr/local/minio/upload \
http://192.168.0.103:9000/usr/local/minio/upload \
> /usr/local/minio/log/run.log

5.3 节点 192.168.0.102 的脚本内容

#!/bin/bash
export MINIO_ROOT_USER=admin
export MINIO_ROOT_PASSWORD=password
/usr/local/minio/bin/minio server --address "192.168.0.102:9000" --console-address ":7000" \
http://192.168.0.100:9000/usr/local/minio/upload \
http://192.168.0.101:9000/usr/local/minio/upload \
http://192.168.0.102:9000/usr/local/minio/upload \
http://192.168.0.103:9000/usr/local/minio/upload \
> /usr/local/minio/log/run.log

5.4 节点 192.168.0.103 的脚本内容

#!/bin/bash
export MINIO_ROOT_USER=admin
export MINIO_ROOT_PASSWORD=password
/usr/local/minio/bin/minio server --address "192.168.0.103:9000" --console-address ":7000" \
http://192.168.0.100:9000/usr/local/minio/upload \
http://192.168.0.101:9000/usr/local/minio/upload \
http://192.168.0.102:9000/usr/local/minio/upload \
http://192.168.0.103:9000/usr/local/minio/upload \
> /usr/local/minio/log/run.log

6 授权 minio 目录

4 台服务器都执行以下命令:

# chmod +x -R /usr/local/minio

7 将 minio 加入系统服务

4 台服务器都执行以下命令:

# vim /usr/lib/systemd/system/minio.service
[Unit]
Description=Minio service
Documentation=https://docs.minio.io/

[Service]
WorkingDirectory=/usr/local/minio/run/
ExecStart=/usr/local/minio/run/minio-run.sh

Restart=on-failure
RestartSec=5

[Install]
WantedBy=multi-user.target

# chmod +x /usr/lib/systemd/system/minio.service

8 启动 minio 服务

4 台服务器都执行以下命令:

# systemctl daemon-reload

# systemctl start minio

9 使用 nginx 负载均衡

在日志里增加 "$upstream_status" "$upstream_addr" 以便打印真实的服务端 IP 地址:

http {
    include       mime.types;
    default_type  application/octet-stream;

    log_format  main  '$remote_addr - $remote_user [$time_local] "$request" '
                      '$status $body_bytes_sent "$http_referer" '
                      '"$http_user_agent" "$http_x_forwarded_for"'
					  '"$upstream_status" "$upstream_addr"';
}

9.1 后台调用 endpoint

在 nginx.conf 文件里增加如下配置:

   upstream lb_minio {
        server 192.168.0.100:9000;
        server 192.168.0.101:9000;
        server 192.168.0.102:9000;
        server 192.168.0.103:9000;
    }

    server {
        listen 9000;
        server_name localhost;
		access_log  logs/minio.access.log  main;
		error_log  logs/minio.error.log;
		
        location / {
            proxy_set_header   X-Real-IP $remote_addr;
            proxy_set_header   X-Forwarded-Host  $host:$server_port;
            proxy_set_header   X-Forwarded-For $proxy_add_x_forwarded_for;
            proxy_set_header   X-Forwarded-Proto  $http_x_forwarded_proto;
            proxy_set_header   Host $http_host;
   
            proxy_pass http://lb_minio;
        }
    }

此时，minio 对外的 ENDPOINT 为: http://${NGINX_HOST}:9000

9.2 前端访问 console

在 nginx.conf 文件里增加如下配置:

    upstream lb_minio_console {
		server 192.168.0.100:7000;
		server 192.168.0.101:7000;
		server 192.168.0.102:7000;
		server 192.168.0.103:7000;
    }

    server {
        listen 7000;
        server_name localhost;
		access_log  logs/minio.access.log  main;
		error_log  logs/minio.error.log;
		
        location / {
            proxy_pass http://lb_minio_console;
        }
    }

此时，在浏览器的地址栏输入 http://${NGINX_HOST}:7000 即可访问 minio 的 Console 页面。

FAQ

minio 服务启动失败

查看服务日志:
```
# journalctl -u minio
```

ERROR Unable to initialize backend: format.json file: expected format-type: fs, found: xl

删除文件存储目录里的 .minio.sys文件:

# ls -la
total 0
drwxr-xr-x. 3 root root  24 Jan 12 11:53 .
drwxr-xr-x. 6 root root  53 Jan 12 11:08 ..
drwxr-xr-x. 9 root root 125 Jan 12 14:14 .minio.sys

# rm -rf .minio.sys