docker-compose 搭建 Prometheus+Grafana监控系统

有关监控选型之前有写过一篇文章: 监控系统选型，一文轻松搞定！

监控对象

Linux服务器
Docker
Redis
MySQL

数据采集

1)、prometheus: 采集数据

2)、node-exporter: 收集操作系统和硬件信息的metrics

3)、cadvisor : 收集Docker的metrics

4)、redis-exporter: 收集Redis的metrics

5)、 mysql-exporter: 收集MySQL的metrics

报表

grafana: 图表展示

一、环境搭建

1、MySQL用户授权

之前想用root账号尝试收集MySQL的metrics,但在启动docker的时候一直报错：

“Error pinging mysqld" err="Error 1049: Unknown database

后来去官方地址在发现，需要对用户进行授权才能收集监控数据信息。

gitHub开源项目有说明: https://github.com/prometheus/mysqld_exporter

所以这里重新创建用户并授权。

CREATE USER 'exporter'@'%' IDENTIFIED BY '123456';
GRANT PROCESS, REPLICATION CLIENT ON *.* TO 'exporter'@'%';
GRANT SELECT ON performance_schema.* TO 'exporter'@'%';

注意：建议为用户设置最大连接限制，以避免在重负载下监控抓取使服务器过载。

2、配置docker-compose.yml

我在/etc/prometheus创建一个docker-compose.yml文件,文件内容如下

version: '2'

networks:
    monitor:
        driver: bridge

services:
    prometheus:
        image: prom/prometheus
        container_name: prometheus
        hostname: prometheus
        restart: always
        volumes:
            - ./prometheus.yml:/etc/prometheus/prometheus.yml
        ports:
            - "9090:9090"
        networks:
            - monitor

    alertmanager:  #预警模块
        image: prom/alertmanager
        container_name: alertmanager
        hostname: alertmanager
        restart: always
        ports:
            - "9093:9093"
        networks:
            - monitor

    grafana:
        image: grafana/grafana
        container_name: grafana
        hostname: grafana
        restart: always
        ports:
            - "3000:3000"
        networks:
            - monitor

    node-exporter:
        image: quay.io/prometheus/node-exporter
        container_name: node-exporter
        hostname: node-exporter
        restart: always
        ports:
            - "9100:9100"
        networks:
            - monitor

    cadvisor:
        image: google/cadvisor:latest
        container_name: cadvisor
        hostname: cadvisor
        restart: always
        volumes:
            - /:/rootfs:ro
            - /var/run:/var/run:rw
            - /sys:/sys:ro
            - /var/lib/docker/:/var/lib/docker:ro
        ports:
            - "8899:8080"
        networks:
            - monitor

    redis-exporter:
        image: oliver006/redis_exporter
        container_name: redis-exporter
        hostname: redis-exporter
        restart: always
        ports:
            - "9121:9121"
        command:
            - "--redis.addr=redis://127.0.0.1:6379"
        networks:
            - monitor

    mysql_xporter:
        image: prom/mysqld-exporter
        container_name: mysql-exporter
        hostname: mysql-exporter
        restart: always
        ports:
            - "9104:9104"
        environment:
            DATA_SOURCE_NAME: 'exporter:123456@(127.0.0.1:3306)'
        networks:
            - monitor

因为这里prometheus容器的配置文件重新挂载了，挂载到/etc/prometheus/目录下，所以在该目录创建好prometheus.yml文件。

3、配置prometheus.yml

global:
  scrape_interval:     15s
  evaluation_interval: 15s
scrape_configs:
  - job_name: 'prometheus'
    static_configs:
    - targets: ['ip:9090'] //ip为自己服务器IP
  - job_name: 'cadvisor'
    static_configs:
    - targets: ['ip:8899']
  - job_name: 'node'
    static_configs:
    - targets: ['ip:9100']
  - job_name: 'redis_exporter'
    static_configs:
    - targets: ['ip:9121']
  - job_name: 'mysql_exporter'
    static_configs:
    - targets: ['ip:9104']