使用ELK进行日志分析
0x01 前言:
前段时间做应急,总是需要溯源分析,痛点是数据量比较大,想要短时间能分析出来。再者就是之前在调查某酒店事件的时候特别羡慕某产商有各种分析溯源工具。反思过后,终于在没有那么忙的时候开始搭建平台,开始采坑
0x02 ELK搭建:
wget https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-6.4.2.rpm
wget https://artifacts.elastic.co/downloads/kibana/kibana-6.4.2-x86_64.rpm
wget https://artifacts.elastic.co/downloads/logstash/logstash-6.4.2.rpm
wget http://download.redis.io/releases/redis-5.0.0.tar.gz
我安装的是一个精简版的centos7,所以需要安装Java环境
rpm -qa | grep java*
yum install java-1.8.0-openjdk* -y
#如果存在java,需要删除掉
rpm -e --nodeps 后面跟系统自带的jdk名
http://download.oracle.com/otn-pub/java/jdk/8u191-b12/2787e4a523244c269598db4e85c51e0c/jdk-8u191-linux-x64.tar.gz
rpm -ivh kibana-6.4.2-x86_64.rpm
rpm -ivh logstash-6.4.2.rpm
rpm -ivh elasticsearch-6.4.2.rpm
yum install gcc-c++
https://nginx.org/download/nginx-1.13.12.tar.gz
tar -zxvf nginx-1.13.12.tar.gz
cd nginx-1.13.12
./configure
make& make install
cd /usr/local/nginx/sbin/
./nginx
./nginx -s stop
./nginx -s quit
./nginx -s reload
修改配置文件
vim /etc/logstash/logstash.yml
vim /etc/elasticsearch/elasticsearch.yml
vim /etc/kibana/kibana.yml
启动服务
systemctl start logstash.service
systemctl start elasticsearch.service
systemctl start kibana.service
利用redis作为输入源:
wget http://download.redis.io/releases/redis-5.0.0.tar.gz
tar zxvf redis-5.0.0.tar.gz
cd redis-5.0.0
make && make install
修改redis.conf。
bind 0.0.0.0
protected-mode no
daemonize yes
maxclients 1000000
启动redis
mv redis.conf /etc/
redis-server /etc/redis.conf
汉化:
https://github.com/anbai-inc/Kibana_Hanization/
python main.py /usr/share/kibana
chrome插件:
https://chrome.google.com/webstore/search/elasticsearch