Installation LEK Cluster
The structure of cluster like this:
We used four VM:
A 10.32.xxx.213 ubuntu12.04
B 10.32.xxx.214 ubuntu12.04
C 10.13.xxx.85 ubuntu14.04
D 10.32.xxx.160 ubuntu14.04
Building up this cluster is not complicated: same as installing single node LEK, just add a Redis which act as a broker!
We use redis 3.0.2, you can install it like this:
$ wget http://download.redis.io/releases/redis-3.0.2.tar.gz $ tar xzf redis-3.0.2.tar.gz $ cd redis-3.0.2 $ make //build $ make install //install $ cd utils $ ./install_server.sh //The script will ask you a few questions and will setup everything you need to run Redis properly as a background daemon that will start again on system reboots.
Now, everything has installed. We can run this cluster and just make the kibana get data from shipper.
In shipper B and D, the logstash’s configuration file:
input { file { path => ['/var/log/syslog', '/var/log/kern.log'] type => "syslog" } } output { redis { data_type => "channel" key => "logstash-*" host => "10.32.xxx.213" port => 6379 }
In A, the logstash’s configuration file:
input { redis { data_type => "pattern_channel" key => "logstash-*" host => "10.32.xxx.213" port => "6379" } } output { stdout { } elasticsearch { host => "10.13.xxx.85" protocol => "http" } }
After all these, then yon can run your cluster smoothly.