logstash-output-mongodb安装

 

1.安装插件:
[root@localhost bin]# ./logstash-plugin install logstash-output-mongodb
Validating logstash-output-mongodb
Installing logstash-output-mongodb

 

2.查看插件版本
./logstash-plugin list --verbose
logstash-output-mongodb (3.1.7)

 

同步报错误:

验证了logstasg-output-mongodb 3.1.6也是报这个错误,换成3.1.5该问题不出现.

[2023-11-03T03:25:28,954][WARN ][logstash.outputs.mongodb ] MONGODB | Failed to handshake with 192.168.1.108:29001: ArgumentError: wrong number of arguments (given 2, expected 1)
[2023-11-03T03:25:28,955][WARN ][logstash.outputs.mongodb ] MONGODB | Error checking 192.168.1.108:29001: ArgumentError: wrong number of arguments (given 2, expected 1)
[2023-11-03T03:25:29,469][WARN ][logstash.outputs.mongodb ] MONGODB | Failed to handshake with 192.168.1.108:29001: ArgumentError: wrong number of arguments (given 2, expected 1)
[2023-11-03T03:25:29,469][WARN ][logstash.outputs.mongodb ] MONGODB | Error checking 192.168.1.108:29001: ArgumentError: wrong number of arguments (given 2, expected 1)
[2023-11-03T03:25:29,986][WARN ][logstash.outputs.mongodb ] MONGODB | Failed to handshake with 192.168.1.108:29001: ArgumentError: wrong number of arguments (given 2, expected 1)
[2023-11-03T03:25:29,986][WARN ][logstash.outputs.mongodb ] MONGODB | Error checking 192.168.1.108:29001: ArgumentError: wrong number of arguments (given 2, expected 1)

 

解决办法:
a.重新安装logstash
b.指定版本logstash-output-mongodb:
[root@localhost bin]#./logstash-plugin install --version=3.1.5 logstash-output-mongodb
c.重新安装logstash-input-mongodb
[root@localhost bin]# ./logstash-plugin install /soft/mongo2es/logstash-input-mongodb/logstash-input-mongodb-0.4.1.gem

 

 

3.mongodb同步到mongodb的配置例子

[root@localhost config]# vi sync_mongo_mongo.conf 
input {
    mongodb {
        codec => "json"
        parse_method => "simple"
        uri => 'mongodb://192.168.1.108:29001/db_pushmsg'
        placeholder_db_dir => '/opt/logstash-6.8.5/db_dir'
        ##placeholder_db_name =>'app_message_all.db'
        collection => 'app_message_all'
    }
}
# 该部分被注释，表示filter是可选的
filter {
  mutate {
    remove_field => ["host","log_entry","logdate","@version"]
  }

}


output {
    mongodb {
        uri => 'mongodb://192.168.1.109:29001'
        database => 'db_pushmsg'
        collection => 'app_message_all_01'
    }
}
~                      

 

发现加上@timestamp报错误

filter {
  mutate {
    remove_field => ["host","log_entry","logdate","@version","@timestamp"]
  }

}

 

[2023-11-03T05:54:03,939][WARN ][logstash.outputs.mongodb ] Failed to send event to MongoDB, retrying in 3 seconds {:event=>#<LogStash::Event:0x79c0b2e2>, :exception=>java.lang.NullPointerException}
[2023-11-03T05:54:06,940][WARN ][logstash.outputs.mongodb ] Failed to send event to MongoDB, retrying in 3 seconds {:event=>#<LogStash::Event:0x79c0b2e2>, :exception=>java.lang.NullPointerException}