logstash输出多个索引样式(顶级字段与二级字段)

filebeat配置

复制代码
#表示的是会把 service作为fields的二级字段
filebeat.inputs:
- type: log enabled: true paths: - /var/log/aa.log fields: service: aa - type: log enabled: true paths: - /var/log/messages* fields: service: message
复制代码

fields_under_root:如果该选项设置为true,则新增fields成为顶级目录,而不是将其放在fields目录下。自定义的field会覆盖filebeat默认的field。例如添加如下配置:

#表示的是会把 service作为fields顶级字段
fields: service: message fields_under_root:
true

logstash配置

复制代码
#表示的是会把 service作为fields的二级字段logstash配置
output { stdout { codec
=> json } elasticsearch { hosts => ["https://node01:9200","https://node02:9200","https://node03:9200"] ssl => true cacert => "/home/logstash/logstash-7.5.1/config/certs/ca.crt" index => "logstash-%{[fields][service]}-%{+YYYY.MM.dd}" user => "logstash_writer" password => "logstash" } }
#表示的是会把 service作为fields的顶级字段logstash配置
output {
  stdout {
    codec => json
  }
  elasticsearch {
    hosts => ["https://node01:9200","https://node02:9200","https://node03:9200"]
    ssl => true
    cacert => "/home/logstash/logstash-7.5.1/config/certs/ca.crt"
    index => "logstash-%{[service]}-%{+YYYY.MM.dd}"
    user => "logstash_writer"
    password => "logstash"
  }
}
复制代码

也可以这样写

复制代码
if [fields][service] == 'aa' {
    elasticsearch {
hosts => ["https://node01:9200","https://node02:9200","https://node03:9200"]
index
=> "logstash-aa-%{+YYYY.MM.dd}"
user
=> "logstash_writer"
password
=> "logstash"
}
}

if [fields][service] == "messages" {
elasticsearch {
hosts
=> ["https://node01:9200","https://node02:9200","https://node03:9200"]
index
=> "logstash-messages-%{+YYYY.MM.dd}"
user
=> "logstash_writer"
password
=> "logstash"
}
}
复制代码

 

posted @   fat_girl_spring  阅读(2210)  评论(0编辑  收藏  举报
编辑推荐:
· Linux系列:如何用heaptrack跟踪.NET程序的非托管内存泄露
· 开发者必知的日志记录最佳实践
· SQL Server 2025 AI相关能力初探
· Linux系列:如何用 C#调用 C方法造成内存泄露
· AI与.NET技术实操系列(二):开始使用ML.NET
阅读排行:
· 被坑几百块钱后,我竟然真的恢复了删除的微信聊天记录!
· 没有Manus邀请码?试试免邀请码的MGX或者开源的OpenManus吧
· 【自荐】一款简洁、开源的在线白板工具 Drawnix
· 园子的第一款AI主题卫衣上架——"HELLO! HOW CAN I ASSIST YOU TODAY
· Docker 太简单,K8s 太复杂?w7panel 让容器管理更轻松!
点击右上角即可分享
微信分享提示