vector --- A lightweight, ultra-fast tool for building observability pipelines

A lightweight, ultra-fast tool for building observability pipelines

https://vector.dev/

 

Take control of your observability data

 

Collect, transform, and route all your logs and metrics with one simple tool.

 

---

Why Vector?

 

 

 

Ultra fast and reliable

Built in Rust, Vector is blistering fast, memory efficient, and designed to handle the most demanding workloads.

 

 

End to end

Vector strives to be the only tool you need to get observability data from A to B, deploying as a daemon, sidecar, or aggregator.

 

 

Unified

Vector supports logs and metrics, making it easy to collect and process all your observability data.

 

 

Vendor neutral

Vector doesn’t favor any specific vendor platforms and fosters a fair, open ecosystem with your best interests in mind. Lock-in free and future proof.

 

 

Programmable transforms

Vector’s highly configurable transforms give you the full power of programmable runtimes. Handle complex use cases without limitation.

 

 

Clear guarantees

Guarantees matter, and Vector is clear on which guarantees it provides, helping you make the appropriate trade-offs for your use case.

---

 

 

https://wiki.eryajf.net/pages/0322lius/#_1-2-2-1-remap

0.2 为什么用 vector

如果说官方有自卖自夸之嫌，那么我给出自身实践的数据以供参考：

本人所在公司每天产生约 15T 的日志量，在公司日志架构中 logstash 起着这样的作用：从 kafka 中消费数据，然后进行清洗、格式转换，最终写入 elasticsearch；公司一共有 34 台 16c64g 规格的 logstash 机器，然而这样的高配集群在晚高峰的时候会显得很吃力，每晚必定会报一堆 kafka 堵塞的告警；经过调研决定使用 vector 替换 logstash，最终只用了 10 台 16c16g 的机器便完成替换，并且之后再也没有报过 kafka 堆积告警！