vector --- A lightweight, ultra-fast tool for building observability pipelines
A lightweight, ultra-fast tool for building observability pipelines
https://vector.dev/
Take control of your observability data
Collect, transform, and route all your logs and metrics with one simple tool.
Why Vector?
Ultra fast and reliableBuilt in Rust, Vector is blistering fast, memory efficient, and designed to handle the most demanding workloads.End to endVector strives to be the only tool you need to get observability data from A to B, deploying as a daemon, sidecar, or aggregator.Vendor neutralVector doesn’t favor any specific vendor platforms and fosters a fair, open ecosystem with your best interests in mind. Lock-in free and future proof.Programmable transformsVector’s highly configurable transforms give you the full power of programmable runtimes. Handle complex use cases without limitation.Clear guaranteesGuarantees matter, and Vector is clear on which guarantees it provides, helping you make the appropriate trade-offs for your use case.
https://wiki.eryajf.net/pages/0322lius/#_1-2-2-1-remap
0.2 为什么用 vector
如果说官方有自卖自夸之嫌,那么我给出自身实践的数据以供参考:
本人所在公司每天产生约 15T 的日志量,在公司日志架构中 logstash 起着这样的作用:从 kafka 中消费数据,然后进行清洗、格式转换,最终写入 elasticsearch;公司一共有 34 台 16c64g 规格的 logstash 机器,然而这样的高配集群在晚高峰的时候会显得很吃力,每晚必定会报一堆 kafka 堵塞的告警;经过调研决定使用 vector 替换 logstash,最终只用了 10 台 16c16g 的机器便完成替换,并且之后再也没有报过 kafka 堆积告警!
出处:http://www.cnblogs.com/lightsong/
本文版权归作者和博客园共有,欢迎转载,但未经作者同意必须保留此段声明,且在文章页面明显位置给出原文连接。
【推荐】编程新体验,更懂你的AI,立即体验豆包MarsCode编程助手
【推荐】凌霞软件回馈社区,博客园 & 1Panel & Halo 联合会员上线
【推荐】抖音旗下AI助手豆包,你的智能百科全书,全免费不限次数
【推荐】博客园社区专享云产品让利特惠,阿里云新客6.5折上折
【推荐】轻量又高性能的 SSH 工具 IShell:AI 加持,快人一步
· 一个费力不讨好的项目,让我损失了近一半的绩效!
· 清华大学推出第四讲使用 DeepSeek + DeepResearch 让科研像聊天一样简单!
· 实操Deepseek接入个人知识库
· CSnakes vs Python.NET:高效嵌入与灵活互通的跨语言方案对比
· Plotly.NET 一个为 .NET 打造的强大开源交互式图表库
2023-12-06 Using Redis with FastAPI