流式分析
大数据流式处理项目
- Nginx 日志实时URL请求分析
- MySQL实时数据抽取分析
整体技术架构
- Nginx + Flume + Kafka + Flink + Clickhouse + Springboot + netty +Vue+ElementUI
- DTS (canal)
前置知识
-
Nginx http://nginx.org/
-
Flume http://flume.apache.org/
-
Kafka http://kafka.apache.org/
-
Flink scala https://flink.apache.org/
-
Clickhouse https://clickhouse.tech/
-
[python |go | java]
-
[WS | SSE]
-
[template | Vue]
技术改变一切