随笔分类 -  Flume

常用sink
摘要：HDFS Sink # sink1 a3.sinks.k1.type = hdfs a3.sinks.k1.hdfs.path = /origin_data/gmall/db/business_db/inc/%{tableName}_inc/%Y-%m-%d a3.sinks.k1.hdfs.fil 阅读全文
posted @ 2022-08-26 22:33 Avery_rainys 阅读(26) 评论(0) 推荐(0) 编辑
常用Channel
摘要：Kafka Channel 生产者 a1.channels.c1.type = org.apache.flume.channel.kafka.KafkaChannel a1.channels.c1.kafka.bootstrap.servers = hadoop102:9092,hadoop103: 阅读全文
posted @ 2022-08-26 22:31 Avery_rainys 阅读(32) 评论(0) 推荐(0) 编辑
常用source
摘要：Kafka Sources a3.sources.r1.type = org.apache.flume.source.kafka.KafkaSource a3.sources.r1.batchSize = 5000 a3.sources.r1.batchDurationMillis = 2000 a 阅读全文
posted @ 2022-08-26 22:27 Avery_rainys 阅读(17) 评论(0) 推荐(0) 编辑

点击右上角即可分享
微信分享提示