Cccc杨

导航

Flume的Channel选择器

a1.sources = r1
a1.channels = c1 c2
a1.sinks = s1 s2

a1.sources.r1.type = netcat
a1.sources.r1.bind = master
a1.sources.r1.port = 44444
a1.sources.r1.channels = c1 c2
a1.sources.r1.selector = replicating

a1.channels.c1.type = memory
a1.channels.c1.capacity = 1000
a1.channels.c1.transactionCapacity = 100

a1.channels.c2.type = memory
a1.channels.c2.capacity = 1000
a1.channels.c2.transactionCapacity = 100

a1.sinks.s1.type = logger
a1.sinks.s1.channel = c1

a1.sinks.s2.type = hdfs
a1.sinks.s2.channel = c2

a1.sinks.s2.hdfs.path = hdfs://master:9000/usr/root/flumedate/necat
a1.sinks.s2.hdfs.fileType = DataStream

通过选择器 把44444的端口数据采集到hdfs和日志打印输出

posted on 2021-02-23 19:49  Cccc杨  阅读(211)  评论(0编辑  收藏  举报