WARN conf.FlumeConfiguration: Could not configure sink sink1 due to: No channel configured for sink: sink1 org.apache.flume.conf.ConfigurationException: No channel configured for sink: sink1
1、错误如下所示,启动flume采集文件到hdfs案例的时候,出现如下所示的错误:
大概是说No channel configured for sink,所以应该是sink哪里配置出现了错误,百度了一下,然后检查了一下自己的配置:
1 18/04/24 08:31:02 WARN conf.FlumeConfiguration: Could not configure sink sink1 due to: No channel configured for sink: sink1 2 org.apache.flume.conf.ConfigurationException: No channel configured for sink: sink1 3 at org.apache.flume.conf.sink.SinkConfiguration.configure(SinkConfiguration.java:51) 4 at org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.validateSinks(FlumeConfiguration.java:681) 5 at org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.isValid(FlumeConfiguration.java:347) 6 at org.apache.flume.conf.FlumeConfiguration$AgentConfiguration.access$000(FlumeConfiguration.java:213) 7 at org.apache.flume.conf.FlumeConfiguration.validateConfiguration(FlumeConfiguration.java:127) 8 at org.apache.flume.conf.FlumeConfiguration.<init>(FlumeConfiguration.java:109) 9 at org.apache.flume.node.PropertiesFileConfigurationProvider.getFlumeConfiguration(PropertiesFileConfigurationProvider.java:189) 10 at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:89) 11 at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140) 12 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) 13 at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) 14 at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) 15 at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) 16 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) 17 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 18 at java.lang.Thread.run(Thread.java:745) 19 18/04/24 08:31:02 INFO conf.FlumeConfiguration: Post-validation flume configuration contains configuration for agents: [agent1]
2、解决方法如下所示:
参考链接如https://stackoverflow.com/questions/31798967/flume-could-not-configure-sink-no-channel-configured-for-sink
作者说应该是下面那种配置,一下子就明白了,自己的配置错误了,自己的如下所示:
修改以后,继续启动,解决问题。
[hadoop@slaver1 soft]$ flume-ng agent -n agent1 -c conf -f flume-1.5.0-cdh5.3.6-bin/conf/flume-conf.properties -Dflume.root.logger=DEBUG,console
【推荐】国内首个AI IDE,深度理解中文开发场景,立即下载体验Trae
【推荐】编程新体验,更懂你的AI,立即体验豆包MarsCode编程助手
【推荐】抖音旗下AI助手豆包,你的智能百科全书,全免费不限次数
【推荐】轻量又高性能的 SSH 工具 IShell:AI 加持,快人一步
· 如何编写易于单元测试的代码
· 10年+ .NET Coder 心语,封装的思维:从隐藏、稳定开始理解其本质意义
· .NET Core 中如何实现缓存的预热?
· 从 HTTP 原因短语缺失研究 HTTP/2 和 HTTP/3 的设计差异
· AI与.NET技术实操系列:向量存储与相似性搜索在 .NET 中的实现
· 周边上新:园子的第一款马克杯温暖上架
· Open-Sora 2.0 重磅开源!
· 分享 3 个 .NET 开源的文件压缩处理库,助力快速实现文件压缩解压功能!
· Ollama——大语言模型本地部署的极速利器
· DeepSeek如何颠覆传统软件测试?测试工程师会被淘汰吗?