摘要: 打算下载flink程序的日志看看,发现报错:yarn application -list -appStates ALL |grep Flink yarn logs -applicationId application_1554280683684_749610Log aggregation has not completed or is not enabled.解决:yarn-site.xml 配置... 阅读全文
posted @ 2019-06-05 20:38 春江师兄 阅读(955) 评论(0) 推荐(0) 编辑
摘要: package window.non_keyedimport org.apache.flink.api.common.functions.FlatMapFunctionimport org.apache.flink.streaming.api.functions.source.SourceFunctionimport org.apache.flink.streaming.api.scala.Str... 阅读全文
posted @ 2019-06-05 10:40 春江师兄 阅读(2673) 评论(0) 推荐(0) 编辑
摘要: 窗口的划分:翻滚窗口(Tumbling Window,无重叠)滚动窗口(Sliding Window,有重叠)会话窗口(Session Window,活动间隙)窗口的类型: 窗口在处理数据前,会对数据做分流,有两种控制流的方式,按照数据流划分:Keyed和Non-Keyed Windows。 Keyed Windows:就是有按照某个字段分组的数据流使用的窗口,可以理解为按照原始数据流中的... 阅读全文
posted @ 2019-06-05 10:07 春江师兄 阅读(1070) 评论(0) 推荐(0) 编辑
摘要: package windowimport org.apache.flink.api.common.functions.AggregateFunctionimport org.apache.flink.api.scala._import org.apache.flink.streaming.api.functions.source.SourceFunctionimport org.apache.fl... 阅读全文
posted @ 2019-06-05 09:57 春江师兄 阅读(3483) 评论(2) 推荐(0) 编辑
摘要: package windowimport org.apache.flink.streaming.api.functions.source.SourceFunctionimport org.apache.flink.streaming.api.scala.StreamExecutionEnvironmentimport org.apache.flink.streaming.api.windowing... 阅读全文
posted @ 2019-06-05 09:50 春江师兄 阅读(856) 评论(0) 推荐(0) 编辑
摘要: package windowimport org.apache.flink.api.common.functions.AggregateFunctionimport org.apache.flink.streaming.api.functions.source.SourceFunctionimport org.apache.flink.streaming.api.scala.StreamExecu... 阅读全文
posted @ 2019-06-05 09:49 春江师兄 阅读(2217) 评论(0) 推荐(0) 编辑
摘要: package windowimport org.apache.flink.api.common.functions.{AggregateFunction, FoldFunction}import org.apache.flink.api.scala._import org.apache.flink.streaming.api.functions.source.SourceFunctionimpo... 阅读全文
posted @ 2019-06-05 09:48 春江师兄 阅读(1209) 评论(0) 推荐(0) 编辑