摘要: 引入依赖 <dependency> <groupId>com.alibaba</groupId> <artifactId>fastjson</artifactId> <version>1.2.33</version> </dependency> val env = StreamExecutionEn 阅读全文
posted @ 2021-06-24 19:34 nohert 阅读(841) 评论(0) 推荐(0) 编辑
摘要: import it.bigdata.flink.study.SensorReding import org.apache.flink.api.common.state.{ValueState, ValueStateDescriptor} import org.apache.flink.configu 阅读全文
posted @ 2021-06-24 19:32 nohert 阅读(345) 评论(0) 推荐(0) 编辑
摘要: import it.bigdata.flink.study.SensorReding import org.apache.flink.api.common.serialization.SimpleStringSchema import org.apache.flink.streaming.api.s 阅读全文
posted @ 2021-06-24 19:31 nohert 阅读(87) 评论(0) 推荐(0) 编辑
摘要: import java.sql.{Connection, Driver, DriverManager, PreparedStatement}import it.bigdata.flink.study.SensorRedingimport org.apache.flink.configuration. 阅读全文
posted @ 2021-06-24 19:29 nohert 阅读(134) 评论(0) 推荐(0) 编辑
摘要: import java.sql.{Connection, DriverManager, PreparedStatement} import it.bigdata.flink.study.SensorReding import org.apache.flink.configuration.Config 阅读全文
posted @ 2021-06-24 19:28 nohert 阅读(542) 评论(0) 推荐(0) 编辑
摘要: import it.bigdata.flink.study.SensorReding import org.apache.flink.api.common.serialization.SimpleStringEncoder import org.apache.flink.core.fs.Path i 阅读全文
posted @ 2021-06-24 19:12 nohert 阅读(112) 评论(0) 推荐(0) 编辑
摘要: import java.util import it.bigdata.flink.study.SensorReding import org.apache.flink.api.common.functions.RuntimeContext import org.apache.flink.stream 阅读全文
posted @ 2021-06-24 19:11 nohert 阅读(281) 评论(0) 推荐(0) 编辑
摘要: class MyRichMapper extends RichMapFunction[SensorReding,String]{ override def open(parameters: Configuration): Unit = { //做一些初始化操作,比如数据库的连接 // getRunt 阅读全文
posted @ 2021-06-24 19:06 nohert 阅读(382) 评论(0) 推荐(0) 编辑
摘要: 数据 sensor_1,1547718101,35.8 sensor_1,1547718102,22.2 sensor_1,1547718101,55.3 sensor_1,1547718102,24.1 sensor_1,1547718103,57 sensor_1,1547718103,58 s 阅读全文
posted @ 2021-06-24 19:03 nohert 阅读(356) 评论(0) 推荐(0) 编辑
摘要: 数据: sensor_1,1547718101,35.8 sensor_1,1547718102,22.2 sensor_1,1547718101,55.3 sensor_1,1547718102,24.1 sensor_1,1547718103,57 sensor_1,1547718103,58 阅读全文
posted @ 2021-06-24 18:56 nohert 阅读(173) 评论(0) 推荐(0) 编辑
摘要: import org.apache.flink.api.common.functions.{FilterFunction, ReduceFunction, RichMapFunction} import org.apache.flink.configuration.Configuration imp 阅读全文
posted @ 2021-06-24 18:52 nohert 阅读(214) 评论(0) 推荐(0) 编辑
摘要: import org.apache.flink.api.common.functions.{FilterFunction, ReduceFunction, RichMapFunction} import org.apache.flink.configuration.Configuration imp 阅读全文
posted @ 2021-06-24 18:49 nohert 阅读(234) 评论(0) 推荐(0) 编辑
摘要: import org.apache.flink.api.scala.ExecutionEnvironment import org.apache.flink.api.scala._ object WordCount { /** * 第一个flink,wordcount * @param args * 阅读全文
posted @ 2021-06-24 18:46 nohert 阅读(62) 评论(0) 推荐(0) 编辑
摘要: import org.apache.flink.api.java.utils.ParameterTool import org.apache.flink.streaming.api.scala.{DataStream, StreamExecutionEnvironment} import org.a 阅读全文
posted @ 2021-06-24 18:44 nohert 阅读(37) 评论(0) 推荐(0) 编辑
摘要: package it.bigdata.flink.study import java.util.Properties import org.apache.flink.api.common.serialization.SimpleStringSchema import org.apache.flink 阅读全文
posted @ 2021-06-24 18:42 nohert 阅读(82) 评论(0) 推荐(0) 编辑
摘要: flink代码开发基础随记 1.常用设置 设置共享组:slotsharingGroup(“a”) 关闭合并任务链操作,每个任务独享solt:env.disableOperatorChaining() 设置并行度: env.setParallelism(1) Flatmap用法: FlatMap(Li 阅读全文
posted @ 2021-06-24 18:39 nohert 阅读(185) 评论(0) 推荐(0) 编辑
摘要: Flink运行时组件: JobManager 作业管理器 TaskManager 任务管理器 ResourceManager 资源管理器 Dispacher 分发器 阅读全文
posted @ 2021-06-24 18:37 nohert 阅读(153) 评论(0) 推荐(0) 编辑
摘要: Flink 命令: 提交任务: ./bin/flink run -c it.bigdata.flink.study.SteamWordCount -p 1 /root/jar/maven_flink-1.0-SNAPSHOT-jar-with-dependencies.jar --host 10.1 阅读全文
posted @ 2021-06-24 18:36 nohert 阅读(499) 评论(0) 推荐(0) 编辑
摘要: 1.打开idea,选择new project,跳转至如下界面: 2.单击next 下一步,输入项目名称,单击finish完成 3.在项目main项目下新建scala目录,并新建文件,文件名称为 hello.scala 4.新建文件之后,进入helllo.scala文件,会弹出添加sdk,添加自己版本 阅读全文
posted @ 2021-06-24 18:35 nohert 阅读(288) 评论(0) 推荐(1) 编辑
摘要: 1.下载安装包,flink-1.12.0-bin-scala_2.12.tgz 下载地址:https://flink.apache.org/downloads.html 2.解压安装包,tar -zvxf ./ flink-1.12.0-bin-scala_2.12.tgz -C ../softwa 阅读全文
posted @ 2021-06-24 18:31 nohert 阅读(590) 评论(0) 推荐(0) 编辑