摘要:
引入依赖 <dependency> <groupId>com.alibaba</groupId> <artifactId>fastjson</artifactId> <version>1.2.33</version> </dependency> val env = StreamExecutionEn 阅读全文
摘要:
import it.bigdata.flink.study.SensorReding import org.apache.flink.api.common.state.{ValueState, ValueStateDescriptor} import org.apache.flink.configu 阅读全文
摘要:
import it.bigdata.flink.study.SensorReding import org.apache.flink.api.common.serialization.SimpleStringSchema import org.apache.flink.streaming.api.s 阅读全文
摘要:
import java.sql.{Connection, Driver, DriverManager, PreparedStatement}import it.bigdata.flink.study.SensorRedingimport org.apache.flink.configuration. 阅读全文
摘要:
import java.sql.{Connection, DriverManager, PreparedStatement} import it.bigdata.flink.study.SensorReding import org.apache.flink.configuration.Config 阅读全文
摘要:
import it.bigdata.flink.study.SensorReding import org.apache.flink.api.common.serialization.SimpleStringEncoder import org.apache.flink.core.fs.Path i 阅读全文
摘要:
import java.util import it.bigdata.flink.study.SensorReding import org.apache.flink.api.common.functions.RuntimeContext import org.apache.flink.stream 阅读全文
摘要:
class MyRichMapper extends RichMapFunction[SensorReding,String]{ override def open(parameters: Configuration): Unit = { //做一些初始化操作,比如数据库的连接 // getRunt 阅读全文
摘要:
数据 sensor_1,1547718101,35.8 sensor_1,1547718102,22.2 sensor_1,1547718101,55.3 sensor_1,1547718102,24.1 sensor_1,1547718103,57 sensor_1,1547718103,58 s 阅读全文
摘要:
数据: sensor_1,1547718101,35.8 sensor_1,1547718102,22.2 sensor_1,1547718101,55.3 sensor_1,1547718102,24.1 sensor_1,1547718103,57 sensor_1,1547718103,58 阅读全文
摘要:
import org.apache.flink.api.common.functions.{FilterFunction, ReduceFunction, RichMapFunction} import org.apache.flink.configuration.Configuration imp 阅读全文
摘要:
import org.apache.flink.api.common.functions.{FilterFunction, ReduceFunction, RichMapFunction} import org.apache.flink.configuration.Configuration imp 阅读全文
摘要:
import org.apache.flink.api.scala.ExecutionEnvironment import org.apache.flink.api.scala._ object WordCount { /** * 第一个flink,wordcount * @param args * 阅读全文
摘要:
import org.apache.flink.api.java.utils.ParameterTool import org.apache.flink.streaming.api.scala.{DataStream, StreamExecutionEnvironment} import org.a 阅读全文
摘要:
package it.bigdata.flink.study import java.util.Properties import org.apache.flink.api.common.serialization.SimpleStringSchema import org.apache.flink 阅读全文
摘要:
flink代码开发基础随记 1.常用设置 设置共享组:slotsharingGroup(“a”) 关闭合并任务链操作,每个任务独享solt:env.disableOperatorChaining() 设置并行度: env.setParallelism(1) Flatmap用法: FlatMap(Li 阅读全文
摘要:
Flink运行时组件: JobManager 作业管理器 TaskManager 任务管理器 ResourceManager 资源管理器 Dispacher 分发器 阅读全文
摘要:
Flink 命令: 提交任务: ./bin/flink run -c it.bigdata.flink.study.SteamWordCount -p 1 /root/jar/maven_flink-1.0-SNAPSHOT-jar-with-dependencies.jar --host 10.1 阅读全文
摘要:
1.打开idea,选择new project,跳转至如下界面: 2.单击next 下一步,输入项目名称,单击finish完成 3.在项目main项目下新建scala目录,并新建文件,文件名称为 hello.scala 4.新建文件之后,进入helllo.scala文件,会弹出添加sdk,添加自己版本 阅读全文
摘要:
1.下载安装包,flink-1.12.0-bin-scala_2.12.tgz 下载地址:https://flink.apache.org/downloads.html 2.解压安装包,tar -zvxf ./ flink-1.12.0-bin-scala_2.12.tgz -C ../softwa 阅读全文