Flink1.18 Transfrom - RichFunction

合集 - flink1.18.x 开发常用代码案例模板(30)

1.Flink1.18环境代码编写02-262.Flink1.18传统批处理代码编写02-263.flink1.18传统流处理环境编写02-264.flink1.18流批一体DataStream代码编写02-265.Flink1.18 Source - FileSource02-266.Flink1.18 Source - fromElements02-267.Flink1.18 Source - KafkaSource02-268.Flink1.18 Source - 数据生成器02-269.Flink1.18 Transfrom - Map02-2610.Flink1.18 Transfrom - flatMap02-2611.Flink1.18 Transfrom - Filter02-2612.Flink1.18 Transfrom - KeyBy02-26

13.Flink1.18 Transfrom - RichFunction02-26

14.Flink1.18 Transfrom - SimpleAggregate简单聚合算子02-2615.Flink1.18 Transfrom - Reduce02-2616.Flink1.18 Transfrom - 分区器【7种现成】02-2617.Flink1.18 Transfrom - CustomPartition自定义分区器02-2618.Flink1.18 Transfrom - 分流【Filter】02-2619.Flink1.18 Transfrom - 分流【侧输出流 ProcessFunction】02-2620.Flink1.18 Transfrom - 合流【Union】02-2621.Flink1.18 Transfrom - 合流【Connect, 并行度为1的情况】02-2622.Flink1.18 Transfrom - 合流【Connect 两个流数据进行关联】02-2623.Flink1.18 Sink - 到文件 新版本写法sinkToFile02-2624.Flink1.18 Sink - 到Kafka 新版本写法sinkTo的使用02-2625.Flink1.18 Sink - 到Kafka自定义序列化类 新版本写法sinkTo的使用02-2626.Flink1.18 Sink - 到JDBC 使用新依赖【因返回值是sinkFunction, 故目前只支持addSink使用, 1.18版本不支持sinkTo】02-2627.Flink1.18 Sink - 精确一次ExactlyOnce到JDBC 使用新依赖【因返回值是sinkFunction, 故目前只支持addSink使用, 1.18版本不支持sinkTo】02-2628.Flink1.18 Sink - 自定义sink02-2629.大数据之路Week10_day07 (JavaAPI 操作Redis 与Hbase建立索引，通过查询redis中的索引查询Hbase数据）2020-01-1230.大数据之路Week10_day07 (JavaAPI 操作Redis 模拟将redis当作缓存，从Mysql数据库中查询数据）2020-01-12

收起

package com.xiaohu.transfrom;

import com.xiaohu.bean.WaterSensor;
import org.apache.flink.api.common.functions.RichFilterFunction;
import org.apache.flink.configuration.Configuration;
import org.apache.flink.streaming.api.datastream.DataStreamSource;
import org.apache.flink.streaming.api.environment.StreamExecutionEnvironment;

/*
    富函数与普通的function的区别在于多了一个算子运行前执行方法open()和一个算子结束后执行方法close()

    所有的算子都有一个对应的RichXxxFunction


    注意：
        正常退出【算子执行结束或命令页面中cancel】，close方法会执行，cancel后会close方法执行且也会报错提示
        但是若异常退出【手动，突然宕机】，close方法不会执行



 */
public class RichFunctionDemo {
    public static void main(String[] args) throws Exception {
        StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();

        env.setParallelism(1);

        DataStreamSource<WaterSensor> senorDS = env.fromElements(
                new WaterSensor("s1", 1L, 5),
                new WaterSensor("s2", 2L, 2),
                new WaterSensor("s3", 3L, 3),
                new WaterSensor("s1", 4L, 4),
                new WaterSensor("s2", 5L, 5),
                new WaterSensor("s1", 6L, 6)
        );

//       senorDS.filter(new FilterFunction<WaterSensor>() {
//           @Override
//           public boolean filter(WaterSensor value) throws Exception {
//               return "s1".equals(value.getId());
//           }
//       }).print();

       //使用富函数
        senorDS.filter(new RichFilterFunction<WaterSensor>() {

            @Override
            public void open(Configuration parameters) throws Exception {
                System.out.println("我来了。。。。");
            }

            @Override
            public boolean filter(WaterSensor value) throws Exception {
                return "s1".equals(value.getId());
            }

            @Override
            public void close() throws Exception {
                System.out.println("我结束了。。。。");
            }
        }).print();




        env.execute();
    }
}