Flink学习笔记——Environment
Flink有以下几种Environment
1. 批处理Environment,ExecutionEnvironment
1 | ExecutionEnvironment env = ExecutionEnvironment.getExecutionEnvironment(); |
2.流处理Environment,StreamExecutionEnvironment
1 | StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(); |
3. 本机Environment,LocalEnvironment
1 | ExecutionEnvironment env = LocalEnvironment.getExecutionEnvironment(); |
4. java集合Environment,CollectionEnvironment
1 | ExecutionEnvironment env = CollectionEnvironment.getExecutionEnvironment(); |
Ref
1 | https: //www .yuque.com /cuteximi/base/flink-02 ?language=en-us |
创建Environment的方法
1. getExecutionEnvironment ,含义就是本地运行就是 createLocalEnvironment,如果是通过client提交到集群上,就返回集群的环境
1 2 3 4 | Creates an execution environment that represents the context in which the program is currently executed. * If the program is invoked standalone, this method returns a local execution environment, as returned by * {@link #createLocalEnvironment()}. If the program is invoked from within the command line client to be * submitted to a cluster, this method returns the execution environment of this cluster. |
Ref
1 | https: //github .com /apache/flink/blob/master/flink-java/src/main/java/org/apache/flink/api/java/ExecutionEnvironment .java |
2. createLocalEnvironment ,返回本地执行环境,需要在调用时指定默认的并行度,比如
1 2 3 | LocalStreamEnvironment env1 = StreamExecutionEnvironment.createLocalEnvironment(1); LocalEnvironment env2 = ExecutionEnvironment.createLocalEnvironment(1); |
3. createRemoteEnvironment, 返回集群执行环境,将 Jar 提交到远程服务器。需要在调用时指定 JobManager 的 IP 和端口号,并指定要在集群中运行的 Jar 包,比如
1 2 3 | StreamExecutionEnvironment env1 = StreamExecutionEnvironment.createRemoteEnvironment( "127.0.0.1" , 8080, "/path/word_count.jar" ); ExecutionEnvironment env2 = ExecutionEnvironment.createRemoteEnvironment( "127.0.0.1" , 8080, "/path/word_count.jar" ); |
本文只发表于博客园和tonglin0325的博客,作者:tonglin0325,转载请注明原文链接:https://www.cnblogs.com/tonglin0325/p/14116392.html
【推荐】国内首个AI IDE,深度理解中文开发场景,立即下载体验Trae
【推荐】编程新体验,更懂你的AI,立即体验豆包MarsCode编程助手
【推荐】抖音旗下AI助手豆包,你的智能百科全书,全免费不限次数
【推荐】轻量又高性能的 SSH 工具 IShell:AI 加持,快人一步
· 10年+ .NET Coder 心语,封装的思维:从隐藏、稳定开始理解其本质意义
· .NET Core 中如何实现缓存的预热?
· 从 HTTP 原因短语缺失研究 HTTP/2 和 HTTP/3 的设计差异
· AI与.NET技术实操系列:向量存储与相似性搜索在 .NET 中的实现
· 基于Microsoft.Extensions.AI核心库实现RAG应用
· 10年+ .NET Coder 心语 ── 封装的思维:从隐藏、稳定开始理解其本质意义
· 地球OL攻略 —— 某应届生求职总结
· 提示词工程——AI应用必不可少的技术
· Open-Sora 2.0 重磅开源!
· 字符编码:从基础到乱码解决
2018-12-10 Elasticsearch学习笔记——常用命令