随笔分类 - Spark代码笔记

org.apache.spark.shuffle.FetchFailedException: The relative remote executor(Id: 21), which maintains the block data to fetch is dead.

摘要：# 问题描述 org.apache.spark.shuffle.FetchFailedException: The relative remote executor(Id: 21), which maintains the block data to fetch is dead. 最近在做Spark 阅读全文

posted @ 2023-07-05 09:37 逆光飞翔- 阅读(1264) 评论(0) 推荐(0)

spark之交集并集差集拉链

摘要：spark之交集并集差集拉链 def main(args: Array[String]): Unit = { val sparkConf = new SparkConf().setMaster("local[*]").setAppName("Operator") val sc = new Spark 阅读全文

posted @ 2021-09-22 19:52 逆光飞翔- 阅读(481) 评论(0) 推荐(0)