scala mapPartitionsWithIndex函数的使用
摘要:
var rdd1=sc.makeRDD(Array((1,"A"),(2,"B"),(3,"C"),(4,"D")),2) rdd1.partitions.size res20:int=2 rdd1.mapPartitionsWithIndex{ (partIdx,iter)=>{ var part 阅读全文
posted @ 2018-04-26 19:11 chengjunde 阅读(1180) 评论(0) 推荐(0) 编辑