Spark SQL查看物理执行计划,explain

sql语句方式
flightData2015.createOrReplaceTempView("flightData2015")
spark.sql("select DEST_COUNTRY_NAME ,sum(count) as destination_total" +
" from flightData2015 group by DEST_COUNTRY_NAME order by sum(count) limit 5").explain
code方式
import org.apache.spark.sql.functions._
flightData2015.groupBy("DEST_COUNTRY_NAME")
.sum("count")
.withColumnRenamed("sum(count)","destination_total")
.sort(desc("destination_total"))
.limit(5)
.explain
posted @ 2020-03-07 21:51  再见傅里叶  阅读(3044)  评论(0编辑  收藏  举报