摘要:
row_number,rank,dense_rank,percent_rank 阅读全文
摘要:
val df6 = spark.sql("select gender,children,max(age),avg(age),count(age) from Affairs group by Cube(gender,children) order by 1,2") df6.show +------+--------+--------+--------+----------+ ... 阅读全文
摘要:
mean均值,variance方差,stddev标准差,corr(Pearson相关系数),skewness偏度,kurtosis峰度 阅读全文
摘要:
collect_set去除重复元素;collect_list不去除重复元素select gender, concat_ws(',', collect_set(children)), concat_ws(',', collect_list(children)) from Affairs group b 阅读全文
摘要:
视图,SQL 阅读全文
摘要:
data.groupBy("gender").agg(count($"age"),max($"age").as("maxAge"), avg($"age").as("avgAge")).show +------+----------+------+------+ |gender|count(age)|m... 阅读全文
摘要:
DataFrame,数据框,去重,差集,交集 阅读全文
摘要:
持久化,存储级别,StorageLevel 阅读全文
摘要:
DataFrame,数据框,行操作,列操作,物理执行计划,逻辑执行计划 阅读全文