ALINK(十四):数据处理(一)数据划分 (SplitBatchOp) 一
Java 类名:com.alibaba.alink.operator.batch.dataproc.SplitBatchOp
Python 类名:SplitBatchOp
功能介绍
本算子将输入数据按比例拆分为两部分。
参数说明
名称 |
中文名称 |
描述 |
类型 |
是否必须? |
默认值 |
fraction |
拆分到左端的数据比例 |
拆分到左端的数据比例 |
Double |
✓ |
|
randomSeed |
随机数种子 |
随机数种子 |
Integer |
null |
代码示例
Python 代码
from pyalink.alink import * import pandas as pd useLocalEnv(1) df_data = pd.DataFrame([['Ohio', 2000, 1.5], ['Ohio', 2001, 1.7], ['Ohio', 2002, 3.6], ['Nevada', 2001, 2.4], ['Nevada', 2002, 2.9], ['Nevada', 2003, 3.2],]) batch_data = BatchOperator.fromDataframe(df_data, schemaStr='f1 string, f2 bigint, f3 double') spliter = SplitBatchOp().setFraction(0.5) spliter.linkFrom(batch_data) spliter.print()
spliter.getSideOutput(0).print() #另外的部分
Java 代码
import org.apache.flink.types.Row; import com.alibaba.alink.operator.batch.BatchOperator; import com.alibaba.alink.operator.batch.dataproc.SplitBatchOp; import com.alibaba.alink.operator.batch.source.MemSourceBatchOp; import org.junit.Test; import java.util.Arrays; import java.util.List; public class SplitBatchOpTest { @Test public void testSplitBatchOp() throws Exception { List <Row> df_data = Arrays.asList( Row.of("Ohio", 2001, 1.7), Row.of("Ohio", 2002, 3.6), Row.of("Nevada", 2001, 2.4), Row.of("Nevada", 2002, 2.9) ); BatchOperator <?> batch_data = new MemSourceBatchOp(df_data, "f1 string, f2 int, f3 double"); BatchOperator <?> spliter = new SplitBatchOp().setFraction(0.5); spliter.linkFrom(batch_data); spliter.print(); } }
运行结果
本文来自博客园,作者:秋华,转载请注明原文链接:https://www.cnblogs.com/qiu-hua/p/14887463.html