|NO.Z.00009|——————————|BigDataEnd|——|Hadoop&OLAP_Kylin.V09|——|Kylin.v09|Kylin构建Cube|增量构建Cube.V2|

一、增量Cube构建

### --- 增量cube构建流程

~~~     步骤：定义数据源 => 定义model => 定义Cube => 构建Cube

二、定义数据源

### --- 准备数据源

~~~     # 准备数据源
[root@hadoop02 ~]# ll /data/kylin/
~~~准备数据源
dw_sales1001_data.txt
dw_sales1002_data.txt
dw_sales1003_data.txt
dw_sales1004_data.txt

### --- 创建数据表

~~~     # 切换数据库
hive (default)> use yanqi_kylin;
hive (yanqi_kylin)>

~~~     # 创建数据表

hive (yanqi_kylin)> drop table yanqi_kylin.dw_sales1;

hive (yanqi_kylin)> create table yanqi_kylin.dw_sales1(
                    id string,
                    channelId string,
                    productId string,
                    regionId string,
                    amount int,
                    price double
                    )
                    partitioned by (dt string)
                    ROW FORMAT DELIMITED FIELDS TERMINATED BY ',';

### --- 加载数据：4天时间

~~~     # 加载数据：2021-10-01
hive (yanqi_kylin)> load data local inpath "/data/kylin/dw_sales1001_data.txt"
                    into table yanqi_kylin.dw_sales1
                    partition(dt="2021-10-01");

~~~     # 加载数据：2021-10-02

hive (yanqi_kylin)> load data local inpath "/data/kylin/dw_sales1002_data.txt"
                    into table yanqi_kylin.dw_sales1
                    partition(dt="2021-10-02");

~~~     # 加载数据：2021-10-03

hive (yanqi_kylin)> load data local inpath "/data/kylin/dw_sales1003_data.txt"
                    into table yanqi_kylin.dw_sales1
                    partition(dt="2021-10-03");

~~~     # 加载数据：2021-10-04

hive (yanqi_kylin)> load data local inpath "/data/kylin/dw_sales1004_data.txt"
                    into table yanqi_kylin.dw_sales1
                    partition(dt="2021-10-04");

### --- 查看加载的数据

~~~     # 查看加载的数据
hive (yanqi_kylin)> show partitions  dw_sales1;
partition
dt=2021-10-01
dt=2021-10-02
dt=2021-10-03
dt=2021-10-04

~~~     # 统计每天的数据

hive (yanqi_kylin)> select dt, count(*) from yanqi_kylin.dw_sales1 group by dt;
dt  _c1
2021-10-01  1000
2021-10-02  1207
2021-10-03  647
2021-10-04  1098                                  

---

 

 

 

 

 

 

 

 

 

---

Walter Savage Landor:strove with none,for none was worth my strife.Nature I loved and, next to Nature, Art:I warm'd both hands before the fire of life.It sinks, and I am ready to depart

                                                                                                                                                   ——W.S.Landor

---