|NO.Z.00025|——————————|BigDataEnd|——|Hadoop&实时数仓.V05|——|项目.v05|ODS层处理|将kafka中的维表写入DIM层.V2|

一、启动相关服务

### --- 启动相关服务

~~~     # 启动zookeeper服务
[root@hadoop01 ~]# ./zk.sh start
~~~     # 启动kafka服务：所有节点
[root@hadoop01 ~]# kafka-server-start.sh -daemon /opt/yanqi/servers/kafka_2.12/config/server.properties

~~~     # 启动hdfs服务
[root@hadoop01 ~]# start-dfs.sh
 
~~~     # 启动yarn服务:可以不启动
[root@hadoop03 ~]# start-yarn.sh

~~~     # 启动mysql服务

[root@hadoop03 ~]# systemctl start mysqld

~~~     # 启动canal服务

[root@hadoop02 ~]# sh /opt/yanqi/servers/canal/bin/startup.sh

~~~     # 启动hbash服务

[root@hadoop02 ~]# start-hbase.sh

二、在hbash中创建表

~~~     # 在hbash中创建yanqi_trade_orders，yanqi_area表

[root@hadoop02 ~]# /opt/yanqi/servers/hbase-1.3.1/bin/hbase shell
hbase(main):056:0> create 'yanqi_trade_orders' , 'f1'
hbase(main):056:0> create 'yanqi_area' , 'f1'

~~~     # 查看orders表中的数据

hbase(main):004:0> scan 'yanqi_area'
ROW                                         COLUMN+CELL 
hbase(main):001:0> scan  'yanqi_trade_orders'
ROW                                         COLUMN+CELL
~~~当前没有数据

三、启动kafka生产者消费者

~~~     # 启动kafka生产者

[root@hadoop02 ~]# kafka-console-producer.sh --broker-list hadoop02:9092 --topic canal

~~~     # 启动kafka消费者

[root@hadoop02 ~]# kafka-console-consumer.sh --zookeeper hadoop02:2181/myKafka --topic canal --from-beginning
~~~等待消费数据

---

 

 

 

 

 

 

 

 

 

---

Walter Savage Landor:strove with none,for none was worth my strife.Nature I loved and, next to Nature, Art:I warm'd both hands before the fire of life.It sinks, and I am ready to depart

                                                                                                                                                   ——W.S.Landor

---