mapreduce启动命令

mapreduce启动命令

hadoop jar /var/lib/hadoop-hdfs/codejar/flash_format_testip.jar com.js.dataclean.hm2_hour.Hm2_hour_Driver /data/hm2 /data/offline/hm2_output_2022-07-01 -D mapreduce.job.priority=VERY_HIGH -D mapreduce.map.memory.mb=4096 -D mapreduce.reduce.memory.mb=4096

 

hive load 加载数据到表中

load data inpath '/data/offline/hm2_output_lzh/2022-06-30-16/dt=2022-06-30/hour=15/msgtype=helper/part-*' into table hm2.helper partition(dt='2022-06-30',hour='15',msgtype='helper');