Hadoop-3.x.x配置LZOP压缩

Hadoop配置文件core-site.xml

添加下列配置

<configuration>
    <property>
        <name>io.compression.codecs</name>
        <value>
            org.apache.hadoop.io.compress.GzipCodec,
            org.apache.hadoop.io.compress.DefaultCodec,
            org.apache.hadoop.io.compress.BZip2Codec,
            org.apache.hadoop.io.compress.SnappyCodec,
            com.hadoop.compression.lzo.LzoCodec,
            com.hadoop.compression.lzo.LzopCodec
        </value>
    </property>

    <property>
        <name>io.compression.codec.lzo.class</name>
        <value>com.hadoop.compression.lzo.LzoCodec</value>
    </property>
</configuration>

将jar(点击下载，提取码 jlpb)丢进${HADOOP_HOME}/share/hadoop/common下

重启HDFS集群即可

至于这个jar怎么来的，等有空我整理在后面把，先干活

 

posted @ 2020-09-14 15:03  wen1995  阅读(307)  评论(0)  编辑  收藏  举报