dremio parquet zstd 压缩支持docker 镜像

为了方便测试测试，我构建了一个docker 镜像

镜像

Dockerfile

FROM  dremio/dremio-oss:23.0.1

USER root

COPY dremio.conf /opt/dremio/conf/dremio.conf

COPY --from=hengyunabc/arthas:latest /opt/arthas /opt/arthas

COPY zstd-jni-1.5.0-1.jar /opt/dremio/jars/3rdparty/

COPY libhadoop.so.1.0.0 /opt/dremio/lib/libhadoop.so

COPY dremio-sabot-kernel-23.0.1-202210141019030815-c1de8bcc.jar /opt/dremio/jars/dremio-sabot-kernel-23.0.1-202210141019030815-c1de8bcc.jar

USER dremio

可以使用的镜像

dalongrong/dremio:23.1-zstd

使用

docker-compose

version: "3"

services:

  mongo:

    image: mongo:4.2

    environment:

      - "MONGO_INITDB_ROOT_USERNAME=root"

      - "MONGO_INITDB_ROOT_PASSWORD=dalongdemo"

    ports:

      - "27017:27017"

  minio:

    image: minio/minio

    ports:

      - "9002:9000"

      - "19001:19001"

    environment:

      MINIO_ACCESS_KEY: minio

      MINIO_SECRET_KEY: minio123

    command: server --console-address :19001 --quiet /data

  dremio:

    image: dalongrong/dremio:23.1-zstd

    volumes:

      - ./dat:/data

    ports:

      - "9047:9047"

      - "8849:8849"

      - "31010:31010"

参考资料

https://github.com/rongfengliang/dremio-parquet-zstd
https://www.modb.pro/db/376402