dremio parquet zstd 压缩支持docker 镜像
为了方便测试测试,我构建了一个docker 镜像
镜像
Dockerfile
FROM dremio/dremio-oss:23.0.1
USER root
COPY dremio.conf /opt/dremio/conf/dremio.conf
COPY --from=hengyunabc/arthas:latest /opt/arthas /opt/arthas
COPY zstd-jni-1.5.0-1.jar /opt/dremio/jars/3rdparty/
COPY libhadoop.so.1.0.0 /opt/dremio/lib/libhadoop.so
COPY dremio-sabot-kernel-23.0.1-202210141019030815-c1de8bcc.jar /opt/dremio/jars/dremio-sabot-kernel-23.0.1-202210141019030815-c1de8bcc.jar
USER dremio
可以使用的镜像
dalongrong/dremio:23.1-zstd
使用
docker-compose
version: "3"
services:
mongo:
image: mongo:4.2
environment:
- "MONGO_INITDB_ROOT_USERNAME=root"
- "MONGO_INITDB_ROOT_PASSWORD=dalongdemo"
ports:
- "27017:27017"
minio:
image: minio/minio
ports:
- "9002:9000"
- "19001:19001"
environment:
MINIO_ACCESS_KEY: minio
MINIO_SECRET_KEY: minio123
command: server --console-address :19001 --quiet /data
dremio:
image: dalongrong/dremio:23.1-zstd
volumes:
- ./dat:/data
ports:
- "9047:9047"
- "8849:8849"
- "31010:31010"
参考资料
https://github.com/rongfengliang/dremio-parquet-zstd
https://www.modb.pro/db/376402