airflow

基于airflow官方镜像制作自己的镜像，如给镜像安装pymongo

FROM        10.60.10.119:5000/common/air_grpc:0.0.2
 

USER 0
RUN  pip install pymongo
USER airflow

镜像里都装了啥，可以通过docker history + 镜像来查看

 

LocalExecutor executes tasks locally in parallel. It uses the multiprocessing Python library and queues to parallelize the execution of tasks.

CeleryExecutor  is one of the ways you can scale out the number of workers. For this to work, you need to setup a Celery backend (RabbitMQ, Redis, …) and change your airflow.cfg to point the executor parameter to CeleryExecutor and provide the related Celery settings

SequentialExecutor:This executor will only run one task instance at a time, can be used for debugging. It is also the only executor that can be used with sqlite since sqlite doesn’t support multiple connections