11 2021 档案

airflow.exceptions.AirflowException: `python_callable` param must be callable
摘要：后来发现是自己为了测试，两个task，调用的pythonOperator是同一个python方法导致的 阅读全文
posted @ 2021-11-29 17:00 巴黎爱工作 阅读(595) 评论(0) 推荐(0) 编辑
Passing Data Between Airflow Tasks
摘要：introduction Sharing data between tasks is a very common use case in Airflow. If you've been writing DAGs, you probably know that breaking them up int 阅读全文
posted @ 2021-11-10 17:58 巴黎爱工作 阅读(137) 评论(0) 推荐(0) 编辑
airflow sample to pass metadata to task. -----XCOM
摘要：1. At first, let us take a look at one sample which one we do not need to pass the metadata import random from datetime import datetime, timedelta fro 阅读全文
posted @ 2021-11-10 16:37 巴黎爱工作 阅读(48) 评论(0) 推荐(0) 编辑
airflow sample to start google chrome broswer
摘要：from datetime import datetime, timedelta from airflow.utils.dates import days_ago from airflow import DAG from airflow.operators.python import PythonO 阅读全文
posted @ 2021-11-10 16:34 巴黎爱工作 阅读(63) 评论(0) 推荐(0) 编辑

点击右上角即可分享
微信分享提示