利用celery进行分布式爬虫

转载：https://zhuanlan.zhihu.com/p/100107333
转载：https://blog.csdn.net/jclian91/article/details/86750042?biz_id=102&utm_term=python%20celery%E5%88%86%E5%B8%83%E5%BC%8F%E7%88%AC%E8%99%AB&utm_medium=distribute.pc_search_result.none-task-blog-2_allsobaiduweb~default-0-86750042&spm=1018.2118.3001.4449
转载：https://www.jianshu.com/p/b26124772a00