总结在部署分布式爬虫环境过程中常见的若干问题

 

1、pip安装的第三方包/本地包都到哪里了？

https://blog.csdn.net/yinshuilan/article/details/93590388

 

2、Running setup.py install for Twisted ... error

https://blog.csdn.net/code_AC/article/details/71159244

 

3、什么是Twisted?

https://www.cnblogs.com/tangkaixin/articles/4315697.html

 

4、安装MySQL

https://www.cnblogs.com/nangua19/p/10452020.html

 

5、python包更换源

https://blog.csdn.net/sscc_learning/article/details/85339529

 

 

6、爬虫开发过程中验证http参数

https://httpbin.org/get

 

7、python模块索引大全

https://yiyibooks.cn/xx/python_352/py-modindex.html

 

8、redis添加服务

https://www.jb51.net/article/132969.htm