爬虫开发环境安装
1.安装anaconda3
www.continuum.io/downloads
2.安装scrapy
conda install -c conda-forge scrapy
3.安装pycharm2016
4.创建scrapy项目
C:\Users\yui>cd C:\pythonproject
C:\pythonproject>scrapy startproject spidertest
5.用pycharm打开项目spidertest
6.命令行运行spidertest
C:\pythonproject>cd spidertest
C:\pythonproject\spidertest>scrapy crawl dmoz
