scrapy安装
1 安装python2.7
添加环境变量:path=D:\Program Files (x86)\python;D:\Program Files (x86)\python\Scripts;
验证:
2 安装Twisted
1) 安装setuptools
下载地址:http://pypi.python.org/packages/2.7/s/setuptools/setuptools-0.6c11.win32-py2.7.exe
2) 安装Zope.Interface
下载地址:http://pypi.python.org/packages/2.7/z/zope.interface/zope.interface-4.0.1-py2.7-win32.egg
安装命令:
D:\Python27\Scripts>easy_install.exe zope.interface-4.0.1-py2.7-win32.egg
验证安装:
进入python命令行: import zope.interface
3) 安装Twisted
下载地址:http://pypi.python.org/packages/2.7/T/Twisted/Twisted-12.1.0.win32-py2.7.msi
四、 安装w3lib
下载地址: http://pypi.python.org/packages/source/w/w3lib/w3lib-1.2.tar.gz
进入解压目录:python setup.py install
验证:import w3lib
五、 安装libxml2
下载地址:http://users.skynet.be/sbi/libxml-python/binaries/libxml2-python-2.7.7.win32-py2.7.exe
验证:import libxml2
六、 安装pyOpenSSL
下载地址:http://pypi.python.org/packages/2.7/p/pyOpenSSL/pyOpenSSL-0.13.winxp32-py2.7.msi
验证安装:import OpenSSL
七、 安装Scrapy
下载地址:http://pypi.python.org/packages/source/S/Scrapy/Scrapy-0.14.4.tar.gz
进入解压目录: python setup.py install
验证:打开cmd,输入scrapy
Scrapy 0.14.4 - no active project Usage: scrapy <command> [options] [args] Available commands: fetch Fetch a URL using the Scrapy downloader runspider Run a self-contained spider (without creating a project) settings Get settings values shell Interactive scraping console startproject Create new project version Print Scrapy version view Open URL in browser, as seen by Scrapy Use "scrapy <command> -h" to see more info about a command