Scrapy各项命令说明
关于Scrapy这个爬虫框架,方块字的资料实在是少。这几天查资料的时候看到了些有用处的文字,记录在此,以作备忘。
You have to execute it in your 'startproject' folder. You will have another commands if it finds your scrapy.cfg file. You can see the diference here:
$ scrapy startproject bar
$ cd bar/
$ ls
bar scrapy.cfg
$ scrapy
Scrapy0.12.0.2536- project: bar
Usage:
scrapy <command>[options][args]
Available commands:
crawl Start crawling from a spider or URL
deploy Deploy project inScrapyd target
fetch Fetch a URL using the Scrapy downloader
genspider Generatenew spider using pre-defined templates
list List available spiders
parse Parse URL (using its spider)andprint the results
queue Deprecated command.SeeScrapyd documentation.
runserver Deprecated command.Use'server' command instead
runspider Run a self-contained spider (without creating a project)
server StartScrapyd server forthis project
settings Get settings values
shell Interactive scraping console
startproject Createnew project
version PrintScrapy version
view Open URL in browser,as seen byScrapy
Use"scrapy <command> -h" to see more info about a command
$ cd ..
$ scrapy
Scrapy0.12.0.2536-no active project
Usage:
scrapy <command>[options][args]
Available commands:
fetch Fetch a URL using the Scrapy downloader
runspider Run a self-contained spider (without creating a project)
settings Get settings values
shell Interactive scraping console
startproject Createnew project
version PrintScrapy version
view Open URL in browser,as seen byScrapy
Use"scrapy <command> -h" to see more info about a command