Scrapy各项命令说明

关于Scrapy这个爬虫框架,方块字的资料实在是少。这几天查资料的时候看到了些有用处的文字,记录在此,以作备忘。

You have to execute it in your 'startproject' folder. You will have another commands if it finds your scrapy.cfg file. You can see the diference here:

$ scrapy startproject bar
$ cd bar
/
$ ls
bar  scrapy
.cfg
$ scrapy
Scrapy0.12.0.2536- project: bar

Usage:
  scrapy
<command>[options][args]

Available commands:
  crawl        
Start crawling from a spider or URL
  deploy        
Deploy project inScrapyd target
  fetch        
Fetch a URL using the Scrapy downloader
  genspider    
Generatenew spider using pre-defined templates
  list          
List available spiders
  parse        
Parse URL (using its spider)andprint the results
  queue        
Deprecated command.SeeScrapyd documentation.
  runserver    
Deprecated command.Use'server' command instead
  runspider    
Run a self-contained spider (without creating a project)
  server        
StartScrapyd server forthis project
  settings      
Get settings values
  shell        
Interactive scraping console
  startproject  
Createnew project
  version      
PrintScrapy version
  view          
Open URL in browser,as seen byScrapy

Use"scrapy <command> -h" to see more info about a command


$ cd
..
$ scrapy
Scrapy0.12.0.2536-no active project

Usage:
  scrapy
<command>[options][args]

Available commands:
  fetch        
Fetch a URL using the Scrapy downloader
  runspider    
Run a self-contained spider (without creating a project)
  settings      
Get settings values
  shell        
Interactive scraping console
  startproject  
Createnew project
  version      
PrintScrapy version
  view          
Open URL in browser,as seen byScrapy

Use"scrapy <command> -h" to see more info about a command

posted on 2012-04-10 23:01  icycore  阅读(3524)  评论(0编辑  收藏  举报

导航