摘要: #coding=utf-8 _date_ = '2018/12/9 16:18' import requests import re import json import time def get_one_page(url): headers={ 'User-Agent':'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKi... 阅读全文
posted @ 2018-12-09 17:36 404NooFound 阅读(235) 评论(0) 推荐(0) 编辑
摘要: class MonggoPipline(object): def __init__(self,mongo_uri,mongo_db): self.mongo_uri=mongo_uri self.mongo_db=mongo_db @classmethod def from_crawler(cls,crawler): re... 阅读全文
posted @ 2018-12-09 16:16 404NooFound 阅读(63) 评论(0) 推荐(0) 编辑