【python爬虫】scrapy入门4--添加cookies

(1) settings.py

取消注释:COOKIES_ENABLED = True

 

(2)爬虫xx.py

    def parse(self, response):
        c_dic = {自己抓包}
            # 获取cookies
        xxx自己写原始页面xxx
            yield scrapy.Request(url,cookies=c_dic,callback=self.parse_news)


    def parse_news(self,response):
        xxx跳转页面xxx

 

posted @ 2020-05-07 18:25  HuaBro  阅读(421)  评论(0编辑  收藏  举报