摘要：
scrapy框架默认是有去重（重复的请求直接忽略掉）设置的，就是如果多个请求完全相同，那么就会报错“Filtered duplicate request no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplic 阅读全文
摘要：
SELECT channel, count(*) from crawled_goods where datediff(created_at,NOW())=0 and channel like '%yijiupi%'GROUP BY( channel) 阅读全文