随笔分类 - 爬虫

【3】httpie

摘要：sudo apt install httpie pip install httpie http http://httpbin.org/get 语法高亮 http http://httpbin.org/get HTTP/1.1 200 OK Access-Control-Allow-Credentia 阅读全文

posted @ 2020-03-17 21:40 狂奔~ 编辑

【2】wget

摘要：wget wget http://httpbin.org/image/png wget -O test.png http://httpbin.org/image/png 以指定名字保存下载的文件 wget --limit-rate=20k test.png http://httpbin.org/im 阅读全文

posted @ 2020-03-15 10:46 狂奔~ 编辑

【1】curl

摘要：爬虫：数据的抓取 library: requests urllib pycurl Tools: curl wget httpie curl http://www.baidu.com 参数说明 -A 设置user-agent curl -A "python" http://www.baidu.co 阅读全文

posted @ 2020-03-14 10:25 狂奔~ 编辑