requests库
优于urllib,基于urllib3
基本用法
1 r = requests.get('https://github.com/timeline.json') 2 r = requests.post("http://httpbin.org/post") 3 4 #传递 URL 参数 5 payload = {'key1': 'value1', 'key2': 'value2'} 6 r = requests.get("http://httpbin.org/get", params=payload) 7 8 #响应内容 9 r.text 10 r.content 11 12 #JSON 响应内容 13 r.json() 14 15 #原始响应内容 16 r.raw 17 18 #定制请求头 19 headers = {'user-agent': 'my-app/0.0.1'} 20 r = requests.get(url, headers=headers) 21 22 #Cookie 23 cookies = dict(cookies_are='working') 24 r = requests.get(url, cookies=cookies) 25 26 jar = requests.cookies.RequestsCookieJar() 27 r = requests.get(url, cookies=jar)
高级用法
#会话对象 s = requests.Session() #超时(timeout) r = requests.get('https://github.com', timeout=5) #代理 proxies = { "http": "http://10.10.1.10:3128", "https": "http://10.10.1.10:1080", } requests.get("http://example.org", proxies=proxies)
更多用法
http://cn.python-requests.org/zh_CN/latest/user/advanced.html#advanced