批量下载URL图片到本地
参考链接:
https://www.jianshu.com/p/0eff5fb281c0
获取请求的原始响应:response.raw() response.iter_content()
request.get(url)默认下载在内存中,下载完成才保存到本地硬盘;response.iter_content()是边下载边存硬盘
示例如下:
import requests f = open('urldownload/20221027.txt') picurls = f.readlines(-1) print("当前有{}个图片待下载".format(len(picurls))) for i,picurl in enumerate(picurls): picurl = picurl.strip()#消除URL中的空格 pic_resp= requests.get(picurl,stream=True)#请求的响应.stream=true来获取请求的原始套接字响应 pic_resp.raise_for_status() with open("urldownload/20221001_{}.jpg".format(i),'wb') as f: for chunk in pic_resp.iter_content(1024*1024):#获取请求的原始响应。 chunksize可以根据自己需求自行调整 f.write(chunk) print("当前下载图片号:{}".format(i)) f.close()