python 爬虫随机获取User-Agent
可以有两种方法:
1、随机生成
首先安装 pip install fake-useragent
import random from fake_useragent import UserAgent def gererateUserAgent(self): # ua = UserAgent() # headers = {'User-Agent': ua.random} # print(headers) lst=[] for i in range(10): ua = UserAgent() lst.append(ua.random) print(lst)
如报错:python fake_useragent.errors.FakeUserAgentError: Maximum amount of retries reached
升级:pip3 install -U fake-useragent
2、从列表中随机选择
import random def getheaders(): user_agent_list = ['Mozilla/5.0 (Windows NT 6.2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/28.0.1464.0 Safari/537.36', 'Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/31.0.1650.16 Safari/537.36', 'Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.3319.102 Safari/537.36', 'Mozilla/5.0 (X11; CrOS i686 3912.101.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.116 Safari/537.36', 'Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.93 Safari/537.36', 'Mozilla/5.0 (Windows NT 6.2; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/32.0.1667.0 Safari/537.36', 'Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:17.0) Gecko/20100101 Firefox/17.0.6', 'Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/28.0.1468.0 Safari/537.36', 'Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2224.3 Safari/537.36', 'Mozilla/5.0 (X11; CrOS i686 3912.101.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.116 Safari/537.36'] UserAgent=random.choice(user_agent_list)
3、查看google浏览器用户代理:
在浏览器地址输入:chrome://version
Python 使用随机UserAgent报错 get_browsers(verify_ssl=verify_ssl)::
pip install --upgrade fake_useragent
参考:
https://blog.csdn.net/weixin_39792686/article/details/110829708