python 爬虫随机获取User-Agent

  可以有两种方法:

  1、随机生成

    首先安装 pip install fake-useragent

   import random
    from fake_useragent import UserAgent
    def gererateUserAgent(self):
        # ua = UserAgent()
        # headers = {'User-Agent': ua.random}
        # print(headers)
        lst=[]
        for i in range(10):
            ua = UserAgent()
            lst.append(ua.random)
        print(lst)

 

如报错:python fake_useragent.errors.FakeUserAgentError: Maximum amount of retries reached

升级:pip3 install -U fake-useragent

 

  2、从列表中随机选择

import random
def getheaders():
    user_agent_list = ['Mozilla/5.0 (Windows NT 6.2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/28.0.1464.0 Safari/537.36',
                       'Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/31.0.1650.16 Safari/537.36',
                       'Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.3319.102 Safari/537.36',
                       'Mozilla/5.0 (X11; CrOS i686 3912.101.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.116 Safari/537.36',
                       'Mozilla/5.0 (Windows NT 6.2; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.93 Safari/537.36',
                       'Mozilla/5.0 (Windows NT 6.2; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/32.0.1667.0 Safari/537.36',
                       'Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:17.0) Gecko/20100101 Firefox/17.0.6',
                       'Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/28.0.1468.0 Safari/537.36',
                       'Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2224.3 Safari/537.36',
                       'Mozilla/5.0 (X11; CrOS i686 3912.101.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453.116 Safari/537.36']
    UserAgent=random.choice(user_agent_list)

   3、查看google浏览器用户代理:

    在浏览器地址输入:chrome://version

  

  

  Python  使用随机UserAgent报错 get_browsers(verify_ssl=verify_ssl)::

  pip install --upgrade fake_useragent

  参考:

  https://blog.csdn.net/weixin_39792686/article/details/110829708

  https://qq52o.me/2505.html

 

    

posted on 2018-12-27 11:17  shaomine  阅读(8192)  评论(0编辑  收藏  举报