selenium & python

合集 - Python Script(95)

1.Python List Comprehensions All In One2023-08-022.Python 3 List Type errors All In One2023-07-313.Python Files All In One2023-07-284.Python exceptions All In One2023-07-285.Python decorator method and decorator property All In One2023-07-276.Python data hiding All In One 2023-07-267.Python Magic Methods & Operator Overloading All In One2023-07-198.How to fix the for...in loop errors in Python All In One2023-06-039.How to check function arguments type in Python All In One2023-06-0210.Python rpi_ws281x library All In One2023-06-0211.Python function argument All In One2023-06-0212.How to use variable in Python String All In One2023-06-0113.How to change the default Python2 to Python3 on Linux All In One2023-05-2514.Python & PEP All In One2023-05-1915.How to use pip3 install the latest version package All In One2023-05-1716.Python for loop with index All In One2023-05-1317.Python try...catch All In One2023-05-1118.Python OOP & Class private method All In One2023-05-1119.Python range function All In One2023-05-1120.pip3 & python3 -m pip All In One2023-05-0721.Python 3 alias All In One2023-04-3022.Python Ternary Operator All In One2023-04-2823.The principle of uploading files with command line tools All In One2023-04-2824.Python __init__() method & __init__.py file All In One2023-04-2725.Python relative import local package module file All In One2023-04-2726.Python check whether a list includes some value All In One2023-04-2727. Python timezone package All In One2023-04-1328.Python script get date and time All In One2023-04-1229.如何把一个 Python 项目包发布到 PyPI 上指南教程 All In One2023-04-0130.Python 3 vs Python 2 All In One2023-03-3031.Python 脚本接收命令行参数的多种方式 All In One2023-03-3032.Python 数据类型转换 All In One2023-03-3033.Python errors All In One2023-03-2934.Python 元组解构 All In One2023-03-2835.Python custom modify the __add__ method All In One2022-08-2136.Python 3 function & *args & **kwargs All In One2022-08-2037.Python list methods All In One2022-08-1938.Python 字符串插值 All In One2022-08-1739.Pycharm 如何自定义新建的 Python 文件的注释模版 All in One2022-08-1740.Python & PEP 8 & Style Guide All In One2022-08-1741.小甲鱼 All In One2022-08-1242.PyScript All In One2022-07-2443.QRcode ORC All In One2022-04-0944.Python 3 Data Types All In One2021-05-2945.free Python ebook & videos2021-03-1546.Python API Frameworks All In One2021-03-1347.Python Read JSON File2021-02-1948.2020～2021 职业规划书2021-01-1349.Python Web Framework All In One2021-01-1050.Python errors All In One2021-01-0951.如何使用 Python 编写后端 API 接口2021-01-0952.Python Coding Interview All In One2020-09-0253.Jupyter All In One2020-09-0254.How to use PyPI to publish a Python package All In One2020-08-1855.Python3 & Decorators with arguments & @Decorators with arguments bug2020-08-1356.Python Lambda & Functional Programming2020-08-1357.Python & file operation mode2020-08-1058.Python Turtle2020-08-1059.Python 2 to Python 3 convert2020-08-0660.Spyder & Kite2020-08-0661..pyc & Python2020-08-0562.Python Learning Paths2020-08-0563.Python Web Frameworks2020-08-0564.PEP 8 & Style Guide2020-08-0565.Python Crawler All In One2020-08-0466.Python Quiz & Python Exercise2020-08-0467.Anaconda2020-08-0468.Python module all in one2020-08-0469.PIP & Python packages management All In One2020-08-0470.Versatile Python 3.x2020-08-0371.Python Tutorials2020-07-2872.Flask2020-05-25

73.selenium & python2020-01-03

74.如何抓取电商的数据 & Python2019-04-1675.Python & dict & switch...case All In One2019-01-3076.Spyder & Python All In One2019-01-3077.How to install python3 on macOS All In One2019-01-3078.NLP & AI2019-01-3079.macOS & Python & Redis All In One2018-10-1780.Python & Spider2018-06-2481.How to run multiple Python versions on Windows?2018-05-1782.MySQL & Python2018-05-1783.Python file 操作 open 官方的文档2016-09-2384.Python关键字查询2016-09-2285.常见算法：python 一个简单的方法来实现Fibonacci序列只用迭代器，没有任何复杂的递归数据结构！2016-09-2186.如何在pycharm中切换python版本(2/3) 的图解教程2016-09-2087.修复 PyCharm 使用中文字符 Python 报错的完美解决方案 All In One2016-09-1988.how to updating Node.js and npm2016-09-1889.PEP 8 -- Style Guide for Python Code All In One2016-09-0190.如何在 Python 中使用 UTF-8 编码 All In One2016-08-0791.sphinx 文档生成器 （基于 python ）2016-06-0792.使用 ReStructuredText + Sphinx + Python 开发wiki ebooks!2015-12-2893.如何在Eclipse正确安装配置PyDev插件的官方教程，以及error 问题的解决方法：2015-11-3094.在线的代码托管平台 coding.net ===中国扩展版github2015-11-2195.python ( pycharm EDU)2015-10-25

收起

selenium & python

A browser automation framework and ecosystem

https://github.com/SeleniumHQ/selenium

https://selenium.dev/

Selenium automates browsers

自动化Web应用程序以进行测试

demos

https://github.com/huaisha1224/Selenium-Example

#!/usr/bin/env python3
#encoding = utf-8

from selenium import webdriver
import time
import csv

def buff_pubg():
    pubg_price = {}
    for page in range(1,13):
        url = ('https://buff.163.com/market/?game=pubg#tab=selling&page_num=%s&sort_by=price.desc' %page)
        print('第%s页:'%page,url)
        pubg_headers = ['name','money']
        driver = webdriver.Firefox()
        driver.get(url)

        for i in range(1,21):
            #获取饰品名称和价格
            try:
                name = driver.find_element_by_xpath(
                    ('/html/body/div[6]/div/div[4]/div[1]/ul/li[%s]/h3/a') %i)
                money = driver.find_element_by_xpath(
                    ('/html/body/div[6]/div/div[4]/div[1]/ul/li[%s]/p/strong') %i)
                pubg_price[name.text] = money.text[1:] #把饰品名称和对应的价格写入到字典里面
            except:
                pass

        driver.close()
    #print(len(buff))
    #写入内容到csv文件
    try:
        with open('buff_pubg.csv', 'a+', newline='') as csvfile:
            writer = csv.DictWriter(csvfile, fieldnames=pubg_headers)
            writer.writeheader()
            for k,v in pubg_price.items():
                #print(k,v)
                writer.writerow({'name': k, 'money': v})
            csvfile.close()
    except:
        pass

def buff_dota2():
    dota2_price = {}
    for page in range(1,327): #327
        url = ('https://buff.163.com/market/?game=dota2#tab=selling&page_num=%s&sort_by=price.desc' %page)
        print('第%s页'%page, url)
        dota2_headers = ['name','money']
        dota2_driver = webdriver.Firefox()
        dota2_driver.get(url)

        for i in range(1,21):
            #获取Dota2饰品价格
            try:
                dota2_name = dota2_driver.find_element_by_xpath(
                    ('/html/body/div[6]/div/div[4]/div[1]/ul/li[%s]/h3/a') %i)
                dota2_money = dota2_driver.find_element_by_xpath(
                    ('/html/body/div[6]/div/div[4]/div[1]/ul/li[%s]/p/strong') %i)
                dota2_price[dota2_name.text] = dota2_money.text[1:]
                #print(dota2_price)
            except:
                pass

        dota2_driver.close()
    #print(dota2_price)
    #把内容写入csv文件
    try:
        with open('buff_dota2.csv', 'a+', newline='') as csvdota2:
            writer = csv.DictWriter(csvdota2,fieldnames=dota2_headers)
            writer.writeheader()
            for k,v in dota2_price.items():
                #print(k,v)
                writer.writerow({'name':k, 'money':v})
            csvdota2.close()
    except:
        pass

if __name__ == '__main__':
    #buff_pubg()
    buff_dota2()

---

---