selenium
Python Automation Scripts Examples Use Django And Selenium
Django is the most popular web framework in the python world. You can use it to create a website quickly and simply. Selenium is the most popular website automation testing framework, it can be used to implement website automation function testing in source code with coding language python, java, etc. This example will tell you how to set up and run Django and Selenium to make a development environment for website functional tests.
If you do not install Python Django and selenium modules, you need to install them first. You can run the command pip list
in a terminal to verify the Python Django and selenium module installation. If the two modules do not exist in the list, follow the below steps to install them.
1. Use Pip To Install Django Python Module.
192:~ $ pip install django
Collecting django
Downloading https://files.pythonhosted.org/packages/51/1a/e0ac7886c7123a03814178d7517dc822af0fe51a72e1a6bff26153103322/Django-2.1-py3-none-any.whl (7.3MB)
100% |████████████████████████████████| 7.3MB 200kB/s
Requirement already satisfied: pytz in ./anaconda3/lib/python3.6/site-packages (from django) (2018.4)
Installing collected packages: django
Successfully installed django-2.1
2. Use Pip To Install Selenium Python Module.
192:~ $ pip install selenium
Collecting selenium
Downloading https://files.pythonhosted.org/packages/b8/53/9cafbb616d20c7624ff31bcabd82e5cc9823206267664e68aa8acdde4629/selenium-3.14.0-py2.py3-none-any.whl (898kB)
100% |████████████████████████████████| 901kB 714kB/s
Requirement already satisfied: urllib3 in ./anaconda3/lib/python3.6/site-packages (from selenium) (1.22)
Installing collected packages: selenium
Successfully installed selenium-3.14.0
3. Create Django Project And Startup Django Web Server.
- Open a terminal and input the below command in your working directory.
$ django-admin.py startproject TodoList
- Run
ls -l
command, then you can find the directory TodoList under the current working folder. - CD into the TodoList folder, there is a folder also named TodoList and a file manage.py. The inside TodoList folder is the place where all these webserver project files are saved, the manage.py file is the Django webserver management file. The _pycache_ folder is the cache folder for all the project python source files.
- To start up the Django project web server, please run the below command.
192:TodoList $ python manage.py runserverPerforming system checks...System check identified no issues (0 silenced).You have 15 unapplied migration(s). Your project may not work properly until you apply the migrations for app(s): admin, auth, contenttypes, sessions.Run 'python manage.py migrate' to apply them.August 30, 2018 - 16:01:58Django version 2.1, using settings 'TodoList.settings'Starting development server at http://127.0.0.1:8000/Quit the server with CONTROL-C.
- Now the Django web server has been created and started up, open a web browser and access url http://127.0.0.1:8000/ to see the Django project welcome page.
4. Run Selenium In Python Code To Test Above Django Server.
- Now save the below code in a file TestDjango.py and execute
python TestDjango.py
in a terminal, you can get the error message in the console.from selenium import webdriverimport timedef assert_django_title():# Create the Firefox web browserbrowser = webdriver.Firefox(executable_path = '/Users/zhaosong/Documents/WorkSpace/tool/geckodriver')# Access the Django web server home page.browser.get('http://127.0.0.1:8000/')# Assert the web page title, the web page title do not contains Djangl so you can see error message in the console.assert 'Django' in browser.title# Sleep 10 seconds.time.sleep(10)# Close and quit the Firefox web browserbrowser.quit()if __name__ == '__main__':assert_django_title()
5. Use Python Unittest Module To Test Django Home Page Title.
- Python unittest module tests the Django home page title example source code.
from selenium import webdriverimport timeimport unittestclass DjangoTest(unittest.TestCase):# This method is invoked when test case start.def setUp(self):# Create the Firefox browser when test case setup.self.browser = webdriver.Firefox(executable_path = '/Users/zhaosong/Documents/WorkSpace/tool/geckodriver')# This method is invoked when test case complete.def tearDown(self):# Close and quit the Firefox browser when test case tear down.self.browser.quit()# This is the test method.def testHomePage(self):# Get Django home page.self.browser.get('http://127.0.0.1:8000/')# Sleep 10 seconds to wait for the page load.time.sleep(10)# Assert whether the web page title contains word Djangl or not.self.assertIn("Djangl", self.browser.title, 'Browser title do not contains Django')if __name__ == '__main__':# Runn all test case function.unittest.main()
- Run above python code will get the below error message in the console.
======================================================================FAIL: testHomePage (__main__.DjangoTest)----------------------------------------------------------------------Traceback (most recent call last):File "/Users/zhaosong/Documents/WorkSpace/dev2qa.com-example-code/PythonExampleProject/com/dev2qa/example/selenium/SeleniumDjangoExample.py", line 23, in testHomePageself.assertIn("Djangl", self.browser.title, 'Browser title do not contains Django')AssertionError: 'Djangl' not found in 'Django: the Web framework for perfectionists with deadlines.' : Browser title do not contains Django----------------------------------------------------------------------Ran 1 test in 15.181sFAILED (failures=1)
selenium用法详解
selenium主要是用来做自动化测试,支持多种浏览器,爬虫中主要用来解决JavaScript渲染问题。
模拟浏览器进行网页加载,当requests,urllib无法正常获取网页内容的时候
一、声明浏览器对象
注意点一,Python文件名或者包名不要命名为selenium,会导致无法导入
from selenium import webdriver
#webdriver可以认为是浏览器的驱动器,要驱动浏览器必须用到webdriver,支持多种浏览器,这里以Chrome为例
browser = webdriver.Chrome()
二、访问页面并获取网页html
from selenium import webdriver
browser = webdriver.Chrome()
browser.get('https://www.taobao.com')
print(browser.page_source)#browser.page_source是获取网页的全部html
browser.close()
三、查找元素
单个元素
from selenium import webdriver
browser = webdriver.Chrome()
browser.get('https://www.taobao.com')
input_first = browser.find_element_by_id('q')
input_second = browser.find_element_by_css_selector('#q')
input_third = browser.find_element_by_xpath('//*[@id="q"]')
print(input_first,input_second,input_third)
browser.close()
常用的查找方法
find_element_by_name
find_element_by_xpath
find_element_by_link_text
find_element_by_partial_link_text
find_element_by_tag_name
find_element_by_class_name
find_element_by_css_selector
也可以使用通用的方法
from selenium import webdriver
from selenium.webdriver.common.by import By
browser = webdriver.Chrome()
browser.get('https://www.taobao.com')
input_first = browser.find_element(BY.ID,'q')#第一个参数传入名称,第二个传入具体的参数
print(input_first)
browser.close()
多个元素,elements多个s
input_first = browser.find_elements_by_id('q')
四、元素交互操作-搜索框传入关键词进行自动搜索
from selenium import webdriver
import time
browser = webdriver.Chrome()
browser.get('https://www.taobao.com')
input = browser.find_element_by_id('q')#找到搜索框
input.send_keys('iPhone')#传送入关键词
time.sleep(5)
input.clear()#清空搜索框
input.send_keys('男士内裤')
button = browser.find_element_by_class_name('btn-search')#找到搜索按钮
button.click()
更多操作: http://selenium-python.readthedocs.io/api.html#module-selenium.webdriver.remote.webelement#可以有属性、截图等等
五、交互动作,驱动浏览器进行动作,模拟拖拽动作,将动作附加到动作链中串行执行
from selenium import webdriver
from selenium.webdriver import ActionChains#引入动作链
browser = webdriver.Chrome()
url = 'http://www.runoob.com/try/try.php?filename=jqueryui-api-droppable'
browser.get(url)
browser.switch_to.frame('iframeResult')#切换到iframeResult框架
source = browser.find_element_by_css_selector('#draggable')#找到被拖拽对象
target = browser.find_element_by_css_selector('#droppable')#找到目标
actions = ActionChains(browser)#声明actions对象
actions.drag_and_drop(source, target)
actions.perform()#执行动作
更多操作: http://selenium-python.readthedocs.io/api.html#module-selenium.webdriver.common.action_chains
六、执行JavaScript
有些动作可能没有提供api,比如进度条下拉,这时,我们可以通过代码执行JavaScript
from selenium import webdriver
browser = webdriver.Chrome()
browser.get('https://www.zhihu.com/explore')
browser.execute_script('window.scrollTo(0, document.body.scrollHeight)')
browser.execute_script('alert("To Bottom")')
七、获取元素信息
获取属性
from selenium import webdriver
from selenium.webdriver import ActionChains
browser = webdriver.Chrome()
url = 'https://www.zhihu.com/explore'
browser.get(url)
logo = browser.find_element_by_id('zh-top-link-logo')#获取网站logo
print(logo)
print(logo.get_attribute('class'))
browser.close()
获取文本值
from selenium import webdriver
browser = webdriver.Chrome()
url = 'https://www.zhihu.com/explore'
browser.get(url)
input = browser.find_element_by_class_name('zu-top-add-question')
print(input.text)#input.text文本值
browser.close()
# 获取Id,位置,标签名,大小
from selenium import webdriver
browser = webdriver.Chrome()
url = 'https://www.zhihu.com/explore'
browser.get(url)
input = browser.find_element_by_class_name('zu-top-add-question')
print(input.id)#获取id
print(input.location)#获取位置
print(input.tag_name)#获取标签名
print(input.size)#获取大小
browser.close()
八、Frame操作
frame相当于独立的网页,如果在父类网frame查找子类的,则必须切换到子类的frame,子类如果查找父类也需要先切换
from selenium import webdriver
from selenium.common.exceptions import NoSuchElementException
browser = webdriver.Chrome()
url = 'http://www.runoob.com/try/try.php?filename=jqueryui-api-droppable'
browser.get(url)
browser.switch_to.frame('iframeResult')
source = browser.find_element_by_css_selector('#draggable')
print(source)
try:
logo = browser.find_element_by_class_name('logo')