pyautowin笔记

?

1 2 3 4

Application(backend='uia').start(cmd_line=r"xxx.exe", work_dir=r"xxxApplication") # backend优先使用'uia';拿不到元素，在考虑换'win32' app = Application(backend='uia').connect(path="xxx.exe") # 连接exe进程名称 win = app.window(title_re="CLIP.*")  # 主窗 win.print_control_identifiers()　 win_err = app.window(title_re="Error") # 弹窗及其子元素需要额外获取

　　

 

====》 判断程序的backend

法1:使用工具spy++　 
   如果是GUI的程序，用spy++这个微软的小工具来看，从类名前缀能看出是什么编写的程序。
   a、afx__开头的：mfc写的；　
   b、t_开头的：一般是delphi，少部分是c++builder；比如主窗体一般是tMainForm；　 
   c、thunder_开头的：一般是VB6写的；　 
   d、windows__开发头的，一般都是.net写的；　 
   e、awt__或者swing__开头的，一般都是java写的；　 
   f、其他的直接以win32api gui控件开头的，一般都是c++或者VC++写的。　 
法2:使用工具inspect
  点击inspect左上角的下拉列表，切换到“UI Automation”，然后鼠标点一下你需要测试的程序窗体，inspect就会显示相关信息。　
 inspect中显示了程序的有关信息,说明backend为uia,inspect中显示拒绝访问，说明程序的backend应该是win32
=================================

===》 特殊元素识别【无text，只有uname，靠下标获取元素】

?

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112

def capture_as_image(self, rect=None): # 转自 https://www.cnblogs.com/qican/p/13262198.html         """         Return a PIL image of the control.           See PIL documentation to know what you can do with the resulting         image.         """         control_rectangle = self.rectangle()         if not (control_rectangle.width() and control_rectangle.height()):             return None           # PIL is optional so check first         if not ImageGrab:             print("PIL does not seem to be installed. "                   "PIL is required for capture_as_image")             self.actions.log("PIL does not seem to be installed. "                              "PIL is required for capture_as_image")             return None           if rect:             control_rectangle = rect           # get the control rectangle in a way that PIL likes it         width = control_rectangle.width()         height = control_rectangle.height()         left = control_rectangle.left         right = control_rectangle.right         top = control_rectangle.top         bottom = control_rectangle.bottom         box = (left, top, right, bottom)           # check the number of monitors connected         if (sys.platform == 'win32') and (len(win32api.EnumDisplayMonitors()) > 1):                 hwin = win32gui.GetDesktopWindow()                 hwidef capture_as_image(self, rect=None):         """         Return a PIL image of the control.           See PIL documentation to know what you can do with the resulting         image.         """         control_rectangle = self.rectangle()         if not (control_rectangle.width() and control_rectangle.height()):             return None           # PIL is optional so check first         if not ImageGrab:             print("PIL does not seem to be installed. "                   "PIL is required for capture_as_image")             self.actions.log("PIL does not seem to be installed. "                              "PIL is required for capture_as_image")             return None           if rect:             control_rectangle = rect           # get the control rectangle in a way that PIL likes it         width = control_rectangle.width()         height = control_rectangle.height()         left = control_rectangle.left         right = control_rectangle.right         top = control_rectangle.top         bottom = control_rectangle.bottom         box = (left, top, right, bottom)<br>　　　　　pyautogui.screenshot(imageFilename=img_path, , region=(left, top, width, height))'''<br>           # check the number of monitors connected         if (sys.platform == 'win32') and (len(win32api.EnumDisplayMonitors()) > 1):                 hwin = win32gui.GetDesktopWindow()                 hwindc = win32gui.GetWindowDC(hwin)                 srcdc = win32ui.CreateDCFromHandle(hwindc)                 memdc = srcdc.CreateCompatibleDC()                 bmp = win32ui.CreateBitmap()                 bmp.CreateCompatibleBitmap(srcdc, width, height)                 memdc.SelectObject(bmp)                 memdc.BitBlt((0, 0), (width, height), srcdc, (left, top), win32con.SRCCOPY)                   bmpinfo = bmp.GetInfo()                 bmpstr = bmp.GetBitmapBits(True)                 pil_img_obj = Image.frombuffer('RGB',                                                (bmpinfo['bmWidth'], bmpinfo['bmHeight']),                                                bmpstr,                                                'raw',                                                'BGRX',                                                0,                                                1)         else:             # grab the image and get raw data as a string             pil_img_obj = ImageGrab.grab(box)           return pil_img_obj ndc = win32gui.GetWindowDC(hwin)                 srcdc = win32ui.CreateDCFromHandle(hwindc)                 memdc = srcdc.CreateCompatibleDC()                 bmp = win32ui.CreateBitmap()                 bmp.CreateCompatibleBitmap(srcdc, width, height)                 memdc.SelectObject(bmp)                 memdc.BitBlt((0, 0), (width, height), srcdc, (left, top), win32con.SRCCOPY)                   bmpinfo = bmp.GetInfo()                 bmpstr = bmp.GetBitmapBits(True)                 pil_img_obj = Image.frombuffer('RGB',                                                (bmpinfo['bmWidth'], bmpinfo['bmHeight']),                                                bmpstr,                                                'raw',                                                'BGRX',                                                0,                                                1)         else:             # grab the image and get raw data as a string             pil_img_obj = ImageGrab.grab(box)           return pil_img_obj'''

　　

1）截取该元素  

2）图片识别位置、文本【若有】、颜色识别

3）点击识别的文字

===================

1、有名称，可以直接用 win[name]的方式获取，即 win.print_control_identifiers() 可以打印出来名称的。

2、大多数元素用click_input()即可，不行，尝试用click()；【部分元素虽然是表面是wrapper，但实际是btn和checkbox，可以用click()]

3、无名称的元素，可以用父元素的descendents()获取，如dlag_win.descendants()，得到一个list，用index取元素，进行点击 

4、元素查看用 inspect.exe； 下载安装windows sdk里面自带：https://developer.microsoft.com/en-us/windows/downloads/windows-10-sdk/#sysreq

5、窗口选择

1）、根据窗口标题/类名选择： app["QQ"]

2）根据窗口类名选择 ：window = app.TXGuiFoundation

3）获取坐标 ：  print(app["QQ"].rectangle())

6 窗口控件基本属性获取方法

1）获取控件类型：wrapper_object()
2）获取控件支持的方法：print(dir(a.wrapper_object()))
3) 获取控件的子元素：children()
4)获取控件类名：class_name()
5)以字典的形式返回控件的属性：get_properties()
【以上全部可以用inspect直接查看获取】

 

7。文本 ele.texts()

8  控件/窗口截图：

ele.capture_as_image()`

 

9 菜单操作：

?

1 2 3 4 5 6 7

# 通过下标选择菜单项menu = window['menu'] print(menu.items())#获取菜单的子菜单项 m = menu.item_by_index(1) print(m)# 通过路径选择菜单项menu = window['menu'] print(menu.items())#获取菜单的子菜单项 m = menu.item_by_path("文件->新建连接...") print(m)

　

10 等待：window.wait(wait_for='ready',timeout=10,retry_inteval=1)

 

 

 

 

 

wait_until(10.5, .5, self.item_count, 10)#等待item_count函数的结果为5的时候开始停止等待。。。若超过10s，则超时报错

 

 

官网： https://pywinauto.readthedocs.io/en/latest/code/pywinauto.application.html?highlight=wait#pywinauto.application.WindowSpecification.wait

参考：https://www.pythonf.cn/read/127079#timings_161

参考：https://www.cnblogs.com/wuxunyan/p/9366178.html