移动端设备管理平台 atx server2实践
目录
1、需求背景
- 移动设备（Android和IOS）异地调试，包括但不限于apk安装，功能测试，日志查看，屏幕截图等。
- 移动设备管理，重启，关机，网络管理等。
- 结合设备管理平台完成app UI自动化测试。
- 异常调试时延迟可接受，画质可接受。
2、初步调研
了解需求后便开始在网络上查看资料，大部分都是自动化工具的，关于设备管理平台的介绍很少。多番查阅之下，发现业内目前的移动端设备主要有以下几种：
2.1、云测试平台
- 优点：省心，机型多，服务全面。
- 缺点：费用不菲，部分是按照时间收费的。
2.2、开源工具
STF
- 优点：开源免费
- 缺点：网络延迟比较严重
atx server
这个是在TesterHome上看到的，感觉不错决定试一试，感谢作者。github地址如下：
https://github.com/openatx/atxserver2
2.3、VNC
Android VNC Server多年不更新，Android 5.x由于Pie的限制用不了，需要重新编译，过程略复杂，作为安卓未入门级选手果断直接放弃。
2.4、企业内部自研云测试平台
比如美团点评的云真机平台，知乎的云测试平台，这种的一般都是投入一个团队在研发，成本大。
3、ATX Server安装
我使用的机器是Ubuntu18，Windows平台推荐用源码安装。
依赖环境
- Python3
- rethinkdb
安装rethinkdb
官方安装手册地址：https://www.rethinkdb.com/docs/install/ 。根据平台选择对应的安装方法。官方给出的ubuntu安装方法如下：
source /etc/lsb-release && echo "deb http://download.rethinkdb.com/apt $DISTRIB_CODENAME main" | sudo tee /etc/apt/sources.list.d/rethinkdb.list
wget -qO- https://download.rethinkdb.com/apt/pubkey.gpg | sudo apt-key add -
sudo apt-get update
sudo apt-get install rethinkdb
无法定位到rethinkdb，有的网友说是http改成了https，修改后重新安装也不行。经过查阅资料，rethinkdb不支持ubuntu18,于是尝试用deb的包安装。下载倒数第四个。
下载地址：https://github.com/srh/rethinkdb/releases/tag/v2.3.6.srh.1
安装方法：
Run sudo dpkg -i foo.deb to install a deb package.
If you get a message about missing some dependencies, run sudo apt-get install -f to install them.
Then run rethinkdb --version to test that installation succeeded.
安装atx server
clone代码到本地
git clone https://github.com/openatx/atxserver2.git
安装curl工具
sudo apt install curl
安装docker-compose
sudo curl -L https://github.com/docker/compose/releases/download/1.22.0/docker-compose-$(uname -s)-$(uname -m) -o /usr/local/bin/docker-compose
将当前用户假如docker组
sudo gpasswd -a ${USER} docker
编辑/etc/default/docker文件
加入如下配置
DOCKER_OPTS="-H tcp://127.0.0.1:4243 -H unix:///var/run/docker.sock"
重启docker或重启机器
service docker restart
退出命令行，切换到代码docker-compose.yml所在目录，执行
docker-compose up
启动日志如下：
stephen@stephen-K55VD:~/atx-server/atxserver2$ docker-compose up
Creating network "atxserver2_default" with the default driver
Pulling rethinkdb (rethinkdb:2.3.6)...
2.3.6: Pulling from library/rethinkdb
9811207f4eba: Pull complete
d7c48489ee79: Pull complete
bd3fe89ae346: Pull complete
1914a1a7f89d: Pull complete
bf26223d4854: Pull complete
Digest: sha256:37340d5fcc7b0e83eed0e699a6af5362a3d8ff19cf3f80819dcf75d6c5ebcc18
Status: Downloaded newer image for rethinkdb:2.3.6
Building web
Step 1/6 : FROM python:3.6
3.6: Pulling from library/python
6f2f362378c5: Pull complete
494c27a8a6b8: Pull complete
7596bb83081b: Pull complete
372744b62d49: Pull complete
615db220d76c: Pull complete
1865698adfb0: Pull complete
7159b3304cc0: Pull complete
ad0713808ef6: Pull complete
7ba593904573: Pull complete
Digest: sha256:904bc648c46a22d0bca62340785da841eaeb7099addb2fc4941a5a8b878c5ce7
Status: Downloaded newer image for python:3.6
---> 48c06762acf0
Step 2/6 : ADD . /app
---> abff59a2fca3
Step 3/6 : WORKDIR /app
---> Running in cc16e0af3f06
Removing intermediate container cc16e0af3f06
---> 61b746c8516d
Step 4/6 : RUN pip install -r requirements.txt
---> Running in 8faf64de476a
Collecting six (from -r requirements.txt (line 1))
Downloading https://files.pythonhosted.org/packages/73/fb/00a976f728d0d1fecfe898238ce23f502a721c0ac0ecfedb80e0d88c64e9/six-1.12.0-py2.py3-none-any.whl
Collecting bunch (from -r requirements.txt (line 2))
Downloading https://files.pythonhosted.org/packages/ef/bf/a4cf1779a4ffb4f610903fa08e15d1f4a8a2f4e3353a02afbe097c5bf4a8/bunch-1.0.1.tar.gz
Collecting logzero (from -r requirements.txt (line 3))
Downloading https://files.pythonhosted.org/packages/97/24/27295d318ea8976b12cf9cc51d82e7c7129220f6a3cc9e3443df3be8afdb/logzero-1.5.0-py2.py3-none-any.whl
Collecting tornado>=5.0 (from -r requirements.txt (line 4))
Downloading https://files.pythonhosted.org/packages/03/3f/5f89d99fca3c0100c8cede4f53f660b126d39e0d6a1e943e95cc3ed386fb/tornado-6.0.2.tar.gz (481kB)
Collecting requests (from -r requirements.txt (line 5))
Downloading https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl (57kB)
Collecting apkutils-patch<=0.6.0,>=0.5.4 (from -r requirements.txt (line 6))
Downloading https://files.pythonhosted.org/packages/d0/e3/fd4d547044b9fcf0af7eca25c055dc1169aadc47a3677eb5951426c9a66a/apkutils-patch-0.5.4.tar.gz (60kB)
Collecting rethinkdb==2.4.2.post1 (from -r requirements.txt (line 7))
Downloading https://files.pythonhosted.org/packages/98/4b/b22065b2686f440f8eaa8a7326e96a442ce98b7b637d28529958b83b2128/rethinkdb-2.4.2.post1-py2.py3-none-any.whl (155kB)
Collecting certifi>=2017.4.17 (from requests->-r requirements.txt (line 5))
Downloading https://files.pythonhosted.org/packages/60/75/f692a584e85b7eaba0e03827b3d51f45f571c2e793dd731e598828d380aa/certifi-2019.3.9-py2.py3-none-any.whl (158kB)
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 (from requests->-r requirements.txt (line 5))
Downloading https://files.pythonhosted.org/packages/e6/60/247f23a7121ae632d62811ba7f273d0e58972d75e58a94d329d51550a47d/urllib3-1.25.3-py2.py3-none-any.whl (150kB)
Collecting idna<2.9,>=2.5 (from requests->-r requirements.txt (line 5))
Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl (58kB)
Collecting chardet<3.1.0,>=3.0.2 (from requests->-r requirements.txt (line 5))
Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB)
Collecting pyelftools (from apkutils-patch<=0.6.0,>=0.5.4->-r requirements.txt (line 6))
Downloading https://files.pythonhosted.org/packages/fa/9a/0674cb1725196568bdbca98304f2efb17368b57af1a4bb3fc772c026f474/pyelftools-0.25.tar.gz (499kB)
Collecting cigam (from apkutils-patch<=0.6.0,>=0.5.4->-r requirements.txt (line 6))
Downloading https://files.pythonhosted.org/packages/3c/d0/19ff49c1938aea4e0076ee084ca23845408cffb51582b2be975f926533b5/cigam-0.0.3-py3-none-any.whl
Collecting xmltodict (from apkutils-patch<=0.6.0,>=0.5.4->-r requirements.txt (line 6))
Downloading https://files.pythonhosted.org/packages/28/fd/30d5c1d3ac29ce229f6bdc40bbc20b28f716e8b363140c26eff19122d8a5/xmltodict-0.12.0-py2.py3-none-any.whl
Building wheels for collected packages: bunch, tornado, apkutils-patch, pyelftools
Building wheel for bunch (setup.py): started
Building wheel for bunch (setup.py): finished with status 'done'
Stored in directory: /root/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c
Building wheel for tornado (setup.py): started
Building wheel for tornado (setup.py): finished with status 'done'
Stored in directory: /root/.cache/pip/wheels/61/7e/7a/5e02e60dc329aef32ecf70e0425319ee7e2198c3a7cf98b4a2
Building wheel for apkutils-patch (setup.py): started
Building wheel for apkutils-patch (setup.py): finished with status 'done'
Stored in directory: /root/.cache/pip/wheels/43/70/ff/194b6150b109c3143bf17d8821a21cb7060de738038b920c64
Building wheel for pyelftools (setup.py): started
Building wheel for pyelftools (setup.py): finished with status 'done'
Stored in directory: /root/.cache/pip/wheels/55/2f/15/4ce6885a52f475de68c16f3116a94d2156d588390cdb6c507c
Successfully built bunch tornado apkutils-patch pyelftools
Installing collected packages: six, bunch, logzero, tornado, certifi, urllib3, idna, chardet, requests, pyelftools, cigam, xmltodict, apkutils-patch, rethinkdb
Successfully installed apkutils-patch-0.5.4 bunch-1.0.1 certifi-2019.3.9 chardet-3.0.4 cigam-0.0.3 idna-2.8 logzero-1.5.0 pyelftools-0.25 requests-2.22.0 rethinkdb-2.4.2.post1 six-1.12.0 tornado-6.0.2 urllib3-1.25.3 xmltodict-0.12.0
Removing intermediate container 8faf64de476a
---> 1fa1eb974541
Step 5/6 : ENTRYPOINT [ "scripts/wait-for-db.sh" ]
---> Running in 38527f1e1551
Removing intermediate container 38527f1e1551
---> b107d738e458
Step 6/6 : CMD ["python", "main.py"]
---> Running in 2c4b41cc5b10
Removing intermediate container 2c4b41cc5b10
---> 41a3cc6d72f4
Successfully built 41a3cc6d72f4
Successfully tagged atxserver2_web:latest
WARNING: Image for service web was built because it did not already exist. To rebuild this image you must use `docker-compose build` or `docker-compose up --build`.
Creating atxserver2_rethinkdb_1 ... done
Creating atxserver2_web_1 ... done
Attaching to atxserver2_rethinkdb_1, atxserver2_web_1
rethinkdb_1 | Recursively removing directory /data/rethinkdb_data/tmp
rethinkdb_1 | Initializing directory /data/rethinkdb_data
rethinkdb_1 | Running rethinkdb 2.3.6~0jessie (GCC 4.9.2)...
rethinkdb_1 | Running on Linux 4.15.0-34-generic x86_64
rethinkdb_1 | Loading data from directory /data/rethinkdb_data
rethinkdb_1 | Listening for intracluster connections on port 29015
rethinkdb_1 | Listening for client driver connections on port 28015
rethinkdb_1 | Listening for administrative HTTP connections on port 8080
rethinkdb_1 | Listening on cluster addresses: 127.0.0.1, 172.18.0.2
rethinkdb_1 | Listening on driver addresses: 127.0.0.1, 172.18.0.2
rethinkdb_1 | Listening on http addresses: 127.0.0.1, 172.18.0.2
rethinkdb_1 | Server ready, "32b5db1e779c_vxj" d1530d1a-a1e6-4c91-ba9a-09343c76dd16
web_1 | RethinkDB is running
web_1 | [I 190616 05:21:21 main:70] listen on port http://172.18.0.3:4000
web_1 | [I 190616 05:21:50 web:2246] 302 GET / (172.18.0.1) 1.69ms
web_1 | [I 190616 05:21:50 web:2246] 200 GET /login?next=%2F (172.18.0.1) 3.17ms
web_1 | [I 190616 05:21:50 web:2246] 200 GET /favicon.ico (172.18.0.1) 34.69ms
web_1 | [I 190616 05:22:00 web:2246] 302 POST /login (172.18.0.1) 307.36ms
web_1 | [I 190616 05:22:00 web:2246] 302 GET / (172.18.0.1) 9.53ms
web_1 | [I 190616 05:22:00 web:2246] 200 GET /devices (172.18.0.1) 18.83ms
web_1 | [I 190616 05:22:00 web:2246] 200 GET /static/vendor/fontawesome-5.7.2/css/all.css (172.18.0.1) 1.48ms
在浏览器地址栏输入：http://172.18.0.3:4000/devices，具体的地址见启动日志，页面如下：
至此，说明atx sever部署成功了，pull镜像的时间略长，耐心等等，接下来就是部署atxserver2-android-provider。
4、安卓设备接入
vim .bashrc,在环境变量中加入
SERVER_URL="http://172.18.0.3:4000" # 这个修改成自己的atxserver2地址
IMAGE="codeskyblue/atxserver2-android-provider"
保存后，source .bashrc 使之生效。然后执行命令：
docker pull $IMAGE
安装pillow
pip3 install pillow
安装wediter
pip3 install -U weditor
安装adb工具
apt-get install android-tools-adb
机器安装uiautomator2
pip install --pre --upgrade uiautomator2
使用usb线连接上手机，打开开发者模式。查看当前机器上挂的设备
stephen@stephen-K55VD:~$ adb devices
List of devices attached
9fb1c6ae device
初始化（可选步骤）
python3.6 -m uiautomator2 init
最后执行下面这条命令，该镜像会把所有必要的资源 （atx-uiautomator.apk, minicap, minitouch, atx-agent) 全部推送到手机上。安装时需要确认。
docker run --rm --privileged -v /dev/bus/usb:/dev/bus/usb --net host \
${IMAGE} python main.py --server ${SERVER_URL}
等待一切推送完成后，激动人心的时候到了，打开web端看一下效果。点击立即使用可以操作手机。
5、Docker端口转发
截至目前，部署成功，来尝试从别的机器访问web页面，发现无法打开，初步怀疑是防火墙的问题，后排除。导致无法访问的原因是：docker 需要设置端口。
列出容器信息：
stephen@stephen-K55VD:~$ docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
b0bae8e68a86 codeskyblue/atxserver2-android-provider "python main.py --se…" 12 minutes ago Up 12 minutes affectionate_ardinghelli
7c5284cbdb9e atxserver2_web "scripts/wait-for-db…" 5 hours ago Up 4 hours 0.0.0.0:4000->4000/tcp atxserver2_web_1
32b5db1e779c rethinkdb:2.3.6 "rethinkdb --bind all" 5 hours ago Up 4 hours 8080/tcp, 28015/tcp, 29015/tcp atxserver2_rethinkdb_1
查看容器地址：
docker inspect "web服务所在的容器id"| grep IPAddress
stephen@stephen-K55VD:~/atx-server/atxserver2$ docker inspect 7c5284cbdb9e| grep IPAddress
"SecondaryIPAddresses": null,
"IPAddress": "",
"IPAddress": "172.18.0.3",
设置端口转发
iptables -t nat -A DOCKER -p tcp --dport 4001 -j DNAT --to-destination 172.18.0.3:4000
然后使用地址：http://本机地址:4001 ，查看本机地址用ifconfig，然后就可以从其它机器上访问了。
5、小结
非常棒的一款工具，开源，简洁易用，期待更多新特性，不足之处是画质有点模糊，接下来实践一下IOS设备如何接入和是否能和appium集成。
