安卓自动化之minicap截图

安卓自动化之minicap截图

关于安卓自动化使用找图方法点击时，最大的痛点是使用原生adb截图速度太慢了，大概需要3s的时间，再加上我们使用opencv的找图算法，时间就去都三秒多了，为了解决这一个痛点，我们就可以使用minicap，他是通过在安卓常驻一个miniservice，通过adb跟我们的程序进行通信，它实时获取屏幕信息转化为数据流发送给我们的程序，我们只需实时去接收数据并把它转化成图片即可

1.第一步当然是先在安卓上安装我们的miniservice

pip install uiautomator2 
python -m uiautomator2 init 
or
import uiautomator2 as u2
device =u2.connect()

我们在初始化的时候或者使用uiautomator2时会默认安装适合我们安卓架构的minicapservice

2.第二部使用adb命令启动安卓中的minicapservice

adb forward tcp:1717 localabstract:minicap
adb shell LD_LIBRARY_PATH=/data/local/tmp /data/local/tmp/minicap -P 6480x960@6480x960/0

6480x960@6480x960 是我们安卓设备的屏幕像素

adb shell wn size

3.第三步，编写接收数据，并转换成图片

import socket
import sys
import struct
from collections import OrderedDict
class Banner:
    def __init__(self):
        self.__banner = OrderedDict(
            [('version', 0),
             ('length', 0),
             ('pid', 0),
             ('realWidth', 0),
             ('realHeight', 0),
             ('virtualWidth', 0),
             ('virtualHeight', 0),
             ('orientation', 0),
             ('quirks', 0)
             ])
    def __setitem__(self, key, value):
        self.__banner[key] = value
    def __getitem__(self, key):
        return self.__banner[key]
    def keys(self):
        return self.__banner.keys()
    def __str__(self):
        return str(self.__banner)
class MiniCap:
    def __init__(self, host, port, banner):
        self.buffer_size = 4096
        self.host = host
        self.port = port
        self.banner = banner
        self.socket = None
        self.stop_flag = False
    def connect(self):
        """
        Connect to the specified host and port.
        Raises:
            socket.error: If there is any error creating the socket or connecting.
        """
        try:
            self.socket = socket.socket(socket.AF_INET, socket.SOCK_STREAM)
            self.socket.connect((self.host, self.port))
        except socket.error as e:
            print(f"Failed to connect to {self.host}:{self.port}. Error: {e}")
            raise e
    @classmethod
    def save_image(cls, data):
        file_name = 'received_image.jpg'  # 图片名
        with open(file_name, 'wb') as f:
            for b in data:
                f.write(b.to_bytes(1, 'big'))
    def consume(self,stop_flag):
        readBannerBytes = 0
        bannerLength = 24
        readFrameBytes = 0
        frameBodyLength = 0
        data = []
        while not stop_flag:
            try:
                chunk = self.socket.recv(self.buffer_size)
            except socket.error as e:
                print(e)
                sys.exit(1)
            cursor = 0
            buf_len = len(chunk)
            while cursor