Building the automated Android UI testing in Continuous integration at LINE MAN Wongnai

"Building the automated Android UI testing in Continuous integration at LINE MAN Wongnai" at Android Bangkok 2023

Transcript

1. Building the automated Android UI testing in Continuous Integration Somkiat Khitwongwattana Android GDE @akexorcist At LINE MAN Wongnai
2. LINE MAN Wongnai LINE MAN Rider LINE MAN Driver Wongnai Merchant Wongnai POS Consumer Local Business Rider & Driver Wongnai POS Manager
3. LINE MAN Wongnai LINE MAN Rider LINE MAN Driver Wongnai Merchant Wongnai POS React Native Native Android (Kotlin) Wongnai POS Manager
4. Running Android UI testing in continuous integration is challenging for developers, but it's necessary for future scalability of Android apps.
6. Our previous infrastructure Which isn’t good enough for current requirements • Not scalable • Not maintainable • Unstable 🥲 😢 😭
7. Native Android React Native Marathon Detox Allure Jest Yes No UI Testing Integration End-to-end Test Reporting Yes Yes Test Executor Continuous Integration GitLab GitLab
8. Android Device Provider Marathon Detox Allure Jest Yes No UI Testing Integration End-to-end Test Reporting Yes Yes Test Executor tinuous gration tLab tLab
9. Candidates Smartphone Test Farm Genymotion Device Image Firebase Test Lab
10. Firebase Test Lab Key Features • Test both Android and iOS apps • Real and virtual devices • Google Play Service included • Wide range of supported devices • Test matrix execution is supported Note: Test reports are stored on Google Cloud Storage https://firebase.google.com/products/test-lab
11. Firebase Test Lab Pricing Virtual device • No-cost up to 60 min / day • Then $1 / device / hour Physical device • No-cost up to 30 min / day • Then $5 / device / hour
12. Genymotion Device Image Key Features • Available on well-known cloud service providers • Virtual devices without GPU • Remotely control via web browser and HTTP API • Run app for ARM natively with ARM64 instances • Provide SSH and ADB access https://www.genymotion.com
13. Genymotion Device Image Pricing Depending on the instance size t4g.medium • 2 vCPU • 4GB of memory • $0.295 / hr c6g.xlarge • 4 vCPU • 8GB of memory • $0.636 / hr
14. Smartphone Test Farm Key Features • Open-source project • Remote control any device from your browser • Monitor your device inventory • Reserve and release any device with STF API https://github.com/DeviceFarmer/stf
15. Price Maintainability Custom Test Executor VPN Stability Configurability Ease of use
16. Price Ease of use C ustom Test Executor VPN Stability M aintainability C onfigurability Firebase Test Lab Genymotion Device Image Smartphone Test Farm
17. Swollen battery problem on a physical device
18. Build App APK & Test APK Run UI Test Generate Test Report
19. Run UI Test GitLab Runner Genymotion Device Image on AWS EC2 Start Job Create Instance Initialization Test Execution End Job Test Execution Initialization Destroy Instance
20. Run UI Test GitLab Runner Genymotion Device Image on AWS EC2 Start Job Create Instance Initialization Test Execution End Job Test Execution Initialization Destroy Instance
21. Run UI Test GitLab Runner Genymotion Device Image on AWS EC2 Start Job Create Instance Initialization Test Execution End Job Test Execution Initialization Destroy Instance Terraform
22. Run UI Test GitLab Runner Genymotion Device Image on AWS EC2 Start Job Create Instance Initialization Test Execution End Job Test Execution Initialization Destroy Instance Connect ADB Shell Script
23. Run UI Test GitLab Runner Genymotion Device Image on AWS EC2 Start Job Create Instance Initialization Test Execution End Job Test Execution Initialization Destroy Instance Install APKs & Run UI test Collect test result & device log
24. Run UI Test GitLab Runner Genymotion Device Image on AWS EC2 Start Job Create Instance Initialization Test Execution End Job Test Execution Initialization Destroy Instance Terraform
25. Run UI Test GitLab Runner Genymotion Device Image on AWS EC2 Start Job Create Instance Initialization Test Execution End Job Test Execution Initialization Destroy Instance
26. Run UI Test GitLab Runner Genymotion Device Image on AWS EC2 Start Job Create Instance Initialization Test Execution End Job Test Execution Initialization Destroy Instance
27. Run UI Test GitLab Runner Genymotion Device Image on AWS EC2 Start Job Create Instance Initialization Test Execution End Job Test Execution Initialization Destroy Instance Cron Job Destroy instance
28. Run UI Test GitLab Runner Genymotion Device Image on AWS EC2 Start Job Create Instance Initialization Test Execution End Job Test Execution Initialization Destroy Instance Terraform
29. AMI AWS VPC • AMI: Amazon Machine Image • VPC: Virtual Private Cloud Subscribe Launch Genymotion Instance
30. Original Genymotion AMI • ADB disabled by default • No Google Mobile Services • Undesired screen size • No WebView engine • English language by default
31. All setup operations Enable ADB connection Connect device Change screen resolution Change device location Change device language Install OpenGApps Install Google Maps and Chrome for Android Reboot the device Reconnect the ADB after device rebooted Grant location permission for Google Maps Allow Google’s Location Service from Google Maps HTTP ADB HTTP HTTP ADB ADB ADB ADB ADB ADB ADB
32. Genymotion HTTP API • ADB • Clipboard • Screen resolution • Screen orientation • Download, upload, or delete file • Send key, mouse, or tap event • Screenshot • Battery • GPS • And more
33. All setup operations Enable ADB connection Connect device Change screen resolution Change device location Change device language Install OpenGApps Install Google Maps and Chrome for Android Reboot the device Reconnect the ADB after device rebooted Grant location permission for Google Maps Allow Google’s Location Service from Google Maps HTTP ADB HTTP HTTP ADB ADB ADB ADB ADB ADB ADB POST /api/v1/configure/adb { "active": true, "active_on_reboot": true }
34. All setup operations Enable ADB connection Connect device Change screen resolution Change device location Change device language Install OpenGApps Install Google Maps and Chrome for Android Reboot the device Reconnect the ADB after device rebooted Grant location permission for Google Maps Allow Google’s Location Service from Google Maps HTTP ADB HTTP HTTP ADB ADB ADB ADB ADB ADB ADB adb connect <ip_address>
35. All setup operations Enable ADB connection Connect device Change screen resolution Change device location Change device language Install OpenGApps Install Google Maps and Chrome for Android Reboot the device Reconnect the ADB after device rebooted Grant location permission for Google Maps Allow Google’s Location Service from Google Maps HTTP ADB HTTP HTTP ADB ADB ADB ADB ADB ADB ADB POST /api/v1/android/resolution { "width": 720, "height": 1440, "dpi": 300 }
36. Screen resolution configuration Mobile Tablet • 720 x 1,440 px • 384 x 768 dp • 300 DPI • 1,335 x 751 px • 1,335 x 751 dp • 160 DPI
37. Screen resolution configuration Mobile Tablet • 720 x 1,440 px • 384 x 768 dp • 300 DPI • 1,335 x 751 px • 1,335 x 751 dp • 160 DPI https://developer.android.com/reference/android/util/DisplayMetrics
38. Screen resolution configuration Mobile Tablet • 720 x 1,440 px • 384 x 768 dp • 300 DPI • 1,335 x 751 px • 1,335 x 751 dp • 160 DPI https://developer.android.com/reference/android/util/DisplayMetrics DP x (DPI / 160) = PX
39. All setup operations Enable ADB connection Connect device Change screen resolution Change device location Change device language Install OpenGApps Install Google Maps and Chrome for Android Reboot the device Reconnect the ADB after device rebooted Grant location permission for Google Maps Allow Google’s Location Service from Google Maps HTTP ADB HTTP HTTP ADB ADB ADB ADB ADB ADB ADB POST /api/v1/sensors/gps { "latitude": 13.7223497, "longitude": 100.5804235, "altitude": 0, "accuracy": 10, "bearing": 0, "speed": 0 }
40. All setup operations Enable ADB connection Connect device Change screen resolution Change device location Change device language Install OpenGApps Install Google Maps and Chrome for Android Reboot the device Reconnect the ADB after device rebooted Grant location permission for Google Maps Allow Google’s Location Service from Google Maps HTTP ADB HTTP HTTP ADB ADB ADB ADB ADB ADB ADB adb shell setprop persist.sys.local "th-TH"
41. All setup operations Enable ADB connection Connect device Change screen resolution Change device location Change device language Install OpenGApps Install Google Maps and Chrome for Android Reboot the device Reconnect the ADB after device rebooted Grant location permission for Google Maps Allow Google’s Location Service from Google Maps HTTP ADB HTTP HTTP ADB ADB ADB ADB ADB ADB ADB
42. OpenGApps An open-source initiative that provides Google Apps package Pico package • Google Play services https://opengapps.org
43. All setup operations Enable ADB connection Connect device Change screen resolution Change device location Change device language Install OpenGApps Install Google Maps and Chrome for Android Reboot the device Reconnect the ADB after device rebooted Grant location permission for Google Maps Allow Google’s Location Service from Google Maps HTTP ADB HTTP HTTP ADB ADB ADB ADB ADB ADB ADB adb shell wget <download_url> -O /sdcard/Download/opengapps.zip adb shell system/bin/flash-archive.sh /sdcard/Download/opengapps.zip
44. All setup operations Enable ADB connection Connect device Change screen resolution Change device location Change device language Install OpenGApps Install Google Maps and Chrome for Android Reboot the device Reconnect the ADB after device rebooted Grant location permission for Google Maps Allow Google’s Location Service from Google Maps HTTP ADB HTTP HTTP ADB ADB ADB ADB ADB ADB ADB adb shell wget <download_url> -O /sdcard/Download/chrome.zip adb shell pm install -r /sdcard/Download/chrome.apk adb shell wget <download_url> -O /sdcard/Download/maps.zip adb shell pm install -r /sdcard/Download/maps.apk
45. Enable ADB connection Connect device Change screen resolution Change device location Change device language Install OpenGApps Install Google Maps and Chrome for Android Reboot the device Reconnect the ADB after device rebooted Grant location permission for Google Maps Allow Google’s Location Service from Google Maps All setup operations HTTP ADB HTTP HTTP ADB ADB ADB ADB ADB ADB ADB adb reboot adb disconnect
46. Enable ADB connection Connect device Change screen resolution Change device location Change device language Install OpenGApps Install Google Maps and Chrome for Android Reboot the device Reconnect the ADB after device rebooted Grant location permission for Google Maps Allow Google’s Location Service from Google Maps All setup operations HTTP ADB HTTP HTTP ADB ADB ADB ADB ADB ADB ADB
47. Allow Google’s Location Service Using a shell script and ADB to enable Google's Location Service from the Google Maps app
48. All setup operations Enable ADB connection Connect device Change screen resolution Change device location Change device language Install OpenGApps Install Google Maps and Chrome for Android Reboot the device Reconnect the ADB after device rebooted Grant location permission for Google Maps Allow Google’s Location Service from Google Maps HTTP ADB HTTP HTTP ADB ADB ADB ADB ADB ADB ADB adb shell pm grant com.google.android.apps.maps \ android.permission.ACCESS_COARSE_LOCATION adb shell pm grant com.google.android.apps.maps \ android.permission.ACCESS_FINE_LOCATION
49. All setup operations Enable ADB connection Connect device Change screen resolution Change device location Change device language Install OpenGApps Install Google Maps and Chrome for Android Reboot the device Reconnect the ADB after device rebooted Grant location permission for Google Maps Allow Google’s Location Service from Google Maps HTTP ADB HTTP HTTP ADB ADB ADB ADB ADB ADB ADB adb shell uiautomator dump adb pull /sdcard/window_dump.xml
50. All setup operations Enable ADB connection Connect device Change screen resolution Change device location Change device language Install OpenGApps Install Google Maps and Chrome for Android Reboot the device Reconnect the ADB after device rebooted Grant location permission for Google Maps Allow Google’s Location Service from Google Maps HTTP ADB HTTP HTTP ADB ADB ADB ADB ADB ADB ADB adb shell uiautomator dump adb pull /sdcard/window_dump.xml <?xml version='1.0' encoding='UTF-8' standalone='yes' ?> <hierarchy rotation="0"> <node index="0" text="" resource-id="" class="android.widget.FrameLayout" package="com.android.launcher3" content-desc="" checkable="false" checked="false" clickable="false" enabled="true" focusable="false" focused="false" scrollable="false" long-clickable="false" password="false" selected="false" bounds="[0,0][1080,2072]"> <node index="0" text="" resource-id="" class="android.widget.LinearLayout" package="com.android.launcher3" content-desc="" checkable="false" checked="false" clickable="false" enabled="true" focusable="false" focused="false" scrollable="false" long-clickable="false"
51. All setup operations Enable ADB connection Connect device Change screen resolution Change device location Change device language Install OpenGApps Install Google Maps and Chrome for Android Reboot the device Reconnect the ADB after device rebooted Grant location permission for Google Maps Allow Google’s Location Service from Google Maps HTTP ADB HTTP HTTP ADB ADB ADB ADB ADB ADB ADB adb shell uiautomator dump adb pull /sdcard/window_dump.xml <?xml version='1.0' encoding='UTF-8' standalone='yes' ?> <hierarchy rotation="0"> <node index="0" text="" resource-id="" class="android.widget.FrameLayout" package="com.android.launcher3" content-desc="" checkable="false" checked="false" clickable="false" enabled="true" focusable="false" focused="false" scrollable="false" long-clickable="false" password="false" selected="false" bounds="[0,0][1080,2072]"> <node index="0" text="" resource-id="" class="android.widget.LinearLayout" package="com.android.launcher3" content-desc="" checkable="false" checked="false" clickable="false" enabled="true" focusable="false" focused="false" scrollable="false" long-clickable="false"
52. All setup operations Enable ADB connection Connect device Change screen resolution Change device location Change device language Install OpenGApps Install Google Maps and Chrome for Android Reboot the device Reconnect the ADB after device rebooted Grant location permission for Google Maps Allow Google’s Location Service from Google Maps HTTP ADB HTTP HTTP ADB ADB ADB ADB ADB ADB ADB adb shell uiautomator dump adb pull /sdcard/window_dump.xml <?xml version='1.0' encoding='UTF-8' standalone='yes' ?> <hierarchy rotation="0"> <node index="0" text="" resource-id="" class="android.widget.FrameLayout" package="com.android.launcher3" content-desc="" checkable="false" checked="false" clickable="false" enabled="true" focusable="false" focused="false" scrollable="false" long-clickable="false" password="false" selected="false" bounds="[0,0][1080,2072]"> <node index="0" text="" resource-id="" class="android.widget.LinearLayout" package="com.android.launcher3" content-desc="" checkable="false" checked="false" clickable="false" enabled="true" focusable="false" focused="false" scrollable="false" long-clickable="false" text="" resource-id="" bounds="[0,0][1080,2072]"
53. All setup operations Enable ADB connection Connect device Change screen resolution Change device location Change device language Install OpenGApps Install Google Maps and Chrome for Android Reboot the device Reconnect the ADB after device rebooted Grant location permission for Google Maps Allow Google’s Location Service from Google Maps HTTP ADB HTTP HTTP ADB ADB ADB ADB ADB ADB ADB adb shell uiautomator dump adb pull /sdcard/window_dump.xml <?xml version='1.0' encoding='UTF-8' standalone='yes' ?> <hierarchy rotation="0"> <node index="0" text="" resource-id="" class="android.widget.FrameLayout" package="com.android.launcher3" content-desc="" checkable="false" checked="false" clickable="false" enabled="true" focusable="false" focused="false" scrollable="false" long-clickable="false" password="false" selected="false" bounds="[0,0][1080,2072]"> <node index="0" text="" resource-id="" class="android.widget.LinearLayout" package="com.android.launcher3" content-desc="" checkable="false" checked="false" clickable="false" enabled="true" focusable="false" focused="false" scrollable="false" long-clickable="false" text="SKIP" bounds="[0,0][1080,2072]" Example
54. All setup operations Enable ADB connection Connect device Change screen resolution Change device location Change device language Install OpenGApps Install Google Maps and Chrome for Android Reboot the device Reconnect the ADB after device rebooted Grant location permission for Google Maps Allow Google’s Location Service from Google Maps HTTP ADB HTTP HTTP ADB ADB ADB ADB ADB ADB ADB PATTERN='string(//node[@text="SKIP"][1]/@bounds)' POSITION=$( xmllint --xpath $PATTERN window_dump.xml | awk -F '[\\[\\],]' '{printf("%d %d",($2+$5)/2,($3+$6)/2)}' ) adb shell input tab $POSITION
55. All setup operations Enable ADB connection Connect device Change screen resolution Change device location Change device language Install OpenGApps Install Google Maps and Chrome for Android Reboot the device Reconnect the ADB after device rebooted Grant location permission for Google Maps Allow Google’s Location Service from Google Maps HTTP ADB HTTP HTTP ADB ADB ADB ADB ADB ADB ADB PATTERN='string(//node[@text="SKIP"][1]/@bounds)' POSITION=$( xmllint --xpath $PATTERN window_dump.xml | awk -F '[\\[\\],]' '{printf("%d %d",($2+$5)/2,($3+$6)/2)}' ) adb shell input tab $POSITION
56. Allow Google’s Location Service • Launch Google Maps app • Tap on “SKIP” button • Tap on current location button • Tap on “OK” button • Back to home screen • Start the UI testing
57. AMI AWS VPC • AMI: Amazon Machine Image • VPC: Virtual Private Cloud Subscribe Launch Genymotion Instance Terraform
58. AMI AWS • AMI: Amazon Machine Image • VPC: Virtual Private Cloud Sub Launch VPC Genymotion Instance
59. AMI AWS • AMI: Amazon Machine Image • VPC: Virtual Private Cloud Sub Launch VPC Genymotion Instance Setup Custom AMI Snapshot
60. AMI AWS • AMI: Amazon Machine Image • VPC: Virtual Private Cloud Sub Launch VPC Genymotion Instance Setup Custom AMI Snapshot Packer
61. GitLab Runner Genymotion Device Image on AWS EC2 Start Job Create Instance Initialization Test Execution End Job Test Execution Initialization Destroy Instance Terraform
62. GitLab Runner Genymotion Device Image on AWS EC2 Start Job Pre-configured Instance Initialization Test Execution End Job Test Execution Initialization Destroy Instance Terraform Custom AMI
63. Summary Now • More scalable and stable CI system for Android UI testing • Compatible with any mobile framework for Android app • All of our Android apps have been successfully migrated to this new CI system • Provide teams with a seamless opportunity to implement automated end-to-end testing • Genymotion's monthly costs are highly cost-effective for our CI/CD system's results
64. Summary On the other side • Genymotion charges by usage time. Optimizing UI testing to reduce the time spent will significantly reduce costs for the company. • Working with a Site Reliability Engineer to create the system will take a few months, with additional months needed for improvements. • Running Genymotion with public IP address will be vulnerable to bot script embedding by attackers.
65. Android Developer Site Reliability Engineer CI for Android UI Testing
66. Thank you Somkiat Khitwongwattana Android GDE @akexorcist