App size regression detection on CI

About how to automate process of detecting app size regression on your CI

Transcript

1. App size regression detection
2. Agenda • Reason to care • apk & app bundle 2 • Regression detection options
3. Reason 3
4. Install conversion rate Does app size impact install conversion rate? https://medium.com/googleplaydev/shrinking-apks-growing-installs 4
5. Install conversion rate Does app size impact install conversion rate? • smaller APK sizes correlate with higher install conversion rates https://medium.com/googleplaydev/shrinking-apks-growing-installs 4
6. Install conversion rate Does app size impact install conversion rate? • smaller APK sizes correlate with higher install conversion rates Lower conversion rate Slower downloads Higher uninstall Lower update rates https://medium.com/googleplaydev/shrinking-apks-growing-installs • For every 6 MB increase to an APK’s size, we see a decrease in the install conversion rate of 1%. 4
7. APK & App bundle 5
8. Apk structure Directories: Files: 6
9. Apk structure Directories: META-INF/ CERT.SF CERT.RSA assets/ textures/… sounds/… materials/… shaders/… licenses.txt res/ drawable/*.png lib/ x86/native-lib.so x86_64/… armeabi/… armeabi-v7a/… armeabi-v8a/… Files: 6
10. Apk structure Directories: META-INF/ CERT.SF CERT.RSA assets/ textures/… sounds/… materials/… shaders/… licenses.txt res/ drawable/*.png lib/ x86/native-lib.so x86_64/… armeabi/… armeabi-v7a/… armeabi-v8a/… Files: resources.arsc res/ drawable/… values/… layout/… classes.dex dex/ classes.dex classes2.dex AndroidManifest.xml 6
11. Generate an apk https://developer.android.com/guide/app-bundle/app-bundle-format 7
12. Generate an apk https://developer.android.com/guide/app-bundle/app-bundle-format 7
13. Generate an apk 1. Legacy apk Build universal apk via assemble[Debug/Release] Contains files for all device configurations https://developer.android.com/guide/app-bundle/app-bundle-format 7
14. Generate an apk 1. Legacy apk Build universal apk via assemble[Debug/Release] Contains files for all device configurations 2. Dynamic delivery with App Bundle • Of fi cial android app publishing format • Allows to build an apk for speci fi c device
 Decreases the apk size by ~35% https://developer.android.com/guide/app-bundle/app-bundle-format 7
15. BUNDLE-METADATA/ BundleCon fi g.pb Android App Bundle (*.aab) https://developer.android.com/guide/app-bundle/app-bundle-format 8
16. Base module (base/) assets.pb resources.pb native.pb manifest/ AndroidManifest.xml dex/ classes.dex classes2.dex root/ com/… … res/ layout/… … drawable/… drawable-hdpi/… drawable-xhdpi/… … values/… values-en/… values-fr/… … assets/ textures/… sounds/… materials/… shaders/… licenses.txt lib/ x86/native-lib.so x86_64/… armeabi/… armeabi-v7a/… armeabi-v8a/… … BUNDLE-METADATA/ BundleCon fi g.pb Android App Bundle (*.aab) https://developer.android.com/guide/app-bundle/app-bundle-format 8
17. Base module (base/) assets.pb resources.pb native.pb manifest/ AndroidManifest.xml dex/ classes.dex classes2.dex root/ com/… … res/ layout/… … drawable/… drawable-hdpi/… drawable-xhdpi/… … values/… values-en/… values-fr/… … assets/ textures/… sounds/… materials/… shaders/… licenses.txt lib/ x86/native-lib.so x86_64/… armeabi/… armeabi-v7a/… armeabi-v8a/… … Dynamic feature 1 (feature1/) … Dynamic feature 2 (feature2/) … BUNDLE-METADATA/ BundleCon fi g.pb Android App Bundle (*.aab) https://developer.android.com/guide/app-bundle/app-bundle-format 8
18. Base module (base/) assets.pb resources.pb native.pb manifest/ AndroidManifest.xml dex/ classes.dex classes2.dex root/ com/… … res/ layout/… … drawable/… drawable-hdpi/… drawable-xhdpi/… … values/… values-en/… values-fr/… … assets/ textures/… sounds/… materials/… shaders/… licenses.txt lib/ x86/native-lib.so x86_64/… armeabi/… armeabi-v7a/… armeabi-v8a/… … Dynamic feature 1 (feature1/) … Dynamic feature 2 (feature2/) … Asset pack 1 (asset_pack_1) manifest/ AndroidManifest.xml assets/ textures/… sounds/… materials/… shaders/… licenses.txt Asset pack 2 (asset_pack_2) manifest/ AndroidManifest.xml assets/ textures/… sounds/… materials/… shaders/… licenses.txt BUNDLE-METADATA/ BundleCon fi g.pb Android App Bundle (*.aab) https://developer.android.com/guide/app-bundle/app-bundle-format 8
19. https://developer.android.com/guide/app-bundle/app-bundle-format
20. Base APK (base-master.apk) Base con fi
21. Base APK (base-master.apk) Base con (feature1-master.apk) Dynamic feature 2 APK (feature1-master.apk) Dynamic feature 3 APK (feature1-master.apk) https://developer.android.com/guide/app-bundle/app-bundle-format
22. Base APK (base-master.apk) Base con (feature1-master.apk) Dynamic feature 2 APK (feature1-master.apk) Dynamic feature 3 APK (feature1-master.apk) Feature 1 con fi guration Split APKs: feature2-xxhdpi.apk feature2-xhdpi.apk feature2-hdpi.apk ... ABI con fi guration Split APKs: feature2-x86.apk feature2-x86_64.apk feature2-armeabi.apk ... Language con fi guration Split APKs: feature2-en.apk feature2-fr.apk feature2-de.apk ... Feature 2 con fi
23. Development detection 10
24. Development size detection 11
25. Development size detection commit commit commit commit 11
26. Development size detection Build release apk ./gradlew assembleRelease 11
27. Development size detection Build release apk Store size metrics ./gradlew assembleRelease Upload to gcloud: gsutil 11
28. Development size detection Build release apk Store size metrics Compare current and previous apks ./gradlew assembleRelease Upload to gcloud: gsutil Compare with diffuse tool java -jar diffuse-binary.jar diff --apk current.apk previous.apk 11
29. Development size detection Build release apk Store size metrics Compare current and previous apks ./gradlew assembleRelease Upload to gcloud: gsutil Compare with diffuse tool java -jar diffuse-binary.jar diff --apk current.apk previous.apk 11
30. Development size detection Build release apk Store size metrics Compare current and previous apks ./gradlew assembleRelease Upload to gcloud: gsutil Compare with diffuse tool 12
31. Development size detection Build release apk Store size metrics Compare current and previous apks ./gradlew assembleRelease Upload to gcloud: gsutil Compare with diffuse tool Run every 3 hours 12
32. Development size detection Build release apk Store size metrics Compare current and previous apks ./gradlew assembleRelease Upload to gcloud: gsutil Compare with diffuse tool Run every 3 hours Schedule a workflow 12
33. Development size detection Build release apk Store size metrics Compare current and previous apks Run every 3 hours 12
34. Development size detection Build release apk Store size metrics Compare current and previous apks Run every 3 hours Build release apk Store size metrics Compare current and previous apks Run every 3 hours 12
35. Development size detection Build release apk Store size metrics Compare current and previous apks Run every 3 hours Build release apk Store size metrics Compare current and previous apks Run every 3 hours ~3h 12
36. Development size detection Build release apk Store size metrics Compare current and previous apks Run every 3 hours Build release apk Store size metrics Compare current and previous apks Run every 3 hours ~3h Collect involved commits 12
37. Drawbacks 13
38. Drawbacks • Late regression detection 13
39. Drawbacks • Late regression detection • Requires manual work 13
40. Drawbacks • Late regression detection • Requires manual work • Legacy apk 13
41. Pull request detection 14
42. Pull request size detection: option 1 15
43. Pull request size detection: option 1 commit commit commit commit development 15
44. Pull request size detection: option 1 development Build bundle release ./gradlew bundleRelease 15
45. Pull request size detection: option 1 development Build bundle release ./gradlew bundleRelease Generate device speci fi c apk Using bundletool 15
46. Pull request size detection: option 1 development Build bundle release ./gradlew bundleRelease Generate device speci fi c apk Using bundletool java -jar bundletool.jar build-apks 15
47. Pull request size detection: option 1 development Build bundle release ./gradlew bundleRelease Generate device speci fi c apk Using bundletool java -jar bundletool.jar build-apks --device-spec=device-spec.json { "supportedAbis": ["armeabi-v7a"], "supportedLocales": ["en"], "screenDensity": 640, "sdkVersion": 27 } 15
48. Pull request size detection: option 1 development Build bundle release ./gradlew bundleRelease Generate device speci fi c apk Using bundletool java -jar bundletool.jar build-apks --device-spec=device-spec.json --bundle=current.aab --output=current-release.apks --mode=system 15
49. Pull request size detection: option 1 development Build bundle release ./gradlew bundleRelease Generate device speci fi c apk Using bundletool java -jar bundletool.jar build-apks --device-spec=device-spec.json --bundle=current.aab --output=current-release.apks --ks=/MyApp/keystore.jks --ks-pass=file:/MyApp/keystore.pwd --ks-key-alias=MyKeyAlias --key-pass=file:/MyApp/key.pwd --mode=system https://developer.android.com/studio/command-line/bundletool 15
50. Pull request size detection: option 1 development Build bundle release ./gradlew bundleRelease Generate device speci fi c apk Using bundletool Store the metrics gsutil: bundle/apk/etc. 16
51. Pull request size detection: option 1 development Build bundle release ./gradlew bundleRelease Generate device speci fi c apk Using bundletool Store the metrics gsutil: bundle/apk/etc. 16
52. Pull request size detection: option 1 development 16
53. Pull request size detection: option 1 development feature/task1 17
54. Pull request size detection: option 1 development feature/task1 17
55. Pull request size detection: option 1 development feature/task1 Build bundle release 17
56. Pull request size detection: option 1 development feature/task1 Build bundle release Generate device speci fi c apk 17
57. Pull request size detection: option 1 development feature/task1 Build bundle release Generate device speci fi c apk Download development build 17
58. Pull request size detection: option 1 development feature/task1 Build bundle release Generate device speci fi c apk Download development build git merge-base development feature/task1 17
59. Pull request size detection: option 1 development feature/task1 Build bundle release Generate device speci fi c apk Download development build git merge-base development feature/task1 Compare dev and pr apks Using diffuse tool 17
60. Pull request size detection: option 1 development feature/task1 Build bundle release Generate device speci fi c apk Download development build git merge-base development feature/task1 Compare dev and pr apks Using diffuse tool Report on PR Detailed diffuse report/Block PR 17
61. Pull request size detection: option 1 development feature/task1 Build bundle release Generate device speci fi c apk Download development build Compare dev and pr apks Report on PR Check git changed fi les 17
62. Pull request size detection: option 1 development feature/task1 Build bundle release Generate device speci fi c apk Download development build Compare dev and pr apks Report on PR Check git changed fi les Compile release code ./gradlew app:compileReleaseJavaWithJavac 17
63. development feature/task1 Build bundle release Generate device speci fi les Compile release code Drawback 17
64. Pull request size detection: option 2 18
65. Pull request size detection: option 2 development Build bundle release Generate device speci fi c apk Store the metrics 18
66. Pull request size detection: option 2 development Build bundle release Generate device speci fi c apk Store the metrics 18
67. Pull request size detection: option 2 development 18
68. Pull request size detection: option 2 development 19
69. Pull request size detection: option 2 development Build bundle release Generate device speci fi c apk 19
70. Pull request size detection: option 2 development Build bundle release Generate device speci fi c apk Checkout development 19
71. Pull request size detection: option 2 development Build bundle release Generate device speci fi c apk Checkout development head_commit = git merge-base development task1 git checkout $head_commit 19
72. Pull request size detection: option 2 development Build bundle release Generate device speci fi c apk Checkout development Build bundle release 19
73. Pull request size detection: option 2 development Build bundle release Generate device speci fi c apk Checkout development Build bundle release Generate device speci fi c apk 19
74. Pull request size detection: option 2 development Build bundle release Generate device speci fi c apk Checkout development Compare PR and development apks Using diffuse tool Report on PR Diffuse report/Block PR Build bundle release Generate device speci fi c apk 19
75. Pull request size detection: option 2 development Build bundle release Generate device speci fi c apk Checkout development Compare PR and development apks Report on PR Check git changed fi les Build bundle release Generate device speci fi c apk 19
76. Results 20
77. Results • Full visibility of app size changes 20
78. Results • Full visibility of app size changes • Automated size regression detection 20
79. Results • Full visibility of app size changes • Automated size regression detection 20
80. Sources • Spotify ruler plugin • Bundletool 21 https://engineering.atspotify.com/2022/02/introducing-ruler-our-tool-for-measuring-android-app-size/ https://developer.android.com/studio/command-line/bundletool • Reduce your app size https://developer.android.com/topic/performance/reduce-apk-size
81. Thank you Any questions?