Mastering Screenshot Testing Libraries for Android

Slides of my workshop "Mastering Screenshot Testing Libraries for Android: A Hands-On Workshop" at Droidcon Berlin 2023
-------------------------------------------------------------------------------
Join me for an in-depth workshop where you'll discover the most popular screenshot testing libraries for Android. With so many options to choose from, I'll guide you through the pros and cons of each library, including the newest player on the scene: Roborazzi, based on Robolectric from Google.

This is a hands-on workshop where you'll have the opportunity to explore the different libraries and write both, JVM and on-device screenshot tests on your own. By the end of the workshop, you'll have the skills and knowledge to confidently choose the best screenshot testing libraries for your projects.

Regardless of your level, this is a must-attend workshop to take your UI testing skills to the next level. Don't miss out on this chance to become a screenshot testing pro!
---------------------------------------------------------------
Repos of the workshop:
https://github.com/sergio-sastre/Android-screenshot-testing-playground
https://github.com/sergio-sastre/AndroidUiTestingUtils

Transcript

1. BY SERGIO SASTRE MASTERING SCREENSHOT TESTING LIBRARIES FOR ANDROID
2. Android Studio Electric Eel | 2022.1.1 AGP 7.4 JDK 11 Emulator API 30 - Pixel 3a Tools for the workshop 1 3 4 @Gio_Sastre Github Repo https://github.com/sergio-sastre/Android-screenshot-testing-playground 2 Screenshot testing companion library https://github.com/sergio-sastre/AndroidUiTestingUtils
3. Dropshot, Roborazzi & Paparazzi @Gio_Sastre Workshop’s agenda 1 2 3 Screenshot testing theory What it is & How it works Existing libraries Final thoughts on-device vs. jvm screenshot tests 5 Jvm screenshot tests Roborazzi & Paparazzi On-device screenshot tests Shot & Dropshots Tips & tricks Testing different configurations Which configurations to test 4
4. WHAT Screenshot testing is @Gio_Sastre
5. Special type of UI tests take a screenshot of it, compare it to its reference we inflate a UI component, where and @Gio_Sastre
6. WORKS HOW Screenshot testing @Gio_Sastre
7. record AND verify @Gio_Sastre
8. write test CI @Gio_Sastre <code> +
9. record CI @Gio_Sastre
10. = CI @Gio_Sastre
11. CI new <code> PR + @Gio_Sastre
12. approve CI @Gio_Sastre
13. merge CI @Gio_Sastre
14. CI new <code> PR verify @Gio_Sastre
15. CI new <code> PR @Gio_Sastre
16. CI new <code> PR @Gio_Sastre
17. CI new <code> PR @Gio_Sastre
18. CI new <code> PR verify @Gio_Sastre
19. CI new <code> PR @Gio_Sastre
20. CI new <code> PR @Gio_Sastre
21. CI new <code> PR @Gio_Sastre
22. CI Intentional change forgot to record regression bug YES NO @Gio_Sastre
23. @Gio_Sastre Verify CI CI
24. @Gio_Sastre Verify CI CI
25. @Gio_Sastre Verify CI CI
26. @Gio_Sastre Verify CI CI
27. @Gio_Sastre Verify CI CI
28. @Gio_Sastre Verify CI CI
29. @Gio_Sastre Verify CI CI
30. @Gio_Sastre Verify CI CI
31. @Gio_Sastre Verify CI CI
32. @Gio_Sastre Verify CI CI
33. @Gio_Sastre Verify CI CI
34. @Gio_Sastre Verify CI CI
35. @Gio_Sastre Verify CI CI
36. @Gio_Sastre Verify CI CI
37. @Gio_Sastre Verify CI CI
38. @Gio_Sastre Verify CI CI
39. @Gio_Sastre Verify Custom on top of java.awt Differ Differ Custom wrapper on top of external library comparison algorithm https://github.com/dropbox/differ * * *
40. EXIST? Which Screenshot testing libraries @Gio_Sastre
41. Screenshot testing libraries android-testify Paparazzi screenshot-tests for-android Shot Dropshots Snappy Roborazzi @Gio_Sastre
42. on-device Screenshot testing libraries @Gio_Sastre
43. jvm layoutlib robolectric robolectric * Needs to be con igured * Screenshot testing libraries @Gio_Sastre
44. in this workshop jvm jvm on-device on-device Screenshot testing libraries @Gio_Sastre
45. coding time it’s @Gio_Sastre
46. Dropshots Shot tolerance record & verify gradle managed devices test reports general value for all tests only from CLI @Gio_Sastre standard xml report configuration problematic Windows support Kotlin gradle scripts AGP 8.0 ⚠ ⚠ super easy per test from CLI & AS very nice HTML with diffs not supported not supported verify on device verify on local machine + diffs
47. Android Orchestrator without with 18 Tests tips & tricks
48. Android Orchestrator without with 18 Tests tips & tricks
49. coding time it’s @Gio_Sastre
50. Paparazzi complex animations (views) Side effects (compose) render elevation configuration easy but… easy only library Bazel support ⚠ not supported Roborazzi modules app & library modules Bazel support different API levels Activity & Fragment supported not supported not supported not fully supported not supported supported @Gio_Sastre supported2 1 2 1 Due to layoutlib 2 Due to Robolectric 2 supported supported2 2
51. @Gio_Sastre Configuration matters 1 3 Locale UI Mode 2 Orientation 4 6 Custom themes Display Size 5 Font Size
52. @Gio_Sastre Locale + Spanish German Chinese LTR RTL Arabic Urdu Hebrew … …
53. @Gio_Sastre Locale + en_XA LTR RTL ar_XB Pseudolocale Pseudolocale
54. @Gio_Sastre Locale
55. Settings Display Font size > > Font Size @Gio_Sastre
56. @Gio_Sastre Font Size
57. Display Size Settings Display Display size > > @Gio_Sastre
58. Display Size @Gio_Sastre
59. Font Size vs. Display Size @Gio_Sastre
60. Font Size + Display Size @Gio_Sastre
61. MANY CONFIGS? HOW to screenshot test so @Gio_Sastre
62. @Gio_Sastre possible Display size Font size + Locale UI Mode Orientation out of the box out of the box out of the box 1 via updateConfiguration() possible switch height & width 1 Activities under test must be open, otherwise still possible with AndroidUiTestingUtils out of the box Custom theme out of the box possible via updateConfiguration() out of the box out of the box out of the box robolectric based
63. coding time it’s @Gio_Sastre
64. JVM ? ON-DEVICE or @Gio_Sastre
65. supported supported supported supported supported complex animations (views) Side effects (compose) render elevation not supported different API levels Activity & Fragment not supported not supported supported not fully supported not supported supported @Gio_Sastre supported2 1 2 1 Due to layoutlib 2 Due to Robolectric supported supported 2 robolectric based 2 2
66. @Gio_Sastre * Only possible with Paparazzi and Roborazzi On-device on-device vs. jvm Best fidelity Foldable support Special configuration (adb) Jvm Very fast Less flaky Accessibility services * (no issues with emulators)
67. @Gio_Sastre on-device vs. jvm https://ubiratansoares.dev/posts/screenshot-testing-for-android-landscape/
68. Repo & Library recap 1 @Gio_Sastre Github Repo https://github.com/sergio-sastre/Android-screenshot-testing-playground 2 Screenshot testing companion library https://github.com/sergio-sastre/AndroidUiTestingUtils
69. attention for your THANKS
70. GitHub @SergioSastre sergio-sastre-florez @sergio-sastre @Gio_Sastre Hashnode blogs Sergio Sastre Flórez Lead & Senior Android developer appdev.de Linkedin