Screenshot your Entire App with Screengrab and Firebase

Transcript

1. Screenshot your Entire App Edward Dale Freeletics © Edward Dale,

   2016 1

2. Screenshot your Entire App with Screengrab and Firebase Edward Dale

   Freeletics © Edward Dale, 2016 2

3. Find the bug(s) © Edward Dale, 2016 3

4. © Edward Dale, 2016 4

5. © Edward Dale, 2016 5

6. Some things are best verified visually ! Screenshot © Edward

   Dale, 2016 6

7. Screenshots are useful for • Acceptance testing • Edge case

   • Localization • Multiple devices • Regression testing © Edward Dale, 2016 7

8. Screenshot testing tools • Espresso tests • Dependency injection •

   Dependency mocking • Screengrab • Firebase Cloud Test Lab for Android © Edward Dale, 2016 8

9. Espresso test setup @MediumTest public class BuyCoachScreenGrab { @Inject DummyUserManager

   mUserManager; @Rule public ActivityTestRule<BuyCoachActivity> mActivityRule = new ActivityTestRule<>(BuyCoachActivity.class, false, false); © Edward Dale, 2016 9

10. Automated localized screenshots of your Android app on every device

    Screengrab ▶ Fastlane ▶ Fabric ▶ Twitter Combination of command-line tool and classes used in tests © Edward Dale, 2016 10

11. Screengrab test @Test public void testTestimonialMale() { when(mUserManager.getUser().getGender()).thenReturn(Gender.MALE); mActivityRule.launchActivity(new Intent());

    onView(withId(R.id.feature_pager_videos)).perform(scrollTo()); Screengrab.screenshot("buy_coach_male_testimonial"); } © Edward Dale, 2016 11

12. Screengrab test @Test public void testTestimonialMale() { when(mUserManager.getUser().getGender()).thenReturn(Gender.MALE); mActivityRule.launchActivity(new Intent());

    onView(withId(R.id.feature_pager_videos)).perform(scrollTo()); Screengrab.screenshot("buy_coach_male_testimonial"); } @Test public void testTestimonialFemale() { when(mUserManager.getUser().getGender()).thenReturn(Gender.FEMALE); mActivityRule.launchActivity(new Intent()); onView(withId(R.id.feature_pager_videos)).perform(scrollTo()); Screengrab.screenshot("buy_coach_female_testimonial"); } © Edward Dale, 2016 12

13. Screengrab configuration app_package_name 'com.freeletics.debug' app_apk_path 'Freeletics-debug.apk' tests_apk_path 'Freeletics-debug-androidTest.apk' locales ['en-US',

    'fr-FR', 'it-IT', 'de-DE', 'pt-PT', 'es-ES', 'tr-TR', 'ja-JA'] use_tests_in_classes ['com.freeletics.coach.view.BuyCoachScreenGrab'] © Edward Dale, 2016 13

14. Running Screengrab $ ./gradlew clean assembleDebug assembleDebugTest $ screengrab ©

    Edward Dale, 2016 14

15. Firebase Cloud Test Lab for Android Test your app on

    devices hosted in a Google datacenter. Combination of command-line tool and classes used in tests Also supports virtual devices © Edward Dale, 2016 15

16. Firebase Cloud Test Lab for Android Test your app on

    devices hosted in a Google datacenter. Combination of command-line tool and classes used in tests Also supports virtual devices $€£¥ © Edward Dale, 2016 16

17. Firebase test @Test public void testTestimonialMale() { when(mUserManager.getUser().getGender()).thenReturn(Gender.MALE); Activity activity

    = mActivityRule.launchActivity(new Intent()); onView(withId(R.id.feature_pager_videos)).perform(scrollTo()); ScreenShotter.takeScreenshot("buy_coach_male_testimonial", activity); } © Edward Dale, 2016 17

18. Screengrab Screengrab.screenshot("buy_coach_male_testimonial"); Firebase ScreenShotter.takeScreenshot("buy_coach_male_testimonial", activity); © Edward Dale, 2016 18

19. Running Firebase gcloud beta test android run --type instrumentation --app

    Freeletics-debug.apk --test Freeletics-debug-androidTest.apk --device-ids Nexus6 --os-version-ids 21 --locales en-US,fr-FR,it-IT,de-DE,pt-PT,es-ES,tr-TR,ja-JA --orientations portrait --test-targets "class com.freeletics.coach.view.BuyCoachScreenGrab" Also possible to stick this in a YML configuration file. © Edward Dale, 2016 19

20. Screengrab vs Firebase Fight! © Edward Dale, 2016 20

21. Screengrab • ✅ Free • ✅ No waiting for a

    free device • ❌ Limited by your devices © Edward Dale, 2016 21

22. Firebase • ✅ Easy to setup a test matrix •

    ✅ Fits well with a CI system • ❌ Have to wait your turn • ❌ Costs money • $5/hour for real device • $1/hour for virtual device © Edward Dale, 2016 22

23. My suggestion Use both © Edward Dale, 2016 23

24. Cross-platform test @Test public void testTestimonialMale() { when(mUserManager.getUser().getGender()).thenReturn(Gender.MALE); Activity activity

    = mActivityRule.launchActivity(new Intent()); onView(withId(R.id.feature_pager_videos)).perform(scrollTo()); ScreenShotter.takeScreenshot("buy_coach_male_testimonial", activity); Screengrab.screenshot("buy_coach_male_testimonial"); } Screengrab for daily development Firebase for CI regression testing © Edward Dale, 2016 24

25. Thanks! Edward Dale (@scompt) Freeletics (We're hiring) © Edward Dale,

    2016 25