How we test Mobile Apps (QA in a nutshell)

In this presentation from 2018, we present how test mobile apps at QuickBird Studios. The audience were app testers and QA experts (not programmers), so the presentation is not focused on code but more focused on overall strategies.

Transcript

1. Mobile Testing Stefan Kofler & Malte Bucksch 1
2. About us Stefan Kofler & Malte Bucksch 2
3. Agenda I. Why should you test apps? II. What stops you from testing apps? III. Testing strategies I. Manual GUI testing II. Automated GUI testing III. Automated integration testing IV. Automated unit testing IV. Our testing approach V. Continuous integration VI. Cloud-based testing Stefan Kofler & Malte Bucksch 3
4. Why should you test your app? Stefan Kofler & Malte Bucksch 4
5. Stefan Kofler & Malte Bucksch 5 Device Fragmentation
6. Many things can go wrong Stefan Kofler & Malte Bucksch 6
7. Translation Stefan Kofler & Malte Bucksch 7
8. Users will uninstall your app quickly
9. Stefan Kofler & Malte Bucksch 9 Storage Data usage Battery Users will uninstall your app quickly
10. What stops you from testing? Stefan Kofler & Malte Bucksch 10 Priorities Time Discipline
11. Stefan Kofler & Malte Bucksch 11 Testing strategies
12. Manual GUI testing Stefan Kofler & Malte Bucksch 12
13. Manual GUI testing: Layout Stefan Kofler & Malte Bucksch 13
14. Manual GUI testing: CPU Stefan Kofler & Malte Bucksch 14
15. Automatic GUI testing Stefan Kofler & Malte Bucksch 15
16. Automatic GUI testing Stefan Kofler & Malte Bucksch 16 Robotic UI tests Predefined UI tests
17. Predefined UI tests Stefan Kofler & Malte Bucksch 17
18. UI Testing with Espresso: Code Stefan Kofler & Malte Bucksch 18 @Test public void greeterSaysHello() { }
19. UI Testing with Espresso: Code Stefan Kofler & Malte Bucksch 19 @Test public void greeterSaysHello() { onView(withId(R.id.addNote)) .perform(click()); }
20. UI Testing with Espresso: Code Stefan Kofler & Malte Bucksch 20 @Test public void greeterSaysHello() { onView(withId(R.id.addNote)) .perform(click()); onView(withId(R.id.noteContent)) .perform(typeText(“Espresso rules")); }
21. UI Testing with Espresso: Code Stefan Kofler & Malte Bucksch 21 @Test public void greeterSaysHello() { onView(withId(R.id.addNote)) .perform(click()); onView(withId(R.id.noteContent)) .perform(typeText(“Espresso rules")); onView(withId(R.id.ok)) .perform(click()); }
22. UI Testing with Espresso: Code Stefan Kofler & Malte Bucksch 22 @Test public void greeterSaysHello() { onView(withId(R.id.addNote)) .perform(click()); onView(withId(R.id.noteContent)) .perform(typeText(“Espresso rules")); onView(withId(R.id.ok)) .perform(click()); onView(withText("Espresso rules")) .check(matches(isDisplayed())); }
23. Recording an Espresso Test Stefan Kofler & Malte Bucksch 23
24. Robotic GUI tests Stefan Kofler & Malte Bucksch 24
25. Robotic GUI tests: Crashes Stefan Kofler & Malte Bucksch 26
26. Robotic GUI tests Stefan Kofler & Malte Bucksch 27
27. Robotic GUI tests: Screenshots Stefan Kofler & Malte Bucksch 28
28. Robotic GUI tests: Security Stefan Kofler & Malte Bucksch 29
29. Integration tests Stefan Kofler & Malte Bucksch 31 Component Dependency A Dependency B Dependency C
30. Integration tests Stefan Kofler & Malte Bucksch 32 Component Dependency A Dependency B Dependency C
31. Automated Unit tests Stefan Kofler & Malte Bucksch 33
32. Automated Unit tests Stefan Kofler & Malte Bucksch 34 Local Tests Instrumented Tests
33. Unit tests totally got us to the moon Stefan Kofler & Malte Bucksch 35
34. Stefan Kofler & Malte Bucksch 36
35. Our approach with MVVM Stefan Kofler & Malte Bucksch 37 View View Model Model Presentation User Input Business Logic Data User action Update Update Notify
36. View Models Stefan Kofler & Malte Bucksch 38 View View Model User action Update
37. View Model Example: ContactsViewModel Stefan Kofler & Malte Bucksch 39 Input: - List of all contacts - Search Text Output: - List of filtered contacts
38. View Models Stefan Kofler & Malte Bucksch 40 View View Model User action Update
39. View Model Tests Stefan Kofler & Malte Bucksch 41 Unit Test View Model Input Output
40. View Model Tests Stefan Kofler & Malte Bucksch 42 func testSearchFilter() { // Given // When // Then }
41. View Model Tests Stefan Kofler & Malte Bucksch 43 func testSearchFilter() { // Given viewModel.inputs.allContacts = ["Stefan", "Malte", "Julian", "Sebastian"] // When // Then }
42. View Model Tests Stefan Kofler & Malte Bucksch 44 func testSearchFilter() { // Given viewModel.inputs.allContacts = ["Stefan", "Malte", "Julian", "Sebastian"] // When viewModel.input.filterText = "Seba" // Then }
43. View Model Tests Stefan Kofler & Malte Bucksch 45 func testSearchFilter() { // Given viewModel.inputs.allContacts = ["Stefan", "Malte", "Julian", "Sebastian"] // When viewModel.input.filterText = "Seba" // Then Assert(viewModel.output.filteredContacts == ["Sebastian"]) }
44. Continuous Integration Stefan Kofler & Malte Bucksch 46 Develop Commit Build Automatic Test Manual Test Release
45. Continuous Integration for Mobile Apps Stefan Kofler & Malte Bucksch 47
46. Example: Gitlab + Buddybuild Stefan Kofler & Malte Bucksch 48
47. Example: Gitlab + Buddybuild Stefan Kofler & Malte Bucksch 49
48. Example: Buddybuild test results Stefan Kofler & Malte Bucksch 50
49. Example: Buddybuild code coverage Stefan Kofler & Malte Bucksch 51
50. Cloud based testing on real devices Stefan Kofler & Malte Bucksch 52
51. Cloud based testing on real devices Stefan Kofler & Malte Bucksch 53 Automated UI Tests Remote Control
52. Cloud based testing on real devices Stefan Kofler & Malte Bucksch 54
53. Happy testing! Stefan Kofler & Malte Bucksch 55