Android Testing at Mobel (December 9, 2015)

Slides for the 'Testing on mobile' session (Mobel user group : http://www.meetup.com/mo-bel/events/226864160/)

Transcript

1. Android Testing
2. Testing
3. Confidence Refactor possible Code handover Fix bugs once
4. Android history
7. Instrumentation Process Test package InstrumentationTestRunner Application package Test case classes JUnit
8. // Start the main activity of the application under test
 mActivity = getActivity();
 // Get a handle to the Activity object's main UI widget, a Spinner
 mSpinner = (Spinner) mActivity.findViewById(com.android.example.spinner.R.id.Spinner);
 // Set the Spinner to a known position
 mActivity.setSpinnerPosition(TEST_STATE_DESTROY_POSITION);
 // Stop the activity - The onDestroy() method should save the state of the Spinner
 mActivity.finish();
 // Re-start the Activity - the onResume() method should restore the state of the Spinner
 mActivity = getActivity();
 // Get the Spinner's current position
 int currentPosition = mActivity.getSpinnerPosition();
 // Assert that the current position is the same as the starting position
 assertEquals(TEST_STATE_DESTROY_POSITION, currentPosition); Test Activity state saving and restoration
11. Testing tools Android Studio / Gradle Android Testing Support Library Espresso
12. AndroidJUnitRunner Espresso UIAutomator
13. Unit tests Integration / UI tests Other Unit tests
14. (UNIT) TESTS ISOLATED REPEATABLE FAST SELF-DOCUMENTING ž Test traits
15. Easy to execute Easy to debug Realistic Fluent API Device, emulator, … …
16. Mockable Android Jar
17. Demo app GearMonster http://gearmonster.appfoundry.be/
18. Google Android Testing Codelab Best (introductory) Android testing example available at the moment (imho) https://www.code-labs.io/codelabs/android-testing/
19. Demo notes app
20. Model View Presenter Model Presenter View
21. Model View Presenter Model Presenter View Android UI
24. Find, perform, check onView(ViewMatcher) .perform(ViewAction) .check(ViewAssertion);
25. Espresso Espresso onView(withId(R.id.some_id)).perform(click()); 
 
 onView(withText("Hi there”)).check(matches(isDisplayed())); 
 
 onView(withId(R.id.some_id)).check(matches(withText(containsString(“someString”)))); 
 
 onData(is(someObject)).perform(click());
26. Espresso API onView(Matcher<View>) onData(Matcher<Object>) Espresso withId() withText() ViewMatchers perform() check() ViewInteraction / DataInteraction click() enterText() scrollTo() ViewActions matches(Matcher<View>) doesNotExist() ViewAssertions find view to operate on composed of © Stephan Linzner (Google)
27. Espresso cheat sheet https://github.com/googlesamples/android-testing/tree/master/downloads
28. Espresso: add note
29. Espresso test anatomy @RunWith(AndroidJUnit4.class) @LargeTest public class NotesScreenTest { @Rule public ActivityTestRule<NotesActivity> notesActivityTestRule = new ActivityTestRule<>(NotesActivity.class);
30. Espresso test anatomy @RunWith(AndroidJUnit4.class) @LargeTest public class NotesScreenTest { @Rule public ActivityTestRule<NotesActivity> notesActivityTestRule = new ActivityTestRule<>(NotesActivity.class);
31. Espresso: exercise UI @Test
 public void addNoteToNotesList() throws Exception {
 
 // Click on the add note button
 onView(withId(R.id.fab_add_notes)).perform(click());
 
 // Add note title and description
 onView(withId(R.id.add_note_title)).perform(typeText(“More”));
 onView(withId(R.id.add_note_description)).perform(typeText(“Testing”));
 
 // Save the note
 onView(withId(R.id.fab_add_notes)).perform(click());
 
 // Verify note is displayed on screen
 onView(withItemText(“Testing”)).check(matches(isDisplayed()));
 }
32. Espresso: exercise UI @Test
 public void addNoteToNotesList() throws Exception {
 
 // Click on the add note button
 onView(withId(R.id.fab_add_notes)).perform(click());
 
 // Add note title and description
 onView(withId(R.id.add_note_title)).perform(typeText(“More”));
 onView(withId(R.id.add_note_description)).perform(typeText(“Testing”));
 
 // Save the note
 onView(withId(R.id.fab_add_notes)).perform(click());
 
 // Verify note is displayed on screen
 onView(withItemText(“Testing”)).check(matches(isDisplayed()));
 }
33. Espresso: exercise UI @Test
 public void addNoteToNotesList() throws Exception {
 
 // Click on the add note button
 onView(withId(R.id.fab_add_notes)).perform(click());
 
 // Add note title and description
 onView(withId(R.id.add_note_title)).perform(typeText(“More”));
 onView(withId(R.id.add_note_description)).perform(typeText(“Testing”));
 
 // Save the note
 onView(withId(R.id.fab_add_notes)).perform(click());
 
 // Verify note is displayed on screen
 onView(withItemText(“Testing”)).check(matches(isDisplayed()));
 }
35. Screen Object Pattern public class LoginScreen {
 
 private static final ViewInteraction USERNAME = onView(withId(R.id.username));
 private static final ViewInteraction PASSWORD = onView(withId(R.id.password));
 private static final ViewInteraction LOGIN = onView(withId(R.id.loginbutton));
 
 public void typeUsername(String username) {
 USERNAME.perform(clearText(), typeText(username));
 }
 
 public void typePassword(String password) {
 PASSWORD.perform(clearText(), typeText(password));
 }
 
 public void clickLoginButton() {
 LOGIN.perform(click());
 }
 
 }
36. Espresso: Intents
37. Espresso: Intents
38. Intent validation @Test public void validateIntentSentToPackage() { // User action that results in an external "phone" activity being launched. user.clickOnView(system.getView(R.id.callButton)); // Using a canned RecordedIntentMatcher to validate that an intent resolving // to the "phone" activity has been sent. intended(toPackage("com.android.phone")); }
39. Intent stubbing @Test public void activityResult_IsHandledProperly() { // Build a result to return when a particular activity is launched. Intent resultData = new Intent(); String phoneNumber = "012-345-678"; resultData.putExtra("phone", phoneNumber); ActivityResult result = new ActivityResult(Activity.RESULT_OK, resultData); // Set up result stubbing when an intent sent to "contacts" is seen. intending(toPackage("com.android.contacts")).respondWith(result)); // User action that results in "contacts" activity being launched. // Launching activity expects phoneNumber to be returned and displays it on the screen. onView(withId(R.id.pickButton)).perform(click()); // Assert that data we set up above is shown. onView(withId(R.id.phoneNumber).check(matches(withText(phoneNumber))); }
40. Intent matchers intended(allOf( hasAction(Intent.ACTION_CHOOSER), hasExtra(is(Intent.EXTRA_INTENT), allOf( hasAction(Intent.ACTION_SEND), hasExtra(Intent.EXTRA_TEXT, "Expected url") ))));
41. Espresso cheat sheet https://github.com/googlesamples/android-testing/tree/master/downloads
42. Espresso synchronization public class IdleMonitor implements IdlingResource {
 
 @Override
 public String getName() {
 return IdleMonitor.class.getSimpleName();
 }
 
 @Override
 public boolean isIdleNow() {
 // return true if resource is idle
 return false;
 }
 
 @Override
 public void registerIdleTransitionCallback(ResourceCallback resourceCallback) {
 // store a reference to the resourceCallback
 // notify resourceCallback when idle
 }
 } Espresso.registerIdlingResources(idlingResource);
43. Testing network resources
44. Wiremock { "request": { "method": "GET", "url": "/api/mytest" }, "response": { "status": 200, "body": "More content\n" } }
45. Wiremock stubFor(get(urlEqualTo("/some/thing")) .willReturn(aResponse() .withStatus(404) .withBody(“No!!”)));
46. OKHTTP MockWebServer public void testServerErrorShouldShowEmptyState() { MockServiceModule mockServiceModule = new MockServiceModule(); DaggerHelper.initWithTestModules(mockServiceModule); // Setup the MockWebServer MockResponse mockResponse = new MockResponse(); mockResponse.setResponseCode(500); mockServiceModule.getMockWebServer().enqueue(mockResponse); // mockwebserver + restadapter are setup, now init activity getActivity(); onView(withId(R.id.list_empty_image)).check( matches(isDisplayed())); }
47. Unit tests Integration / UI tests Other Performance tests
48. Performance Testing Harness
49. Performance
50. Performance
51. Custom Test Rules @Rule
 public EnableTestTracing enableTestTracing;
 
 @Rule
 public EnablePostTestDumpsys enablePostTestDumpsys;
 
 @Rule
 public EnableLogcatDump enableLogcatDump;
 
 @Rule
 public EnableNetStatsDump enableNetStatsDump;
53. Tips & tricks
54. Android Unmock Gradle Plugin unMock { // URI to download the android-all.jar from downloadFrom 'https://oss.sonatype.org/content/groups/public/org/robolectric/android-all/4.3_r2-robolectric-0/android- all-4.3_r2-robolectric-0.jar' keep "android.widget.BaseAdapter" keep "android.widget.ArrayAdapter" keep "android.os.Bundle" keepStartingWith "android.text.TextUtils" keepStartingWith "android.util." keepStartingWith "android.text." keepStartingWith "com.android.internal.R" keepStartingWith "com.android.internal.util." keep "android.net.Uri" }
55. Unit tests Integration / UI tests Other Other tests
56. The Monkey
57. evil monkey…
58. AssertJ Android for checking assertions to read / write http://square.github.io/assertj-android/ Syntactic sugar Ŷ Extension of the AssertJ library Ŷ Makes tests easier Ŷ Fluent syntax Ŷ
59. AssertJ Android Regular JUnit AssertJ Android assertEquals(View.GONE, view.getVisibility()); assertThat(view).isGone(); expected: <8> but was: <4> Expected visibility <gone> but was <invisible>.
60. AssertJ Android Regular JUnit assertEquals(View.VISIBLE, layout.getVisibility()); assertEquals(VERTICAL, layout.getOrientation()); assertEquals(4, layout.getChildCount()); assertEquals(SHOW_DIVIDERS_MIDDLE, layout.getShowDividers()); AssertJ Android assertThat(layout).isVisible() .isVertical() .hasChildCount(4) .hasShowDividers(SHOW_DIVIDERS_MIDDLE);
61. Awaitility @Test
 public void test_mediaPlayer_liveStream() {
 
 MediaControllerCompat mediaController = new MediaControllerCompat(getContext(), audioPlayerService.getMediaSessionToken());
 String uri = "http://stream.be/service/mp3:web/program_ondemand_128.mp3/playlist.m3u8";
 Bundle extras = new Bundle();
 extras.putBoolean(AudioPlayerService.EXTRA_CONTINUE_ON_RESUME, false);
 mediaController.getTransportControls().playFromMediaId(uri, extras);
 await().atMost(10, TimeUnit.SECONDS).until(musicIsActive());
 
 } Test asynchronous system Express expectations in easy to read manner
62. Spoon
63. Test Driven Development RED FAILING TEST GREEN FIXED TEST BLUE REFACTOR
64. Automatic On every commit / scheduled Unit tests UI integration tests with Espresso
65. Test devices
66. Remote
69. Creating software = complex Continuous integration Ensure quality Automate high-quality, robust and reliable apps tedious / error-prone activities
70. Reduce risk Continuous integration Reduce overhead Quality Assurance
71. Automate all the things
72. Continuous integration 1 2 3 4 CODE & COMMIT BUILD & CHECK CI PICKUP REPORT RESULTS
73. Metrics
74. Dashboard
75. Dashing
76. Panic…
77. Build pipeline Checkout / compile Unit tests Test coverage Code analysis Create deployable artifact Deploy for automatic QA test Trigger automated QA stage
78. Auto publish Delivery Promote app to production Automate Google Play alpha / beta iTunes Connect without additional tools
79. Continuous Delivery
80. Continuous delivery / deliverable Continuous Delivery Deliverable Push on demand Confidence of being deployable
81. Feature-based deployment A successful Git branching model http://nvie.com/posts/a-successful-git-branching-model/
84. Test app distribution
85. Test app distribution
86. Internal QA Testing Internal alpha testing program Beta testing / staged rollout of being deployable
87. Resources
88. Android Testing Support Library https://google.github.io/android-testing-support-library/
89. Google Codelabs https://www.code-labs.io/
90. Google Testing Samples / Blueprint https://github.com/googlesamples/android-testing/ https://github.com/googlesamples/android-testing-templates/
91. Resources AT&T Application Resource Optimizer (mentioned by Friedger Müffke & Jo Somers) https://developer.att.com/application-resource-optimizer Wiremock http://wiremock.org/ Android Unmock Gradle Plugin https://github.com/bjoernQ/unmock-plugin AssertJ Android https://github.com/square/assertj-android Awaitility https://github.com/jayway/awaitility Spoon https://square.github.io/spoon/
92. Suggested reading Test Driven Development: By Example Beck, Kent (978-0321146533) Continuous Integration: Improving Software Quality and Reducing Risk Duvall, Paul M. et al. (978-0321336385) Working Effectively with Legacy Code Feathers, Michael (978-0131177055)
94. Questions? Filip Maelbrancke Consultant @ AppFoundry filip.maelbrancke@appfoundry.be @fmaelbrancke
95. Thank you!