Android UI testing for beginners @Alex_Zhukovich http://alexzh.com 

Observations Ø Android has no clear way to structure of an application Ø Huge activities / fragments Ø Hard to add features Ø Hard to test Ø Many apps tested in manual way 

Solution ü Architectural patterns (MVP, MVVM, etc) ü Automated testing ü Test coverage ü Continuous Integration 

App 

Types of testing Unit testing –JUnit –Mockito –PowerMockito –etc UI testing –Espresso –Robotium –Robolectric –UI Automator –etc 

Android project structure Source code module/src/main/java Unit tests module/src/test/java Instrumentation tests module/src/androidTest/java 

Category of Android tests Run on the JVM (local tests) Require Android device (instrumentation tests) Tests 

Running local tests in Android Studio Gradle ./gradlew test Result of tests: {MODULE}/build/reports/tests/ Run menu Run / Edit Configurations… Project tree 

Running instrumentation tests in Android Studio Gradle ./gradlew connectedAndroidTest ./gradlew cAT Result of tests: {MODULE}/build/reports/ androidTests/connected/ Run menu Run / Edit Configurations… Project tree 

UI Automator Viewer 

UI Automator Viewer Ø Android Studio Tools / Android / Android Device Monitor Ø Application {ANDROID_SDK}/ tools / uiautomatorviewer 

Espresso 

What is Espresso? Ø Android UI test framework Ø Compatible with Android 2.2 (API level 8) or higher Ø Part of Android Testing Support Library 

Why is Espresso? Ø Easy to setup Ø Readable tests Ø Extendable Ø Smart waiting 

Install / Update Android Support Libraries Ø Android SDK Manager Ø Terminal 

Integrate Espresso to the project android { defaultConfig { testInstrumentationRunner "android.support.test.runner.AndroidJUnitRunner" } } ... dependencies { ... androidTestCompile 'com.android.support.test.espresso:espresso-core:2.2.2' androidTestCompile 'com.android.support.test.runner:0.5' } 

Recommendation for setting up the device / emulator One small recommendation for avoiding flakiness is turning off animation on real or virtual devices. • Window animation scale • Transition animation scale • Animator duration scale • Settings / Developer Options/ 

Espresso UI tests onView(ViewMatcher) .perform(ViewAction) .check(ViewAssertion); onData(ObjectMatcher) .DataOptions .perform(ViewAction) .check(ViewAssertion); 

ViewMatcher onView(withId(R.id.pay_button)) ← ViewMatcher .perform(ViewAction) .check(ViewAssertion); 

ViewAction onView(withId(R.id.pay_button)) .perform(click()) ← ViewAction .check(ViewAssertion); 

ViewAssertion onView(withId(R.id.pay_button)) .perform(click()) .check(matches(isDisplayed())); ← ViewAssertion 

Is it pass? @Test public void testSomeView() { onView(withId(R.id.test)); } 

Hamcrest http://www.marcphilipp.de/downloads/posts/2013-01-02-hamcrest-quick-reference/Hamcrest-1.3.pdf 

First test case @RunWith(AndroidJUnit4.class) public class MainActivityEspressoTest { @Rule public ActivityTestRule mActivityRule = new ActivityTestRule<>(MainActivity.class); @Test public void validateNumberPicker() { ... onView(withId(R.id.coffee_increment)) .perform(click()); onView(withId(R.id.coffee_count)) .check(matches(withText("1"))); ... } } 

Snackbar @Test public void shouldDisplayOrderMoreCoffeeSnackBar() { onView(withId(R.id.pay)) .perform(click()); onView(withId(android.support.design.R.id.snackbar_text)) .check(matches(withText(R.string.message_more_coffee))); } 

Toast @Test public void shouldDisplayOrderMoreCoffeeToast() { onView(withId(R.id.pay)) .perform(click()); onView(withText(R.string.message_more_coffee)) .inRoot(isRoot()) .check(matches(isDisplayed())); } 

isRoot matcher public static Matcher isRoot() { return new TypeSafeMatcher() { @Override public void describeTo(Description description) { description.appendText("is toast"); } @Override protected boolean matchesSafely(Root root) { if ((root.getWindowLayoutParams().get().type == WindowManager.LayoutParams.TYPE_TOAST)) { IBinder windowToken = root.getDecorView().getWindowToken(); IBinder appToken = root.getDecorView().getApplicationWindowToken(); if (windowToken == appToken) { return true; } } return false; } }; } 

Enter text @Test public void shouldVerifyOrderAndEnterUsername() { ... onView(withId(R.id.comment_toolbar)) .perform(typeText("Alex"), closeSoftKeyboard()); onView(withId(R.id.comment_toolbar)) .check(matches(withText("Alex"))); } 

AdapterView java.lang.Object ↳ android.view.View ↳ android.view.ViewGroup ↳ android.widget.AdapterView https://developer.android.com/reference/android/widget/AdapterView.html 

onData onData(ObjectMatcher) .DataOptions .perform(ViewAction) .check(ViewAssertion) 

onData – ArrayAdapter onData(allOf(is(instanceOf(String.class)), is("Americano"))) .check(matches(isDisplayed())); ArrayAdapter adapter = new ArrayAdapter<>( this, android.R.layout.simple_list_item_1, android.R.id.text1, coffeeList); 

onData – custom adapter @Test public void clickCoffeeItem() { ... onData(withCoffee(espresso)) .inAdapterView(withId(R.id.detail_list)) .perform(click()); } public class CoffeeAdapter extends BaseAdapter { ... @Override public Object getItem(int position) { return mOrderedCoffee.keySet().toArray()[position]; } } 

withCoffee matcher public static Matcher withCoffee(final Coffee coffee) { return new BoundedMatcher(Coffee.class) { @Override public void describeTo(Description description) { description.appendText("has value: "); description.appendText(coffee.toString()); } @Override protected boolean matchesSafely(Coffee item) { return item.equals(coffee); } }; } 

RecyclerView java.lang.Object ↳ android.view.View ↳ android.view.ViewGroup ↳ android.support.v7.widget.RecyclerView It is not an AdapterView https://developer.android.com/reference/android/support/v7/widget/RecyclerView.html 

RecyclerView dependencies { ... androidTestCompile('com.android.support.test.espresso:espresso-contrib:2.2') { // Necessary to avoid version conflicts exclude group: 'com.android.support', module: 'appcompat' exclude group: 'com.android.support', module: 'support-v4' exclude group: 'com.android.support', module: 'support-annotations' exclude module: 'recyclerview-v7' } } onView(withId(recyclerViewId)) .perform(RecyclerViewActions.actionOnItemAtPosition(3, click())); 

RecyclerViewActions Ø actionOnHolderItem Ø actionOnItem Ø actionOnItemAtPosition Ø scrollTo Ø scrollToHolder Ø scrollToPosition https://developer.android.com/reference/android/support/test/espresso/contrib/RecyclerViewActions.html 

Configure custom intents @Rule public ActivityTestRule mActivityRule = new ActivityTestRule(PaymentActivity.class) { @Override protected Intent getActivityIntent() { Intent result = new Intent(...); result.putExtra(...); return result; } }; 

Configure custom intents @Rule public ActivityTestRule mActivityRule = new ActivityTestRule<>( PaymentActivity.class, true, false); // is activity launch? @Test public void shouldTestSomething() { Context context = InstrumentationRegistry.getTargetContext(); Intent intent = new Intent(context, MainActivity.class); intent.putExtra(PaymentActivity.TOTAL_PRICE, 5.0f); mActivityRule.launchActivity(intent); ... } 

IdlingResource public class ServiceIdlingResource implements IdlingResource { public ServiceIdlingResource(Context context) { this.mContext = context; } @Override public String getName() { return ServiceIdlingResource.class.getSimpleName(); } @Override public boolean isIdleNow() { boolean idle = !isIntentServiceRunning(); if (idle && mCallback != null) { mCallback.onTransitionToIdle(); } return idle; } @Override public void registerIdleTransitionCallback(ResourceCallback callback) { this.mCallback = callback; } private boolean isIntentServiceRunning() { ... } } http://blog.sqisland.com/2015/04/espresso-custom-idling-resource.html 

Using IdlingResource @Before public void setup() { mServiceIdlingResource = new ServiceIdlingResource(InstrumentationRegistry.getTargetContext()); registerIdlingResources(mServiceIdlingResource); } @Test public void shouldOrderCoffee() { ... } @After public void tearDown() { unregisterIdlingResources(mServiceIdlingResource); } 

Basic application test @Test public void shouldCheckIntentValues() { ... mActivityRule.launchActivity(intent); onView(withId(R.id.anim_toolbar)) .check(matches( withToolbarTitle(is(espresso.getName())))); onView(withId(R.id.recyclerView)) .check(matches(atPosition(0, context.getString(R.string.ingredients), ingredients.toString()))); ... } 

withToolbarTitle matcher public static Matcher withToolbarTitle(final Matcher textMatcher) { return new BoundedMatcher(Toolbar.class) { @Override public boolean matchesSafely(Toolbar toolbar) { return textMatcher.matches(toolbar.getTitle()); } @Override public void describeTo(Description description) { description.appendText("with toolbar title: "); textMatcher.describeTo(description); } }; } 

UI Automator 

What is UI Automator? Ø Android UI test framework Ø Part of Android Testing Support Library Ø Interacting with any applications Ø Interacting with a system 

Why is UI Automator? Ø Easy to setup Ø Readable tests Ø Access to device state Ø UI Automator requires Android 4.3 (API 18) or higher 

Install / Update Android Support Libraries Ø Android SDK Manager Ø Terminal 

Integrate UI Automator to the project android { defaultConfig { testInstrumentationRunner "android.support.test.runner.AndroidJUnitRunner" } } ... dependencies { ... androidTestCompile 'com.android.support.test.uiautomator:uiautomator-v18:2.1.1' } 

Integrate UI Automator to the project (API < 18) Manifest Test annotation @SdkSuppress(minSdkVersion = 18) public class OrderCoffeeActivity { @Test public void shouldOrderThreeEspresso() { ... } } 

Basic UI Automator components Ø UiDevice Ø UiCollection Ø UiObject / UiObject2 Ø UiScrollable Ø UiSelector Ø Configurator 

UiDevice Press "Home" button mUiDevice.pressHome(); Press "Back" button mUiDevice.pressBack(); Press at power button mUiDevice.wakeUp(); Click at arbitrary coordinates mUiDevice.click(300, 215); Open the notifications mUiDevice.openNotification(); 

Test for calculator application @Test public void shouldSumTwoNumbers() throws UiObjectNotFoundException { mDevice = UiDevice.getInstance(InstrumentationRegistry.getInstrumentation()); mDevice.pressHome(); UiObject2 allApps = mDevice.findObject(By.desc("Apps")); allApps.click(); UiObject2 calculatorApp = mDevice.findObject(By.desc("Calculator")); calculatorApp.click(); mDevice.wait(Until.hasObject(By.text("5")), 3000); UiObject2 two = mDevice.findObject(By.text("2")); UiObject2 three = mDevice.findObject(By.text("3")); ... two.click(); plus.click(); three.click(); equal.click(); UiObject2 result = mDevice.findObject(By.res("com.android.calculator2", "formula")); assertEquals("5", result.getText()); } 

Espresso + UI Automator 

Example @RunWith(AndroidJUnit4.class) public class FullOrderTest { ... @Test public void shouldOrderThreeEspressos() { ... onView(withId(R.id.pay)).perform(click()); mDevice.openNotification(); mDevice.wait(Until.hasObject(By.text(notificationTitle)), 3000); UiObject2 title = mDevice.findObject(By.text(notificationTitle)); assertEquals(notificationTitle, title.getText()); ... } } 

Tips 

Do not copy your code between tests 

Use available stuff 

Use Hamcrest library 

Focus on app behavior 

Many small tests better than big one 

Launch directly desired screen 

Links • Google samples – Android architecture https://github.com/googlesamples/android-architecture • Espresso https://google.github.io/android-testing-support-library/docs/espresso/index.html • Testing UI for Multiple Apps https://developer.android.com/training/testing/ui-testing/uiautomator-testing.html • SimpleCoffeeOrderTestProject https://github.com/AlexZhukovich/SimpleCoffeeOrderTestProject • Introduction to Android testing http://alexzh.com/tag/testing/ • Android Testing Codelab https://codelabs.developers.google.com/codelabs/android-testing/ @Alex_Zhukovich 

Any Questions? @Alex_Zhukovich