UI Tests are Easy to Write said no Android dev ever Kevin Lai & Valera Zakharov 

Why? 

Aug 2016 Nov 2017 

1. No time 2. Too hard to develop 3. Not enough knowledge 

2011 

No content

No content

No content

No content

Any test is good... … until you start running it in CI 

2013 

No content

API for Test Authors onView(withId(R.id.greeting)) .perform(click()); onView(withText("Hello Droidcon SF!")) .check(matches(isDisplayed())); 

2014 

No content

No content

2015 

No content

No content

No content

No content

No content

2016 

No content

https://academy.realm.io/posts/writing-solid-ui-tests-on-android-mdevcamp-zakharov 

UI tests can still be Targeted & Hermetic 

2017 

No content

Today 

At Slack 

Android Test Pyramid at Slack 100ish e2e 555 functional UI 3448 unit 

Developer Feedback Workflow Ease of Testing App Quality Release Process “Writing quality UI tests is still a difficult thing to do. It would be great to have some time put into building up a base to work from” 2.5/4 

http://jakewharton.com/testing-robots 

What How How What Presenter / Components Model View Robot Test UI Test Architecture 

I’m going on a UI test adventure 

The Problem 

What How How What Presenter / Components Model View Robot Test Test 

Lots of Components Data Providers - fetch and cache Persistence - cache data Managers - app-wide process or state (e.g. message sending, channel syncing) Helpers - data massaging API Actions - REST and websocket requests Presenters? Great! 

Repetitive Mocking - User User user = User.builder().../* setters */...build(); when(mockUsersDataProvider.getUser(USER_ID)) .thenReturn(Observable.just(user)); when(mockUserPresenceManager.isUserActive(USER_ID, true)) .thenReturn(true); when(mockDndInfoDataProvider.getDndInfo(userId)) .thenReturn(Observable.just(new DndInfo(/* params */))); 

Repetitive Mocking - Channel Channel channel = Channel.builder().../* setters */...build(); when(mockChannelsDataProvider.getChannelObservable(CHANNEL_ID)) .thenReturn(Observable.just(channel)); when(mockChannelNameHelper.getDisplayNameObservable(eq(channel))) .thenReturn(Observable.just(CHANNEL_NAME)); 

@Before @Override public void setUp() throws Exception { super.setUp(); User user = User.builder().../* setters */...build(); when(mockUsersDataProvider.getUser(USER_ID)) .thenReturn(Observable.just(user)); when(mockUserPresenceManager.isUserActive(USER_ID, true)) .thenReturn(true); when(mockDndInfoDataProvider.getDndInfo(userId)) .thenReturn(Observable.just(new DndInfo(/* params */))); Channel channel = Channel.builder().../* setters */...build(); when(mockChannelsDataProvider.getMessagingChannelObservable(CHANNEL_ID)) .thenReturn(Observable.just(channel)); when(mockChannelNameHelper.getDisplayNameObservable(eq(channel))) .thenReturn(Observable.just(CHANNEL_NAME)); launchActivity(); } 

The Solution 

No content

What How How What Presenter / Components Model View Robot Test Test 

How How What Robot Test View Model Presenter / Components What 

Power Pack 

No content

How Robot Test View How PowerPack What Presenter / Components Model How What 

Set up Models not Components slackPowerPack.usersPack() .addUser(User.builder().../* setters */...build()) .addUser(User.builder().../* setters */...build()) .pack(); slackPowerPack.channelsPack() .addChannel(Channel.builder().../* setters */...build()) .addChannel(Channel.builder().../* setters */...build()) .addChannel(Channel.builder().../* setters */...build()) .pack(); 

Under the hood public UsersPack.Builder usersPack() { return UsersPack.builder() .dndInfoDataProvider(mockDndInfoDataProvider) .persistentStore(mockPersistentStore) .usersDataProvider(mockUsersDataProvider) .userPresenceManager(mockUserPresenceManager); } 

public class UsersPack { public void pack() { UsersPack usersPack = build(); UsersDataProvider usersDataProvider = usersPack.usersDataProvider(); UserPresenceManager userPresenceManager = usersPack.userPresenceManager(); DndInfoDataProvider dndInfoDataProvider = usersPack.dndInfoDataProvider(); // More components... List users = usersPack.users(); for (User user : users) { when(usersDataProvider.getUser(user.id())) .thenReturn(Observable.just(user)); when(userPresenceManager.isUserActive(user.id(), true)) .thenReturn(true); when(dndInfoDataProvider.getDndInfo(user.id())) .thenReturn(Observable.just(new DndInfo(/* params */))); // More mocking... } } } 

Under the hood public ChannelsPack.Builder channelsPack() { return ChannelsPack.builder() .accountManager(mockAccountManager) .featureFlagStore(mockFeatureFlagStore) .lastOpenedMsgChannelIdStore(mockLastOpenedMsgChannelIdStore) .mpdmDisplayNameHelper(mockMpdmDisplayNameHelper) .persistentStore(mockPersistentStore) .prefsManager(mockPrefsManager) .slackApi(mockSlackApi) .channelListDataProvider(mockChannelListDataProvider) .channelNameHelper(mockChannelNameHelper) .channelsPaneDataProvider(mockChannelsPaneDataProvider) .channelsDataProvider(mockChannelsDataProvider) .messageCountManager(mockMessageCountManager) .notificationPrefsDataProvider(mockNotificationPrefsDataProvider) .notificationPrefsManager(mockNotificationPrefsManager) .userChannelListDataProvider(mockUserChannelListDataProvider); 

@Before @Override public void setUp() throws Exception { super.setUp(); slackPowerPack = new SlackPowerPack(context.getApplicationContext()); slackPowerPack.usersPack() .addUser(User.builder().../* setters */...build()) .addUser(User.builder().../* setters */...build()) .pack(); slackPowerPack.channelsPack() .addChannel(Channel.builder().../* setters */...build()) .addChannel(Channel.builder().../* setters */...build()) .addChannel(Channel.builder().../* setters */...build()) .pack(); launchActivity(); } 

Wins ● *Pack classes encapsulate all mockito statements ● Tests benefit from updates in one place ● Test authors focus on writing their actual test ● Fluent APIs 

Developer Feedback Workflow Ease of Testing App Quality Release Process “Ease of test writing: this has improved a lot. It would be nice to take the time to update some of our old tests to use PowerPack/our latest patterns." 2.5/4 2.92/4 “I would also love an easy way to set up a team.” 

Focus on the pattern 

No content

The Solution ++ 

@Before @Override public void setUp() throws Exception { super.setUp(); User user = User.builder().../* setters */...build(); when(mockUsersDataProvider.getUser(USER_ID)) .thenReturn(Observable.just(user)); when(mockUserPresenceManager.isUserActive(USER_ID, true)) .thenReturn(true); when(mockDndInfoDataProvider.getDndInfo(userId)) .thenReturn(Observable.just(new DndInfo(/* params */))); Channel channel = Channel.builder().../* setters */...build(); when(mockChannelsDataProvider.getMessagingChannelObservable(CHANNEL_ID)) .thenReturn(Observable.just(channel)); when(mockChannelNameHelper.getDisplayNameObservable(eq(channel))) .thenReturn(Observable.just(CHANNEL_NAME)); launchActivity(); } 

@Before @Override public void setUp() throws Exception { super.setUp(); slackPowerPack = new SlackPowerPack(context.getApplicationContext()); slackPowerPack.usersBuilder() .addUser(User.builder().../* setters */...build()) .addUser(User.builder().../* setters */...build()) .pack(); slackPowerPack.channelsBuilder() .addChannel(Channel.builder().../* setters */...build()) .addChannel(Channel.builder().../* setters */...build()) .addChannel(Channel.builder().../* setters */...build()) .pack(); launchActivity(); } 

@Before @Override public void setUp() throws Exception { super.setUp(); slackPowerPack = new SlackPowerPack(context.getApplicationContext(), "team_a_config.json"); launchActivity(); } 

JSON Config { “logged_in_user”: String “team”: { } “users”: [ ], “channels”: [ ], “history”: [ { “channel_id”: String “messages”: [ ] } ] } 

public class WorkspaceConfig { private String logged_in_user; private Team team; private List channels; private List dms; private List users; private List history; } 

2018 

{ "ok": true, "channels": [ { "id": "C0G9QF9GW", "name": "random", "is_channel": true, "created": 1449709280, "creator": "U0G9QF9C6", "is_archived": false, "is_general": false, "name_normalized": "random", "is_shared": false, "is_org_shared": false, "is_member": true, "is_private": false, "is_mpim": false, "members": [ "U0G9QF9C6", "U0G9WFXNZ" ], "topic": { "value": "Other stuff", "creator": "U0G9QF9C6", "last_set": 1449709352 }, "previous_names": [], "num_members": 2 }, JSON Config { “logged_in_user”: String “team”: { } “users”: [ ], “channels”: [ ], “history”: [ { “channel_id”: String “messages”: [ ] } ] } 

Charging the Power Pack E2E Test record API Data Replay Test (e.g. Perf) Real Backend Hermetic Functional Test profit replay generate fetch 

@valera_zakharov @kevin_lai14