Automated Testing Dimitris K.

Quality Brand Automated Testing

Automated Testing Extremely important to us

Quality Yesterday Automated Testing

Quality Yesterday Manual Testing Automated Testing

Unit Testing Quality Yesterday Automated Testing

Quality Yesterday “Add ability to compile and run tests” - Eric Burke Automated Testing

Quality Today Automated Testing

No Flakiness Quality Today Automated Testing

Easy to write tests Quality Today Automated Testing

Catch edge cases Quality Today Automated Testing

Quality Today Automated Testing Graybox testing is preferred

Quality Today Automated Testing Tests are red == master is red

Robots Automated Testing

Robots Thin layer above UI framework Automated Testing Fluent API Single point to update your code

Robots public class InvoiceScreenRobot extends ScreenRobot { public InvoiceScreenRobot typeTitle(String title) { onView(withId(R.id.title)).perform(typeText(title)); return this; } // More here... public void clickSend() { onView(withId(R.id.send)).perform(click()); } } Automated Testing

Robots public void testSendInvoice() { withRobot(InvoiceScreenRobot.class) // .typeTitle("Sample Title") // .typeNumber("#000001") // .typeName("Square User") // .typeEmail("squareuser@squareup.com") // .clickSend(); } Automated Testing

Robots public void testSendInvoice() { withRobot(InvoiceScreenRobot.class) // .checkIsDisabled(R.id.send) // .typeTitle("Sample Title") // .typeNumber("#000001") // .typeName("Square User") // .typeEmail("squareuser@squareup.com") // .checkIsEnabled(R.id.send) // .clickSend(); } Automated Testing

Mock Mode Automated Testing

Mock Mode Eliminate network flakiness Automated Testing Rapid development Test network edge cases

Mock Mode @Provides @Singleton MyService provideMyService(RestAdapter adapter) { return adapter.create(MyService.class); } Automated Testing

Mock Mode @Provides @Singleton MyService provideMyService(RestAdapter adapter) { MyService real = restAdapter.create(MyService.class); MyService mock = new MockMyService(); return ServiceProxy.newInstance(MyService.class, mock, real); } Automated Testing

Mock Mode public class ServiceProxy implements InvocationHandler { @Override public Object invoke(Object proxy, Method method, Object[] args) throws Throwable { Object service = mockModeOn() ? mock : real; try { return method.invoke(service, args); } catch (InvocationTargetException e) { throw e.getTargetException(); } } Automated Testing

Mock Mode public class MockMyService implements MyService { @Override public Response doSomething(Request request) { delay(); boolean success = true; return new Response(success); } } Automated Testing

Test Matrix Automated Testing

Test Matrix Automated Testing Card Not Present Flow

Test Matrix 7 card types Automated Testing 4 languages 4 receipt types

Test Matrix Automated Testing 112 tests to write

Burst Automated Testing

Burst Test Generator Automated Testing

Burst Variation Proximity Automated Testing

Burst Type Safety Automated Testing

Burst Use Everywhere Automated Testing

Burst Automated Testing Not @Parameterized.Parameters(name = "{0}") public static List parameters() { return Arrays.asList(new Object[] { new Factory() { @Override public BufferedSink create(Buffer data) { return data; } @Override public String toString() { return "Buffer"; } }, }, new Object[] { new Factory() { @Override public BufferedSink create(Buffer data) { return new RealBufferedSink(data); } @Override public String toString() { return "RealBufferedSink"; } } }); } @Parameterized.Parameter public Factory factory;

Burst public enum Soda { COKE, PEPSI, RC_COLA } @RunWith(BurstJUnit4.class) public class SampleTest { @Test public void sodas(Soda soda) { // Test will run 3 times assertNotNull(soda); } } Automated Testing

Burst public enum Soda { COKE, PEPSI, RC_COLA } @RunWith(BurstJUnit4.class) public class SampleTest { @Test public void sodasAndSnacks(Soda soda, Snack snack) { // Test will run 9 times assertNotNull(soda); assertNotNull(snack); } } public enum Snack { CHIPS, KITKAT, CANDY } Automated Testing

Burst Friendly Test Naming Automated Testing

Burst sodasAndSnacks[Soda.COKE, Snack.CHIPS] sodasAndSnacks[Soda.COKE, Snack.KITKAT] sodasAndSnacks[Soda.COKE, Snack.CANDY] Automated Testing

Burst @TabletOnly public void testTabletFeature() { // This test will only be executed on tablets. } Automated Testing

Burst @TabletOnly public void testTabletFeature() { // This test will only be executed on tablets. } @PhoneOnly public void testPhoneFeature() { // This test will only be executed on phones. } Automated Testing

Automated Testing @TabletOnly public void testTipBringsAmountOver25() { loginAsAndStartActivity("bart"); performAuthSteps(2499L); // Tip withRobot(TipScreenRobot.class).clickTipOptionOne(); // Sign withRobot(SignScreenRobot.class) .performSign() .clickContinue(); // Receipt withRobot(ReceiptScreenRobot.class) .performEmailReceipt("bart@squareup.com") .clickNewSale(); }

Tips Automated Testing

Tips Animations OFF Automated Testing

Don’t Sleep() Tips Automated Testing

Tips Screenshots Automated Testing

Tips Automated Testing @Override protected void setUp() throws Exception { super.setUp(); setFailureHandler(new RegisterFailureHandler(this)); }

Tips Automated Testing public class RegisterFailureHandler implements FailureHandler { private final TestCase testCase; public RegisterFailureHandler(TestCase testCase) { this.testCase = testCase; } @Override public void handle(Throwable throwable, Matcher viewMatcher) { // Very useful for finding out what went wrong... takeAndUploadScreenshot(testCase.getName()); // Delegate to real failure handler here. } }

Tips Automated Testing public class ScreenShotProxy implements InvocationHandler { @Override public Object invoke(Object proxy, Method method, Object[] args) throws Throwable { try { Object result = method.invoke(proxy, args); takeScreenShot(); // <----- magic. return result; } catch (InvocationTargetException e) { throw e.getTargetException(); } } }

Tips Keyboard :( Automated Testing

A https://github.com/square/burst https://squareup.com/careers https://github.com/square/burst