Mobile Testing @AutoScout24

The talk will give an insight into the world of mobile testing and dealing among other things with the following questions:
* What infrastructure do I need to testiOS & Android apps?
* What is the setup for this?
* How can the development process look like?
* What is the practical implementation for Android & iOS?

Transcript

1. Mobile Testing @ AutoScout24 Felix Schulze Teamlead Mobile Software Development
2. Every change can break your app! Picture: http://fav.me/d3g96mr
4. autoscout24.de
5. Picture: http://www.fastcodesign.com/1673162/the-disintegration-of-android-visualized Android Fragmentation
6. Picture: http://www.fastcodesign.com/1673162/the-disintegration-of-android-visualized Android Fragmentation
7. Picture: http://www.forbes.com/sites/chuckjones/2013/12/15/android-fragmentation-samsung-is-dominant-but-will-that-always-be-the-case/2/ iOS Fragmentation
8. Earlier 1 % iOS 6 9 % iOS 7 90 % App Store July 2014 Earlier 0,4 % Gingerbread (2.3) 13,5 % Ice Cream (4.0) 11,4 % Jelly Bean (4.1-4.3) 56,8 % KitKat (4.4) 17,9 % Play Store July 2014
10. @x2on Continuous Integration • Tool • Minimize risk & Quality improvement • Automate! • Example: Xcode Bots, Jenkins, TeamCity, Bamboo, ...
11. @x2on Components • Build management • Unit tests • Integration tests • Automatic beta versions
12. Beta App Interner App Store General Setup CI Server Changes Results Build Agent‘s
13. Build Unit-Tests Integration-Tests Every Hour Detail Setup Sourcecode Changes Alpha Version Every Hour
14. Hard & Software Setup • Server: • TeamCity Continuous Integration Server • Build Agents: • Mac Mini’s in 19’’ Racks • Mac OS X 10.9 / Xcode 5 / Homebrew / JDK 7
15. Hard & Software Setup • Teammonitor: • Raspberry PI Server • Raspberry PI Client
16. Android automatic test devices • 19’’ Rack Case • Mac Mini with two 10 Port USB 3.0 Hubs • Many Android Devices
17. Android Setup • Dependencies: • Maven • Build: • gradle-android-plugin
18. Android Setup • Tests: • Robotium • Spoon • gradle-spoon-plugin • ADB-Sanity-Check • Package: • gradle • gradle-hockeyapp-plugin
19. Android Setup • Static Code Check: • Checkstyle • PMD
20. iOS Setup • Dependencies • CocoaPods • gradle-cocoapods-plugin • Build • xctool
21. iOS Setup • Tests • xctool • xtool teamcity reporter (FSJUnitTestLogger) • Package • xctool • gradle-hockeyapp-plugin
22. iOS Tests • Unit Tests: Apple XCTest • Mock: OCMock 3 • View Tests: ios-snapshot-test-case • PNG view rendering / compare
23. @x2on Reference Failed Diff
24. Automatic Alpha Versions • iOS: Enterprise Dev Account • Hockey App • Automatic In-App-Updates • Crash Reports • Usage Statistics
25. Crash Analyzing
26. Crash Analyzing
27. REST Tests • Rest Assured • Java DSL for REST Testing expect().
 body("vehicle.id", equalTo(456)).
 body("vehicle.title", equalTo("Test").
 when().
 get("/vehicle?id=456");
28. Questions + Contact • Felix Schulze @x2on • github.com/AutoScout24 • github.com/x2on