Android Building, Testing and reversing

Slides of the Talk at the Romobos 2013, Cluj Napoca

Transcript

2. Agenda: -Intro -Android Testing -Creating a project -JUnit Testing -Mock Objects + UI Testing -Integration and acceptance test -Performance and system testing -Advance assertions -TDD -Real App Dev !
3. Agenda: -Tools -Continuous Integration !
4. Ego slide Mobile Developer @ Sixt M. Sc. UCM/RWTH CS Teacher at Alcalá University ! ! ! +EnriqueLópezMañas @eenriquelopez
5. Ego slide Mobile Developer @ Sixt M.Sc. Politehnica Timisoara ! ! ! +ami.antoch
6. Keywords Continuous Integration TDD JUnit / Unit Testing Instrumentation Behavior Driven Development Performance Testing Profiling
7. What you need • Java SE Version 1.6 • Android SDK Tools • Eclipse IDE for Java Developers • ADT • (Android Bundle)
8. Testing • Develop • Finding • Correcting
9. Is about productivity! $59.5 billion annually ! 1/3 could be saved ! (National Institute of Standards and Technology (USA))
10. Why, what, how, when During, before ! Continuous Integration ! Classes, methods, lines, basic blocks..
11. Activity lifecycle
12. Activity lifecycle Databases and filesystem operations
13. Activity lifecycle Databases and filesystem operations Physical characteristics of the device
14. Activity lifecycle Databases and filesystem operations Physical characteristics of the device (AVD and Genymotion)
15. UnitTests Written by programmers for programmers JUnit
16. Elements of a test The fixture Method setUp() Method tearDown() Test preconditions (retrospection vs. annotations)
17. Assertions • assertEquals() • assertFalse() • assertNotNull() • assertNotSame() • assertNull() • assertSame() • assertTrue() • fail()
18. Mock objects Mimic objects • MockApplication • MockContentProvider • MockContentResolver • MockContext • MockCursor • MockDialogInterface • MockPackageManager • MockResources
19. UI Tests Annotation @UIThreadTest Class TouchUtils • Click • Drag • LongClick • Scroll • Tap • Touch
20. Environments Eclipse… …but also IntelliJ! …and Netbeans!
21. Instrumentation Foundation Control application under test and permit injection
22. Project Test MyProject MyProjectTest
23. Testing Target Device AVD Machines GenyMotion
24. Summary
25. Android Testing Best practice: test should live in a separate correlated project • Stripped (not included in main) • Easier to run in Emulator • Takes less time • Encourages code reusability
26. Create project
27. AVD
28. Genymotion
29. DDMS
30. TestAnnotations @SmallTest @MediumTest @LargeTest @Smoke @FlakyTest (tolerance=4) @UIThreadTest @Suppress
31. Running Test From Eclipse
33. Running Single Test
34. Running from the emulator
35. Running from the command line
36. Running from the command line • All • From an specific test case • Specific test by name • By category • (create custom annotations)
37. Debug bugs
38. Summary • Created first Android project • Followed best practice creating companion project • Simple test class • Eclipse • Command line options
39. Mockup • All Mock implementations • All methods non functional • Throw UnsupportedOperationExceiption
40. UI Testing • Android SDK Tools, 21+ • API 16+ • uiaumatorviewer • uiautomator Tools
41. Integration tests Individual components work jointly
42. Integration tests Individual components work jointly Acceptance tests QA, Business language
43. Performance tests Performance behavior System test • GUI Test • Smoke Tests • Performance • Installation
44. Benchmarking • Traditional logging statement methods • Creating Android performance tests • Using profiling tools • Microbenchmarks using Caliper
45. Benchmarking /* (non-Javadoc) * @see android.text.TextWatcher#onTextChanged( * java.lang.CharSequence, int, int, int) */ public void onTextChanged(CharSequence s, int start, int before, int count) { if (!mDest.hasWindowFocus() || mDest.hasFocus() || s == null ) { return; } final String str = s.toString(); if ( "".equals(str) ) { mDest.setText(""); return; } final long t0; if ( BENCHMARK_TEMPERATURE_CONVERSION ) { t0 = System.currentTimeMillis(); } !
46. Benchmarking try { final double temp = Double.parseDouble(str); final double result = (mOp == OP.C2F) ? TemperatureConverter.celsiusToFarenheit(temp); TemperatureConverter.fahrenheitToCelsius(temp); final String resultString = String.format("%.2f", result); mDest.setNumber(result); mDest.setSelection(resultString.length()); } catch (NumberFormatException e) { // WARNING // this is generated while a number is entered, // for example just a '-' // so we don't want to show the error } catch (Exception e) { mSource.setError("ERROR: " + e.getLocalizedMessage()); } if ( BENCHMARK_TEMPERATURE_CONVERSION ) { long t = System.currentTimeMillis() - t0; Log.i(TAG, "TemperatureConversion took " + t + " ms to complete."); } }
47. Android performance tests Classes hidden only for System apps :(
48. Assertions in depth • assertEquals • assertFalse • assertNotNull • assertNotSame • assertNull • assertSame • assertTrue • assertFail
49. Assertions in depth public void testNotImplementedYet() { fail("Not implemented yet"); }
50. Assertions in depth public void testShouldThrowException() { try { MyFirstProjectActivity.methodThatShouldThrowException(); fail("Exception was not thrown"); } catch ( Exception ex ) { // do nothing } }
51. Custom messages public void testMax() {
 final int a = 1;
 final int b = 2;
 final int expected = b;
 final int actual = Math.max(a, b);
 assertEquals("Expection " + expected + " but was " + actual, expected, actual); }
52. Static imports public void testAlignment() { final int margin = 0; ... android.test.ViewAsserts.assertRightAligned( mMessage, mCapitalize, margin); ! }
53. Static imports import static android.test.ViewAsserts.assertRightAligned; public void testAlignment() {
 final int margin = 0;
 assertRightAligned(mMessage, mCapitalize, margin); }
54. View assertions assertBaselineAligned
55. View assertions assertBaselineAligned
 assertBotomAligned
56. View assertions assertBaselineAligned
 assertBotomAligned assertGroupContains
57. View assertions assertBaselineAligned
 assertBotomAligned assertGroupContains assertGroupIntegrity
58. View assertions assertBaselineAligned
 assertBotomAligned assertGroupContains assertGroupIntegrity assertGroupNotContains
59. View assertions assertBaselineAligned
 assertBotomAligned assertGroupContains assertGroupIntegrity assertGroupNotContains assertHasScreenCoordinates
60. View assertions assertBaselineAligned
 assertBotomAligned assertGroupContains assertGroupIntegrity assertGroupNotContains assertHasScreenCoordinates assertHorizontalCenterAligned
61. View assertions assertLeftAligned
62. View assertions assertLeftAligned assertOffScreenAbove
63. View assertions assertLeftAligned assertOffScreenAbove assertOffScreenBelow
64. View assertions assertLeftAligned assertOffScreenAbove assertOffScreenBelow assertOnScreen
65. View assertions assertLeftAligned assertOffScreenAbove assertOffScreenBelow assertOnScreen assertRightAligned
66. View assertions assertLeftAligned assertOffScreenAbove assertOffScreenBelow assertOnScreen assertRightAligned assertTopAligned
67. View assertions assertLeftAligned assertOffScreenAbove assertOffScreenBelow assertOnScreen assertRightAligned assertTopAligned assertVerticalCenterAligned
68. Example public void testUserInterfaceLayout() {
 final int margin = 0;
 final View origin = mActivity.getWindow().getDecorView(); assertOnScreen(origin, mMessage); assertOnScreen(origin, mCapitalize); assertRightAligned(mMessage, mCapitalize, margin); }
69. Even more 
 assertions assertAssignableFrom
70. Even more 
 assertions assertAssignableFrom assertContainsRegex
71. Even more 
 assertions assertAssignableFrom assertContainsRegex assertContainsInAnyOrder
72. Even more 
 assertions assertAssignableFrom assertContainsRegex assertContainsInAnyOrder assertContainsInOrder
73. Even more 
 assertions assertAssignableFrom assertContainsRegex assertContainsInAnyOrder assertContainsInOrder assertEmpty
74. Even more 
 assertions assertAssignableFrom assertContainsRegex assertContainsInAnyOrder assertContainsInOrder assertEmpty assertEquals
75. Even more 
 assertions assertMatchesRegex
76. Even more 
 assertions assertMatchesRegex assertNotContainsRegex
77. Even more 
 assertions assertMatchesRegex assertNotContainsRegex assertNotEmpty
78. Even more 
 assertions assertMatchesRegex assertNotContainsRegex assertNotEmpty assertNotMatchesRegex
79. Even more 
 assertions assertMatchesRegex assertNotContainsRegex assertNotEmpty assertNotMatchesRegex checkEqualsAndHashCodeMethods
80. Example @UiThreadTest public void testNoErrorInCapitalization() { final String msg = "this is a sample"; mMessage.setText(msg); mCapitalize.performClick(); final String actual = mMessage.getText().toString(); final String notExpectedRegexp = “(?i:ERROR)"; assertNotContainsRegex("Capitalization found error:", notExpectedRegexp, actual); }
81. assertActivityRequiresPermission public void testActivityPermission() { final String PKG = "com.example.aatg.myfirstproject"; final String ACTIVITY = PKG + ".MyFirstProjectActivity"; final String PERMISSION = android.Manifest.permission.WRITE_EXTERNAL_STORAGE; assertActivityRequiresPermission(PKG, ACTIVITY, PERMISSION); }
82. assertReadingContentUriRequiresPermission public void testReadingContacts() { final Uri URI = ContactsContract.AUTHORITY_URI; final String PERMISSION = android.Manifest.permission.READ_CONTACTS; assertReadingContentUriRequiresPermission(URI, PERMISSION); }
83. assertWritingContentUriRequiresPermission public void testWritingContacts() { final Uri URI = ContactsContract.AUTHORITY_URI; final String PERMISSION = android.Manifest.permission.WRITE_CONTACTS; assertWritingContentUriRequiresPermission(URI, PERMISSION); }
84. ActivityMonitor public void testFollowLink() { final Instrumentation inst = getInstrumentation(); IntentFilter intentFilter = new IntentFilter(Intent.ACTION_VIEW); intentFilter.addDataScheme("http"); intentFilter.addCategory(Intent.CATEGORY_BROWSABLE); ActivityMonitor monitor = inst.addMonitor(intentFilter, null, false); assertEquals(0, monitor.getHits()); TouchUtils.clickView(this, mLink); monitor.waitForActivityWithTimeout(5000); assertEquals(1, monitor.getHits()); inst.removeMonitor(monitor); }
85. Example project
86. Summary Used several types of assertion Explained mock objects Exemplified different tests
87. Test Driven Development
88. Test Driven Development
89. Test Driven Development • Difficult to divert code • Focus NO SILVER BULLET
90. Example project - temperature converter
91. Requirements: • Application convert from Celsius to F. • … and viceversa • Two fields to input data • When temperature is entered, other field updates • Error displayed • Some space reserved keyboard • Entry fields start empty • Digits right aligned • Last entered values retained after onPause()
92. Concept design
93. Create projects
94. From requirement to tests
95. AVD and Emulator Options
96. Headless emulator emulator -avd test -no-window -no-audio -no-boot-anim -port 5580 &
97. Monkeyrunner
98. Building with ant android update project —path .
99. Jenkins
100. Testing recipes
102. Thank you ! + Enrique López Mañas @eenriquelopez