grafite.pdf

Transcript

1. 1.

   Gra-Fi-Te Leveraging Gradle and Firebase for Android Testing Santosh Astagi

   Rally Health
2. 2.

   Gradlew wrapper - ./gradlew

3. 3.

   Gradle tasks - ./gradlew tasks

4. 4.

   Android plugin for gradle - com.android.tools.build:gradle:#.#.# Android tasks Build tasks

   Install tasks Verification tasks - Testing tasks
5. 5.

   Unit tests - test Running all tests - ./gradlew test

   Running all tests for a flavor - ./gradlew test{flavor}UnitTest Running individual tests - ./gradlew test{flavor}UnitTest\ —tests {packageName}.{testMethodName} Wild cards - ./gradlew test{flavor}UnitTest\ —tests *includedTestTitle*
6. 6.

   Instrumentation tests - androidTest Running all tests - ./gradlew connectedAndroidTest

   OR cAT Running a specific test - ./gradlew connectedAndroidTest\ -Pandroid.testInstrumentationRunnerArguments.class\ ={package name}.{class name}#{method name} GOTCHA - testCoverage, orchestrator:1.0.2 with gradle plugin <3.2 android plugin - 3.3.0+, gradle version - 4.9
7. 7.

   Filtering tests - Annotations @SmallTest - < 100ms, unit tests

   ./gradlew connectedAndroidTest\ -Pandroid.testInstrumentationRunnerArguments.size\ =Large @MediumTest - < 2s, every checkin, avoid blocking operations @LargeTest - <120s, Atleast once a day, all external communications
8. 8.

   testOptions{} - Android Plugin DSL Reference Specify reportDir, resultsDir testBuildType

   to change default from debug unitTests {…} (Possible additions below) includeAndroidResources true returnDefaultValues true
9. 9.

   Coverage reports testCoverageEnabled true ./gradlew createDebugCoverageReport apply plugin: "jacoco" Coverage

   report: jacoco/test{flavor}UnitTest.exec
10. 10.

    Gradle tasks task taskname( ) { } Copy from "origin"

    into "destination" Gradle DSL method not found: 'from()' type:
11. 11.

    Gradle tasks task taskname( ) type: //Pre built task description:

    //Meaningful enough dependsOn: //task to be executed before group: //E.g. verification, install ./gradlew taskName -PpropertyName=propertyValue project.hasProperty(“propertyName”) project.property(“propertyName”)
12. 12.

    Unified reports task unifiedReport( type: JacocoReport, dependsOn: ['testDebugUnitTest'], ‘createDebugCoverageReport’] )

    { sourceDirectories = files(coverageSourceDirs) classDirectories = files([javaClasses], [kotlinClasses]) executionData = fileTree(dir: project.projectDir, includes: [“coverage.exec”, “testDebugUnitTest.exec”)
13. 13.

    Unified reports task unifiedReport( type: JacocoReport, dependsOn: ['testDebugUnitTest'] ) {

    } reports { xml.enabled = true html.enabled = true } /build/reports/jacoco/…
14. 14.

    None
15. 15.

    Robolectric tests coverage Prior 3.0 plugin, jacoco node in unitTests

    block Search for tasks of type test tasks.withType(Test) { jacoco.includeNoLocationClasses = true } }
16. 16.

    Kotlin data classes

17. 17.

    Jacoco snapshot build https://oss.sonatype.org/content/repositories/snapshots project.jacoco { toolVersion = '0.8.2-SNAPSHOT' }

18. 18.

    Multi module apps

19. 19.

    app models networking ext.jacocoReport = {Project project, String variant ->

    } jacocoReport(project, ‘debug’) jacocoReport(project, ‘debug’) jacocoReport(project, ‘debug’)
20. 20.

    Gradle methods ext.jacocoTestReport = {Project project, String variant -> }

    jacocoTestReport(project, ‘flavorName’) project.tasks.create( name: ‘jacocoTestReport’ ) { }
21. 21.

    Combining reports apply plugin: ‘android-reporting’ ./gradlew connectedAndroidTest mergeAndroidReports {root project}/build/reports

    ./gradlew createDebugCoverageReport mergeAndroidReports
22. 22.

    Unified reporting root level gradle task Update coverage directories using

    $rootProject Update class directories using $rootProject /build/reports/jacoco/…
23. 23.

    Cloud testing

24. 24.

    Cloud testing Firebase testlab, Saucelabs, Genymotion, Amazon, Xamarin etc. Firebase

    testlab beta for iOS announced at I/O 18 Firebase - wide range of devices and emulators
25. 25.

    Testlab - options, useful configurations - -timeout - max. time

    this execution can run (timeout code sent back) - - performance-metrics - CPU usage, network usage, FPS - - results-bucket - Specify gcloud bucket Specific exit codes to play nicely with scripts
26. 26.

    Firebase console - using reports Stored in Google Cloud bucket

    Contains more than just logs, views and performance, can get code coverage, results xml, full log
27. 27.

    Firebase testlab - Running tests

28. 28.

    Firebase - device options gcloud firebase test android models list

29. 29.

    Firebase console - command line Type - robo, instrumentation, game-loop

    gcloud firebase test android run --type instrumentation --app app/build/outputs/apk/debug/app-debug.apk --test app/build/outputs/apk/androidTest/debug/app-debug-androidTest.apk --devices-ids Nexus5 --os-version-ids 23 --locales en --orientations portrait --environment-variables coverage=true,coverageFile="/sdcard/coverage.ec"
30. 30.

    Firebase testlab - Artifacts and fetching

31. 31.

    Firebase - gcloud options Firebase test artifacts stores in Google

    cloud buckets Install gsutil to get CLI to interact with bucket artifacts gsutil ls gs://testingplaygroundresults
32. 32.

    Coverage reports Enable device storage in manifest --directories-to-pull /sdcard gsutil

    cp gs://testingplaygroundresults/*/*/artifacts/ coverage.ec .
33. 33.

    None
34. 34.

    Test sharing through flank

35. 35.

    Flank - Walmart Labs Scaling automated UI tests - Espresso

    and Appium Throttling support Device config Test results downloaded to project root
36. 36.

    Flank - Walmart Labs Test 1 Test 2 Test 3

    Test 4 Test 5 Stores test times during first run Uses test times to distribute tests across devices https://github.com/TestArmada/flank
37. 37.

    https://github.com/sastagi/grafite @sastagi Thank you