Test Case
Test Suite
Test Case Test Case Test Case
Slide 10
Slide 10 text
Test Case
Test Case
Test Case
Test Case
Slide 11
Slide 11 text
Test Case
Test Case
Test Case
Test Case
Firebase Test Lab
Slide 12
Slide 12 text
gCloud
Tool to run tests on Firebase
Integrates with CI
Slide 13
Slide 13 text
~ gCloud firebase test android models list
Slide 14
Slide 14 text
MODEL_ID MAKE MODEL_NAME FORM RESOLUTION OS
Nexus4 LG Nexus 4 VIRTUAL 2560 x 1600 19,21,22
sailfish Google Pixel PHYSICAL 1080 x 1920 25, 26
~ gCloud firebase test android models list
Slide 15
Slide 15 text
~ gCloud firebase test android run
—type
robo tests
instrumentation
Slide 16
Slide 16 text
~ gCloud firebase test android run
—type instrumentation
—app app-debug-unaligned.apk
Slide 17
Slide 17 text
~ gCloud firebase test android run
—type instrumentation
—app app-debug-unaligned.apk
—device model=Nexus6, version=21 local=en, orientation=portrait
Slide 18
Slide 18 text
Upload
Google Cloud Storage
Slide 19
Slide 19 text
Google Cloud Storage
Run Tests
Report
Slide 20
Slide 20 text
No content
Slide 21
Slide 21 text
~ gCloud firebase test android run
—type robo
Slide 22
Slide 22 text
No content
Slide 23
Slide 23 text
Get Report
Test Lab
gCloud
Build APK
CI Pipeline
Slide 24
Slide 24 text
UI Tests
Time
Slide 25
Slide 25 text
Flank
Run Android and iOS tests in parallel
Uses Kotlin Coroutines
Flank
flank:
##
test shards - the amount of groups to split the test suite into
max-test-shards: 2
Slide 30
Slide 30 text
Flank
flank:
##
test shards - the amount of groups to split the test suite into
max-test-shards: 2
##
shard time - the amount of time tests within a shard should take
shard-time: 2
Slide 31
Slide 31 text
~ flank android test run
Slide 32
Slide 32 text
Test Case
Test Case
Test Case
Test Case
Parallel
Slide 33
Slide 33 text
Merged Results
Shared 2
Parallel
Shard 1
Slide 34
Slide 34 text
Test Case
Test Case
Test Case
Test Case
Problems
Flaky tests
Slide 35
Slide 35 text
Flaky Test Causes
● Concurrency problems
● Flaky third party code
● Resource idling.
Slide 36
Slide 36 text
Flank
flank:
##
Number of Flaky test attempts
num-flaky-test-attempts: 2
Slide 37
Slide 37 text
CI Setup
Get Report
Test Lab
Flank
Build APK
Slide 38
Slide 38 text
CI Setup
Get Report
Test Lab
Flank
Build APK
Docker
Slide 39
Slide 39 text
Fladle
Gradle plugin for using Flank
Multi Module Testing support