Android testing with Kotlin

Transcript

1. Android testing with Kotlin Markiyan Antonyuk
2. Markiyan Antonyuk
3. What
4. What Software testing is an investigation conducted to provide stakeholders with information about the quality of the software product or service under test. Software testing can also provide an objective, independent view of the software to allow the business to appreciate and understand the risks of software implementation. Test techniques include the process of executing a program or application with the intent of finding software bugs (errors or other defects), and verifying that the software product is fit for use.
5. What Software testing is an investigation conducted to provide stakeholders with information about the quality of the software product or service under test. Software testing can also provide an objective, independent view of the software to allow the business to appreciate and understand the risks of software implementation. Test techniques include the process of executing a program or application with the intent of finding software bugs (errors or other defects), and verifying that the software product is fit for use. Process to check software quality and to push us to work more.
6. Why
7. Why Because I’ve found to 2 bugs
8. Unit testing Unit tests are the fundamental tests in your app testing strategy. By creating and running unit tests against your code, you can easily verify that the logic of individual unit is correct. Running unit tests after every build helps you to quickly catch and fix software regressions introduced by code changes to your app.
9. Unit testing Unit tests are the fundamental tests in your app testing strategy. By creating and running unit tests against your code, you can easily verify that the logic of individual units is correct. Running unit tests after every build helps you to quickly catch and fix software regressions introduced by code changes to your app.
10. Unit tests
11. class UnitTest { <- test class fun `test 2 plus 2 is 4`() { <- test function assertEquals(4, 2 + 2) <- assertion } }
12. class UnitTest { <- test class @Test <- @Test annotation to mark function as test fun `test 2 plus 2 is 4`() { <- test function assertEquals(4, 2 + 2) <- assertion } }
13. class UnitTest { <- test class @Test <- @Test annotation to mark function as test fun `test 2 plus 2 is 4`() { <- test function assertEquals(4, 2 + 2) <- assertion } } @Suite.SuiteClasses(UnitTest::class) <- suite
14. AAA - Arrange, Act, Assert @Test fun `test 2 plus 4 is 4`() { // arrange (initialize) val first = 2 val second = 2 // act (do job) val result = first + second // assert (verify) assertEquals(4, result) }
15. JUnit @Before <- before each test function @After <- after each test function @BeforeClass <- before execution of test class (static context) @AfterClass <- after execution of test class (static context)
16. Android Unit testing Unit tests that run on your local machine only. These tests are compiled to run locally on the Java Virtual Machine (JVM) to minimize execution time. If your tests depend on objects in the Android framework, we recommend using Robolectric. For tests that depend on your own dependencies, use mock objects to emulate your dependencies' behavior.
17. Android Unit testing Unit tests that run on your local machine only. These tests are compiled to run locally on the Java Virtual Machine (JVM) to minimize execution time. If your tests depend on objects in the Android framework, we recommend using Robolectric. For tests that depend on your own dependencies, use mock objects to emulate your dependencies' behavior.
19. Android SDK is useless in unit tests
20. Let’s test
21. class LoginRepository(private val dataSource: DataSource) { fun login(login: String, password: String): User = dataSource.login(login, password) }
22. @Test fun `test login should return user from data source`() { val user = User(0, "KLUG") }
23. @Test fun `test login should return user from data source`() { val user = User(0, "KLUG") val loginRepository = LoginRepository(dataSource) }
24. @Test fun `test login should return user from data source`() { val user = User(0, "KLUG") val dataSource = object : DataSource { override fun login(login: String, password: String): User = user } val loginRepository = LoginRepository(dataSource) }
25. @Test fun `test login should return user from data source`() { val user = User(0, "KLUG") val dataSource = object : DataSource { override fun login(login: String, password: String): User = user } val loginRepository = LoginRepository(dataSource) val userResult = loginRepository.login("User", "Password") }
26. @Test fun `test login should return user from data source`() { val user = User(0, "KLUG") val dataSource = object : DataSource { override fun login(login: String, password: String): User = user } val loginRepository = LoginRepository(dataSource) val userResult = loginRepository.login("User", "Password") assertEquals(user, userResult) }
27. @Test fun `test login should return user from data source`() { val user = User(0, "KLUG") var called = false val dataSource = object : DataSource { override fun login(login: String, password: String): User { called = true return user } } val loginRepository = LoginRepository(dataSource) val userResult = loginRepository.login("User", "Password") assertEquals(user, userResult) assertTrue(called) }
28. @Test fun `test login should return user from data source`() { val user = User(0, "KLUG") var called = false val dataSource = object : DataSource { override fun login(login: String, password: String): User { Is proper login/pass passed? called = true return user } } val loginRepository = LoginRepository(dataSource) val userResult = loginRepository.login("User", "Password") assertEquals(user, userResult) assertTrue(called) }
29. @Test fun `test login should return user from data source`() { val user = User(0, "KLUG") var called = false val dataSource = object : DataSource { What if DataSource is final class? override fun login(login: String, password: String): User { Is proper login/pass passed? called = true return user } } val loginRepository = LoginRepository(dataSource) val userResult = loginRepository.login("User", "Password") assertEquals(user, userResult) assertTrue(called) }
30. Mocking
31. Mockito
32. Mockito
33. Mockito There is something more interesting for Kotlin
34. MockK https://mockk.io/
35. MockK https://mockk.io/ • Mocking
36. MockK https://mockk.io/ • Mocking • Object, Constructor, Extensions mocking
37. MockK https://mockk.io/ • Mocking • Object, Constructor, Extensions mocking • DSL
38. MockK https://mockk.io/ • Mocking • Object, Constructor, Extensions mocking • DSL • Verification order
39. MockK https://mockk.io/ • Mocking • Object, Constructor, Extensions mocking • DSL • Verification order • Coroutines • … and much more
40. @Test fun `test login should return user from data source`() { val user = User(0, "KLUG") var called = false val dataSource = object : DataSource { What if DataSource is final class? override fun login(login: String, password: String): User { Is proper login/pass passed? called = true return user } } val loginRepository = LoginRepository(dataSource) val userResult = loginRepository.login("User", "Password") assertEquals(user, userResult) assertTrue(called) }
41. @Test fun `test login should return user from data source`() { val user = User(0, "KLUG") val loginRepository = LoginRepository(dataSource) val userResult = loginRepository.login("User", "Password") assertEquals(user, userResult) }
42. @Test fun `test login should return user from data source`() { val user = User(0, "KLUG") val dataSource = mockk<DataSource>() { every { login(any(), any()) } returns user } val loginRepository = LoginRepository(dataSource) val userResult = loginRepository.login("User", "Password") assertEquals(user, userResult) }
43. inline fun <reified T : Any> mockk( name: String? = null, relaxed: Boolean = false, vararg moreInterfaces: KClass<*>, relaxUnitFun: Boolean = false, block: T.() -> Unit = {} )
44. @Test fun `test login should return user from data source`() { val user = User(0, "KLUG") val dataSource = mockk<DataSource>() { every { login(any(), any()) } returns user } val loginRepository = LoginRepository(dataSource) val userResult = loginRepository.login("User", "Password") assertEquals(user, userResult) }
45. @Test fun `test login should return user from data source`() { val user = User(0, "KLUG") val dataSource = mockk<DataSource>() { every { login(any(), any()) } returns user } val loginRepository = LoginRepository(dataSource) val userResult = loginRepository.login("User", "Password") verify { dataSource.login("User", "Password") } assertEquals(user, userResult) }
46. fun verify( ordering: Ordering = Ordering.UNORDERED, inverse: Boolean = false, atLeast: Int = 1, atMost: Int = Int.MAX_VALUE, exactly: Int = -1, timeout: Long = 0, verifyBlock: MockKVerificationScope.() -> Unit )
47. @Test fun `test login should return user from data source`() { val user = User(0, "KLUG") val dataSource = mockk<DataSource>() { every { login(any(), any()) } returns user } val loginRepository = LoginRepository(dataSource) val userResult = loginRepository.login("User", "Password") verify { dataSource.login("User", "Password") } assertEquals(user, userResult) }
48. Object @Test fun `object mocking`() { assertEquals(1, Object.returnOne()) mockkObject(Object) every { Object.returnOne() } returns 2 assertEquals(2, Object.returnOne()) unmockkObject(Object) assertEquals(1, Object.returnOne()) }
49. Extensions @Test fun `extensions mocking`() { mockkStatic("kotlin.io.FilesKt__UtilsKt") or class with extensions every { File("/").deleteRecursively() } returns true assertTrue(File("/").deleteRecursively()) unmockkStatic("kotlin.io.FilesKt__UtilsKt") }
50. Extensions @Test fun `extensions mocking`() { mockkStatic("kotlin.io.FilesKt__UtilsKt") or class with extensions every { File("/").deleteRecursively() } returns true assertTrue(File("/").deleteRecursively()) unmockkStatic("kotlin.io.FilesKt__UtilsKt") } every { File("/").deleteRecursively() } answers { throw Exception("") }
51. Switch implementation @Test fun `switch implementation`() { val scheme = Uri.parse("http://myuri").scheme assertEquals("http", scheme) }
52. Switch implementation @Test fun `switch implementation`() { val scheme = Uri.parse("http://myuri").scheme assertEquals("http", scheme) } java.lang.RuntimeException: Method parse in android.net.Uri not mocked.
53. package android.net; public abstract class Uri implements Comparable<Uri>, Parcelable { public static Uri parse(String uriString) { return new Uri() { … } public String getScheme() { return "http"; } }
54. LiveData & ViewModel class LoginViewModel( private val repository: Repository ) : ViewModel() { private val _userLiveData = MutableLiveData<User>() val userLiveData: LiveData<User> = _userLiveData fun login(email: String, pass: String) { viewModelScope.launch(Dispatchers.IO) { val user = repository.login(email, pass) _userLiveData.postValue(user) } …
55. @Test fun `test login`() { val repository = mockk<Repository>() val observer = mockk<Observer<User>>() val viewmodel = LoginViewModel(repository) viewmodel.userLiveData.observeForever(observer) viewmodel.login("email", "pass") verify { observer.onChanged(any()) } }
56. @Test fun `test login`() { val repository = mockk<Repository>() val observer = mockk<Observer<User>>() val viewmodel = LoginViewModel(repository) viewmodel.userLiveData.observeForever(observer) viewmodel.login("email", "pass") _userLiveData.postValue(user) verify { observer.onChanged(any()) } }
57. @get:Rule val rule = InstantTaskExecutorRule() @Test fun `test login`() { val repository = mockk<Repository>() val observer = mockk<Observer<User>>() val viewmodel = LoginViewModel(repository) viewmodel.userLiveData.observeForever(observer) viewmodel.login("email", "pass") verify { observer.onChanged(any()) } }
58. @get:Rule val rule = InstantTaskExecutorRule() @Test viewModelScope.launch(Dispatchers.IO) fun `test login`() { val repository = mockk<Repository>() val observer = mockk<Observer<User>>() val viewmodel = LoginViewModel(repository) viewmodel.userLiveData.observeForever(observer) viewmodel.login("email", "pass") verify { observer.onChanged(any()) } }
59. class LoginViewModel( private val repository: Repository, private val dispatcher: CoroutineDispatcher ) : ViewModel() …
60. class LoginViewModel( private val repository: Repository, private val dispatcher: CoroutineDispatcher ) : ViewModel() … @Test fun `test login`() { … val viewmodel = LoginViewModel(repository, Dispatchers.Unconfined) … }
61. Integration tests
62. E2E vs Isolation
64. • Data should be static
65. • Data should be static • Different sets of data
66. • Data should be static • Different sets of data • Server errors, can’t emulate all
67. • Data should be static • Different sets of data • Server errors, can’t emulate all • Authenticate each test run
68. • Data should be static • Different sets of data • Server errors, can’t emulate all • Authenticate each test run • Response duration
69. • Data should be static • Different sets of data • Server errors, can’t emulate all • Authenticate each test run • Response duration • Can be down
70. • Data should be static • Different sets of data • Server errors, can’t emulate all • Authenticate each test run • Response duration • Can be down • This is AQA work
72. • You decide whether to do error or what data to return
73. • You decide whether to do error or what data to return • Tests and app components are independent of each other
74. • You decide whether to do error or what data to return • Tests and app components are independent of each other • Do not rely on anything except app
75. • You decide whether to do error or what data to return • Tests and app components are independent of each other • Do not rely on anything except app • You’re the BOSS here
76. MockWebServer https://github.com/square/okhttp/tree/master/mockwebserver
77. MockWebServer https://github.com/square/okhttp/tree/master/mockwebserver • Behaves like a real back-end
78. MockWebServer https://github.com/square/okhttp/tree/master/mockwebserver • Behaves like a real back-end • Enqueue responses
79. MockWebServer https://github.com/square/okhttp/tree/master/mockwebserver • Behaves like a real back-end • Enqueue responses • No response delay
80. MockWebServer https://github.com/square/okhttp/tree/master/mockwebserver • Behaves like a real back-end • Enqueue responses • No response delay • Full control
81. Let’s check
83. This code is already tested in Unit Tests
84. Mock your ViewModel
85. Mock ViewModel val viewModel = mockk<LoginViewModel>()
86. Mock ViewModel val userLiveData = MutableLiveData<User>() val viewModel = mockk<LoginViewModel>() { every { user } returns userLiveData }
87. Mock ViewModel val userLiveData = MutableLiveData<User>() val viewModel = mockk<LoginViewModel>() { every { user } returns userLiveData } injectViewModel(viewModel) rule.launchActivity(null) userLiveData.postValue(User(0, "Markiyan"))
88. Mock ViewModel val userLiveData = MutableLiveData<User>() val viewModel = mockk<LoginViewModel>() { every { user } returns userLiveData } injectViewModel(viewModel) rule.launchActivity(null) userLiveData.postValue(User(0, "Markiyan"))
89. This won’t work before Android-9 io.mockk.MockKException: no answer found for
90. class LoginViewModel( private val repository: Repository, private val dispatcher: CoroutineDispatcher ) : ViewModel() { val user = MutableLiveData<User>() val loading = MutableLiveData<Boolean>() val error = MutableLiveData<Throwable>() …
91. open class LoginViewModel( private val repository: Repository, private val dispatcher: CoroutineDispatcher ) : ViewModel() { open val user = MutableLiveData<User>() open val loading = MutableLiveData<Boolean>() open val error = MutableLiveData<Throwable>() …
92. All-Open https://kotlinlang.org/docs/reference/compiler-plugins.html#all-open-compiler-plugin
93. All-Open https://kotlinlang.org/docs/reference/compiler-plugins.html#all-open-compiler-plugin plugins { id "org.jetbrains.kotlin.plugin.allopen" version "1.3.61" }
94. All-Open https://kotlinlang.org/docs/reference/compiler-plugins.html#all-open-compiler-plugin plugins { id "org.jetbrains.kotlin.plugin.allopen" version "1.3.61" } annotation class OpenForTesting
95. All-Open https://kotlinlang.org/docs/reference/compiler-plugins.html#all-open-compiler-plugin plugins { id "org.jetbrains.kotlin.plugin.allopen" version "1.3.61" } annotation class OpenForTesting allOpen { annotation("com.klug.testtodo.OpenForTesting") }
96. @OpenForTesting class LoginViewModel( private val repository: Repository, private val dispatcher: CoroutineDispatcher ) : ViewModel() { val user = MutableLiveData<User>() val loading = MutableLiveData<Boolean>() val error = MutableLiveData<Throwable>() …
97. @OpenForTesting class LoginViewModel( private val repository: Repository, private val dispatcher: CoroutineDispatcher ) : ViewModel() { val user = MutableLiveData<User>() val loading = MutableLiveData<Boolean>() val error = MutableLiveData<Throwable>() …
98. Espresso
99. Test @Test fun testLogin() { onView() }
100. Test @Test fun testLogin() { onView(withId()) }
101. Test @Test fun testLogin() { onView(withId(R.id.etLogin)) }
102. Test @Test fun testLogin() { onView(withId(R.id.etLogin)).perform() }
103. Test @Test fun testLogin() { onView(withId(R.id.etLogin)).perform(typeText()) }
104. Test @Test fun testLogin() { onView(withId(R.id.etLogin)).perform(typeText("login")) }
105. Test @Test fun testLogin() { onView(withId(R.id.etLogin)).perform(typeText("login")) onView(withId(R.id.etPassword)).perform(typeText("password")) onView(withId(R.id.btnLogin)).perform(click()) onView(withId(R.id.imgUserAvatar)).check(matches(isDisplayed())) onView(withId(R.id.tvUserName)) .check(matches(allOf(isDisplayed(), withText("User Name")))) }
106. Use extensions
107. Use extensions private fun Int.asView() = onView(withId(this))
108. Use extensions private fun Int.asView() = onView(withId(this)) fun ViewInteraction.click() = perform(ViewActions.click()) fun Int.click() = asView().click()
109. Use extensions private fun Int.asView() = onView(withId(this)) fun ViewInteraction.click() = perform(ViewActions.click()) fun Int.click() = asView().click() infix fun ViewInteraction.typeText(text: String) = perform(ViewActions.typeText(text)) infix fun Int.typeText(text: String) = asView().typeText(text)
110. Use extensions private fun Int.asView() = onView(withId(this)) fun ViewInteraction.click() = perform(ViewActions.click()) fun Int.click() = asView().click() infix fun ViewInteraction.typeText(text: String) = perform(ViewActions.typeText(text)) infix fun Int.typeText(text: String) = asView().typeText(text) import <your.package.name>.R.id.*
111. @Test fun testLogin() { etLogin typeText "login" etPassword typeText "password" btnLogin.click() imgUserAvatar.isDisplayed() tvUserName.isDisplayed() withText "User Name" }
112. Test @Test fun testLogin() { onView(withId(R.id.etLogin)).perform(typeText("login")) onView(withId(R.id.etPassword)).perform(typeText("password")) onView(withId(R.id.btnLogin)).perform(click()) onView(withId(R.id.imgUserAvatar)).check(matches(isDisplayed())) onView(withId(R.id.tvUserName)) .check(matches(allOf(isDisplayed(), withText("User Name")))) }
113. Espresso Packages
114. Espresso Packages • Core - Matchers, Actions
115. Espresso Packages • Core - Matchers, Actions • Intents - Intents - record, stub, verify
116. Espresso Packages • Core - Matchers, Actions • Intents - Intents - record, stub, verify • Web - WebView testing
117. Espresso Packages • Core - Matchers, Actions • Intents - Intents - record, stub, verify • Web - WebView testing • Remote - Multi-process testing
118. Espresso Packages • Core - Matchers, Actions • Intents - Intents - record, stub, verify • Web - WebView testing • Remote - Multi-process testing • Contrib - RecyclerView, Drawer, DatePicker
119. Espresso Packages • Core - Matchers, Actions • Intents - Intents - record, stub, verify • Web - WebView testing • Remote - Multi-process testing • Contrib - RecyclerView, Drawer, DatePicker • Idling resource - Synchronize jobs
120. UI loading something, custom animations
121. UI loading something, custom animations Thread.sleep(2500)
122. UI loading something, custom animations Thread.sleep(2500)
123. UI loading something, custom animations IdlingResource
124. UI loading something, custom animations IdlingResource Espresso's mechanism for synchronization with background jobs.
125. UI loading something, custom animations IdlingResource Espresso's mechanism for synchronization with background jobs. • CountingIdlingResource • UriIdlingResource • IdlingThreadPoolExecutor / ScheduledIdlingThreadPoolExecutor
126. Idling Resource implementation 'androidx.test.espresso:espresso-idling-resource:3.2.0'
127. Idling Resource implementation 'androidx.test.espresso:espresso-idling-resource:3.2.0' object SplashIdlingResource : IdlingResource { }
128. Idling Resource implementation 'androidx.test.espresso:espresso-idling-resource:3.2.0' object SplashIdlingResource : IdlingResource { override fun isIdleNow(): Boolean override fun registerIdleTransitionCallback(callback) }
129. Idling Resource implementation 'androidx.test.espresso:espresso-idling-resource:3.2.0' object SplashIdlingResource : IdlingResource { override fun isIdleNow(): Boolean = isIdle override fun registerIdleTransitionCallback(callback) { this.callback = callback } }
130. Idling Resource implementation 'androidx.test.espresso:espresso-idling-resource:3.2.0' object SplashIdlingResource : IdlingResource { override fun isIdleNow(): Boolean = isIdle override fun registerIdleTransitionCallback(callback) { this.callback = callback } fun notifyJobStarted() fun notifyJobFinished() }
131. Idling Resource implementation 'androidx.test.espresso:espresso-idling-resource:3.2.0' object SplashIdlingResource : IdlingResource { override fun isIdleNow(): Boolean = isIdle override fun registerIdleTransitionCallback(callback) { this.callback = callback } fun notifyJobStarted() { isIdle = false } fun notifyJobFinished() { isIdle = true callback?.onTransitionToIdle() }
132. Idling Resource object SplashIdlingResource : IdlingResource { override fun isIdleNow(): Boolean = isIdle override fun registerIdleTransitionCallback(callback) { this.callback = callback } fun notifyJobStarted() { isIdle = false } fun notifyJobFinished() { isIdle = true callback?.onTransitionToIdle() } IdlingRegistry.getInstance().register(SplashIdlingResource)
133. Single-Activity
134. Single-Activity inline fun <reified F : Fragment> launchFragmentInContainer( fragmentArgs: Bundle? = null, @StyleRes themeResId: Int = R.style.FragmentScenarioEmptyFragmentActivityTheme, factory: FragmentFactory? = null )
135. Single-Activity inline fun <reified F : Fragment> launchFragmentInContainer( fragmentArgs: Bundle? = null, @StyleRes themeResId: Int = R.style.FragmentScenarioEmptyFragmentActivityTheme, factory: FragmentFactory? = null ) moveToState(Lifecycle.State)
136. Single-Activity inline fun <reified F : Fragment> launchFragmentInContainer( fragmentArgs: Bundle? = null, @StyleRes themeResId: Int = R.style.FragmentScenarioEmptyFragmentActivityTheme, factory: FragmentFactory? = null ) moveToState(Lifecycle.State) recreate()
137. Single-Activity inline fun <reified F : Fragment> launchFragmentInContainer( fragmentArgs: Bundle? = null, @StyleRes themeResId: Int = R.style.FragmentScenarioEmptyFragmentActivityTheme, factory: FragmentFactory? = null ) moveToState(Lifecycle.State) recreate() onFragment {}
138. Code Coverage
139. Setup classpath "com.vanniktech:gradle-android-junit-jacoco-plugin:0.15.0" apply plugin: "com.vanniktech.android.junit.jacoco" junitJacoco { jacocoVersion = '0.8.5' includeInstrumentationCoverageInMergedReport = false }
140. Setup classpath "com.vanniktech:gradle-android-junit-jacoco-plugin:0.15.0" apply plugin: "com.vanniktech.android.junit.jacoco" junitJacoco { jacocoVersion = '0.8.5' includeInstrumentationCoverageInMergedReport = false } ./gradlew jacocoTestReportDebug
143. Much thanks!