Getting Started With Firebase Test Lab for Android

発表内容の詳細
http://tech.vasily.jp/entry/getting_started_with_firebase_test_lab_for_android

関連記事
Firebase Test LabでのAndroidアプリのテストをCLIから実行する
http://qiita.com/Horie1024/items/ba387e1861e12fdca0b6

CircleCIからFirebase Test Labでのテストを実行する
http://qiita.com/Horie1024/items/3c22b67634deb0dd4645

Transcript

1. Ge#ng&Started&With Firebase(Test(Lab(for(Android @Horie1024 2016/9/30(Android(Tes2ng(Bootcamp(#4 ©"VASILY,"Inc.,"2016 1
2. About&Me • Ryosuke)Horie)@Horie1024 • →)ͷௗͷΞΠίϯͰ͢ • VASILY,)Inc. • Android)Developer • iQONͱ͍͏ΞϓϦΛ։ൃ͍ͯ͠·͢ɻ ©"VASILY,"Inc.,"2016 2
3. ©"VASILY,"Inc.,"2016 3
4. ࠓ೔ͷൃදͰΘ͔Δ͜ͱ • Firebase)Test)LabͰͷςετͷ࣮ߦํ๏ ©"VASILY,"Inc.,"2016 4
5. ൃදͷྲྀΕ • Firebase)Test)Labͱ͸ʁ • ར༻͢ΔͨΊͷ४උ • ςετͷ࣮ߦ • ςετ݁Ռͷ֬ೝ • CLIͰͷ࣮ߦͱCIγεςϜͱͷ࿈ܞ ©"VASILY,"Inc.,"2016 5
6. Firebase(Test(Labͱ͸ʁ ©"VASILY,"Inc.,"2016 6
7. Firebase(Test(Labͱ͸ʁ • Google'I/O'2016ͰFirebaseͷҰػೳͱͯ͠ެ։ • چCloud'Test'Lab • Ϋϥ΢υϕʔεͷAndroidΞϓϦͷςετج൫ • Googleͷσʔληϯλʔ্ͰՔಇ͢Δ୺຤ͰςετΛ࣮ߦ ©"VASILY,"Inc.,"2016 7
8. Firebase(Test(Labͷಛ௃ • ࣮ػͰͷςετ͕Մೳ • Googleͷσʔληϯλʔʹ഑ஔ͞Ε࣮ͨػͰςετ͕࣮ߦ • ςετίʔυෆཁͰςετ͕Մೳ • Test*Lab͕ΞϓϦΛղੳ͠Ϣʔβʔͷૢ࡞ΛγϛϡϨʔτ • ։ൃϑϩʔ΁ͷ౷߹͕༰қ • ༷ʑͳςετͷ࣮ߦํ๏Λ༻ҙ ©"VASILY,"Inc.,"2016 8
9. ࣮ߦՄೳͳςετख๏ • Instrumenta+onςετ • Roboςετ ©"VASILY,"Inc.,"2016 9
10. Instrumenta*onςετ • ҎԼ3छͷϑϨʔϜϫʔΫʹରԠ • Espresso • Robo+um • UI0Automator02.0 ©"VASILY,"Inc.,"2016 10
11. Roboςετ • ςετίʔυෆཁͳE2Eςετ • ΞϓϦͷUIߏ଄Λղੳɾ୳ࡧ • Ϣʔβʔͷૢ࡞ΛγϛϡϨʔτ ©"VASILY,"Inc.,"2016 11
12. Roboςετ • Monkey(testͱ͸ڍಈ͕ҟͳΔ • ࣮ߦͷ౓ʹϥϯμϜͳૢ࡞͕ߦΘΕΔΘ͚Ͱ͸ͳ͍ • RoboςετͰγϛϡϨʔτ͞ΕΔૢ࡞ʹ͸࠶ݱੑ͕͋Δ • σόΠεͷઃఆ౳ͷύϥϝʔλ͕ಉ͡ͳΒ͹ৗʹಉ͡ ©"VASILY,"Inc.,"2016 12
13. Roboςετͷ੍ݶ • ϩάΠϯɾೝূॲཧΛᷖճͰ͖ͳ͍ • UnityඇରԠ • ಠࣗͷςετεΫϦϓτͷఆٛෆՄ ©"VASILY,"Inc.,"2016 13
14. RoboςετͰͷೝূॲཧ • System(PropertyͰΞϓϦ͕TestLabͰ࣮ߦத͔Λ൑ผ • TestLabͷ৔߹ͷΈαΠϯΠϯɺϩάΠϯΛεΩοϓͳͲՄೳ String testLabSetting = Settings.System.getString(context.getContentResolver(), "firebase.test.lab"); if ("true".equals(testLabSetting)) { // Test LabͰͷ࣮ߦதʹߦ͏ॲཧ } ©"VASILY,"Inc.,"2016 14
15. ςετͷ࣮ߦํ๏ • Firebase)console • Android)Studio • CLI • Pre7launch)report(RoboςετͷΈ) • Play΁ͷα,)βͰͷAPKΞοϓϩʔυ࣌ʹࣗಈ࣮ߦ ©"VASILY,"Inc.,"2016 15
16. ςετͷ࣮ߦํ๏ • Pre%launch,report • ՝ۚແ͠Ͱ࢖༻Մ • Developer,console͔ΒΦϓτΠϯ ©"VASILY,"Inc.,"2016 16
17. ར༻͢ΔͨΊͷ४උ ©"VASILY,"Inc.,"2016 17
18. FirebaseͷϓϩδΣΫτΛ࡞੒ • Firebase)console͔Β࡞੒ ©"VASILY,"Inc.,"2016 18
19. ՝ۚ • ՝ۚ • BlazeϓϥϯΛબ୒ ©"VASILY,"Inc.,"2016 19
20. ར༻։࢝ ©"VASILY,"Inc.,"2016 20
21. ςετͷ࣮ߦ ©"VASILY,"Inc.,"2016 21
22. ςετ࣮ߦ·ͰͷྲྀΕ • Firebase)console͔Βͷ࣮ߦͷ৔߹ • ςετख๏ͷܾఆ • APKͷΞοϓϩʔυ • ςετ৚݅ͷઃఆ • ςετͷ࣮ߦ ©"VASILY,"Inc.,"2016 22
23. ςετख๏ͷܾఆ • Roboςετ%or%Instrumenta/onςετ ©"VASILY,"Inc.,"2016 23
24. APKͷΞοϓϩʔυ • Roboςετͷ৔߹௨ৗͷAPK ©"VASILY,"Inc.,"2016 24
25. APKͷΞοϓϩʔυ • Instrumenta+onςετͷ৔߹ • ௨ৗͷAPK0+0ςετAPK͕ඞཁ • ҎԼͷίϚϯυͰςετAPKΛੜ੒ $ ./gradlew assembleDebugTest ©"VASILY,"Inc.,"2016 25
26. ςετ৚݅ͷઃఆ • ςετ৚݅ͷઃఆ͸Roboςετɺ Instrumenta.onςετͰڞ௨ • ৄࡉઃఆʹ͸͕ࠩ͋Γ • ઃఆͷ֓೦͕গ͠Θ͔Γʹ͍͘ ©"VASILY,"Inc.,"2016 26
27. ςετ৚݅ͷઃఆʹඞཁͳ֓೦ • Test%Dimension • σόΠεɺAPIϨϕϧɺϩέʔϧɺը໘ͷ޲͖ͳͲ • Test%Execu/on • ༗ޮͳTest)Dimensionͷ૊߹ͤ • Test%Matrix • Test)Execu3onͷϦετ ©"VASILY,"Inc.,"2016 27
28. Test%Dimensionͷબ୒ྫ • σόΠε:#Nexus#4,#Nexus#5,#Nexus#7 • APIϨϕϧ:#21,#22 • ϩέʔϧ:#Japanese • ը໘ͷ޲͖:#ॎ޲͖ ©"VASILY,"Inc.,"2016 28
29. Test%Matrix • Test&Execu+on • ༗ޮͳTest&Dimensionͷ૊߹ͤ • Nexus&7͕APIϨϕϧ22ʹඇରԠ • Nexus&7&+&APIϨϕϧ22͸εΩοϓ • Test&Matrix͸Test&Execu+onͷϦετ • Test&Matrixʹैͬͯςετ͕࣮ߦ ©"VASILY,"Inc.,"2016 29
30. RoboςετͷΦϓγϣϯ • Timeout • Maximum+depth(࠷େਂ౓) • RoboςετͰͷΈબ୒Մೳͳ߲໨ • Roboςετͷνϡʔχϯά͸͜ͷ2߲ ໨Λௐ੔1 1"h$ps:/ /firebase.google.com/docs/test6lab/robo6ux6 test#configuringrobotest ©"VASILY,"Inc.,"2016 30
31. Roboςετͷ༻ޠ • Depth • ը໘ͷ֊૚ͷਂ͞ • Maximum-depthͰ୳ࡧͷݶ౓Λࢦఆ • Root • ϝΠϯεΫϦʔϯ • UI-Branch • ࢬ෼͔Εͨ͠ը໘ભҠͷ෼ذ ©"VASILY,"Inc.,"2016 31
32. ςετͷ࣮ߦ • Test&DimensionΛબ୒ • Լ෦ͷςετΛ։࢝ϘλϯΛΫϦοΫ ©"VASILY,"Inc.,"2016 32
33. ςετ݁Ռͷ֬ೝ ©"VASILY,"Inc.,"2016 33
34. ςετ݁Ռͷ֬ೝ • Test&Execu+onຖʹ݁ՌΛ֬ೝՄೳ • ϩά • εΫϦʔϯγϣοτ • ಈը • Cloud&Storageʹอଘ • อଘظؒ͸ςετ࣮ߦޙ90೔ؒ ©"VASILY,"Inc.,"2016 34
35. ςετ݁Ռͷ֬ೝ • Roboςετͷ৔߹ΞΫςΟϏςΟϚο ϓ͕දࣔ% ©"VASILY,"Inc.,"2016 35
36. CLIͰͷ࣮ߦͱCIγεςϜͱͷ࿈ܞ ©"VASILY,"Inc.,"2016 36
37. CLIͰͷ࣮ߦ • gcloudίϚϯυϥΠϯπʔϧΛ࢖༻ $ gcloud beta test android run \ --type robo \ --app app-debug.apk \ --device-ids Nexus5 \ --os-version-ids 21 \ --locales ja_JP \ --orientations portrait \ --timeout 90s ©"VASILY,"Inc.,"2016 37
38. CLIͰͷ࣮ߦ • ৄࡉ͸Qiitaʹ·ͱΊ͍ͯ·͢ɻ Firebase(Test(LabͰͷAndroidΞϓϦͷςετΛCLI͔Β࣮ߦ͢Δ ©"VASILY,"Inc.,"2016 38
39. CIγεςϜͱͷ࿈ܞ • CLI͔Β࣮ߦͰ͖ΔͷͰCIͷϏϧυ͔Β΋࣮ߦՄೳ • CIͷϏϧυͰgcloudπʔϧ͔ΒςετΛ࣮ߦ ©"VASILY,"Inc.,"2016 39
40. CircleCIͰͷྫ 1. ίʔυͷมߋΛίϛοτ͠ϦϙδτϦʹϓογϡ 2. CircleCI͕มߋΛݕ஌͠ϏϧυΛ։࢝ 3. gcloudίϚϯυϥΠϯπʔϧͷઃఆɺೝূॲཧ 4. apk͓Αͼςετapkͷ࡞੒ 5. Firebase8Test8LabʹΑΔςετͷ࣮ߦ ©"VASILY,"Inc.,"2016 40
41. gcloudπʔϧ • CirlceCIͰ͸σϑΥϧτͰ༻ҙ • ϓϩδΣΫτͷઃఆɺcomponentsͷupdateΛߦ͏ඞཁ͋Γ • JSONαʔϏεΞΧ΢ϯτΩʔͰͷೝূ ©"VASILY,"Inc.,"2016 41
42. CircleCIͷઃఆ • base64Τϯίʔυͨ͠JSONαʔϏεΞΧ΢ϯτΩʔΛ؀ڥม਺ʹొ࿥ ©"VASILY,"Inc.,"2016 42
43. gcloudπʔϧͷೝূ ؀ڥม਺ʹొ࿥ͨ͠ΩʔΛJSONϑΝΠϧʹσίʔυ $ echo $CLIENT_SECRET | base64 --decode > ${HOME}/client-secret.json ©"VASILY,"Inc.,"2016 43
44. gcloudπʔϧͷೝূ gcloud auth activate-service-accountͰೝূ $ gcloud auth activate-service-account --key-file ${HOME}/client-secret.json ©"VASILY,"Inc.,"2016 44
45. CIγεςϜͱͷ࿈ܞ • ৄࡉ͸Qiitaʹ·ͱΊ͍ͯ·͢ɻ CircleCI͔ΒFirebase,Test,LabͰͷςετΛ࣮ߦ͢Δ ©"VASILY,"Inc.,"2016 45
46. ·ͱΊ • Firebase)Test)LabΛ࢖͍࢝ΊΔͷ͸ൺֱత؆୯ • Roboςετ͸ศར͕ͩೝূॲཧͷ໰୊͕େ͖͍ • ೔ຊ੡୺຤͕ແ͍ͷͰࠓޙͷ௥Ճʹظ଴ ©"VASILY,"Inc.,"2016 46
47. ࠷ޙʹ • ຊൃද಺༰ͷৄࡉ͸ฐࣾDeveloper)Blogʹ·ͱΊͯ͋Γ·͢ɻ • Firebase)Test)LabΛ࢖ͬͨAndroidΞϓϦͷςετ ©"VASILY,"Inc.,"2016 47
48. ͋Γ͕ͱ͏͍͟͝·ͨ͠ ©"VASILY,"Inc.,"2016 48