Firebase Test LabのRobo Test いいね👍

Firebase Test LabのRobo Test いいね👍

書き起こし
https://github.com/operando/Notes/tree/master/Shibuya_apk30

shibuya.apk #30
https://shibuya-apk.connpass.com/event/109729/

Transcript

1. Firebase Test Labͷ
   Robo Test ͍͍Ͷ
   shibuya.apk #30
   

   View Slide

2. Firebase Test Lab
   “Test your app on devices
   hosted in a Google data center.“
   

   View Slide

3. Firebase Test Lab
   • Ծ૝σόΠεͱ෺ཧσόΠε྆ํ༻ҙ͞ΕͯΔ
   • ࠓ೥iOS΋αϙʔτ͞Εͨ
   • AndroidͩͱҎԼͷςετ͕Ͱ͖Δ
   • Instrumentation tests
   • Robo Test
   • Game loop test
   

   View Slide

4. Robo Test
   “Robo test analyzes the structure of
   your app's UI and then explores it
   methodically, automatically
   simulating user activities.”
   

   View Slide

5. Robo Test
   ެࣜυΩϡϝϯτ
   https://firebase.google.com/docs/
   test-lab/android/robo-ux-test
   

   View Slide

6. ͳͥ Robo TestΛ࢖͍࢝Ίͨͷ͔
   • ൃ୺͸QAͷํ͕ࢼ͠ʹ࣮ߦͯ͘͠Εͨ
   • ੲʹ࢖ͬͨ࣌͸͋·Γ໾ʹͨͨͳ͔͚ͬͨ
   Ͳɺࠓճࢼͯ͠ΈͨΒྑ͘ͳͬͯͨ
   

   View Slide

7. ͳͥ Robo TestΛ࢖͍࢝Ίͨͷ͔
   • note͸Android 4ܥ·Ͱαϙʔτͯ͠Δ͚Ͳ

   ࣾ಺ʹ·ͱ΋ʹಈ͘4ܥ୺຤͕গͳ͍
   • ϦάϨογϣϯςετతʹखಈͰ৭Μͳը໘Λ
   νΣοΫ͢Δͷ͕໘౗
   • ςετίʔυॻ͍ͯͳ͍
   • ͚ͲɺͳΜ͔ࣗಈͰ৭Μͳը໘ݟͯ΄͍͠
   

   View Slide

8. Firebase Test Lab͕ରԠͯ͠ΔAPIϨϕϧ
   • APIϨϕϧ 18 ʙ 28
   • Jelly Bean MR2 ʙ P·Ͱ
   • े෼ͦ͏
   

   View Slide

9. Robo Testͷ࣮ߦʹඞཁͳ΋ͷ
   • ςετ͍ͨ͠ΞϓϦͷApk
   • Firebase Project
   • ʢίϚϯυϥΠϯ͔Β࣮ߦ͢Δ৔߹͸gcloudʣ
   

   View Slide

10. ແྉͰ࢖͑·͢ʂ
    • Firebaseͷྉۚϓϥϯ͕

    Sparkϓϥϯ or Flameϓϥϯͷ৔߹͸

    ͋Δఔ౓ແྉͰ࢖͑·͢
    • ͪΐͬͱࢼ͢෼ʹ͸े෼࢖͑·͢
    

    View Slide

11. ͓ۚΛ෷͑͹΋ͬͱ࢖͑·͢ʂ
    • Firebaseͷྉۚϓϥϯ͕Blazeϓϥϯͷ৔߹

    ͓ۚ͸͔͔Γ·͕͢ແ੍ݶͰ࢖͑·͢
    • note͸BlazeϓϥϯͰFirebase test labΛ

    ࢖ͬͯ·͢
    

    View Slide

12. Pricing
    • ྉۚͷৄࡉ͸ҎԼΛࢀর
    • https://firebase.google.com/docs/test-
    lab/android/overview#billing
    

    View Slide

13. noteͰͷFirebase test labͷ

    ઌ݄ͷ࢖༻ྉ
    • ෺ཧσόΠεΛ2࣌ؒͪΐͬͱ࢖ͬͯ 534ԁ
    • Ծ૝σόΠε͸਺े෼࢖ͬͯ 0ԁ
    • ͍҆ʂʂ
    • Robo Test͔͠࢖ͬͯͳ͍
    

    View Slide

14. ࢖͏্Ͱ஌͓ͬͯ͘ͱ͍͍͜ͱ
    • Robo TestͷλΠϜΞ΢τ
    • ΧελϜϩάΠϯ
    

    View Slide

15. Robo TestͷλΠϜΞ΢τ
    • Robo ςετΛ࣮ߦ͢Δ࣌ؒ
    • noteͰ͸5෼ʹઃఆͯ͠Δ
    • ·ͣ͸୹͘͸͡Ίͯɺ݁ՌΛݟͯঃʑʹ

    ΞϓϦʹ࠷దͳ࣌ؒΛݟ͚ͭΔͷ͕ྑͦ͞͏
    

    View Slide

16. ΧελϜϩάΠϯ
    • ϩάΠϯ͕ඞཁͳը໘΍ػೳ͕͋Δ৔߹ʹ࢖͏
    • ϩάΠϯը໘ͷid/passwordʹೖΕΔ஋Λ

    ఆٛ͢Δ
    • Robo Test͕ϩάΠϯը໘ʹ͖ͨΒɺͦΕͧΕͷ
    EditTextʹఆٛͨ͠஋ΛೖΕɺϩάΠϯͯ͘͠ΕΔ
    

    View Slide

17. ΧελϜϩάΠϯ
    • ͜Εఆ͓͔ٛͯ͠ͳ͍ͱ

    ʮ͋ΕʁϩάΠϯը໘ શવ ಥഁͰ͖ͯͳ͍ʂ

    μϝ͡ΌΜʂʯ

    ͬͯͳΔͷͰɺఆ͓͖ٛͯ͠·͠ΐ͏
    

    View Slide

18. Demo
    

    View Slide

19. Test Report
    

    View Slide

20. ݁Ռ͕γϯϓϧ
    

    View Slide

21. non-SDK interfaces࢖ͬͯΔ

    ͱ͜Ζग़ͯ͘͠ΕΔ
    • APIϨϕϧ 28Ҏ্Ͱಈ͔͢ͱग़ͯ͘͠ΕΔ
    

    View Slide

22. ύϑΥʔϚϯε΋ग़ͯ͘͠ΕΔ
    

    View Slide

23. ύϑΥʔϚϯε΋ग़ͯ͘͠ΕΔ
    

    View Slide

24. ύϑΥʔϚϯε΋ग़ͯ͘͠ΕΔ
    • Roboͷૢ࡞ಈըͱSyncͯͦ͠ΕͧΕͷάϥϑ
    ͕Ͳ͏ͳͬͯΔͷ͔ݟΕΔͷΑ͍
    

    View Slide

25. View Slide

26. Robo TestͰΫϥογϡͨ͠Β
    StackTraceग़ͯ͘͠ΕΔ
    

    View Slide

27. Robo TestͰΫϥογϡͨ͠Β
    StackTraceग़ͯ͘͠ΕΔ
    • StackTraceݟΔͱRobo Test͸espressoΛ࢖
    ͬͯΞϓϦͷૢ࡞Λͯ͠Δ͜ͱ͕Θ͔Δ
    

    View Slide

28. ςετͷ݁Ռ͕GCSʹอଘ͞ΕΔ
    • ૢ࡞ϩάͷJSON
    • Robo script
    • ͜ͷϩάΛ࢖͑͹ɺಉ͡ૢ࡞ͷRobo Test͕Ͱ͖Δ
    • Logcat
    • Robo Test࣮ߦ࣌ͷ୺຤ͷLogcat
    

    View Slide

29. ςετͷ݁Ռ͕GCSʹอଘ͞ΕΔ
    • Robo͕ૢ࡞ͨ͠ಈը
    • εΫϦʔϯγϣοτ
    • Ϋϩʔϧάϥϑ
    • Robo Testͷૢ࡞͔Β࡞੒͞ΕΔը໘ભҠ
    • ͜Εͳ͔ͳ͔͍͢͝
    

    View Slide

30. Ϋϩʔϧάϥϑ
    

    View Slide

31. Robo TestΛ͍࣮ͭߦͯ͠Δͷ͔
    • noteͰ͸ϦϦʔεલͷQAΛ࢝ΊΔ࣌ʹ

    ෳ਺όʔδϣϯɺෳ਺୺຤Ͱ࣮ߦͯ͠Δ
    • ͲΕͰ࣮ߦ͢Δ͔Ͳ͔ͷςϯϓϨʔτΛ࡞ΕΔͷͰ

    ͦͷςϯϓϨʔτΛ࢖ͬͯຖճ࣮ߦ͢Δͱָ
    • Robo script͸·ͩ࢖ͬͯͳ͍ͷͰ

    ૢ࡞͸ຖճϥϯμϜૢ࡞
    

    View Slide

32. ࠓ౓Ͳ͏͍͔ͨ͠
    • ReleaseϒϥϯνΛ࡞ͬͨΒɺCI্͔ΒࣗಈͰRobo Test࣮ߦ
    • ࠓ͸gcloud͔Firebase ProjectϙνϙνͰ࣮ߦͯ͠Δ
    • Robo scriptΛ࢖ͬͯɺܾΊΒΕͨૢ࡞Λ࣮ߦͰ͖ΔΑ͏ʹ͢Δ
    • ৽͍͠ػೳͱ͔࡞ͬͨΒRobo scriptϝϯς͢Δ

    ඞཁ͋Γͦ͏ͳͷͰͲ͏͠Α͏
    • ӡ༻ͯ͠Δํ͍ͨΒ஌ݟ͍ͩ͘͞
    

    View Slide

33. ͓·͚
    

    View Slide

34. apk͑͋͞Ε͹…
    • ࣗ෼͕ͨͪ࡞ͬͯΔΞϓϦ͡Όͳͯ͘΋

    Robo Test૸ΒͤΒΕΔ
    • ΍Βͳ͍ͰͶ
    

    View Slide

35. gcloudͰRobo TestΛ࣮ߦ
    • gcloudΛΠϯετʔϧ͢Δ
    • https://cloud.google.com/sdk/docs/
    downloads-interactive
    

    View Slide

36. gcloud͔ΒRobo TestΛ࣮ߦ
    gcloud firebase test android run \
    --type robo \
    --app \
    --device model=Pixel2,version=28,locale=ja_JP,orientation=portrait \
    --timeout 90s
    • ͜Μͳײ͡ͷίϚϯυͰ࣮ߦ
    

    View Slide

37. ·ͱΊ
    • Robo Test͸Α͍
    • ؆୯ʹ࢖͍࢝ΊΒΕΔ
    • Test Report͕ॆ࣮ͯ͠Δͷ΋خ͍͠
    • CIͱ͔ʹ΋૊ΈࠐΊΔͷΑ͍
    

    View Slide

38. Thanksʂʂ
    

    View Slide