Firebase A/B TestingとRemote Config を最大限に活用する方法

2023/05/29 Ca.aab #3 資料

Transcript

1. $"BBC
   

   גࣜձࣾλοϓϧ
   ޲த໺࿱
   'JSFCBTF"#5FTUJOHͱ3FNPUF$POGJH
   

   Λ࠷େݶʹ׆༻͢Δํ๏
   

   View Slide

2. ΠϯτϩμΫγϣϯ
   3FNPUF$PO
   fi
   Hʹ͍ͭͯ
   'JSFCBTF"#5FTUJOHʹ͍ͭͯ
   5JQT
   ·ͱΊ
   ໨࣍
   

   View Slide

3. ΠϯτϩμΫγϣϯ
   

   View Slide

4. w ޲த໺࿱Ή͖ͬʔ
   w "OESPJEΤϯδχΞ
   w 'JSFCBTF޷͖͓͡͞Μ
   w ޷͖ͳ'JSFCBTFαʔϏε
   w 3FNPUF$PO
   fi
   H
   ࣗݾ঺հ
   

   View Slide

5. 3FNPUF$PO
   fi
   Hͱ
   

   "#5FTUJOHͷλοϓϧͷࣄྫ΍
   

   5JQTΛڞ༗ͯ͠ɺ
   

   ศར͔΋ͬͯࢥͬͯ΋Β͑Ε͹͏Ε͍͠
   ࠓ೔ͷςʔϚ
   

   View Slide

6. 'JSFCBTF"#5FTUJOHͱ3FNPUF$POGJH
   

   View Slide

7. 3FNPUF$POGJHʹ͍ͭͯ
   

   View Slide

8. w ΞϓϦͷಛఆͷಈ࡞΍σβΠϯΛϦϞʔτ͔Β੍ޚ͢Δࣄ͕Ͱ͖Δ
   w ύϥϝʔλ͸,FZ7BMVFํࣜͰ؅ཧ͢Δ
   w ,FZ͸จࣈྻɺ7BMVF͸จࣈྻɺ਺஋ɺCPPM஋ɺ+40/
   w ಛఆͷϢʔβʔάϧʔϓʹରͯ͠ҟͳΔύϥϝʔλ஋ΛఏڙͰ͖Δ
   w ΞϓϦόʔδϣϯɺσόΠεݴޠɺϢʔβʔϓϩύςΟ౳ʑʜ
   w ϦΞϧλΠϜߋ৽͕Մೳ
   w ࢖༻ྫͱͯ͠ɺ'FBUVSF'MBHɺ6*มߋɺ஍Ҭผͷίϯςϯπͷදࣔɺ
   ϝϯςφϯεϞʔυɺ"#ςετ౳ʑʜ
   3FNPUF$POGJHͱ͸
   

   View Slide

9. λοϓϧͰͷ׆༻
   

   View Slide

10. ϦΞϧλΠϜߋ৽ॲཧ
    

    View Slide

11. w 'JSFCBTF#P.Wʙʢ3FNPUF$PO
    fi
    HWʙʣ଴๬ͷϦΞ
    ϧλΠϜߋ৽Ϧεφʔ͕௥Ճ🎉
    w 'JSFCBTF#P.Wʙʢ3FNPUF$PO
    fi
    HWʙʣ͸'MPX൛
    ͷ"1*΋௥Ճ🎉
    w ্ه͕ϦϦʔε͞ΕΔ·Ͱ͸ɺެࣜEPDʹ͋Δ$MPVE'VODUJPOTͱ
    '$.Λ࢖ͬͨํ๏ͰϦΞϧλΠϜػߏΛ࣮ݱ͍ͯͨ͠
    w 3FNPUF$PO
    fi
    Hߋ৽τϦΨʔͰαΠϨϯτ1VTIΛଧͭ͜ͱͰ૝ఆ֎
    ʹ4FSWFS"1*Λίʔϧͯ͠͠·͍ෛՙߴಅ͢Δ౳ɺएׯ໰୊͕͋ͬͨ
    ϦΞϧλΠϜߋ৽ॲཧ
    

    View Slide

12. ϦΞϧλΠϜߋ৽ॲཧ
    -JTUFOFS൛
    

    View Slide

13. ϦΞϧλΠϜߋ৽ॲཧ
    'MPX൛
    

    View Slide

14. ϦΞϧλΠϜߋ৽ॲཧ
    ΞϓϦͷঢ়ଶ ϦΞϧλΠϜߋ৽௨஌
    'PSFHSPVOE
    ⚪︎
    #BDLHSPVOE
    ⚪︎
    1SPDFTT,JMM º
    1SPDFTT,JMM͔Β෮ؼ
    

    ˞,JMMதʹ3FNPUF$PO
    fi
    Hͷߋ৽͕͋ͬͨ৔߹
    ˚
    

    ˞-JTUFOFSొ࿥λΠϛϯά
    

    View Slide

15. 'FBUVSF'MBH
    

    View Slide

16. w ৽ػೳ౳ͷϦϦʔε࣌ʹݩખͱͳΔCPPM஋ͷϑϥάΛ༻ҙͯ͠ػೳͷ
    ༗ޮແޮΛߦ͑ΔΑ͏ʹͯ͠ϦϦʔε͢Δɻ
    w ৽ػೳͷӨڹΛ੍ޚ͠ͳ͕ΒϦϦʔεग़དྷΔࣄͰɺෆ۩߹ݕ஌࣌ʹແ
    ޮʹͨ͠ΓɺϕετͳλΠϛϯάͰ༗ޮʹͨ͠Γग़དྷΔɻ
    w 3FNPUF$PO
    fi
    Hͷػೳʹ৐ΔࣄͰηάϝϯτͰͷग़͠Θ͚΋Մೳͱͳ
    Δɻ
    'FBUVSF'MBH
    

    View Slide

17. ྫ͑͹ɺ
    

    ϏσΦ௨࿩ػೳΛ'FBUVSF'MBH
    

    Λ࢖ͬͯϦϦʔε
    

    View Slide

18. 'FBUVSF'MBH
    

    View Slide

19. 'FBUVSF'MBH
    

    View Slide

20. ΧφϦΞϦϦʔε
    

    View Slide

21. w ৽ػೳ౳ΛશϢʔβʔʹ͙͢ʹϦϦʔε͢ΔͷͰ͸ͳ͘ɺ·ͣ͸Ұ෦
    ͷϢʔβʔ͚ͩʹఏڙग़དྷΔɻ
    w ໰୊΍ෆ۩߹͕ͳ͍͜ͱΛ֬ೝ্ͨ͠Ͱɺஈ֊తʹશϢʔβʔʹϦ
    Ϧʔε͍ͯ͘͠ɻ
    w ྫ͑͹ɺˠˠˠ
    ΧφϦΞϦϦʔε
    

    View Slide

22. ྫ͑͹ɺ
    

    ϚΠϖʔδͷ"1*ΛΧφϦΞϦϦʔε
    

    Ͱ#''"1*ʹ੾Γସ͑Δ
    

    View Slide

23. ΧφϦΞϦϦʔε
    

    View Slide

24. ΧφϦΞϦϦʔε
    

    View Slide

25. ΧφϦΞϦϦʔε
    

    View Slide

26. ଞʹ΋
    

    ϝϯςφϯεϞʔυ
    Ϛελʔσʔλ
    +40/ͳͲͰ؅ཧͯ͠׆༻͍ͯ͠Δ
    

    View Slide

27. 'JSFCBTF"#5FTUJOHʹ͍ͭͯ
    

    View Slide

28. w ΞϓϦͷҟͳΔ6*ɺػೳɺΤϯήʔδϝϯτ౳ʹର͢ΔมߋΛςετ͠
    ൺֱ͠ɺ࠷΋ύϑΥʔϚϯε͕ྑ͍ઃఆΛಛఆ͢Δ
    w (PPHMFΦϓςΟϚΠζͷػೳΛ׆༻͍ͯͯ͠ɺϕΠζਪఆΛ׆༻͍ͯ͠
    Δ
    w ϕΠζਪఆʜطଘͷσʔλΛ࢖ͬͯɺࠓޙͷσʔλ͕Ͳ͏ͳΔ͔ΑΓ
    ਖ਼֬ʹਪଌ͢Δख๏
    w "OBMZUJDTɺ3FNPUF$PO
    fi
    Hɺ'$.ɺJO"QQ.FTTBHJOH౳ͱ࿈ܞ
    w ςετͷ໨ඪɺର৅ͷϢʔβʔάϧʔϓɺ֤όϦΞϯτʹ͍ͭͯઃఆ͢Δ
    w ςετͷ݁Ռ͸ࣗಈతʹ෼ੳͯ͘͠ΕΔ
    'JSFCBTF"#5FTUJOHͱ͸
    

    View Slide

29. 'JSFCBTF"#5FTUJOHͱ͸
    

    View Slide

30. λοϓϧͰͷ"#ࣄྫ
    

    View Slide

31. αϒεΫϦϓγϣϯొ࿥ૌٻ
    

    σβΠϯΛ"#ςετ͠ɺ
    

    αϒεΫϦϓγϣϯ཰Λ૿Ճ
    

    View Slide

32. αϒεΫϦϓγϣϯૌٻ"#ςετ
    

    View Slide

33. View Slide

34. 'JSFCBTFͷެࣜʹέʔεελσΟͱͯ͠঺հ͞ΕΔ
    

    IUUQT
    fi
    SFCBTFHPPHMFDPNDBTFTUVEJFTUBQQMF
    αϒεΫϦϓγϣϯૌٻ"#ςετ
    

    View Slide

35. ৄࡉͳઃఆʹ͍ͭͯ͸ࣾ֎ൿͳ෦෼
    

    ΋͋ΔͨΊׂѪͱͳΓ·͢ʜ
    

    View Slide

36. αϯϓϧ"#ςετ
    

    

    Χʔυ6*Λطଘͷ࢛֯ܗɺԁܗɺࡾ֯
    ܗʹมߋͯ͠ɺϑϦοΫͯ͘͠ΕΔ͔
    "#ςετ͢Δ
    

    View Slide

37. ৚݅ɿஉੑϢʔβʔ
    

    ৚݅ɿόʔδϣϯίʔυҎ্
    ৚݅ɿϓϥϯը໘Λදࣔͨ͠ࣄ͕͋Δ
    

    ΰʔϧɿΧʔυϑϦοΫ͢Δ
    

    View Slide

38. w ΧʔυͷܗΛطଘɺԁܗɺࡾ֯ܗ
    

    ˠ3FNPUF$PO
    fi
    HʹΧʔυͷܗมߋ༻ͷDBSE@UZQFύϥϝʔλΛ࡞੒
    w ৚݅ɿஉੑϢʔβʔ
    

    ˠ"OBMZUJDTͷ6TFS1SPQFSUZʹϢʔβʔͷੑผΛηοτͯ͠3FNPUF
    $PO
    fi
    HͰઃఆग़དྷΔΑ͏ʹ͢Δ
    w ৚݅ɿόʔδϣϯίʔυҎ্
    

    ˠಛʹ࣮૷ෆཁ
    w ৚݅ɿϓϥϯը໘Λදࣔͨ͠ࣄ͕͋Δ
    

    ˠϓϥϯը໘දࣔλΠϛϯάͰ"OBMZUJDTʹΠϕϯτϩάΛૹΔ
    w ΰʔϧɿΧʔυϑϦοΫ͢Δ
    

    ˠΧʔυϑϦοΫͨ͠λΠϛϯάͰ"OBMZUJDTʹΠϕϯτϩάΛૹΔ
    αϯϓϧ"#ςετ
    

    View Slide

39. w ΧʔυͷܗΛطଘɺԁܗɺࡾ֯ܗ
    

    ˠ3FNPUF$PO
    fi
    HʹΧʔυͷܗมߋ༻ͷύϥϝʔλΛ࡞੒
    

    ˠ,FZΛDBSE@UZQFɺWBMVFΛTRVBSFɺDJSDMFɺUSJBOHMFͰ࡞੒
    αϯϓϧ"#ςετ
    

    View Slide

40. w ৚݅ɿஉੑϢʔβʔ
    

    ˠ"OBMZUJDTͷ6TFS1SPQFSUZʹϢʔβʔͷੑผΛηοτͯ͠3FNPUF
    $PO
    fi
    HͰઃఆग़དྷΔΑ͏ʹ͢Δ
    αϯϓϧ"#ςετ
    

    View Slide

41. w ৚݅ɿϓϥϯը໘Λදࣔͨ͠ࣄ͕͋Δ
    

    ˠϓϥϯը໘දࣔλΠϛϯάͰ"OBMZUJDTʹΠϕϯτϩάΛૹΔ
    w ΰʔϧɿΧʔυϑϦοΫ͢Δ
    

    ˠΧʔυϑϦοΫͨ͠λΠϛϯάͰ"OBMZUJDTʹΠϕϯτϩάΛૹΔ
    αϯϓϧ"#ςετ
    

    View Slide

42. ࣮૷͸׬ྃͨ͠ͷͰ
    

    ଓ͍ͯ"#ςετઃఆ
    

    View Slide

43. View Slide

44. ର৅ͷύοέʔδ໊
    

    View Slide

45. View Slide

46. View Slide

47. View Slide

48. ͋ͱ͸िؒ΄Ͳ
    

    ෼ੳ݁Ռग़Δ·Ͱ଴͚ͭͩ
    

    View Slide

49. 5JQT
    

    View Slide

50. ϢʔβʔϓϩύςΟ໊ͷ
    

    ໋໊ʹ஫ҙ͢Δ
    

    View Slide

51. w ࣄલʹఆٛ͞Ε͍ͯΔϢʔβʔϓϩύςΟ໊͕͋ΔͷͰɺͦ͜ͱ͸ඃΒͳ
    ͍Α͏ʹ͢Δ
    

    IUUQTTVQQPSUHPPHMFDPN
    fi
    SFCBTFBOTXFS
    IMFOWJTJU@JE
    SE
    w λοϓϧͰ͸ඃΔ΋ͷ͸ઐ༻QSF
    fi
    YΛ͚͍ͭͯΔʢUBQQMF@BHFͱ͔ʣ
    w
    fi
    SFCBTF@ɺHPPHMF@ɺHB@ͷQSF
    fi
    Y͸࢖͑ͳ͍
    w ϢʔβʔϓϩύςΟ໊͸จࣈɺϢʔβʔϓϩύςΟ஋͸จࣈ·Ͱ
    

    ·ͨɺӳ਺ࣈͱΞϯμʔείΞͷΈΛؚΊΔ͜ͱ͕Ͱ͖ɺӳࣈͰ࢝ΊΔඞ
    ཁ͕͋Γ
    ϢʔβʔϓϩύςΟ໊
    

    View Slide

52. λʔήοτ৚݅ઃఆ͸
    

    ϢʔβʔϓϩύςΟͱ
    

    ϢʔβʔΦʔσΟΤϯεͷͦΕͧΕͷ
    

    ಛੑʹ߹Θͤͯࢦఆ͢Δ
    

    View Slide

53. View Slide

54. ϢʔβʔϓϩύςΟWTϢʔβʔΦʔσΟΤϯε
    ϢʔβʔϓϩύςΟ ϢʔβʔΦʔσΟΤϯε
    ઃఆɾ࡞੒ͷ࢓ํ
    ίʔυʹͯ
    TFU6TFS1SPQFSUZ
    ίϯιʔϧͷ"VEJFODFT͔
    ΒϢʔβʔϦετ࡞੒
    ઃఆɾ࡞੒ޙίϯιʔϧʹ
    ൓ө͞ΕΔ·Ͱͷ࣌ؒ
    ࣮૷ϦϦʔεޙଈ࣌൓ө
    ϢʔβʔϦετ࡞੒ޙ
    

    ਺࣌ؒͷλΠϜϥά͋Γ
    ઃఆ৚݅ͷ಺༰
    ίʔυͰTFU6TFS1SPQFSUZ
    ʹηοτͨ͠஋ͷΈ
    ෳࡶͳ৚݅Λ૊Έ߹Θͤͯ
    ࡞੒ग़དྷΔ
    λʔήοτ৚͕݅มΘͬͨ
    ৔߹ͷλΠϜϥά
    ΄΅ϦΞϧλΠϜ ਺෼ؒλΠϜϥά͋Γ
    

    View Slide

55. w ϢʔβʔϓϩύςΟͷํ͕λΠϜϥά͕গͳ͘ϦΞϧλΠϜੑ͕͋Δͷ
    Ͱɺ3FNPUF$PO
    fi
    H΍"#5FTUJOHͷλʔήοτʹ͸Ϣʔβʔϓϩύ
    ςΟͷํ͕޲͍͍ͯΔ
    w ϢʔβʔΦʔσΟΤϯε͸͋Β͔͡Ίෳࡶͳ৚݅Ͱ࡞੒͓ͯ͘͠Ϣʔ
    βʔϦετͰλΠϜϥάׂ͕ͱ͋ΔͨΊɺϦΞϧλΠϜੑ͕ٻΊΒΕ
    Δ3FNPUF$PO
    fi
    Hʹ͸͋·Γ޲͍͍ͯͳ͍
    w 3FNPUF$PO
    fi
    HͰ࢖༻͢Δ৔߹͸ɺϢʔβʔϓϩύςΟͷΈͰ͸ࢦఆ
    ग़དྷͳ͍ෳࡶͳ৚͕݅ඞཁͳ৔߹ʹ࢖͏Α͏ʹͨ͠ํ͕ྑ͍
    ϢʔβʔϓϩύςΟWTϢʔβʔΦʔσΟΤϯε
    

    View Slide

56. ΧελϜΠϕϯτͷ࢖༻
    

    View Slide

57. w طଘͰૹ৴͍ͯ͠Δ"OBMZUJDTϩάͷύϥϝʔλ౳Λ৚݅ʹ࢖ͬͯɺ৽
    ͍͠ΠϕϯτϩάΛ࣮૷ແ͠Ͱग़ྗ͢Δࣄ͕ग़དྷΔ
    w "#5FTUJOHͷΞΫςΟ΂ʔγϣϯΠϕϯτ΍ΰʔϧઃఆʹ΋ઃఆՄ
    ೳ
    ΧελϜΠϕϯτ
    

    View Slide

58. w ৚݅ɿϓϥϯը໘Λදࣔͨ͠ࣄ͕͋Δ
    

    ˠϓϥϯը໘දࣔλΠϛϯάͰ"OBMZUJDTʹΠϕϯτϩάΛૹΔ
    ΧελϜΠϕϯτ
    

    View Slide

59. w ֤छը໘ͷදࣔλΠϛϯάͰɺQBSBNʹϖʔδ໊Λ͚ͭͯ"OBMZUJDT
    ʹΠϕϯτϩάΛૹΔ
    ΧελϜΠϕϯτ
    

    View Slide

60. ΧελϜΠϕϯτ
    

    View Slide

61. ΧελϜΠϕϯτ
    

    View Slide

62. View Slide

63. ΧελϜΠϕϯτ
    

    View Slide

64. ࡞੒ͨ͠ΧελϜΠϕϯτ͕"#
    5FTUJOHͰࢦఆग़དྷΔΑ͏ʹͳͬͨͷ
    Ͱ࣮૷ෆཁͰΠϕϯτϩάΛ࡞ΕΔ
    

    View Slide

65. ·ͱΊ
    

    View Slide

66. w 3FNPUF$PO
    fi
    H͸ϦΞϧλΠϜ൓ө΋؆୯ʹग़དྷΔΑ͏ʹͳͬͨ͏
    ͑ʹɺ৭ʑͳϢʔεέʔεͰར༻ग़དྷΔͷͰศརʂ
    

    w "#5FTUJOH͸αʔϏεͷ࠷దͳύϑΥʔϚϯεΛςετͯࣗ͠ಈͰ
    ෼ੳͯ͘͠ΕΔͷͰɺੵۃతʹಋೖ͢΂͖ʂ
    

    w ͜ΕΛແྉͰఏڙͯ͘͠ΕͯΔ'JSFCBTF͍ͬͯ͢͝ʂ
    ·ͱΊ
    

    View Slide