Firebase A/B TestingとRemote Config を最大限に活用する方法

by mukky620

Slide 1

Slide 1 text

$"BBC   גࣜձࣾλοϓϧ ޲த໺࿱ 'JSFCBTF"#5FTUJOHͱ3FNPUF$POGJH   Λ࠷େݶʹ׆༻͢Δํ๏

Slide 2

Slide 2 text

ΠϯτϩμΫγϣϯ 3FNPUF$PO fi Hʹ͍ͭͯ 'JSFCBTF"#5FTUJOHʹ͍ͭͯ 5JQT ·ͱΊ ໨࣍

Slide 3

Slide 3 text

ΠϯτϩμΫγϣϯ

Slide 4

Slide 4 text

w ޲த໺࿱Ή͖ͬʔ w "OESPJEΤϯδχΞ w 'JSFCBTF޷͖͓͡͞Μ w ޷͖ͳ'JSFCBTFαʔϏε w 3FNPUF$PO fi H ࣗݾ঺հ

Slide 5

Slide 5 text

3FNPUF$PO fi Hͱ   "#5FTUJOHͷλοϓϧͷࣄྫ΍   5JQTΛڞ༗ͯ͠ɺ   ศར͔΋ͬͯࢥͬͯ΋Β͑Ε͹͏Ε͍͠ ࠓ೔ͷςʔϚ

Slide 6

Slide 6 text

'JSFCBTF"#5FTUJOHͱ3FNPUF$POGJH

Slide 7

Slide 7 text

3FNPUF$POGJHʹ͍ͭͯ

Slide 8

Slide 8 text

w ΞϓϦͷಛఆͷಈ࡞΍σβΠϯΛϦϞʔτ͔Β੍ޚ͢Δࣄ͕Ͱ͖Δ w ύϥϝʔλ͸,FZ7BMVFํࣜͰ؅ཧ͢Δ w ,FZ͸จࣈྻɺ7BMVF͸จࣈྻɺ਺஋ɺCPPM஋ɺ+40/ w ಛఆͷϢʔβʔάϧʔϓʹରͯ͠ҟͳΔύϥϝʔλ஋ΛఏڙͰ͖Δ w ΞϓϦόʔδϣϯɺσόΠεݴޠɺϢʔβʔϓϩύςΟ౳ʑʜ w ϦΞϧλΠϜߋ৽͕Մೳ w ࢖༻ྫͱͯ͠ɺ'FBUVSF'MBHɺ6*มߋɺ஍Ҭผͷίϯςϯπͷදࣔɺ ϝϯςφϯεϞʔυɺ"#ςετ౳ʑʜ 3FNPUF$POGJHͱ͸

Slide 9

Slide 9 text

λοϓϧͰͷ׆༻

Slide 10

Slide 10 text

ϦΞϧλΠϜߋ৽ॲཧ

Slide 11

Slide 11 text

w 'JSFCBTF#P.Wʙʢ3FNPUF$PO fi HWʙʣ଴๬ͷϦΞ ϧλΠϜߋ৽Ϧεφʔ͕௥Ճ🎉 w 'JSFCBTF#P.Wʙʢ3FNPUF$PO fi HWʙʣ͸'MPX൛ ͷ"1*΋௥Ճ🎉 w ্ه͕ϦϦʔε͞ΕΔ·Ͱ͸ɺެࣜEPDʹ͋Δ$MPVE'VODUJPOTͱ '$.Λ࢖ͬͨํ๏ͰϦΞϧλΠϜػߏΛ࣮ݱ͍ͯͨ͠ w 3FNPUF$PO fi Hߋ৽τϦΨʔͰαΠϨϯτ1VTIΛଧͭ͜ͱͰ૝ఆ֎ ʹ4FSWFS"1*Λίʔϧͯ͠͠·͍ෛՙߴಅ͢Δ౳ɺएׯ໰୊͕͋ͬͨ ϦΞϧλΠϜߋ৽ॲཧ

Slide 12

Slide 12 text

ϦΞϧλΠϜߋ৽ॲཧ -JTUFOFS൛

Slide 13

Slide 13 text

ϦΞϧλΠϜߋ৽ॲཧ 'MPX൛

Slide 14

Slide 14 text

ϦΞϧλΠϜߋ৽ॲཧ ΞϓϦͷঢ়ଶ ϦΞϧλΠϜߋ৽௨஌ 'PSFHSPVOE ⚪︎ #BDLHSPVOE ⚪︎ 1SPDFTT,JMM º 1SPDFTT,JMM͔Β෮ؼ   ˞,JMMதʹ3FNPUF$PO fi Hͷߋ৽͕͋ͬͨ৔߹ ˚   ˞-JTUFOFSొ࿥λΠϛϯά

Slide 15

Slide 15 text

'FBUVSF'MBH

Slide 16

Slide 16 text

w ৽ػೳ౳ͷϦϦʔε࣌ʹݩખͱͳΔCPPM஋ͷϑϥάΛ༻ҙͯ͠ػೳͷ ༗ޮແޮΛߦ͑ΔΑ͏ʹͯ͠ϦϦʔε͢Δɻ w ৽ػೳͷӨڹΛ੍ޚ͠ͳ͕ΒϦϦʔεग़དྷΔࣄͰɺෆ۩߹ݕ஌࣌ʹແ ޮʹͨ͠ΓɺϕετͳλΠϛϯάͰ༗ޮʹͨ͠Γग़དྷΔɻ w 3FNPUF$PO fi Hͷػೳʹ৐ΔࣄͰηάϝϯτͰͷग़͠Θ͚΋Մೳͱͳ Δɻ 'FBUVSF'MBH

Slide 17

Slide 17 text

ྫ͑͹ɺ   ϏσΦ௨࿩ػೳΛ'FBUVSF'MBH   Λ࢖ͬͯϦϦʔε

Slide 18

Slide 18 text

'FBUVSF'MBH

Slide 19

Slide 19 text

'FBUVSF'MBH

Slide 20

Slide 20 text

ΧφϦΞϦϦʔε

Slide 21

Slide 21 text

w ৽ػೳ౳ΛશϢʔβʔʹ͙͢ʹϦϦʔε͢ΔͷͰ͸ͳ͘ɺ·ͣ͸Ұ෦ ͷϢʔβʔ͚ͩʹఏڙग़དྷΔɻ w ໰୊΍ෆ۩߹͕ͳ͍͜ͱΛ֬ೝ্ͨ͠Ͱɺஈ֊తʹશϢʔβʔʹϦ Ϧʔε͍ͯ͘͠ɻ w ྫ͑͹ɺˠˠˠ ΧφϦΞϦϦʔε

Slide 22

Slide 22 text

ྫ͑͹ɺ   ϚΠϖʔδͷ"1*ΛΧφϦΞϦϦʔε   Ͱ#''"1*ʹ੾Γସ͑Δ

Slide 23

Slide 23 text

ΧφϦΞϦϦʔε

Slide 24

Slide 24 text

ΧφϦΞϦϦʔε

Slide 25

Slide 25 text

ΧφϦΞϦϦʔε

Slide 26

Slide 26 text

ଞʹ΋   ϝϯςφϯεϞʔυ Ϛελʔσʔλ +40/ͳͲͰ؅ཧͯ͠׆༻͍ͯ͠Δ

Slide 27

Slide 27 text

'JSFCBTF"#5FTUJOHʹ͍ͭͯ

Slide 28

Slide 28 text

w ΞϓϦͷҟͳΔ6*ɺػೳɺΤϯήʔδϝϯτ౳ʹର͢ΔมߋΛςετ͠ ൺֱ͠ɺ࠷΋ύϑΥʔϚϯε͕ྑ͍ઃఆΛಛఆ͢Δ w (PPHMFΦϓςΟϚΠζͷػೳΛ׆༻͍ͯͯ͠ɺϕΠζਪఆΛ׆༻͍ͯ͠ Δ w ϕΠζਪఆʜطଘͷσʔλΛ࢖ͬͯɺࠓޙͷσʔλ͕Ͳ͏ͳΔ͔ΑΓ ਖ਼֬ʹਪଌ͢Δख๏ w "OBMZUJDTɺ3FNPUF$PO fi Hɺ'$.ɺJO"QQ.FTTBHJOH౳ͱ࿈ܞ w ςετͷ໨ඪɺର৅ͷϢʔβʔάϧʔϓɺ֤όϦΞϯτʹ͍ͭͯઃఆ͢Δ w ςετͷ݁Ռ͸ࣗಈతʹ෼ੳͯ͘͠ΕΔ 'JSFCBTF"#5FTUJOHͱ͸

Slide 29

Slide 29 text

'JSFCBTF"#5FTUJOHͱ͸

Slide 30

Slide 30 text

λοϓϧͰͷ"#ࣄྫ

Slide 31

Slide 31 text

αϒεΫϦϓγϣϯొ࿥ૌٻ   σβΠϯΛ"#ςετ͠ɺ   αϒεΫϦϓγϣϯ཰Λ૿Ճ

Slide 32

Slide 32 text

αϒεΫϦϓγϣϯૌٻ"#ςετ

Slide 33

Slide 33 text

No content

Slide 34

Slide 34 text

'JSFCBTFͷެࣜʹέʔεελσΟͱͯ͠঺հ͞ΕΔ   IUUQT fi SFCBTFHPPHMFDPNDBTFTUVEJFTUBQQMF αϒεΫϦϓγϣϯૌٻ"#ςετ

Slide 35

Slide 35 text

ৄࡉͳઃఆʹ͍ͭͯ͸ࣾ֎ൿͳ෦෼   ΋͋ΔͨΊׂѪͱͳΓ·͢ʜ

Slide 36

Slide 36 text

αϯϓϧ"#ςετ     Χʔυ6*Λطଘͷ࢛֯ܗɺԁܗɺࡾ֯ ܗʹมߋͯ͠ɺϑϦοΫͯ͘͠ΕΔ͔ "#ςετ͢Δ

Slide 37

Slide 37 text

৚݅ɿஉੑϢʔβʔ   ৚݅ɿόʔδϣϯίʔυҎ্ ৚݅ɿϓϥϯը໘Λදࣔͨ͠ࣄ͕͋Δ   ΰʔϧɿΧʔυϑϦοΫ͢Δ

Slide 38

Slide 38 text

w ΧʔυͷܗΛطଘɺԁܗɺࡾ֯ܗ   ˠ3FNPUF$PO fi HʹΧʔυͷܗมߋ༻ͷDBSE@UZQFύϥϝʔλΛ࡞੒ w ৚݅ɿஉੑϢʔβʔ   ˠ"OBMZUJDTͷ6TFS1SPQFSUZʹϢʔβʔͷੑผΛηοτͯ͠3FNPUF $PO fi HͰઃఆग़དྷΔΑ͏ʹ͢Δ w ৚݅ɿόʔδϣϯίʔυҎ্   ˠಛʹ࣮૷ෆཁ w ৚݅ɿϓϥϯը໘Λදࣔͨ͠ࣄ͕͋Δ   ˠϓϥϯը໘දࣔλΠϛϯάͰ"OBMZUJDTʹΠϕϯτϩάΛૹΔ w ΰʔϧɿΧʔυϑϦοΫ͢Δ   ˠΧʔυϑϦοΫͨ͠λΠϛϯάͰ"OBMZUJDTʹΠϕϯτϩάΛૹΔ αϯϓϧ"#ςετ

Slide 39

Slide 39 text

w ΧʔυͷܗΛطଘɺԁܗɺࡾ֯ܗ   ˠ3FNPUF$PO fi HʹΧʔυͷܗมߋ༻ͷύϥϝʔλΛ࡞੒   ˠ,FZΛDBSE@UZQFɺWBMVFΛTRVBSFɺDJSDMFɺUSJBOHMFͰ࡞੒ αϯϓϧ"#ςετ

Slide 40

Slide 40 text

w ৚݅ɿஉੑϢʔβʔ   ˠ"OBMZUJDTͷ6TFS1SPQFSUZʹϢʔβʔͷੑผΛηοτͯ͠3FNPUF $PO fi HͰઃఆग़དྷΔΑ͏ʹ͢Δ αϯϓϧ"#ςετ

Slide 41

Slide 41 text

w ৚݅ɿϓϥϯը໘Λදࣔͨ͠ࣄ͕͋Δ   ˠϓϥϯը໘දࣔλΠϛϯάͰ"OBMZUJDTʹΠϕϯτϩάΛૹΔ w ΰʔϧɿΧʔυϑϦοΫ͢Δ   ˠΧʔυϑϦοΫͨ͠λΠϛϯάͰ"OBMZUJDTʹΠϕϯτϩάΛૹΔ αϯϓϧ"#ςετ

Slide 42

Slide 42 text

࣮૷͸׬ྃͨ͠ͷͰ   ଓ͍ͯ"#ςετઃఆ

Slide 43

Slide 43 text

No content

Slide 44

Slide 44 text

ର৅ͷύοέʔδ໊

Slide 45

Slide 45 text

No content

Slide 46

Slide 46 text

No content

Slide 47

Slide 47 text

No content

Slide 48

Slide 48 text

͋ͱ͸िؒ΄Ͳ   ෼ੳ݁Ռग़Δ·Ͱ଴͚ͭͩ

Slide 49

Slide 49 text

5JQT

Slide 50

Slide 50 text

ϢʔβʔϓϩύςΟ໊ͷ   ໋໊ʹ஫ҙ͢Δ

Slide 51

Slide 51 text

w ࣄલʹఆٛ͞Ε͍ͯΔϢʔβʔϓϩύςΟ໊͕͋ΔͷͰɺͦ͜ͱ͸ඃΒͳ ͍Α͏ʹ͢Δ   IUUQTTVQQPSUHPPHMFDPN fi SFCBTFBOTXFS IMFOWJTJU@JE SE w λοϓϧͰ͸ඃΔ΋ͷ͸ઐ༻QSF fi YΛ͚͍ͭͯΔʢUBQQMF@BHFͱ͔ʣ w fi SFCBTF@ɺHPPHMF@ɺHB@ͷQSF fi Y͸࢖͑ͳ͍ w ϢʔβʔϓϩύςΟ໊͸จࣈɺϢʔβʔϓϩύςΟ஋͸จࣈ·Ͱ   ·ͨɺӳ਺ࣈͱΞϯμʔείΞͷΈΛؚΊΔ͜ͱ͕Ͱ͖ɺӳࣈͰ࢝ΊΔඞ ཁ͕͋Γ ϢʔβʔϓϩύςΟ໊

Slide 52

Slide 52 text

λʔήοτ৚݅ઃఆ͸   ϢʔβʔϓϩύςΟͱ   ϢʔβʔΦʔσΟΤϯεͷͦΕͧΕͷ   ಛੑʹ߹Θͤͯࢦఆ͢Δ

Slide 53

Slide 53 text

No content

Slide 54

Slide 54 text

ϢʔβʔϓϩύςΟWTϢʔβʔΦʔσΟΤϯε ϢʔβʔϓϩύςΟ ϢʔβʔΦʔσΟΤϯε ઃఆɾ࡞੒ͷ࢓ํ ίʔυʹͯ TFU6TFS1SPQFSUZ ίϯιʔϧͷ"VEJFODFT͔ ΒϢʔβʔϦετ࡞੒ ઃఆɾ࡞੒ޙίϯιʔϧʹ ൓ө͞ΕΔ·Ͱͷ࣌ؒ ࣮૷ϦϦʔεޙଈ࣌൓ө ϢʔβʔϦετ࡞੒ޙ   ਺࣌ؒͷλΠϜϥά͋Γ ઃఆ৚݅ͷ಺༰ ίʔυͰTFU6TFS1SPQFSUZ ʹηοτͨ͠஋ͷΈ ෳࡶͳ৚݅Λ૊Έ߹Θͤͯ ࡞੒ग़དྷΔ λʔήοτ৚͕݅มΘͬͨ ৔߹ͷλΠϜϥά ΄΅ϦΞϧλΠϜ ਺෼ؒλΠϜϥά͋Γ

Slide 55

Slide 55 text

w ϢʔβʔϓϩύςΟͷํ͕λΠϜϥά͕গͳ͘ϦΞϧλΠϜੑ͕͋Δͷ Ͱɺ3FNPUF$PO fi H΍"#5FTUJOHͷλʔήοτʹ͸Ϣʔβʔϓϩύ ςΟͷํ͕޲͍͍ͯΔ w ϢʔβʔΦʔσΟΤϯε͸͋Β͔͡Ίෳࡶͳ৚݅Ͱ࡞੒͓ͯ͘͠Ϣʔ βʔϦετͰλΠϜϥάׂ͕ͱ͋ΔͨΊɺϦΞϧλΠϜੑ͕ٻΊΒΕ Δ3FNPUF$PO fi Hʹ͸͋·Γ޲͍͍ͯͳ͍ w 3FNPUF$PO fi HͰ࢖༻͢Δ৔߹͸ɺϢʔβʔϓϩύςΟͷΈͰ͸ࢦఆ ग़དྷͳ͍ෳࡶͳ৚͕݅ඞཁͳ৔߹ʹ࢖͏Α͏ʹͨ͠ํ͕ྑ͍ ϢʔβʔϓϩύςΟWTϢʔβʔΦʔσΟΤϯε

Slide 56

Slide 56 text

ΧελϜΠϕϯτͷ࢖༻

Slide 57

Slide 57 text

w طଘͰૹ৴͍ͯ͠Δ"OBMZUJDTϩάͷύϥϝʔλ౳Λ৚݅ʹ࢖ͬͯɺ৽ ͍͠ΠϕϯτϩάΛ࣮૷ແ͠Ͱग़ྗ͢Δࣄ͕ग़དྷΔ w "#5FTUJOHͷΞΫςΟ΂ʔγϣϯΠϕϯτ΍ΰʔϧઃఆʹ΋ઃఆՄ ೳ ΧελϜΠϕϯτ

Slide 58

Slide 58 text

w ৚݅ɿϓϥϯը໘Λදࣔͨ͠ࣄ͕͋Δ   ˠϓϥϯը໘දࣔλΠϛϯάͰ"OBMZUJDTʹΠϕϯτϩάΛૹΔ ΧελϜΠϕϯτ

Slide 59

Slide 59 text

w ֤छը໘ͷදࣔλΠϛϯάͰɺQBSBNʹϖʔδ໊Λ͚ͭͯ"OBMZUJDT ʹΠϕϯτϩάΛૹΔ ΧελϜΠϕϯτ

Slide 60

Slide 60 text

ΧελϜΠϕϯτ

Slide 61

Slide 61 text

ΧελϜΠϕϯτ

Slide 62

Slide 62 text

No content

Slide 63

Slide 63 text

ΧελϜΠϕϯτ

Slide 64

Slide 64 text

࡞੒ͨ͠ΧελϜΠϕϯτ͕"# 5FTUJOHͰࢦఆग़དྷΔΑ͏ʹͳͬͨͷ Ͱ࣮૷ෆཁͰΠϕϯτϩάΛ࡞ΕΔ

Slide 65

Slide 65 text

·ͱΊ

Slide 66

Slide 66 text

w 3FNPUF$PO fi H͸ϦΞϧλΠϜ൓ө΋؆୯ʹग़དྷΔΑ͏ʹͳͬͨ͏ ͑ʹɺ৭ʑͳϢʔεέʔεͰར༻ग़དྷΔͷͰศརʂ   w "#5FTUJOH͸αʔϏεͷ࠷దͳύϑΥʔϚϯεΛςετͯࣗ͠ಈͰ ෼ੳͯ͘͠ΕΔͷͰɺੵۃతʹಋೖ͢΂͖ʂ   w ͜ΕΛແྉͰఏڙͯ͘͠ΕͯΔ'JSFCBTF͍ͬͯ͢͝ʂ ·ͱΊ