Improves service using Firebase A_B Testing

47addc68d5b643d7ee875059b42404eb?s=47 Suguru Kishimoto
March 28, 2019
440

Improves service using Firebase A_B Testing

47addc68d5b643d7ee875059b42404eb?s=128

Suguru Kishimoto

March 28, 2019
Tweet

Transcript

  1. 2.

    Cookpad Inc. All Rights Reserved. ͓͠ͳ͕͖ w ࣗݾ঺հɺܞΘ͍ͬͯΔαʔϏε঺հ w 'JSFCBTF"#5FTUJOHʹ͍ͭͯ

    w ಋೖํ๏ w ςετͷ݁Ռ͕ͰͨΒ͢Δ͜ͱ w 'JSFCBTF"#5FTUJOHΛΑΓ׆༻͢ΔͨΊʹ w$MPVE'VODUJPOTͱͷ࿈ܞ w#JH2VFSZͱͷ࿈ܞ
  2. 4.

    Cookpad Inc. All Rights Reserved. ,PNFSDPͱ͸ ൢചऀ ΫϦΤΠλʔ ͞Μ͕࡞ͬͨྉཧಓ۩΍͏ͭΘɺௐຯྉ΍৯ࡐΛɺ ߪೖऀ

    ΧελϚʔ ͕ΞϓϦΛ௨ͯ͠ߪೖͰ͖ΔΞϓϦͰ͢ɻ
 ݱࡏɺJ04Ͱ̎ΞϓϦల։͍ͯ͠·͢ɻ ྉཧָ͕͘͠ͳΔϚϧγΣΞϓϦ !4
  3. 9.

    Cookpad Inc. All Rights Reserved. "#ςετͱ͸ w ओʹΠϯλʔωοτϚʔέςΟϯάͰߦΘΕΔɺࢪࡦ൑அͷͨΊͷࢼݧͷ૯শ wࢪࡦͷྑ൱Λ൑அ͢ΔͨΊʹɺͭͷࢪࡦಉ࢜Λൺֱݕ౼͢Δ͜ͱ wԿ͔͠Βͷج४Λ΋ͱʹɺίϯτϩʔϧάϧʔϓͱɺςετΛ͍ͤͨ͞άϧʔϓʹ෼͚ɺ

    ޙऀʹνϟϨϯδΛͤͯ݁͞ՌΛൺֱ͢Δ w৽͍͠΋ͷΛͭಉ࣌ʹνϟϨϯδͤͯ͞ൺֱ͢ΔɺΑΓ͸ɺطଘͱ৽͍͠΋ͷͱΛൺ΂Δ ͜ͱͷํ͕͓͓͍Ͱ͢ ˞ൃදޙमਖ਼͠·ͨ͠ 
 w ྫ  wʮ૘݈ඒ஡ʯ طଘ ͱʮ૘݈ඒ஡ɹεοΩϦϒϨϯυʯʢνϟϨϯδ  wΞϓϦͷԼλϒͷ਺Λͭ طଘ ͱͭʢνϟϨϯδ ग़యIUUQTKBXJLJQFEJBPSHXJLJ"#ςετ
  4. 11.

    Cookpad Inc. All Rights Reserved. ͲΜͳ΋ͷ͔ w 3FNPUF$POpHΛ׆༻ͯ͠ςετΛߦ͏͜ͱ͕Ͱ͖Δ wग़͠෼͚͢Δ஋ΛݩʹΞϓϦͷಈ࡞΍֎؍Λมߋ͠ɺॏࢹ͢Δࢦඪʹ࠷΋ߴ͍ޮՌΛൃ ش͢Δͷ͕Ͳͷύλʔϯ͔Λςετ͢Δ

    wݕূ݁Ռ͕ग़ͨޙɺΞϓϦͷΞοϓσʔτͳ͠ʹมߋΛ൓өͨ͠Γɺݩʹ໭ͨ͠Γ͕Մೳ w /PUJpDBUJPOTΛ࢖ͬͨςετΛߦ͏͜ͱ͕Ͱ͖Δ wΞϓϦ΁ͷϢʔβʔͷऔΓࠐΈʹ࠷΋ޮՌతͳจষ͸ͲΜͳ΋ͷ͔Λࢼ͢͜ͱ͕Ͱ͖Δ w ର৅Ϣʔβʔͷࢦఆ wΞϓϦɺόʔδϣϯɺϢʔβʔϓϩύςΟ΍ΦʔσΟΤϯεɺ1SFEJDUJPOTͰ༧ଌ͞ΕΔϢʔ βʔΛࢦఆ͢Δ͜ͱ͕Ͱ͖Δ
  5. 15.

    Cookpad Inc. All Rights Reserved. ϝϦοτ w 3FNPUF$POpHΛ׆༻ͯ͠ςετΛߦ͏͜ͱ͕Ͱ͖Δ wग़͠෼͚͢Δ஋ΛݩʹΞϓϦͷಈ࡞΍֎؍Λมߋ͠ɺॏࢹ͢Δࢦඪʹ࠷΋ߴ͍ޮՌΛൃش͢Δͷ͕Ͳͷύλʔϯ ͔Λςετ͢Δ

    wݕূ݁Ռ͕ग़ͨޙɺΞϓϦͷΞοϓσʔτͳ͠ʹมߋΛ൓өͨ͠Γɺݩʹ໭ͨ͠Γ͕Մೳ w /PUJpDBUJPOTΛ࢖ͬͨςετΛߦ͏͜ͱ͕Ͱ͖Δ wΞϓϦ΁ͷϢʔβʔͷऔΓࠐΈʹ࠷΋ޮՌతͳจষ͸ͲΜͳ΋ͷ͔Λࢼ͢͜ͱ͕Ͱ͖Δ w ര଎ͰςετΛ։࢝Ͱ͖Δ wίϯιʔϧͰઃఆ࣮ͯ͠ߦ͢Δ͚ͩͳͷͰσΟϨΫλʔͰ΋ૢ࡞ͯ͠ςετΛ։࢝͢Δ͜ͱ͕Ͱ͖Δ w ػೳ͕ఏڙ͞Εͨ౰ॳͱൺ΂ͯ Θ͔Γ΍͍͢6*ͳͷͰઃఆʹށ࿭͏͜ͱ΋গͳ͍ w ର৅Ϣʔβʔͷࢦఆ wΞϓϦɺόʔδϣϯɺϢʔβʔϓϩύςΟ΍ΦʔσΟΤϯεɺ1SFEJDUJPOTͰ༧ଌ͞ΕΔϢʔβʔΛࢦఆ͢Δ͜ͱ͕ Ͱ͖Δ
  6. 16.

    Cookpad Inc. All Rights Reserved. σϝϦοτ w ࣄલʹ४උ͍ͯ͠ͳ͍ͱ͍͖ͳΓಋೖ͸ݫ͍͠ wࣄલʹ"OBMZUJDTΠϕϯτ΍ϢʔβʔϓϩύςΟΛఆ͓͔ٛͯ͠ͳ͍ͱࡉ͔͍ग़͠෼͚΍ɺϝΠϯ ͱͳΔࢦඪΛࢦఆͰ͖ͳ͍ͷͰݕূͮ͠Β͍

    w "#Λ෼͚Δͱ͖ͷࡉ͔͍෼͚ํ΍ಠࣗϧʔϧΛෑ͘ͷ͕೉͍͠ wྫ͑͹ɺVTFS@JEͷԼҰܻͷ਺ࣈ͕ۮ਺ح਺ͱ͍ͬͨ෼͚ํΛ΍Δͷ͕೉͍͠ 'JSFCBTFͷVJEͰ΍ Δ৔߹͸ಛʹɻ 
 ֎෦%#ͷVTFS@JEͰ΍Δ৔߹͸ϢʔβʔϓϩύςΟͱ͔Ͱ͏·͘΍Δ͜ͱʹͳΓͦ͏ɻ w ݕূ฼਺͕গͳ͍ͱ'JSFCBTFͷ൑அʹ࣌ؒΛཁ͢Δ wࣗ෼ͨͪͰ෼ੳ͢Δͱ͖΋ಉ༷ͷ໰୊͕ൃੜ͢ΔͷͰݻ༗ͷ࿩Ͱ͸ͳ͍͕ɺ'JSFCBTFͷίϯιʔ ϧଆͰͲͪΒ͕༏ҐͰ͋Δ͔Λਪఆͯ͘͠ΕΔ΋ͷ͕ɺ฼਺͕গͳ͚Ε͹ͦͷ෼೔਺Λཁ͢Δ͜ ͱʹͳΔ
  7. 20.

    Cookpad Inc. All Rights Reserved. 4UFQλʔήοτઃఆ w λʔήοτͱͳΔର৅Ϣʔβʔɺׂ߹ΛܾΊΔ wΞϓϦɺϢʔβʔϓϩύςΟ౳ΛݩʹλʔήοτΛܾΊΔ wͦͷλʔήοτ಺ͷԿʹରͯ͠ςετΛ࣮ߦ͢Δ͔ΛܾΊΔɻͩͱɺλʔήοτϢʔβʔͰࢦఆͨ͠Ϣʔβʔ

    ͷ͏ͪɺͷϢʔβʔʹରͯ͠"#ςετࣗମΛ࣮ࢪͤ͞Δͱ͍͏͜ͱʹͳΔɻ w ΞΫςΟϕʔγϣϯΠϕϯτΛࢦఆ͢ΔͱɺλʔήοτϢʔβʔͷ͏ͪɺͦͷΠϕϯτΛൃՐͤͨ͞ϢʔβʔͷΈ" #ςετ͕༗ޮʹͳΔ
  8. 22.

    Cookpad Inc. All Rights Reserved. 4UFQ໨ඪ w ࢦඪΛܾΊΔ wςετΛ࣮ߦ͢Δʹ͋ͨͬͯҰ൪ஔ͍͍ͨࢦඪ Πϕϯτ

    Λઃఆ͢Δ wϝΠϯͱͳΔࢦඪͷ΄͔ɺ࠷େͭ·ͰଞͷࢦඪΛࢦఆͰ͖ΔɻσϑΥϧτͰϢʔβʔΤϯήʔδ ϝϯτɺఆணɺΫϥογϡϑϦʔϢʔβʔΛݟΔΑ͏ʹͳ͍ͬͯΔ
  9. 34.

    Cookpad Inc. All Rights Reserved. ৽͍͠ػೳ ঢ়ଶΛ൓ө͢Δ w ػೳΛ൓ө͢Δʹ͸ɺ࣮ߦத΋͘͠͸ςετΛఀࢭޙʹʮόϦΞϯτͷల։ʯΛબͿ w3FNPUF$POpHͷ৔߹͸൓ө͍ͤͨ͞όϦΞϯτͷ஋ΛબΜͰ3FNPUF$POpHΛߋ৽

    w/PUJpDBUJPOTͷ৔߹͸ɺ௨஌Λૹ৴͍ͯ͠ͳ͍Ϣʔβʔʹɺૹ৴͍ͨ͠όϦΞϯτͷ ϝοηʔδΛૹ৴͢Δ wެ։ޙ͸มߋ͕Ͱ͖ͳ͍ͷͰɺมߋͨ͘͠ͳͬͨΒҰ౓ςετΛఀࢭ͔ͯ͠Βෳ੡ ͯ͠ฤू͠࠶౓ެ։͢Δඞཁ͕͋Δ
  10. 42.

    Cookpad Inc. All Rights Reserved. ࣮ࡍʹ΍ͬͨ͜ͱ w ݱঢ়͕͢͞λϒ͔Βݕࡧػೳ͕࢖͑Δ͕ɺϗʔϜը໘্෦ʹݕࡧόʔΛஔ͍ͨ৔߹ʹͦ͜ ͔Βݕࡧ͢ΔϢʔβʔ͕૿Ճ͢Δ͔ɺ͔ͦ͜Βߪೖʹͭͳ͕Δ͔Ͳ͏͔Λଌఆ w3FNPUF$POpHͰݕࡧόʔΛग़͔͢ग़͞ͳ͍͔ͷCPPMΛ੾Γସ͑Δ͚ͩ

    wࢀߟࢦඪͱͳΔΠϕϯτϩά͸ࣄલʹ࢓ࠐΜͰ͓͘ wग़͠෼͚ΔػೳΛ͍Εͨ΋ͷΛ"QQ4UPSFʹਃ੥͠ɺެ։ͨ͠ஈ֊ͰςετΛ։࢝ wग़͠෼͚Δػೳ͕ೖͬͨόʔδϣϯҎ߱ͷϢʔβʔʹͷΈదԠ͞ΕΔΑ͏ʹλʔήοτ Λߜͬͨ w ςετΛ࣮ߦͨ݁͠Ռɺݕࡧόʔ͋Γͳ͠Λൺֱͯ͠ϝΠϯͱͳΔࢦඪʹରͯ͠ͲͪΒ͔ ͕༏Ґʹͳͬͨͱ͸ݴ͑ͳ͍݁ՌʹͳͬͨͷͰɺҰ୴ςετΛఀࢭ͠ɺݪঢ়෮ؼͤͨ͞ɻ
 ࣍ͷҰखΛݕ౼த
  11. 47.

    Cookpad Inc. All Rights Reserved. ྲྀΕ w 3FNPUF$POpHͷ஋Λมߋ͠ɺ൓ө͢Δ w $MPVE'VODUJPOTͷ3FNPUF$POpHΠϕϯττϦΨʔΛ࢖ͬͯɺ୺຤ʹαΠϨϯτ௨஌

    ΛૹΔ w௨஌Λड͚औͬͨΒ࣍ճͷΞϓϦىಈ͔࣌ΞϓϦ͕ΞΫςΟϒͳΒऔಘ͠ʹ͍͘ w ࠷৽ͷ৘ใΛऔಘ͠ʹߦ͘ w͜ͷͱ͖͸Ωϟογϡ࣌ؒΛҰ࣌తʹແࢹͯ͠औಘ͠ʹ͍͘ wऔಘ͕ऴΘͬͨΒ6*౳ʹ൓өͤ͞Δ
  12. 58.