A/Bテスト機構がもたらす
大胆な開発体制及び
ゆるやかなアプリ体験の変化 / Architecture and benefits of AB-test allocation system.

Transcript

1. 1.

   "#ςετػߏ͕΋ͨΒ͢
 େ୾ͳ։ൃମ੍ٴͼ
 ΏΔ΍͔ͳΞϓϦମݧͷมԽ
   #POpSF
   "1*
   
   גࣜձࣾ(VOPTZ
   
   
   ৽نࣄۀ։ൃࣨΤϯδχΞ
 4FJKJ
   5BLBIBTIJ
   !@@UJNBLJO@@

2. 2.

   Seiji Takahashi 
 ͪ·͖Μ @__timakin__ • Career • DeNA •

   Platform Development • Serverside Engineering (Perl)
 • Translimit • Game Development: Craft Warrirors • Game Client Side (Cocos-2dx, C++)
 • Gunosy • Application Dev: LUCRA • Serverside Engineering (Go) • iOS Client Side (Swift) • Engieering • Language: Go (Contributed), Swift • Platform: GAE, AWS
3. 3.

   None
4. 4.

   ΞδΣϯμ w "#ςετͱ͸
   w ͲΜͳ"#Λ͢Δ͔
   w "#ج൫
   w "#͕։ൃମ੍ɾΞϓϦମݧʹ΋ͨΒ͢͜ͱ

5. 5.

   ΞδΣϯμ w "#ςετͱ͸
   w ͲΜͳ"#Λ͢Δ͔
   w "#ج൫
   w "#͕։ൃମ੍ɾΞϓϦମݧʹ΋ͨΒ͢͜ͱ

6. 6.

   "#ςετͱ͸ʁ ࢪࡦͷଥ౰ੑɺԾઆΛݕূ͢ΔͨΊʹɺ
 ϢʔβʔΛαϯϓϦϯάͯ͠ɺ
 6*ͳ͍͠σʔλͷมߋͳͲͷ
 ӨڹΛςετ͢Δ΍ͭ

7. 7.

   "#ςετͷ஫ҙ఺ ݁Ռʹରͯ͠ɺ૬ޓ࡞༻Λ࣋ͬͯ͠·͏Α͏ ͳςετ͸ಉ࣌ฒߦͰ૸Βͤͯ͸μϝ FY
   νϡʔτϦΞϧͷϑϩʔΛ௥Ճ͢ΔςετΛ͢Δͱ͖ʜ
   ؾʹͳΔΧςΰϦͷબ୒ͱɺ
 ϑΥϩʔ͍ͨ͠ഔମͷબ୒ͳͲΛಉ࣌ʹߦΘͤΔͱɺ
   લͷೖྗʹҾ͖ͣΒΕͯޙͷબ୒܏޲͕มΘͬͯ͠·͏ɻ
   

8. 8.

   "#ςετͷ஫ҙ఺ ࢪࡦҎ֎ͷཁҼʹΑͬͯ,1*͕
 ্Լ͍ͯ͠ͳ͍͔ ""ςετ Ϣʔβʔ฼਺͕গͳ͘ɺ਺ࣈ͕όϥ͖ͭқ͍࣌͸ɺ
   ςετҎ֎ͷཁҼʹΑͬͯ݁Ռ্͕Լ͢ΔՄೳੑ͕͋Δɻ
   ࣮ࡍʹػೳ͕ಋೖ͞ΕΔલʹɺର৅ϢʔβʔͷߦಈܭଌΛ
 ͓͍ͯͯ͠ɺςετҎ֎ͷཁҼͷӨڹ͕΄΅ͳ͍͜ͱΛ֬ೝ͢Δɻ
   

9. 9.

   ΞδΣϯμ w "#ςετͱ͸
   w ͲΜͳ"#Λ͢Δ͔
   w "#ج൫
   w "#͕։ൃମ੍ɾΞϓϦମݧʹ΋ͨΒ͢͜ͱ

10. 10.

    ࣮ࡍͷ"#ςετྫ w 1VTI഑৴ճ਺ௐ੔ςετ
    w σΠϦʔͷ1VTI഑৴ճ਺͸ͲΕ͘Β͍͕Ұ൪ܧଓ཰ʹޮ͍ ͯ͘Δͷ͔
    w dճͷϨϯδͰଧͪ෼͚

11. 11.

    ࣮ࡍͷ"#ςετྫ w ΧςΰϦ಺هࣄදࣔग़͠Θ͚
    w ৽نϢʔβʔ޲͚Φεεϝهࣄ
    w هࣄͷߋ৽೔࣌ͷ઱౓
    w ಛఆΧςΰϦͷهࣄΛଟΊʹΦεεϝʹදࣔ

12. 12.

    ࣮ࡍͷ"#ςετྫ w ݕࡧ݁Ռιʔτػೳ
    w ٻΊΔ৘ใΛΑΓಘ΍͘͢͢ΔιʔτػೳΛ࣮૷͢Δ͜ͱͰɺ ݕࡧ69ͷ޲্ɺͻ͍ͯ͸ܧଓ཰΍ଞߦಈΛଅਐ͢Δ͔
    w Φεεϝݹ͍৽͍͠ݕࡧϫʔυͱͷϚον౓߹͍ͳͲͰ ݕࡧ݁ՌΛιʔτՄೳʹ͢ΔόʔΛදࣔ
    w

    ֤બ୒ࢶͷબ୒཰ɺճ਺
13. 13.

    ΞδΣϯμ w "#ςετͱ͸
    w ͲΜͳ"#Λ͢Δ͔
    w "#ج൫
    w "#͕։ൃମ੍ɾΞϓϦମݧʹ΋ͨΒ͢͜ͱ

14. 14.

    "#ج൫ "#
    "1* NBJO
    "1* 6TFS
    %# "#
    %# ෼ੳج൫ ࣮ࢪج൫

15. 15.

    "#ׂΓ౰ͯ શମϢʔβʔ "MMPDBUJPO &YQFSJNFOU 7BSJBOU "MMPDBUJPO &YQFSJNFOU 7BSJBOU

16. 16.

    "#ׂΓ౰ͯ "MMPDBUJPO &YQFSJNFOU 7BSJBOU "MMPDBUJPO શମϢʔβʔͷதͰͷׂ౰཰ɻ
 "#ςετΛॏෳͳ࣮͘ࢪ͢Δͨ Ίͷάϧʔϐϯά৘ใɻ
    "MMPDBUJPO*%͕ಉҰͳΒɺ
 ͦΕʹॴଐ͢Δ"#ςετ͸


    ಉ࣌ʹ࣮ࢪ͢Δ͜ͱ͕Ͱ͖ͳ͍ɻ

17. 17.

    "#ׂΓ౰ͯ "MMPDBUJPO &YQFSJNFOU 7BSJBOU &YQFSJNFOU "#ςετͦͷ΋ͷɻ
 ྫ͑͹1VTI഑৴ճ਺"#Λ࣮ࢪ ͢ΔͳΒɺͦΕʹඥͮ͘Ұݸͷ &YQFSJNFOU͕࡞ΒΕΔɻ
    ଞͷ&YQFSJNFOUͱ


    ޡೝ͞Εͳ͍Α͏ʹɺ
 ϥϯμϜͳLFZ͕ৼΒΕΔɻ
    
18. 18.

    "#ׂΓ౰ͯ "MMPDBUJPO &YQFSJNFOU 7BSJBOU 7BSJBOU "#ςετέʔεɻ
    ྫ͑͹1VTI഑৴ճ਺"#Λ࣮ࢪ ͢ΔͳΒɺʮ̍ճʯʮ̎ճʯͳͲ ͷݸผέʔεΛද͢ɻ
    &YQFSJNFOU͕ϢχʔΫͰ͑͞

    ͋Ε͹ɺ໊લ͕ଞͷ7BSJBOUͱඃͬ ͯ΋໰୊ͳ͍ͷͰɺIVNBO SFBEBCMFͳLFZΛৼΔɻ

19. 19.

    w "MMPDBUF
    w Ϣʔβʔ*%ΛݩʹIBTIΛੜ੒͠ɺಉ͡άϧʔϓͷத͔ΒͲ ͷ"#ςετɺςετέʔεΛ࣮ࢪ͢Δ͔ܾΊΔɻ "#ׂΓ౰ͯ

20. 20.

    None
21. 21.

    ΞδΣϯμ w "#ςετͱ͸
    w ͲΜͳ"#Λ͢Δ͔
    w "#ج൫
    w "#͕։ൃମ੍ɾΞϓϦମݧʹ΋ͨΒ͢͜ͱ

22. 22.

    w ػೳಋೖΛେ୾ʹ͢Δ
    w ϢʔβʔӨڹ͕ඇৗʹେ͖͍ػೳΛϦϦʔε͢Δࡍɺ
 "#ج൫Λར༻͢Δ͜ͱͰɺ͘͝Ұ෦ͷݶఆ͞Εͨ
 Ϣʔβʔʹల։Ͱ͖Δ
    w ݁ՌɺϢʔβʔ΁ͷωΨςΟϒӨڹ͕খ͍͞ঢ়ଶͰ
 େ͖͍ػೳΛϦϦʔεͰ͖ɺϦϦʔε΁ͷ৺ཧোน͕Լ͕Δɻ "#͸։ൃମ੍ΛͲ͏ม͑Δ͔

23. 23.

    w ຊ౰ʹޮ͘ࢪࡦΛߟ͑ΔΑ͏ʹͳΔ
    w ҰݟPSҰฉ͢Δͱө͑Δػೳ΋ɺϦϦʔεͯ͠ޮՌଌఆͨ͠ Βɺ݁Ռతʹ,1*ʹωΨςΟϒʹޮ͍ͯ͠·͏͜ͱ΋ɻ
    w ௚઀໨ʹݟ͑ͳ͍ɺϓϩμΫτΛ࢖͏Ϣʔβʔͷϖϧιφ͕ ঃʑʹ໌֬ʹͳ͍ͬͯ͘ͱಉ࣌ʹɺࢪࡦͱͯ͠౰ͨΓқ͍΋ ͷ͕Կ͔Θ͔ΔΑ͏ʹͳͬͯ͘Δɻ "#͸։ൃମ੍ΛͲ͏ม͑Δ͔

24. 24.

    w ʮյΕͳ͍ΞϓϦʯ͕࢖͑Δ
    w "#ج൫Λར༻ͨ͠HSBDFGVMͳϦϦʔεϑϩʔʹΑͬͯɺ
 ΞϓϦ͕ಥ೗Ϋϥογϡ͢ΔΑ͏ͳػೳ͸ଈ࣌"#ׂΓ౰ͯ Λఀࢭ͢Δ͜ͱͰඇެ։ʹͰ͖Δɻ
    w ݁ՌɺϢʔβʔͱͯ͠͸໨ͷલͷΞϓϦ͕ΫϦςΟΧϧͳ
 ໰୊ʹΑͬͯ࢖͑ͳ͘ͳΔɺͱ͍ͬͨࣄଶ͕গͳ͘ͳΓɺ
 ҆৺ͯ͠ར༻Ͱ͖Δɻ

    "#͸ΞϓϦମݧΛͲ͏ม͑Δ͔
25. 25.

    w ʢશମ࠷దతʹʣೲಘ౓ͷߴ͍ػೳ͕࢖͑Δ
    w ͦ΋ͦ΋,1*ʹޮ͔ͳ͍ɺงғؾΛΑ͘͢Δͱ͍͏ر๬త؍ ଌʹج͍ͮͯػೳΛϦϦʔε͢Δ͜ͱ͕ͳ͍ɻ
    w ݁ՌɺϢʔβʔͷߦಈ͕ຊ౰ʹվળ͞ΕͨػೳɺΞϓϦΛ௕ ͘࢖͏্Ͱେࣄʹͳͬͯ͘Δػೳ͚ͩΛར༻Ͱ͖Δɻ "#͸ΞϓϦମݧΛͲ͏ม͑Δ͔

26. 26.

    ·ͱΊ w แؚɾഉଞͷؔ܎Λ໌֬ʹͨ͠ঢ়ଶͰ"#ςετΛ
 ߦ͏͜ͱ͸ɺ҆શͳϦϦʔεϑϩʔΛங্͘Ͱॏཁɻ
    w ͦ΋ͦ΋Ϣʔβʔମݧ͕վળ͠ͳ͍ػೳΛϦϦʔε͠ͳͯ͘ ࡁΉɻ։ൃऀͱϢʔβʔ૒ํ͕ϋοϐʔʹͳΕΔɻ

27. 27.

    ͋Γ͕ͱ͏͍͟͝·ͨ͠ʂ