Upgrade to Pro — share decks privately, control downloads, hide ads and more …

A/Bテスト機構がもたらす
大胆な開発体制及び
ゆるやかなアプリ体験の変化 / Architecture and benefits of AB-test allocation system.

A/Bテスト機構がもたらす
大胆な開発体制及び
ゆるやかなアプリ体験の変化 / Architecture and benefits of AB-test allocation system.

presentation @yahoo, Bonfire API#1.

5bfed9aa3a9ebccb0c0f0cb65ee9e012?s=128

Seiji Takahashi

February 01, 2018
Tweet

Transcript

  1. "#ςετػߏ͕΋ͨΒ͢
 େ୾ͳ։ൃମ੍ٴͼ
 ΏΔ΍͔ͳΞϓϦମݧͷมԽ #POpSF"1* גࣜձࣾ(VOPTZ ৽نࣄۀ։ൃࣨΤϯδχΞ
 4FJKJ5BLBIBTIJ !@@UJNBLJO@@

  2. Seiji Takahashi 
 ͪ·͖Μ @__timakin__ • Career • DeNA •

    Platform Development • Serverside Engineering (Perl)
 • Translimit • Game Development: Craft Warrirors • Game Client Side (Cocos-2dx, C++)
 • Gunosy • Application Dev: LUCRA • Serverside Engineering (Go) • iOS Client Side (Swift) • Engieering • Language: Go (Contributed), Swift • Platform: GAE, AWS
  3. None
  4. ΞδΣϯμ w "#ςετͱ͸ w ͲΜͳ"#Λ͢Δ͔ w "#ج൫ w "#͕։ൃମ੍ɾΞϓϦମݧʹ΋ͨΒ͢͜ͱ

  5. ΞδΣϯμ w "#ςετͱ͸ w ͲΜͳ"#Λ͢Δ͔ w "#ج൫ w "#͕։ൃମ੍ɾΞϓϦମݧʹ΋ͨΒ͢͜ͱ

  6. "#ςετͱ͸ʁ ࢪࡦͷଥ౰ੑɺԾઆΛݕূ͢ΔͨΊʹɺ
 ϢʔβʔΛαϯϓϦϯάͯ͠ɺ
 6*ͳ͍͠σʔλͷมߋͳͲͷ
 ӨڹΛςετ͢Δ΍ͭ

  7. "#ςετͷ஫ҙ఺ ݁Ռʹରͯ͠ɺ૬ޓ࡞༻Λ࣋ͬͯ͠·͏Α͏ ͳςετ͸ಉ࣌ฒߦͰ૸Βͤͯ͸μϝ FY νϡʔτϦΞϧͷϑϩʔΛ௥Ճ͢ΔςετΛ͢Δͱ͖ʜ ؾʹͳΔΧςΰϦͷબ୒ͱɺ
 ϑΥϩʔ͍ͨ͠ഔମͷબ୒ͳͲΛಉ࣌ʹߦΘͤΔͱɺ લͷೖྗʹҾ͖ͣΒΕͯޙͷબ୒܏޲͕มΘͬͯ͠·͏ɻ

  8. "#ςετͷ஫ҙ఺ ࢪࡦҎ֎ͷཁҼʹΑͬͯ,1*͕
 ্Լ͍ͯ͠ͳ͍͔ ""ςετ Ϣʔβʔ฼਺͕গͳ͘ɺ਺ࣈ͕όϥ͖ͭқ͍࣌͸ɺ ςετҎ֎ͷཁҼʹΑͬͯ݁Ռ্͕Լ͢ΔՄೳੑ͕͋Δɻ ࣮ࡍʹػೳ͕ಋೖ͞ΕΔલʹɺର৅ϢʔβʔͷߦಈܭଌΛ
 ͓͍ͯͯ͠ɺςετҎ֎ͷཁҼͷӨڹ͕΄΅ͳ͍͜ͱΛ֬ೝ͢Δɻ

  9. ΞδΣϯμ w "#ςετͱ͸ w ͲΜͳ"#Λ͢Δ͔ w "#ج൫ w "#͕։ൃମ੍ɾΞϓϦମݧʹ΋ͨΒ͢͜ͱ

  10. ࣮ࡍͷ"#ςετྫ w 1VTI഑৴ճ਺ௐ੔ςετ w σΠϦʔͷ1VTI഑৴ճ਺͸ͲΕ͘Β͍͕Ұ൪ܧଓ཰ʹޮ͍ ͯ͘Δͷ͔ w dճͷϨϯδͰଧͪ෼͚

  11. ࣮ࡍͷ"#ςετྫ w ΧςΰϦ಺هࣄදࣔग़͠Θ͚ w ৽نϢʔβʔ޲͚Φεεϝهࣄ w هࣄͷߋ৽೔࣌ͷ઱౓ w ಛఆΧςΰϦͷهࣄΛଟΊʹΦεεϝʹදࣔ

  12. ࣮ࡍͷ"#ςετྫ w ݕࡧ݁Ռιʔτػೳ w ٻΊΔ৘ใΛΑΓಘ΍͘͢͢ΔιʔτػೳΛ࣮૷͢Δ͜ͱͰɺ ݕࡧ69ͷ޲্ɺͻ͍ͯ͸ܧଓ཰΍ଞߦಈΛଅਐ͢Δ͔ w Φεεϝݹ͍৽͍͠ݕࡧϫʔυͱͷϚον౓߹͍ͳͲͰ ݕࡧ݁ՌΛιʔτՄೳʹ͢ΔόʔΛදࣔ w

    ֤બ୒ࢶͷબ୒཰ɺճ਺
  13. ΞδΣϯμ w "#ςετͱ͸ w ͲΜͳ"#Λ͢Δ͔ w "#ج൫ w "#͕։ൃମ੍ɾΞϓϦମݧʹ΋ͨΒ͢͜ͱ

  14. "#ج൫ "#"1* NBJO "1* 6TFS%# "#%# ෼ੳج൫ ࣮ࢪج൫

  15. "#ׂΓ౰ͯ શମϢʔβʔ "MMPDBUJPO &YQFSJNFOU 7BSJBOU "MMPDBUJPO &YQFSJNFOU 7BSJBOU

  16. "#ׂΓ౰ͯ "MMPDBUJPO &YQFSJNFOU 7BSJBOU "MMPDBUJPO શମϢʔβʔͷதͰͷׂ౰཰ɻ
 "#ςετΛॏෳͳ࣮͘ࢪ͢Δͨ Ίͷάϧʔϐϯά৘ใɻ "MMPDBUJPO*%͕ಉҰͳΒɺ
 ͦΕʹॴଐ͢Δ"#ςετ͸


    ಉ࣌ʹ࣮ࢪ͢Δ͜ͱ͕Ͱ͖ͳ͍ɻ

  17. "#ׂΓ౰ͯ "MMPDBUJPO &YQFSJNFOU 7BSJBOU &YQFSJNFOU "#ςετͦͷ΋ͷɻ
 ྫ͑͹1VTI഑৴ճ਺"#Λ࣮ࢪ ͢ΔͳΒɺͦΕʹඥͮ͘Ұݸͷ &YQFSJNFOU͕࡞ΒΕΔɻ ଞͷ&YQFSJNFOUͱ


    ޡೝ͞Εͳ͍Α͏ʹɺ
 ϥϯμϜͳLFZ͕ৼΒΕΔɻ
  18. "#ׂΓ౰ͯ "MMPDBUJPO &YQFSJNFOU 7BSJBOU 7BSJBOU "#ςετέʔεɻ ྫ͑͹1VTI഑৴ճ਺"#Λ࣮ࢪ ͢ΔͳΒɺʮ̍ճʯʮ̎ճʯͳͲ ͷݸผέʔεΛද͢ɻ &YQFSJNFOU͕ϢχʔΫͰ͑͞

    ͋Ε͹ɺ໊લ͕ଞͷ7BSJBOUͱඃͬ ͯ΋໰୊ͳ͍ͷͰɺIVNBO SFBEBCMFͳLFZΛৼΔɻ

  19. w "MMPDBUF w Ϣʔβʔ*%ΛݩʹIBTIΛੜ੒͠ɺಉ͡άϧʔϓͷத͔ΒͲ ͷ"#ςετɺςετέʔεΛ࣮ࢪ͢Δ͔ܾΊΔɻ "#ׂΓ౰ͯ

  20. None
  21. ΞδΣϯμ w "#ςετͱ͸ w ͲΜͳ"#Λ͢Δ͔ w "#ج൫ w "#͕։ൃମ੍ɾΞϓϦମݧʹ΋ͨΒ͢͜ͱ

  22. w ػೳಋೖΛେ୾ʹ͢Δ w ϢʔβʔӨڹ͕ඇৗʹେ͖͍ػೳΛϦϦʔε͢Δࡍɺ
 "#ج൫Λར༻͢Δ͜ͱͰɺ͘͝Ұ෦ͷݶఆ͞Εͨ
 Ϣʔβʔʹల։Ͱ͖Δ w ݁ՌɺϢʔβʔ΁ͷωΨςΟϒӨڹ͕খ͍͞ঢ়ଶͰ
 େ͖͍ػೳΛϦϦʔεͰ͖ɺϦϦʔε΁ͷ৺ཧোน͕Լ͕Δɻ "#͸։ൃମ੍ΛͲ͏ม͑Δ͔

  23. w ຊ౰ʹޮ͘ࢪࡦΛߟ͑ΔΑ͏ʹͳΔ w ҰݟPSҰฉ͢Δͱө͑Δػೳ΋ɺϦϦʔεͯ͠ޮՌଌఆͨ͠ Βɺ݁Ռతʹ,1*ʹωΨςΟϒʹޮ͍ͯ͠·͏͜ͱ΋ɻ w ௚઀໨ʹݟ͑ͳ͍ɺϓϩμΫτΛ࢖͏Ϣʔβʔͷϖϧιφ͕ ঃʑʹ໌֬ʹͳ͍ͬͯ͘ͱಉ࣌ʹɺࢪࡦͱͯ͠౰ͨΓқ͍΋ ͷ͕Կ͔Θ͔ΔΑ͏ʹͳͬͯ͘Δɻ "#͸։ൃମ੍ΛͲ͏ม͑Δ͔

  24. w ʮյΕͳ͍ΞϓϦʯ͕࢖͑Δ w "#ج൫Λར༻ͨ͠HSBDFGVMͳϦϦʔεϑϩʔʹΑͬͯɺ
 ΞϓϦ͕ಥ೗Ϋϥογϡ͢ΔΑ͏ͳػೳ͸ଈ࣌"#ׂΓ౰ͯ Λఀࢭ͢Δ͜ͱͰඇެ։ʹͰ͖Δɻ w ݁ՌɺϢʔβʔͱͯ͠͸໨ͷલͷΞϓϦ͕ΫϦςΟΧϧͳ
 ໰୊ʹΑͬͯ࢖͑ͳ͘ͳΔɺͱ͍ͬͨࣄଶ͕গͳ͘ͳΓɺ
 ҆৺ͯ͠ར༻Ͱ͖Δɻ

    "#͸ΞϓϦମݧΛͲ͏ม͑Δ͔
  25. w ʢશମ࠷దతʹʣೲಘ౓ͷߴ͍ػೳ͕࢖͑Δ w ͦ΋ͦ΋,1*ʹޮ͔ͳ͍ɺงғؾΛΑ͘͢Δͱ͍͏ر๬త؍ ଌʹج͍ͮͯػೳΛϦϦʔε͢Δ͜ͱ͕ͳ͍ɻ w ݁ՌɺϢʔβʔͷߦಈ͕ຊ౰ʹվળ͞ΕͨػೳɺΞϓϦΛ௕ ͘࢖͏্Ͱେࣄʹͳͬͯ͘Δػೳ͚ͩΛར༻Ͱ͖Δɻ "#͸ΞϓϦମݧΛͲ͏ม͑Δ͔

  26. ·ͱΊ w แؚɾഉଞͷؔ܎Λ໌֬ʹͨ͠ঢ়ଶͰ"#ςετΛ
 ߦ͏͜ͱ͸ɺ҆શͳϦϦʔεϑϩʔΛங্͘Ͱॏཁɻ w ͦ΋ͦ΋Ϣʔβʔମݧ͕վળ͠ͳ͍ػೳΛϦϦʔε͠ͳͯ͘ ࡁΉɻ։ൃऀͱϢʔβʔ૒ํ͕ϋοϐʔʹͳΕΔɻ

  27. ͋Γ͕ͱ͏͍͟͝·ͨ͠ʂ