AB Tests in Mobile App

iOSDC Japan 2016 発表資料

Transcript

1. kazunori kikuchi / GMO PEPABO inc. 2016.08.19 iOSDC AB Tests in Mobile App
2. J04ΤϯδχΞ kazunori kikuchi @kichikuchi NJOOFࣄۀ෦ϓϩμΫτνʔϜ
3. ࠃ಺࠷େڃͷϋϯυϝΠυϚʔέοτ NJOOF
4. ࠃ಺࠷େڃͷϋϯυϝΠυϚʔέοτ NJOOF
5. ࠓ೔࿩͢ίτ 
   Ͳ͏΍ͬͯ"#ςετΛಋೖ͍ͯ͠Δ͔
   
   "#ςετΛ΍ͬͯྑ͔ͬͨίτ
   
   "#ςετΛ΍ͬͯࠔͬͨίτ
6. Ͳ͏΍ͬͯ"#ςετΛಋೖͯ͠ ͍Δ͔
7. SkyLab + Google Analytics
8. SkyLab
9. SkyLab.splitTestWithName("iosdc", conditions: [ "ios" : 0.5 , "dc" : 0.5 ]) { (condition) -> Void in if condition as! String == "ios" { self.sendGA(category: "iosdc", action: "ios", value: nil) } else { self.sendGA(category: "iosdc", action: "dc", value: nil) } } ࢖͍ํ
10. SkyLab.splitTestWithName("iosdc", conditions: [ "ios" : 0.5 , "dc" : 0.5 ]) { (condition) -> Void in if condition as! String == "ios" { self.sendGA(category: "iosdc", action: "ios", value: nil) } else { self.sendGA(category: "iosdc", action: "dc", value: nil) } } ςετͷ໊લ ࢖͍ํ
11. SkyLab.splitTestWithName("iosdc", conditions: [ "ios" : 0.5 , "dc" : 0.5 ]) { (condition) -> Void in if condition as! String == "ios" { self.sendGA(category: "iosdc", action: "ios", value: nil) } else { self.sendGA(category: "iosdc", action: "dc", value: nil) } } ෼ذύλʔϯͱ֬཰ ࢖͍ํ
12. SkyLab.splitTestWithName("iosdc", conditions: [ "ios" : 0.5 , "dc" : 0.5 ]) { (condition) -> Void in if condition as! String == "ios" { self.sendGA(category: "iosdc", action: "ios", value: nil) } else { self.sendGA(category: "iosdc", action: "dc", value: nil) } } ෼ذύλʔϯͱॲཧ ࢖͍ํ
13. SkyLab.splitTestWithName("iosdc", conditions: [ "ios" : 0.5 , "dc" : 0.5 ]) { (condition) -> Void in if condition as! String == "ios" { self.sendGA(category: "iosdc", action: "ios", value: nil) } else { self.sendGA(category: "iosdc", action: "dc", value: nil) } } ςετͷ໊લ ෼ذύλʔϯ໊ ࢖͍ํ
14. ಋೖͱܭଌɾݕূ w "#ςετͷಋೖ
    w 4LZ-BCΛར༻
    w ςετͷೖΕସ͑͸ϦϦʔεຖ
    w ςετ໊ͱ෼ذύλʔϯ͸QMJTUͰ؅ཧ
    w "#ςετͷܭଌɾݕূ
    w (PPHMF
    "OBMZUJDTΛར༻
    w ΧελϜηάϝϯτͰ෼ੳ
15. "#ςετΛ΍ͬͯྑ͔ͬͨίτ
    ☺
16. ݁Ռ͕਺ࣈͰݟ͑Δ w ձһొ࿥ϑϩʔͷมߋͰ਺ొ࿥཰্͕ঢ☺
    w Χʔτ౤ೖޙͷը໘ϑϩʔΛύλʔϯࢼ͠࠷ྑѱͰߪೖ ཰ʹ਺ͷ։͖͕͋ͬͨ
    w ͱ͋ΔλΠϜϥΠϯͰചΓ੾Ε࡞඼΋දࣔ͢ΔΑ͏ʹͨ͠ ͱ͜Ζ෮ؼ཰͕਺ݮগ
17. վળ͸ಋೖ͠ɺվѱ͸Өڹൣғ Λ࠷খݶʹͱͲΊΒΕΔʂ
18. Կ͕վળʹͭͳ͕Δ͔͕Θ͔ͬͯ͘Δ w 6*ύʔπͷαΠζมߋ 
    
    QY ͸Өڹখ
    w ৘ใઃܭͷมߋ ࡏݿ੾Εදࣔඇදࣔ ͸Өڹத
    w ϑϩʔͷมߋ ը໘
    
    ը໘ ͸Өڹେ
19. Ͳ͏͍ͬͨมߋ͕ΞϓϦΛΑ͘ ͢Δ͔ߟ͑ΔνʔϜશମͷྗ͕ 61
    
20. "#ςετΛ΍ͬͯࠔͬͨίτ
    
21. ςετͷઃܭ͕೉͍͠ w ͦ΋ͦ΋Ͳͷ਺ࣈΛݟͨΒ͍͍ʁ
    w ͜ͷมߋ͸ߪೖ཰ʹӨڹ͕ग़Δ͸ͣʂʂͱͳΓ͕ͪͩͬͨ
    w ಉ͡਺ࣈΛࢦඪͱ͢Δςετ͕ෳ਺ೖΔͱݕূύλʔϯ ͕Ұؾʹ૿͑Δ
22. ςετͷݕূ͕େม w ςετΛճ͠ଓ͚ΔͨΊʹ͸ϑϩʔͷཱ͕֬ඞཁ
    w ݕূʹઐ೦Ͱ͖Δਓͷ֬อ
    w ฐࣾͰ͸ΤϯδχΞ͕("৮ͬͯ·͢ʂ
    w ͨͩΤϯδχΞ΋ৗʹख͕ۭ͍ͯΔΘ͚Ͱ͸ͳ͍ɻɻɻ
23. ࣮૷ίετ΍ίʔυͷՄಡੑ w 6*Λେ͖͘มߋ͢Δ৔߹͸޻਺͕ॏΊʹͳΔ͜ͱ΋
    w ςετऴྃ࣌ʹ֘౰ՕॴΛ֎͢࡞ۀ΋͋Δʂ
    w ࠓͷॴେ͖ͳࣦഊ͸ͳ͍͕ݹ͍ςετ͕࢒͍ͬͯͨ͜ͱ ͕
    w ςετͷͨΊͷ෼ذ͕૿͑ͯίʔυ͕ಡΈͮΒ͘ͳΔ
    w Ұ࣌తͳίʔυͳͷͰଥڠ͕ͪ͠ ίϐϖରԠͳͲ
24. ϦϦʔεલݕূ͕େม w "#ςετ։࢝౰ॳ͸ΞϓϦ࡟আ
    
    ࠶Πϯετʔϧ͠ͳ͍ ͱςετύλʔϯ͕มΘΒͳ͔ͬͨ
    w ϦϦʔε௚લʹϓϩϞʔγϣϯίʔυΛൃߦͯ͠ߦ͏ݕ ূͰ࠷େݸൃߦͨ͜͠ͱ͕͋Γ·͢
    w ݱࡏ͸˓˓˓ίϚϯυతͳ΋ͷͰΞϓϦΛ࡟আͤͣʹς ετύλʔϯΛมߋͰ͖ΔΑ͏ʹͯ͠ղফʂ
    w ಛఆͷςετέʔε ಛఆͷ04Ͱ͚ͩى͜Δόά͕͋ͬͨ
25. ࠔͬͨ͜ͱͷ෼ྔ͕ଟ͘ͳͬͯ͠ ·͍·͕ͨ͠ɻɻɻ
26. ಋೖͯ͠ྑ͔ͬͨ"#ςετʂʂ
27. ࣗ෼ͨͪͷߦͬͨػೳ௥Ճɾม ߋʹͲΕ͚ͩͷΠϯύΫτ͕͋ͬ ͔ͨΛ஌ΕΔ
28. ࣗ෼͕ͨͪ͜Ε͸͍͍ΞΠσΞͩʂ ͱࢥ͍ͬͯͨ͜ͱ͕࣮͸Ϣʔβʹ ͱͬͯෆརӹͩͬͨͱ͍͏ࣄ࣮΋ ஌ΕΔ
29. ͜ΕΒͷܦݧΛ௨ͯ͡Կ͕Ϣʔ βʹͱͬͯͷՁ஋ͳͷ͔Λߟ͑Δ ྗ͕޲্͢Δ
30. "#ςετΛ௨ͯ͡ϓϩμΫτͩ ͚Ͱͳ͘νʔϜ΋੒௕Ͱ͖Δʂʂ
31. ͥͻΈͳ͞Μ΋͜ͷػձʹ"#ς ετͷಋೖΛߟ͑ͯΈ͍ͯͩ͘͞ʂ
32. ͓͠·͍