AB Tests in Mobile App

Transcript

1. kazunori kikuchi / GMO PEPABO inc. 2016.08.19 iOSDC AB Tests

   in Mobile App

2. J04ΤϯδχΞ kazunori kikuchi @kichikuchi NJOOFࣄۀ෦ϓϩμΫτνʔϜ

3. ࠃ಺࠷େڃͷϋϯυϝΠυϚʔέοτ NJOOF

4. ࠃ಺࠷େڃͷϋϯυϝΠυϚʔέοτ NJOOF

5. ࠓ೔࿩͢ίτ 
   Ͳ͏΍ͬͯ"#ςετΛಋೖ͍ͯ͠Δ͔
   
   "#ςετΛ΍ͬͯྑ͔ͬͨίτ
   
   "#ςετΛ΍ͬͯࠔͬͨίτ

6. Ͳ͏΍ͬͯ"#ςετΛಋೖͯ͠ ͍Δ͔

7. SkyLab + Google Analytics

8. SkyLab

9. SkyLab.splitTestWithName("iosdc", conditions: [ "ios" : 0.5 , "dc" : 0.5

   ]) { (condition) -> Void in if condition as! String == "ios" { self.sendGA(category: "iosdc", action: "ios", value: nil) } else { self.sendGA(category: "iosdc", action: "dc", value: nil) } } ࢖͍ํ

10. SkyLab.splitTestWithName("iosdc", conditions: [ "ios" : 0.5 , "dc" : 0.5

    ]) { (condition) -> Void in if condition as! String == "ios" { self.sendGA(category: "iosdc", action: "ios", value: nil) } else { self.sendGA(category: "iosdc", action: "dc", value: nil) } } ςετͷ໊લ ࢖͍ํ

11. SkyLab.splitTestWithName("iosdc", conditions: [ "ios" : 0.5 , "dc" : 0.5

    ]) { (condition) -> Void in if condition as! String == "ios" { self.sendGA(category: "iosdc", action: "ios", value: nil) } else { self.sendGA(category: "iosdc", action: "dc", value: nil) } } ෼ذύλʔϯͱ֬཰ ࢖͍ํ

12. SkyLab.splitTestWithName("iosdc", conditions: [ "ios" : 0.5 , "dc" : 0.5

    ]) { (condition) -> Void in if condition as! String == "ios" { self.sendGA(category: "iosdc", action: "ios", value: nil) } else { self.sendGA(category: "iosdc", action: "dc", value: nil) } } ෼ذύλʔϯͱॲཧ ࢖͍ํ

13. SkyLab.splitTestWithName("iosdc", conditions: [ "ios" : 0.5 , "dc" : 0.5

    ]) { (condition) -> Void in if condition as! String == "ios" { self.sendGA(category: "iosdc", action: "ios", value: nil) } else { self.sendGA(category: "iosdc", action: "dc", value: nil) } } ςετͷ໊લ ෼ذύλʔϯ໊ ࢖͍ํ

14. ಋೖͱܭଌɾݕূ w "#ςετͷಋೖ
    w 4LZ-BCΛར༻
    w ςετͷೖΕସ͑͸ϦϦʔεຖ
    w ςετ໊ͱ෼ذύλʔϯ͸QMJTUͰ؅ཧ
    w

    "#ςετͷܭଌɾݕূ
    w (PPHMF
    "OBMZUJDTΛར༻
    w ΧελϜηάϝϯτͰ෼ੳ

15. "#ςετΛ΍ͬͯྑ͔ͬͨίτ
    ☺

16. ݁Ռ͕਺ࣈͰݟ͑Δ w ձһొ࿥ϑϩʔͷมߋͰ਺ొ࿥཰্͕ঢ☺
    w Χʔτ౤ೖޙͷը໘ϑϩʔΛύλʔϯࢼ͠࠷ྑѱͰߪೖ ཰ʹ਺ͷ։͖͕͋ͬͨ
    w ͱ͋ΔλΠϜϥΠϯͰചΓ੾Ε࡞඼΋දࣔ͢ΔΑ͏ʹͨ͠ ͱ͜Ζ෮ؼ཰͕਺ݮগ

17. վળ͸ಋೖ͠ɺվѱ͸Өڹൣғ Λ࠷খݶʹͱͲΊΒΕΔʂ

18. Կ͕վળʹͭͳ͕Δ͔͕Θ͔ͬͯ͘Δ w 6*ύʔπͷαΠζมߋ 
    
    QY ͸Өڹখ
    w ৘ใઃܭͷมߋ ࡏݿ੾Εදࣔඇදࣔ

    ͸Өڹத
    w ϑϩʔͷมߋ ը໘
    
    ը໘ ͸Өڹେ

19. Ͳ͏͍ͬͨมߋ͕ΞϓϦΛΑ͘ ͢Δ͔ߟ͑ΔνʔϜશମͷྗ͕ 61
    

20. "#ςετΛ΍ͬͯࠔͬͨίτ
    

21. ςετͷઃܭ͕೉͍͠ w ͦ΋ͦ΋Ͳͷ਺ࣈΛݟͨΒ͍͍ʁ
    w ͜ͷมߋ͸ߪೖ཰ʹӨڹ͕ग़Δ͸ͣʂʂͱͳΓ͕ͪͩͬͨ
    w ಉ͡਺ࣈΛࢦඪͱ͢Δςετ͕ෳ਺ೖΔͱݕূύλʔϯ ͕Ұؾʹ૿͑Δ

22. ςετͷݕূ͕େม w ςετΛճ͠ଓ͚ΔͨΊʹ͸ϑϩʔͷཱ͕֬ඞཁ
    w ݕূʹઐ೦Ͱ͖Δਓͷ֬อ
    w ฐࣾͰ͸ΤϯδχΞ͕("৮ͬͯ·͢ʂ
    w ͨͩΤϯδχΞ΋ৗʹख͕ۭ͍ͯΔΘ͚Ͱ͸ͳ͍ɻɻɻ

23. ࣮૷ίετ΍ίʔυͷՄಡੑ w 6*Λେ͖͘มߋ͢Δ৔߹͸޻਺͕ॏΊʹͳΔ͜ͱ΋
    w ςετऴྃ࣌ʹ֘౰ՕॴΛ֎͢࡞ۀ΋͋Δʂ
    w ࠓͷॴେ͖ͳࣦഊ͸ͳ͍͕ݹ͍ςετ͕࢒͍ͬͯͨ͜ͱ ͕
    w ςετͷͨΊͷ෼ذ͕૿͑ͯίʔυ͕ಡΈͮΒ͘ͳΔ
    

    w Ұ࣌తͳίʔυͳͷͰଥڠ͕ͪ͠ ίϐϖରԠͳͲ

24. ϦϦʔεલݕূ͕େม w "#ςετ։࢝౰ॳ͸ΞϓϦ࡟আ
    
    ࠶Πϯετʔϧ͠ͳ͍ ͱςετύλʔϯ͕มΘΒͳ͔ͬͨ
    w ϦϦʔε௚લʹϓϩϞʔγϣϯίʔυΛൃߦͯ͠ߦ͏ݕ ূͰ࠷େݸൃߦͨ͜͠ͱ͕͋Γ·͢
    w ݱࡏ͸˓˓˓ίϚϯυతͳ΋ͷͰΞϓϦΛ࡟আͤͣʹς ετύλʔϯΛมߋͰ͖ΔΑ͏ʹͯ͠ղফʂ
    

    w ಛఆͷςετέʔε ಛఆͷ04Ͱ͚ͩى͜Δόά͕͋ͬͨ

25. ࠔͬͨ͜ͱͷ෼ྔ͕ଟ͘ͳͬͯ͠ ·͍·͕ͨ͠ɻɻɻ

26. ಋೖͯ͠ྑ͔ͬͨ"#ςετʂʂ

27. ࣗ෼ͨͪͷߦͬͨػೳ௥Ճɾม ߋʹͲΕ͚ͩͷΠϯύΫτ͕͋ͬ ͔ͨΛ஌ΕΔ

28. ࣗ෼͕ͨͪ͜Ε͸͍͍ΞΠσΞͩʂ ͱࢥ͍ͬͯͨ͜ͱ͕࣮͸Ϣʔβʹ ͱͬͯෆརӹͩͬͨͱ͍͏ࣄ࣮΋ ஌ΕΔ

29. ͜ΕΒͷܦݧΛ௨ͯ͡Կ͕Ϣʔ βʹͱͬͯͷՁ஋ͳͷ͔Λߟ͑Δ ྗ͕޲্͢Δ

30. "#ςετΛ௨ͯ͡ϓϩμΫτͩ ͚Ͱͳ͘νʔϜ΋੒௕Ͱ͖Δʂʂ

31. ͥͻΈͳ͞Μ΋͜ͷػձʹ"#ς ετͷಋೖΛߟ͑ͯΈ͍ͯͩ͘͞ʂ

32. ͓͠·͍