Slide 1
Slide 1 text
kazunori kikuchi / GMO PEPABO inc.
2016.08.19 iOSDC
AB Tests in Mobile App
Slide 2
Slide 2 text
J04ΤϯδχΞ
kazunori kikuchi @kichikuchi
NJOOFࣄۀ෦ϓϩμΫτνʔϜ
Slide 3
Slide 3 text
ࠃ࠷େڃͷϋϯυϝΠυϚʔέοτ
NJOOF
Slide 4
Slide 4 text
ࠃ࠷େڃͷϋϯυϝΠυϚʔέοτ
NJOOF
Slide 5
Slide 5 text
ࠓ͢ίτ
Ͳ͏ͬͯ"#ςετΛಋೖ͍ͯ͠Δ͔
"#ςετΛͬͯྑ͔ͬͨίτ
"#ςετΛͬͯࠔͬͨίτ
Slide 6
Slide 6 text
Ͳ͏ͬͯ"#ςετΛಋೖͯ͠
͍Δ͔
Slide 7
Slide 7 text
SkyLab
+
Google Analytics
Slide 8
Slide 8 text
SkyLab
Slide 9
Slide 9 text
SkyLab.splitTestWithName("iosdc", conditions: [ "ios" : 0.5 , "dc" : 0.5 ])
{ (condition) -> Void in
if condition as! String == "ios" {
self.sendGA(category: "iosdc", action: "ios", value: nil)
} else {
self.sendGA(category: "iosdc", action: "dc", value: nil)
}
}
͍ํ
Slide 10
Slide 10 text
SkyLab.splitTestWithName("iosdc", conditions: [ "ios" : 0.5 , "dc" : 0.5 ])
{ (condition) -> Void in
if condition as! String == "ios" {
self.sendGA(category: "iosdc", action: "ios", value: nil)
} else {
self.sendGA(category: "iosdc", action: "dc", value: nil)
}
}
ςετͷ໊લ
͍ํ
Slide 11
Slide 11 text
SkyLab.splitTestWithName("iosdc", conditions: [ "ios" : 0.5 , "dc" : 0.5 ])
{ (condition) -> Void in
if condition as! String == "ios" {
self.sendGA(category: "iosdc", action: "ios", value: nil)
} else {
self.sendGA(category: "iosdc", action: "dc", value: nil)
}
}
ذύλʔϯͱ֬
͍ํ
Slide 12
Slide 12 text
SkyLab.splitTestWithName("iosdc", conditions: [ "ios" : 0.5 , "dc" : 0.5 ])
{ (condition) -> Void in
if condition as! String == "ios" {
self.sendGA(category: "iosdc", action: "ios", value: nil)
} else {
self.sendGA(category: "iosdc", action: "dc", value: nil)
}
} ذύλʔϯͱॲཧ
͍ํ
Slide 13
Slide 13 text
SkyLab.splitTestWithName("iosdc", conditions: [ "ios" : 0.5 , "dc" : 0.5 ])
{ (condition) -> Void in
if condition as! String == "ios" {
self.sendGA(category: "iosdc", action: "ios", value: nil)
} else {
self.sendGA(category: "iosdc", action: "dc", value: nil)
}
}
ςετͷ໊લ
ذύλʔϯ໊
͍ํ
Slide 14
Slide 14 text
ಋೖͱܭଌɾݕূ
w "#ςετͷಋೖ
w 4LZ-BCΛར༻
w ςετͷೖΕସ͑ϦϦʔεຖ
w ςετ໊ͱذύλʔϯQMJTUͰཧ
w "#ςετͷܭଌɾݕূ
w (PPHMF"OBMZUJDTΛར༻
w ΧελϜηάϝϯτͰੳ
Slide 15
Slide 15 text
"#ςετΛͬͯྑ͔ͬͨίτ
☺
Slide 16
Slide 16 text
݁Ռ͕ࣈͰݟ͑Δ
w ձһొϑϩʔͷมߋͰొ্͕ঢ☺
w Χʔτೖޙͷը໘ϑϩʔΛύλʔϯࢼ͠࠷ྑѱͰߪೖ
ʹͷ։͖͕͋ͬͨ
w ͱ͋ΔλΠϜϥΠϯͰചΓΕ࡞දࣔ͢ΔΑ͏ʹͨ͠
ͱ͜Ζ෮ؼ͕ݮগ
Slide 17
Slide 17 text
վળಋೖ͠ɺվѱӨڹൣғ
Λ࠷খݶʹͱͲΊΒΕΔʂ
Slide 18
Slide 18 text
Կ͕վળʹͭͳ͕Δ͔͕Θ͔ͬͯ͘Δ
w 6*ύʔπͷαΠζมߋ
QY
Өڹখ
w ใઃܭͷมߋ ࡏݿΕදࣔඇදࣔ
Өڹத
w ϑϩʔͷมߋ ը໘ը໘
Өڹେ
Slide 19
Slide 19 text
Ͳ͏͍ͬͨมߋ͕ΞϓϦΛΑ͘
͢Δ͔ߟ͑ΔνʔϜશମͷྗ͕
61
Slide 20
Slide 20 text
"#ςετΛͬͯࠔͬͨίτ
Slide 21
Slide 21 text
ςετͷઃܭ͕͍͠
w ͦͦͲͷࣈΛݟͨΒ͍͍ʁ
w ͜ͷมߋߪೖʹӨڹ͕ग़ΔͣʂʂͱͳΓ͕ͪͩͬͨ
w ಉ͡ࣈΛࢦඪͱ͢Δςετ͕ෳೖΔͱݕূύλʔϯ
͕Ұؾʹ૿͑Δ
Slide 22
Slide 22 text
ςετͷݕূ͕େม
w ςετΛճ͠ଓ͚ΔͨΊʹϑϩʔͷཱ͕֬ඞཁ
w ݕূʹઐ೦Ͱ͖Δਓͷ֬อ
w ฐࣾͰΤϯδχΞ͕("৮ͬͯ·͢ʂ
w ͨͩΤϯδχΞৗʹख͕ۭ͍ͯΔΘ͚Ͱͳ͍ɻɻɻ
Slide 23
Slide 23 text
࣮ίετίʔυͷՄಡੑ
w 6*Λେ͖͘มߋ͢Δ߹͕ॏΊʹͳΔ͜ͱ
w ςετऴྃ࣌ʹ֘ՕॴΛ֎͢࡞ۀ͋Δʂ
w ࠓͷॴେ͖ͳࣦഊͳ͍͕ݹ͍ςετ͕͍ͬͯͨ͜ͱ
͕
w ςετͷͨΊͷذ͕૿͑ͯίʔυ͕ಡΈͮΒ͘ͳΔ
w Ұ࣌తͳίʔυͳͷͰଥڠ͕ͪ͠ ίϐϖରԠͳͲ
Slide 24
Slide 24 text
ϦϦʔεલݕূ͕େม
w "#ςετ։࢝ॳΞϓϦআ࠶Πϯετʔϧ͠ͳ͍
ͱςετύλʔϯ͕มΘΒͳ͔ͬͨ
w ϦϦʔεલʹϓϩϞʔγϣϯίʔυΛൃߦͯ͠ߦ͏ݕ
ূͰ࠷େݸൃߦͨ͜͠ͱ͕͋Γ·͢
w ݱࡏ˓˓˓ίϚϯυతͳͷͰΞϓϦΛআͤͣʹς
ετύλʔϯΛมߋͰ͖ΔΑ͏ʹͯ͠ղফʂ
w ಛఆͷςετέʔεಛఆͷ04Ͱ͚ͩى͜Δόά͕͋ͬͨ
Slide 25
Slide 25 text
ࠔͬͨ͜ͱͷྔ͕ଟ͘ͳͬͯ͠
·͍·͕ͨ͠ɻɻɻ
Slide 26
Slide 26 text
ಋೖͯ͠ྑ͔ͬͨ"#ςετʂʂ
Slide 27
Slide 27 text
ࣗͨͪͷߦͬͨػೳՃɾม
ߋʹͲΕ͚ͩͷΠϯύΫτ͕͋ͬ
͔ͨΛΕΔ
Slide 28
Slide 28 text
͕ࣗͨͪ͜Ε͍͍ΞΠσΞͩʂ
ͱࢥ͍ͬͯͨ͜ͱ͕࣮Ϣʔβʹ
ͱͬͯෆརӹͩͬͨͱ͍͏ࣄ࣮
ΕΔ
Slide 29
Slide 29 text
͜ΕΒͷܦݧΛ௨ͯ͡Կ͕Ϣʔ
βʹͱͬͯͷՁͳͷ͔Λߟ͑Δ
ྗ্͕͢Δ
Slide 30
Slide 30 text
"#ςετΛ௨ͯ͡ϓϩμΫτͩ
͚Ͱͳ͘νʔϜͰ͖Δʂʂ
Slide 31
Slide 31 text
ͥͻΈͳ͞Μ͜ͷػձʹ"#ς
ετͷಋೖΛߟ͑ͯΈ͍ͯͩ͘͞ʂ
Slide 32
Slide 32 text
͓͠·͍