Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
A/Bテストをやるときに 気をつけていること
Search
Shingo Tomioka
October 17, 2018
3
1.6k
A/Bテストをやるときに 気をつけていること
Shingo Tomioka
October 17, 2018
Tweet
Share
More Decks by Shingo Tomioka
See All by Shingo Tomioka
Perk アプリの技術選定とリリースから1年弱経ってのふりかえり
stomk
0
160
Engagement 事業チーム の開発事情
stomk
0
140
モデルの説明コメントを書く文化が会社に浸透してきた話
stomk
0
530
7年間開発を続けるサービスを支える 負債返済日の取り組み
stomk
3
2.3k
Featured
See All Featured
Docker and Python
trallard
44
3.5k
Practical Orchestrator
shlominoach
189
11k
The MySQL Ecosystem @ GitHub 2015
samlambert
251
13k
Mobile First: as difficult as doing things right
swwweet
223
9.7k
Understanding Cognitive Biases in Performance Measurement
bluesmoon
29
1.8k
4 Signs Your Business is Dying
shpigford
184
22k
Build The Right Thing And Hit Your Dates
maggiecrowley
36
2.8k
Documentation Writing (for coders)
carmenintech
72
4.9k
Statistics for Hackers
jakevdp
799
220k
Bash Introduction
62gerente
613
210k
Building an army of robots
kneath
306
45k
A designer walks into a library…
pauljervisheath
207
24k
Transcript
©2018 Wantedly, Inc. A/BςετΛΔͱ͖ʹ ؾΛ͚͍ͭͯΔ͜ͱ 17.Oct.2018 - Shingo Tomioka S-DEV
TALKS #4
©2018 Wantedly, Inc. w Ԭਅޛ !NFFB@U w ΤϯδχΞBU8BOUFEMZ *OD
w 8BOUFEMZ7JTJUͷ։ൃɾάϩʔε ࣗݾհ
©2018 Wantedly, Inc. ઃܭɾ४උஈ֊
©2018 Wantedly, Inc. w ෳม͑ΔͱɺԿ͕ͲΕ͘Β͍ޮ͍ͨͷ͔Θ͔Γʹ͘͘ͳΔ w ྫɿϘλϯͷஔͱจݴ ม͑ΔͳΔ͘Ұͭʹ͢Δ BUY ߪೖ
A B
©2018 Wantedly, Inc. w ༗ҙ͕ࠩग़ΔͷʹඞཁͳظؒΛࣄલʹݟੵΔ w ࠓͷϢʔβʔͩͱ༗ҙ͕ࠩग़Δͷʹϲ݄͔͔Δ͔͠Εͳ͍ w Q͕Լ͕ͬͨλΠϛϯάͰΓ্͛ͨ͘ͳΔͷΛ͙ ࣄલʹظؒΛܾΊΔ
p
©2018 Wantedly, Inc. w ͪΌΜͱ࣮ͨͭ͠ΓͰɺऔΕ͍ͯͳ͔ͬͨΓ͢Δ w ։ൃڥͱຊ൪ڥͷҧ͍ w ಛఆͷ݅Λ࣋ͭϢʔβʔͷͱ͖औΕ͍ͯͳ͍
σϓϩΠͨ͠ΒͳΔ͘ૣ֬͘ೝ͢Δ w ࣈ͕ࢥͬͨΑΓগͳ͘ͳ͍͔ σϓϩΠͨ͠ΒͳΔ͘ૣ͘ɺϩά͕ͪΌΜͱऔΕ͍ͯΔ͔֬ೝ͢Δ
©2018 Wantedly, Inc. ܭଌɾධՁஈ֊
©2018 Wantedly, Inc. w ΫΤϦ͕ؒҧ͍ͬͯΔ͜ͱΑ͋͘Δ w ΫΤϦ͕ؒҧ͍ͬͯͯɺͦΕͬΆ͍ࣈ͕ग़ͯ͠·͏ w ࣈ͕ग़Δͱɺ͙͢ղऍʹΓͨ͘ͳΔ
ࣈ͕ײͱେ͖͘Εͯͳ͍͔֬ೝ͢Δ ՄೳͳΒ ෳͷܭΓ͔ͨͰݕࢉ͢Δ w ྫɿϑϩϯτଆͷϩάͱɺαʔόʔͷϦΫΤετϩά ΫΤϦͷνΣοΫ৻ॏʹ
©2018 Wantedly, Inc. w ฏۉ֎ΕͷӨڹΛड͚͍͢ w ྫɿӾཡ͕৳ͼͨͱࢥͬͨΒɺਓͷϢʔβʔ͕ େྔʹӾཡ͍͚ͯͨͩͩͬͨ͠ ΛݟΕશମతͳΛ
ѲͰ͖Δ ฏۉͰͳ͘ΛݟΔ A B A B 8.0 7.3
©2018 Wantedly, Inc. w ৽͍͠6*ίϯςϯπظతʹΫϦοΫ͕૿͍͑͢ ςετ։࢝ޙ͙͢ͷσʔλΛࣺͯΔ ৽نϢʔβʔʹ͠΅ͬͯݟͯΈΔ New
Button ޮՌʹؾΛ͚ͭΔ
©2018 Wantedly, Inc. w ϖʔδͷίϯςϯπΫϦοΫΛୣ͍߹͏ w ྫɿαΠυόʔͷݟͨΛվળͨ͠ΒɺϝΠϯΧϥϜͷΫϦοΫ͕མͪͨ w ςετରͰͳ͍ࣈ͕࣮མ͍ͪͯΔ͔
Өڹͷ͋Γͦ͏ͳଞͷࢦඪ֬ೝ͢Δ ଞͷࢦඪ͕ѱ͘ͳ͍ͬͯͳ͍͔֬ೝ͢Δ
©2018 Wantedly, Inc. w ࣗͷԾઆʹ߹க͢ΔσʔλΛॏࢹ͠ɺ߹Θͳ͍σʔλΛܰࢹͯ͠ ͠·͏ w "#ςετΛΔͱ͖ɺԿ͔͕Α͘ͳΔͱظ͍ͯ͠Δ w Α͘ͳͬͨࣈʹͯ͠ɺѱ͘ͳͬͨࣈΛܰࢹ͕ͪ͠
όΠΞε͕͋Δ͜ͱΛҙ͓͚ࣝͯͩ͘͠Ͱྫྷ੩ʹஅͰ͖Δ ֬ূόΠΞεʹؾΛ͚ͭΔ
©2018 Wantedly, Inc. w ͍ͬͯΔͷΛΕͯςετ͕ͣͬͱ͍ͬͯΔঢ়ଶ w ظؒͷ͍ςετϓϩδΣΫτͷมΘΓಛʹҙ ऴྃ༧ఆʹϦϚΠϯμʔΛηοτ͓ͯ͘͠
ఆظతʹաڈͷJTTVFϩάΛ֬ೝ͢Δ ग़ͬ͠ͺͳ͠ʹ͠ͳ͍
©2018 Wantedly, Inc. Enjoy A/B testing!