Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
A/Bテストをやるときに 気をつけていること
Search
Shingo Tomioka
October 17, 2018
3
1.6k
A/Bテストをやるときに 気をつけていること
Shingo Tomioka
October 17, 2018
Tweet
Share
More Decks by Shingo Tomioka
See All by Shingo Tomioka
Perk アプリの技術選定とリリースから1年弱経ってのふりかえり
stomk
0
370
Engagement 事業チーム の開発事情
stomk
0
150
モデルの説明コメントを書く文化が会社に浸透してきた話
stomk
0
540
7年間開発を続けるサービスを支える 負債返済日の取り組み
stomk
3
2.4k
Featured
See All Featured
Stop Working from a Prison Cell
hatefulcrawdad
271
21k
GraphQLとの向き合い方2022年版
quramy
49
14k
Automating Front-end Workflow
addyosmani
1370
200k
The Cost Of JavaScript in 2023
addyosmani
53
8.9k
Fireside Chat
paigeccino
39
3.6k
Embracing the Ebb and Flow
colly
87
4.8k
Designing Experiences People Love
moore
142
24k
Being A Developer After 40
akosma
90
590k
Practical Orchestrator
shlominoach
190
11k
Why Our Code Smells
bkeepers
PRO
339
57k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
PRO
23
1.4k
Imperfection Machines: The Place of Print at Facebook
scottboms
268
13k
Transcript
©2018 Wantedly, Inc. A/BςετΛΔͱ͖ʹ ؾΛ͚͍ͭͯΔ͜ͱ 17.Oct.2018 - Shingo Tomioka S-DEV
TALKS #4
©2018 Wantedly, Inc. w Ԭਅޛ !NFFB@U w ΤϯδχΞBU8BOUFEMZ *OD
w 8BOUFEMZ7JTJUͷ։ൃɾάϩʔε ࣗݾհ
©2018 Wantedly, Inc. ઃܭɾ४උஈ֊
©2018 Wantedly, Inc. w ෳม͑ΔͱɺԿ͕ͲΕ͘Β͍ޮ͍ͨͷ͔Θ͔Γʹ͘͘ͳΔ w ྫɿϘλϯͷஔͱจݴ ม͑ΔͳΔ͘Ұͭʹ͢Δ BUY ߪೖ
A B
©2018 Wantedly, Inc. w ༗ҙ͕ࠩग़ΔͷʹඞཁͳظؒΛࣄલʹݟੵΔ w ࠓͷϢʔβʔͩͱ༗ҙ͕ࠩग़Δͷʹϲ݄͔͔Δ͔͠Εͳ͍ w Q͕Լ͕ͬͨλΠϛϯάͰΓ্͛ͨ͘ͳΔͷΛ͙ ࣄલʹظؒΛܾΊΔ
p
©2018 Wantedly, Inc. w ͪΌΜͱ࣮ͨͭ͠ΓͰɺऔΕ͍ͯͳ͔ͬͨΓ͢Δ w ։ൃڥͱຊ൪ڥͷҧ͍ w ಛఆͷ݅Λ࣋ͭϢʔβʔͷͱ͖औΕ͍ͯͳ͍
σϓϩΠͨ͠ΒͳΔ͘ૣ֬͘ೝ͢Δ w ࣈ͕ࢥͬͨΑΓগͳ͘ͳ͍͔ σϓϩΠͨ͠ΒͳΔ͘ૣ͘ɺϩά͕ͪΌΜͱऔΕ͍ͯΔ͔֬ೝ͢Δ
©2018 Wantedly, Inc. ܭଌɾධՁஈ֊
©2018 Wantedly, Inc. w ΫΤϦ͕ؒҧ͍ͬͯΔ͜ͱΑ͋͘Δ w ΫΤϦ͕ؒҧ͍ͬͯͯɺͦΕͬΆ͍ࣈ͕ग़ͯ͠·͏ w ࣈ͕ग़Δͱɺ͙͢ղऍʹΓͨ͘ͳΔ
ࣈ͕ײͱେ͖͘Εͯͳ͍͔֬ೝ͢Δ ՄೳͳΒ ෳͷܭΓ͔ͨͰݕࢉ͢Δ w ྫɿϑϩϯτଆͷϩάͱɺαʔόʔͷϦΫΤετϩά ΫΤϦͷνΣοΫ৻ॏʹ
©2018 Wantedly, Inc. w ฏۉ֎ΕͷӨڹΛड͚͍͢ w ྫɿӾཡ͕৳ͼͨͱࢥͬͨΒɺਓͷϢʔβʔ͕ େྔʹӾཡ͍͚ͯͨͩͩͬͨ͠ ΛݟΕશମతͳΛ
ѲͰ͖Δ ฏۉͰͳ͘ΛݟΔ A B A B 8.0 7.3
©2018 Wantedly, Inc. w ৽͍͠6*ίϯςϯπظతʹΫϦοΫ͕૿͍͑͢ ςετ։࢝ޙ͙͢ͷσʔλΛࣺͯΔ ৽نϢʔβʔʹ͠΅ͬͯݟͯΈΔ New
Button ޮՌʹؾΛ͚ͭΔ
©2018 Wantedly, Inc. w ϖʔδͷίϯςϯπΫϦοΫΛୣ͍߹͏ w ྫɿαΠυόʔͷݟͨΛվળͨ͠ΒɺϝΠϯΧϥϜͷΫϦοΫ͕མͪͨ w ςετରͰͳ͍ࣈ͕࣮མ͍ͪͯΔ͔
Өڹͷ͋Γͦ͏ͳଞͷࢦඪ֬ೝ͢Δ ଞͷࢦඪ͕ѱ͘ͳ͍ͬͯͳ͍͔֬ೝ͢Δ
©2018 Wantedly, Inc. w ࣗͷԾઆʹ߹க͢ΔσʔλΛॏࢹ͠ɺ߹Θͳ͍σʔλΛܰࢹͯ͠ ͠·͏ w "#ςετΛΔͱ͖ɺԿ͔͕Α͘ͳΔͱظ͍ͯ͠Δ w Α͘ͳͬͨࣈʹͯ͠ɺѱ͘ͳͬͨࣈΛܰࢹ͕ͪ͠
όΠΞε͕͋Δ͜ͱΛҙ͓͚ࣝͯͩ͘͠Ͱྫྷ੩ʹஅͰ͖Δ ֬ূόΠΞεʹؾΛ͚ͭΔ
©2018 Wantedly, Inc. w ͍ͬͯΔͷΛΕͯςετ͕ͣͬͱ͍ͬͯΔঢ়ଶ w ظؒͷ͍ςετϓϩδΣΫτͷมΘΓಛʹҙ ऴྃ༧ఆʹϦϚΠϯμʔΛηοτ͓ͯ͘͠
ఆظతʹաڈͷJTTVFϩάΛ֬ೝ͢Δ ग़ͬ͠ͺͳ͠ʹ͠ͳ͍
©2018 Wantedly, Inc. Enjoy A/B testing!