CTRオンライン予測システムのアーキテクチャ

by Yoshitomo Hayashi

Slide 1

Slide 1 text

CTRΦϯϥΠϯ༧ଌ γεςϜͷΞʔΩςΫνϟ ΦϨγΧφΠτvol.3 גࣜձࣾαΠόʔΤʔδΣϯτ ྛ ۍ๎

Slide 2

Slide 2 text

ࣗݾ঺հ ྛɹۍ๎ʢ͸΍͠Α͠ͱ΋ʣ αʔόʔαΠυΤϯδχΞ 2011೥ αΠόʔΤʔδΣϯτೖࣾ ೖࣾޙ͍͔ͭ͘ͷwebαʔϏε୲౰ 2015೥͔ΒMDHͰ഑৴ϩδοΫͷվળ

Slide 3

Slide 3 text

ࣗݾ঺հ झຯ ίʔώʔ ՈͰυϦοϓͨ͠Γ ίʔϧυϒϦϡʔ࡞ͬͨΓ Netﬂix Ξχϝ ΢ΥʔΩϯάɾσου

Slide 4

Slide 4 text

CTRΦϯϥΠϯ༧ଌ γεςϜͷΞʔΩςΫνϟ

Slide 5

Slide 5 text

CTRͱ͸ʁ

Slide 6

Slide 6 text

CTRͱ͸? CTRʢΫϦοΫ཰ʣ CTR = Click / Impression

Slide 7

Slide 7 text

ͳͥ༧ଌ͕ඞཁͳͷ͔ʁ

Slide 8

Slide 8 text

޿ࠂͷऩӹ ΫϦοΫ՝ۚ ޿ࠂ1ΫϦοΫ͋ͨΓʓʓԁʢCPCʣ

Slide 9

Slide 9 text

޿ࠂͷऩӹ ΫϦοΫ՝ۚ ޿ࠂ1ΫϦοΫ͋ͨΓʓʓԁʢCPCʣ ΑΓΫϦοΫ͞ΕΔ CPC͕ߴ͍޿ࠂΛ഑৴͍ͨ͠

Slide 10

Slide 10 text

޿ࠂΛϥϯΩϯά CTR × CPCʹΑΔϥϯΩϯά CTR͸όϯσΟοτΞϧΰϦζϜͰࢉग़ ࣮੷ͷimp, clickΛ࢖༻ ࣮੷ͷूܭ [޿ࠂ࿮ × Ϣʔβʔଐੑ × ޿ࠂ] ຖʹimp, clickΛܭଌ

Slide 11

Slide 11 text

͜Ε·ͰͷϥϯΩϯάͷ՝୊ ࣮੷͕গͳ͍৔߹ʹ͏·͘࠷దԽ͞Εͳ͍ Ϣʔβʔຖʹ࠷దͳ޿ࠂΛ഑৴ग़དྷ͍ͯͳ͍

Slide 12

Slide 12 text

ػցֶशʹΑΔCTR༧ଌ ਺ଟ͘ͷૉੑΛ௥ՃՄೳ ࣮੷͕গͳͯ͘΋͋Δఔ౓༧ଌՄೳ ύʔιφϥΠζ͞ΕͨϥϯΩϯά

Slide 13

Slide 13 text

։ൃମ੍ ॳظ γεςϜΤϯδχΞ2ਓ σʔλαΠΤϯςΟετ1ਓʢळ༿ݪϥϘʣ ݱࡏ γεςϜΤϯδχΞ2ʙ3ਓ σʔλαΠΤϯςΟετ2ਓʢळ༿ݪϥϘ1ਓʣ

Slide 14

Slide 14 text

ΞʔΩςΫνϟ

Slide 15

Slide 15 text

ΞʔΩςΫνϟ ֶशσʔλ JoinࡁΈͷ ϩά ϩά ϩά ػցֶश ϝτϦΫε Ϟσϧ ϑΝΠϧ Ϟσϧ ϑΝΠϧ Stream Aggregator Data Joiner Learner Predictor ModelStore

Slide 16

Slide 16 text

Data-Joiner

Slide 17

Slide 17 text

Data-Joinerͷ໾ׂ ޿ࠂ͕click͞Ε͔ͨͲ͏͔Λ൑ఆ͢Δ imp౸ୡޙɺҰఆظؒclickͷ౸ୡΛ଴ͭ impͱclickͷσʔλͷࠩҟΛແ͘͢ refererͷ஋ʹࠩҟ͕͋ͬͨ

Slide 18

Slide 18 text

Apache IgniteΛ࢖༻࣮ͨ͠૷ Event Notiﬁcations imp click Stream Data Joiner Aggregator

Slide 19

Slide 19 text

Apache IgniteΛ࢖༻࣮ͨ͠૷ Event Notiﬁcations put-event impͷ৔߹͸ TTLΛ5෼ʹઃఆ͠อଘ imp click Stream Data Joiner Aggregator

Slide 20

Slide 20 text

Apache IgniteΛ࢖༻࣮ͨ͠૷ Event Notiﬁcations put-event impͷ৔߹͸ TTLΛ5෼ʹઃఆ͠อଘ put-event clickͷ৔߹͸ରԠ͢Δ impΛݕࡧ͠click͞Εͨ impͱͯ͠Aggregatorʹૹ৴ imp click Stream Data Joiner Aggregator

Slide 21

Slide 21 text

Apache IgniteΛ࢖༻࣮ͨ͠૷ Event Notiﬁcations put-event impͷ৔߹͸ TTLΛ5෼ʹઃఆ͠อଘ put-event clickͷ৔߹͸ରԠ͢Δ impΛݕࡧ͠click͞Εͨ impͱͯ͠Aggregatorʹૹ৴ expired-event 5෼ܦͬͯ΋click͕དྷͳ͍৔ ߹͸click͞Εͳ͔ͬͨimpͱ ͯ͠Aggregatorʹૹ৴ imp click Stream Data Joiner Aggregator

Slide 22

Slide 22 text

Aggregator

Slide 23

Slide 23 text

Aggregatorͷ໾ׂ ֶशʹඞཁͳσʔλΛऩू ϩά͔Βऔಘग़དྷΔ΋ͷ ϩά͔ΒऔಘͰ͖ͳ͍΋ͷ ऩूͨ͠σʔλΛLearnerʹૹΔ σʔλ͸αϯϓϦϯά͠100݅ͣͭ

Slide 24

Slide 24 text

ϩά͔ΒऔಘՄೳͳσʔλ Ϣʔβʔͷ৘ใ UA, IPΞυϨε, referer, ϦλήϢʔβʔ͔ etc. ޿ࠂͷ৘ใ ۀछID, ޿ࠂओID, ΫϦΤΠςΟϒID etc. ໘ͷ৘ใ ޿ࠂ࿮ID, ϝσΟΞID etc.

Slide 25

Slide 25 text

ϩά͔ΒऔಘෆՄೳͳσʔλ Ϣʔβʔͷ৘ใ σϞάϥʢੑผɾ೥ྸʣ ಠࣗʹ࡞੒ͨ͠ૉੑ ߦಈཤྺΛϕʔεʹͨ͠ϢʔβʔΫϥελ ޿ࠂςΩετΫϥελ

Slide 26

Slide 26 text

Learner

Slide 27

Slide 27 text

Learnerͷ໾ׂ Aggregator͔Βड͚औͬͨσʔλΛ࢖༻͠ϞσϧΛߏங͢Δ ϞσϧΛߏங͢ΔίΞ෦෼͸C++ʢσʔλαΠΤϯςΟ ετ୲౰ʣ 15෼ִؒͰϞσϧΛߋ৽ Ϟσϧ͸ϑΝΠϧͰϞσϧετΞʢS3ʣʹอଘ ػցֶशϝτϦΫεʢauroc, logloss etc.ʣΛDBʹอଘ

Slide 28

Slide 28 text

Learner͕ੜ੒͢Δ ϞσϧϑΝΠϧ ֶश༻ϚελϑΝΠϧʢ12ִ࣌ؒؒͰߋ৽ʣ Learner͸͜ͷϑΝΠϧΛ࢖༻ֶͯ͠श͢Δ ༧ଌ༻ϚελϑΝΠϧʢ12ִ࣌ؒؒͰߋ৽ʣ Predictor͕CTRΛ༧ଌ͢Δࡍʹ࢖༻͢Δ ༧ଌ༻ύονϑΝΠϧ ༧ଌ༻ϚελϑΝΠϧ͔Βͷࠩ෼ϑΝΠϧ ͜ͷϑΝΠϧ͕LearnerʹΑͬͯ15෼ִؒͰߋ৽͞ΕΔ

Slide 29

Slide 29 text

Predictor

Slide 30

Slide 30 text

Predictor ༧ଌʹඞཁͳσʔλΛड͚औΓ༧ଌCTRΛฦ͢API 15෼ִؒͰϞσϧετΞ͔Β࠷৽ͷϞσϧϑΝΠ ϧΛऔಘ͠ߋ৽͢Δ

Slide 31

Slide 31 text

༧ଌ͕։࢝ग़དྷΔ·Ͱ ىಈ࣌ʹϚελϑΝΠϧΛಡΈࠐΉ ϚελϑΝΠϧಡΈࠐΈޙ͔Β༧ଌՄೳ ϚελϑΝΠϧͷ࠷ऴߋ৽೔͔࣌Βͷࠩ෼ύον ϑΝΠϧΛద༻͍ͯ͘͠ʢ࠷େͰ47ϑΝΠϧʣ 1ύονϑΝΠϧ5ʙ6ඵͰద༻ՄೳͳͷͰɺ5෼ Ҏ಺Ͱ׬ྃ

Slide 32

Slide 32 text

CTR༧ଌγεςϜಋೖޙ

Slide 33

Slide 33 text

CPMൺֱ ϥϯμϜ ࣮੷CTR ༧ଌCTR ࣮੷CTRରൺ໿7ˋվળ ϥϯμϜରൺ໿50ˋվળ

Slide 34

Slide 34 text

CTRൺֱ ࣮੷CTRରൺ໿6ˋվળ ϥϯμϜରൺ໿8ˋվળ ϥϯμϜ ࣮੷CTR ༧ଌCTR

Slide 35

Slide 35 text

͓·͚

Slide 36

Slide 36 text

Real-Time Optimizer ʢROʣ

Slide 37

Slide 37 text

Real- Time OptimizerʢROʣ 2017೥6݄ϦϦʔε ໨ඪCPAʹ߹ΘͤͯCPCΛࣗಈௐ੔͢Δ

Slide 38

Slide 38 text

CPCͷࢉग़ํ๏ CPC = ໨ඪCPA × CVR ໨ඪCPA 1CVಘΔͷʹࢧ෷ͬͯ΋ྑ͍අ༻ ޿ࠂओ͕ܾఆ CVRʢίϯόʔδϣϯ཰ʣ CV / Click

Slide 39

Slide 39 text

͜Ε·ͰͷCVRࢉग़ํ๏ աڈ࣮੷ΛݩʹώϡʔϦεςΟοΫͳCVRࢉग़ ޿ࠂ࿮ × ΞΧ΢ϯτຖʹCVRΛࢉग़ ϦλήϢʔβʔͷ৔߹ิਖ਼Ϩʔτ

Slide 40

Slide 40 text

ݱঢ়ͷ՝୊ CV͕ग़ʹ͍͘Ҋ݅ͷ৔߹ʹCVRͷਫ਼౓͕ѱ͍ ৽نΞΧ΢ϯτͷ৔߹࣮੷͕ແ͍໰୊ ۀछશମͷ࣮੷Λࢀর ৽ن޿ࠂ࿮ͷ৔߹ʹ࣮੷͕ͳ͍໰୊ ޿ࠂ࿮άϧʔϓͷ࣮੷Λࢀর

Slide 41

Slide 41 text

CTR༧ଌγεςϜͷࢿ࢈Λ ׆༻ͨ͠CVR༧ଌγεςϜ

Slide 42

Slide 42 text

CVR༧ଌγεςϜ Ϟσϧͷߏங͸೔࣍όονʢBatch-Learnerʣ Clickൃੜ͔ΒCVൃੜ·Ͱͷ͕࣌ؒ௕͍ͷͰϦΞ ϧλΠϜͰֶश͸͠ͳ͍ LearnerͷίΞ෦෼΍ɺੜ੒͞ΕΔϞσϧϑΝΠ ϧɺPredictor͸ͦͷ··࢖༻

Slide 43

Slide 43 text

ΞʔΩςΫνϟ Predictor ModelStore Batch-Learner ϞσϧϑΝΠϧ ϞσϧϑΝΠϧ ػցֶश ϝτϦΫε ֶशσʔλ