Cookpad の広告配信を支えるアーキテクチャ

by Ken Wagatsuma

Slide 1

Slide 1 text

$PPLQBEͷ޿ࠂ഑৴Λ ࢧ͑ΔΞʔΩςΫνϟ $PPLQBE*OD զ࠺ݠथʢ,FOKV8BHBUTVNBʣ

Slide 2

Slide 2 text

8IP Kenju Wagatsuma - Serverside Engineer - Ruby, Go, AWS - Recruit HD -> Bit Journey -> Cookpad - github.com/kenju - twitter.com/itiskj - itiskj.hatenablog.com

Slide 3

Slide 3 text

"SDIJUFDUVSF

Slide 4

Slide 4 text

4FSWJDFT • ad4 • admin site • ads • ads delivery server • log architecture • Ofﬂine … ﬂuentd/S3/Redshift • Realtime … Kinesis Streams/DynamoDB/Lambda

Slide 5

Slide 5 text

0WFSBMM"SDIJUFDUVSF BE BET CBUDI ! DBDIF .Z42- .Z42- 4%,

Slide 6

Slide 6 text

-PH"SDIJUFDUVSF

Slide 7

Slide 7 text

%PNBJO.PEFMT

Slide 8

Slide 8 text

0QFSBUJPO $BNQBJHO Ωϟϯϖʔϯɺ഑৴ͷ୯Ґ $BNQBJHO1FSJPE Ωϟϯϖʔϯͷ഑৴ظؒ #PPLJOH $BNQBJHOͱ1SPEVDUͷؔ࿈ςʔϒϧ 1SPEVDU ഑৴ର৅ͷ޿ࠂ࿮ 1MBDFNFOU ෳ਺ͷ1SPEVDUͷू߹ମ $SFBUJWF ΫϦΤΠςΟϒɺը૾΍λά $MJFOU ड஫ઌͷΫϥΠΞϯτ

Slide 9

Slide 9 text

0QFSBUJPO$BNQBJHO

Slide 10

Slide 10 text

0QFSBUJPO$SFBUJWFT

Slide 11

Slide 11 text

0QFSBUJPO $BNQBJHO 1FSJPE #PPLJOH 1MBDFNFOU $MJFOU $BNQBJHO 1SPEVDU 0SHBOJ[BUJPO $SFBUJWF 0SEFS

Slide 12

Slide 12 text

%FMJWFSZ %FMJWFSZ1MBO Ωϟϯϖʔϯ͝ͱͷྲྀྔΛهड़ͨ͠഑৴ܭը %FMJWFSZ1BZMPBE ഑৴͢Δ+40/1BZMPBET (PBM#VEHFUFE $1$࠷దԽܕ (PBM1FSDFOUBHF ഑৴ൺ཰ϕʔε (PBM*NQSFTTJPO ໨ඪ*NQSFTTJPOೖߘܕ (PBM$MJDL ໨ඪ$MJDLೖߘܕ (PBM3FNOBOU ༨৒ࡏݿ഑৴ܕ

Slide 13

Slide 13 text

%FMJWFSZ%FMJWFSZ1MBO { "version": 1, "site_id": 3, "product_id": 537, "product_capacity": 1, "campaigns": [ { "id": 18585, "goal_type": "percentage", "creatives": [ { "id": 60057, "formats": [ "category_hijack_spw_with_image" ], "targets": [ { "keywords": [ "͘Ζ·Ί", "ΫϩϚϝ" ] } ] } ], "rate_numerator": 10000, "rate_denominator": 10000 },

Slide 14

Slide 14 text

%FMJWFSZ%FMJWFSZ1BZMPBE [ { "key": "cookpad-android-search-master", "creatives": [ [ { "id": 111, "template": "image", "click_url": "https://...", "media": { "mime_type": "image/jpeg", "original": "https://example.com/d6663ab44a0c48a1996debc690893493.jpg?1510564210", "width": 300, "height": 250 } } ] ] }

Slide 15

Slide 15 text

5BSHFUJOH $SFBUJWF ʢ࠶ܝʣ $SFBUJWF5BSHFU λʔήςΟϯάϧʔϧΛද͢ந৅Ϟσϧ "SFB3VMF ΤϦΞผλʔήςΟϯά "VEJFODF3VMF ηάϝϯτผλʔήςΟϯά ,FZXPSE3VMF ݕࡧΩʔϫʔυผλʔήςΟϯά 3FDJQF3VMF ϨγϐผλʔήςΟϯά 4DIFEVMF3VMF ༵೔ɾ࣌ؒଳผλʔήςΟϯά

Slide 16

Slide 16 text

5BSHFUJOH $SFBUJWF $SFBUJWF 5BSHFU ,FZXPSE 3VMF 3FDJQF 3VMF 4DIFEVMF 3VMF "SFB 3VMF "VEJFODF 3VMF

Slide 17

Slide 17 text

+BWB4DSJQU4%, EJTQMBZKT

Slide 18

Slide 18 text

EJTQMBZKT'FBUVSFT • Request to the ads delivery server • Parse response & build creative tags • Header Bidding wrapper • Logging for viewable impressions

Slide 19

Slide 19 text

EJTQMBZKT-JCSBSJFT • webpack for building • babel for compile • eslint for static analysis • eslint-plugin-compat (<- one of maintainers #) • karma / jasmine • pupetter as an emulator • istanbul for coverage

Slide 20

Slide 20 text

EJTQMBZKT3FRVFTU3FTQPOTF $ curl --globoﬀ ‘https://example-ads.com/display?slots[pc-top-panel-main][capacity]=1' | jq . { "slots": [ { "key": "pc-top-panel-main", "creatives": [ [ { "id": 62596, "template": "image", "media": { "mime_type": "image/jpeg", "original": "https://img5-ak.cpcdn.com/ad4/19584ec3bf844581a0cfd1917cd785d8.jpg?1535448767", "width": 300, "height": 600, "center_crop": false } } ]

Slide 21

Slide 21 text

3FTQPOTFKT EJTQMBZKTBSDIJUFDUVSF $SFBUJWFKT 4MPUKT 3FRVFTUKT 1BZMPBEKT )FBEFS#JEEJOH )FBEFS#JEEJOH 8SBQQFSKT -PHHJOH -PHHFSKT -PH3FDPSEKT -PHHFS$MJFOUKT

Slide 22

Slide 22 text

EJTQMBZKT)FBEFS#JEEJOH

Slide 23

Slide 23 text

IUUQTUFDIMJGFDPPLQBEDPNFOUSZ .PSF%FUBJMT

Slide 24

Slide 24 text

WT-FHBDZ

Slide 25

Slide 25 text

ϨΨγʔΞʔΩςΫνϟ wϝϯόʔ͕େ͖͘มΘΓҾ͖ܧ͗ࠔ೉ w ݱঢ়ͷίʔυͱHJUCMBNFHJUMPH w ࣾ಺ʹ͸Կਓ͔౰࣌ͷϝϯόʔ͕͍Δ͜ͱ͸·ͩٹ͍ wزଟ΋ͷ7FSTJPOJOH w ೖߘϩδοΫɺ഑৴ϩδοΫɺλʔήςΟϯάϩδοΫɺ 4%,7FSTJPO͢΂ͯಠཱͯ͠਺ੈ୅ଘࡏ͢Δ wػೳ։ൃ༏ઌɺϦΞʔΩςΫνϟઐ໳͸ෆࡏ w ϧʔϧͰ஍ಓʹย෇͚͍ͯͬͨ

Slide 26

Slide 26 text

ϨΨγʔͱͷઓ͍ํ wlௐࠪతϦϑΝΫλϦϯάzʹΑΔʮཧղʯ w ʰϨΨγʔιϑτ΢ΣΞվળΨΠυʱ wςετʹΑΔʮ඼࣭ʯͷݟ͑ΔԽ w ʰ૊৫ʹςετΛॻ͘จԽΛࠜ෇͔ͤΔઓུͱઓज़ʱ CZ!U@XBEB͞Μ wϦϑΝΫλϦϯάͷʮٕज़ʯΛ਎ʹ͚ͭΔ w ʢ࣍ܝʣ

Slide 27

Slide 27 text

ϦϑΝΫλϦϯάͷʮٕज़ʯͱ͸ ۜͷ஄ؙ͸ͳ͍ɺ஍ಓͳٕज़ͷੵΈॏͶ w3FBEBCJMJUZ w ʰ5IF"SUPG3FBEBCMF$PEFʱ wσβΠϯύλʔϯ w ʰ(BNF1SPHSBNNJOH1BUUFSOTʱ wΦϒδΣΫτࢦ޲ઃܭ w ʰΦϒδΣΫτࢦ޲ઃܭ࣮ફΨΠυʱ w FUD

Slide 28

Slide 28 text

ϦϑΝΫλϦϯάͷʮελϯεʯ wطଘͷίʔυϕʔε΁ͷʮଚܟʯ w ࠓͷձࣾͷച্Λ࡞ͬͨڝ૪ྗͷݯઘ wʮ͋Δ΂͖࢟ʯ͔Βߟ͑Δ w ൑அࡐྉʜࠓٻΊΒΕΔ࢓༷ɺϝϯόʔͷٕज़ϨϕϧɺӨڹ ൣғͱϦεΫ w໨తͱखஈΛࠞಉ͠ͳ͍ w αʔϏεͷ੒௕ΛՃ଎ͤ͞ɺ඼࣭ΛߴΊΔͨΊ w ಈతݴޠܕ੩తղੳ$*ʜશͯ͸खஈ

Slide 29

Slide 29 text

ਖ਼͍͠ίετ൑அΛ͢Δ ख౰ͨΓ࣍ୈʹ௚͞ͳ͍ɻ lࠓ೔Կ΋͠ͳ͍͜ͱͷɺ কདྷతͳίετ͸ͲΕ͚ͩ ͩΖ͏ʁz ʰΦϒδΣΫτࢦ޲ઃܭ ࣮ફΨΠυʱQ

Slide 30

Slide 30 text

$IBMMFOHFT

Slide 31

Slide 31 text

ٕज़తνϟϨϯδ wνʔϜͷεϩʔΨϯͰ΋͋Δ wٕज़తνϟϨϯδΛ௨ͨ͡੒Ռˍ੒௕ wٕज़తνϟϨϯδΛ͠ͳ͍ͱރΕͯ͠·͏ wΩϟϦΞҎલʹਫ਼ਆӴੜ্ඞཁ w؆୯ʹͰ͖Δ΋ͷ͸zνϟϨϯδzͰ͸ͳ͍ wࣗ෼ͷݶք஋Λ্͛ΔӦΈ

Slide 32

Slide 32 text

ԿΛʮνϟϨϯδʯ͢Δ͔ ʮ৽͍ٕ͠ज़ʯ͚͕ͩνϟϨϯδͰ͸ͳ͍ w ࣅͨΑ͏ͳϑϨʔϜϫʔΫΛ࢖ͬͨ͜ͱ͕͋Ε͹ɺֶͼ͸ ࣮͸গͳ͍ʢ͔΋͠Εͳ͍ʣ w ߴ඼࣭Λ࣮ݱ͢ΔͨΊͷϦΞʔΩςΫνϟɺίεύͷྑ͍ ςετɺγϡϛϨʔγϣϯ΍౷߹ςετͷ࢓૊Έɺϩάʹ ΑΔՄࢹԽɺೲظతͳνϟϨϯδ

Slide 33

Slide 33 text

ຖ೔ͷྉཧΛָ͠Έʹ͢Δ 5IBOLZPV