Elasticsearch as a DMP - Speaker Deck

Slide 1

Slide 1 text

Intimate Merger Inc. Elasticsearch as a DMP Kazuki Matsuda

Slide 2

Slide 2 text

about me Kazuki Matsuda Intimate Merger Inc. (Employees: 9) Development Division Job content • IT Infra Structure • Development of open DMP - AudienceSearch • Such as BlueKai, Krux, Demdex

Slide 3

Slide 3 text

Elasticsearch as a DMP

Slide 4

Slide 4 text

What is DMP ?

Slide 5

Slide 5 text

DMP is … DMP (Data Management Platform) is • The Platform for centralized management and analyzing • about Audience Data • web site, e-commerce • Internet Survey • ofﬂine data • others… • to achieve the optimization of the marketing action plan

Slide 6

Slide 6 text

DMP is … %.1 Partner Media Internet Survey PrivateDMPʢ1st Partyʣ Ad Serving Other Tools Data Provider

Slide 7

Slide 7 text

DMP is … %.1 Partner Media Internet Survey PrivateDMPʢ1st Partyʣ Ad Serving Other Tools 1TZDIPHSBQIJD %FNPHSBQIJD 4JUF"DDFTT Data Provider (FPHSBQIJD

Slide 8

Slide 8 text

Practical use of Elasticsearch Our DMP contains 360 Million IDs (3rd Party Cookie) • Psychographic Data (Partner Media) • Demographic Data (Internet Survey) • User Agent (Access Log) • Geographic Data (remote IP Address & Ͳ͜Ͳ͜JP) • etc… Practical use of elasticsearch • Extraction of IDs in any conditions • Analysis of the audience group .JMMJPO

Slide 9

Slide 9 text

Data Flow Update Update Update JOIN ※Distinct by ID (KVS)

Slide 10

Slide 10 text

Data Flow Update Update Update JOIN ※Distinct by ID (KVS) 1TZDIPHSBQIJD %FNPHSBQIJD 4JUF"DDFTT (FPHSBQIJD

Slide 11

Slide 11 text

Data on Elasticsearch @JE TFHNFOU LFZXPSET VTFS@BHFOU BSFB PSH < > <5SJQ )BXBJJ> .BD4BGBSJ 5PLZP *OUJNBUF.FSHFS < > 8JO$ISPNF $IJCB <> "OESPJE$ISPNF 5PLZP 3FDSVJU Total Documents: 360 Million Total Size: 1TB Sample

Slide 12

Slide 12 text

Usage example Case1: Ad Serving • Target • Female • Age: 20-29 • Interested in trip to Hawaii • in Tokyo Case2: Analyzing • Comparison of some audience groups • Extraction of features

Slide 13

Slide 13 text

Case1: Ad Serving %.1 Partner Media Internet Survey PrivateDMPʢ1st Partyʣ Ad Serving Other Tools 5SJQ )BXBJJ 'FNBMF "HF Data Provider JO5PLZP

Slide 14

Slide 14 text

Case2: Analyzing keyword: “elasticsearch" Streaming Streaming Engine johtani

Slide 15

Slide 15 text

Case2: Analyzing keyword: “elasticsearch" Advertising

Slide 16

Slide 16 text

Case2: Analyzing keyword: “elasticsearch" Cyber Agent Inc.

Slide 17

Slide 17 text

Case2: Analyzing keyword: “elasticsearch" Male

Slide 18

Slide 18 text

Case2: Analyzing keyword: “elasticsearch"

Slide 19

Slide 19 text

Demo

Slide 20

Slide 20 text

Thank you

Slide 21

Slide 21 text

ΤϯδχΞืू ࠷৽ͷٕज़ʹڵຯͷ͋Δ৽ϝϯόʔΛืूதͰ͢ʂ ࠾༻ٕज़ ։ൃج൫