Elasticsearch as a DMP

第11回Elasticsearch勉強会LT資料

Transcript

1. Intimate Merger Inc. Elasticsearch as a DMP  Kazuki Matsuda
2. about me Kazuki Matsuda Intimate Merger Inc. (Employees: 9) Development Division Job content • IT Infra Structure • Development of open DMP - AudienceSearch • Such as BlueKai, Krux, Demdex 
3. Elasticsearch as a DMP 
4. What is DMP ? 
5. DMP is … DMP (Data Management Platform) is • The Platform for centralized management and analyzing • about Audience Data • web site, e-commerce • Internet Survey • offline data • others… • to achieve the optimization of the marketing action plan 
6. DMP is …  %.1 Partner Media Internet Survey PrivateDMPʢ1st Partyʣ Ad Serving Other Tools Data Provider
7. DMP is …  %.1 Partner Media Internet Survey PrivateDMPʢ1st Partyʣ Ad Serving Other Tools 1TZDIPHSBQIJD %FNPHSBQIJD 4JUF
   "DDFTT Data Provider (FPHSBQIJD
8. Practical use of Elasticsearch Our DMP contains 360 Million IDs (3rd Party Cookie) • Psychographic Data (Partner Media) • Demographic Data (Internet Survey) • User Agent (Access Log) • Geographic Data (remote IP Address & Ͳ͜Ͳ͜JP) • etc… Practical use of elasticsearch • Extraction of IDs in any conditions • Analysis of the audience group   .JMMJPO
9. Data Flow  Update Update Update JOIN ※Distinct by ID (KVS)
10. Data Flow  Update Update Update JOIN ※Distinct by ID (KVS) 1TZDIPHSBQIJD %FNPHSBQIJD 4JUF
    "DDFTT (FPHSBQIJD
11. Data on Elasticsearch  @JE TFHNFOU LFZXPSET VTFS@BHFOU BSFB PSH  <
    > <5SJQ
    )BXBJJ> .BD
    4BGBSJ 5PLZP *OUJNBUF
    .FSHFS  <
    
    > <TVTIJ
    TPDDFS> 8JO
    $ISPNF $IJCB   <> <FMBTUJDTFBSDI> "OESPJE
    $ISPNF 5PLZP 3FDSVJU Total Documents: 360 Million Total Size: 1TB Sample
12. Usage example Case1: Ad Serving • Target • Female • Age: 20-29 • Interested in trip to Hawaii • in Tokyo Case2: Analyzing • Comparison of some audience groups • Extraction of features 
13. Case1: Ad Serving  %.1 Partner Media Internet Survey PrivateDMPʢ1st Partyʣ Ad Serving Other Tools 5SJQ
    )BXBJJ 'FNBMF
    "HF
     Data Provider JO
    5PLZP
14. Case2: Analyzing  keyword: “elasticsearch" Streaming Streaming Engine johtani
15. Case2: Analyzing  keyword: “elasticsearch" Advertising
16. Case2: Analyzing  keyword: “elasticsearch" Cyber Agent Inc.
17. Case2: Analyzing  keyword: “elasticsearch" Male
18. Case2: Analyzing  keyword: “elasticsearch"
19. Demo 
20. Thank you 
21. ΤϯδχΞืू ࠷৽ͷٕज़ʹڵຯͷ͋Δ৽ϝϯόʔΛืूதͰ͢ʂ  ࠾༻ٕज़ ։ൃج൫