카카오 분석플랫폼 변천사

#AnalysisPlatform

카카오내 수천억건이 넘는 데이터 환경에서 비즈니스 의사 결정을 도울수 있는 데이터 분석플랫폼을 구축한 사례를
분석 플랫폼의 변화 과정을 통해 공유드리고자 합니다.

발표자 : jay.kim
카카오 데이터 연구실에서 데이터분석플랫폼을 개발하고 있는 jay 라고 합니다.

Transcript

1. $PQZSJHIU,BLBP$PSQ"MMSJHIUTSFTFSWFE3FEJTUSJCVUJPOPSQVCMJDEJTQMBZJTOPUQFSNJUUFEXJUIPVUXSJUUFOQFSNJTTJPOGSPN,BLBP
   ஠஠য়࠙ࢳ೒ۖಬ߸ୌࢎ
   JG LBLBP
   
   ӣथળ+BZ,JN
   
   
   ஠஠য়
   

   View Slide

2. %BUB"OBMZUJDT1MBUGPSN
   ࢲ࠺झ੄ؘ੉ఠܳࣻ૘ оҕ୊ܻೞৈ࠙ࢳೡࣻ੓ח೒ۖಬ
   ਋ࢶؘ੉ఠ࠙ࢳ೒ۖಬী؀೧ঌইࠇद׮
   

   View Slide

3. (PPHMF"OBMZUJDT "NQMJUVEF .JYQBOFM
   %BUB"OBMZUJDT1MBUGPSN
   ੉޷द઺ীח׮নೠ࠙ࢳ೒ۖಬٜ੉ઓ੤೤פ׮
   

   View Slide

4. %BUB"OBMZUJDT1MBUGPSN ਃҳࢎ೦
   
   4FHNFOU
   'VOOFM 'MPX
   3FUFOUJPO
   %BTICPBSE,1* 6TFS
   &YQMPSBUPSZ 8IBU8IZ)PX "#5FTU
   3FBM
   -
   UJNF 'BTU 4DBMBCMF
   ੉৬э਷׮নೠਃҳࢎ೦ٜ੉ઓ੤೤פ׮
   

   View Slide

5. ߊ಴૓೯
   
   
   ࠙ࢳ೒ۖಬਸѐߊೞݶࢲ੓঻؍ਃҳࢎ೦җ
   
   
   ҳഅदয۰਑ਸযڌѱ೧Ѿ೮ח૑
   
   
   ೒ۖಬ੄߸ୌҗ੿ਸా೧ҕਬܻ٘ѷणפ׮
   

   View Slide

6. ਃҳࢎ೦
   
   
   पदр௑బஎా҅ઁҕ
   
   
   ౟ې೗রѤੌ
   
   

   View Slide

7. ਃҳࢎ೦ ҳࢿ
   
   पदр௑బஎ௿ܼ
   "QBDIF
   
   
   NPEVMF
   
   8"4 .Z42-
   .Z42-
   
   
   GFEFSBUFE
   
   .Z42-ਸࢎਊೞৈࡅܰѱܻನ౴ਸҳഅೡࣻ੓਺
   
   
   ೞܖ੉࢚੄૑಴ܳࠁৈ઱ӟয۵Ҋӝр੉ӡয૑ݶ.Z42-ࠗೞоߊࢤೣ
   
   
   .Z42-؀੢গदәѺೠࣘب੷ೞߊࢤਵ۽ؘ੉ఠ੸੤ীب੉गߊࢤ
   

   View Slide

8. ਃҳࢎ೦
   
   
   ௑బஎా҅৻
   
   
   ࢲ࠺झ࠙दрੌ߹૑಴୶о
   
   
   ౟ې೗রѤੌ
   
   

   View Slide

9. ਃҳࢎ೦ ҳࢿ
   
   "QBDIF
   
   
   NPEVMF
   
   8"4 .Z42-
   .Z42-
   
   
   GFEFSBUFE
   
   ؘ੉ఠ۝੉݆ই૘҅ࢲߡܳ߹ب۽فয࠙૘҅୊ܻ ࢎਊ੗߹೧यೞৈ࠙࢑੷੢
   
   
   
   दрੌ߹૘҅ח0SBDMFীऺੋSBXؘ੉ఠӝ߈ਵ۽ߓ஖૘҅୊ܻ ࢜߷ߓ஖दр
   
   
   
   ૘҅ࢲߡ੢গद੹୓ؘ੉ఠ੸੤ী੉ग0SBDMF؀ীࢲ୊ܻೞ޲۽߽ݾߊࢤ
   ૘҅ࢲߡ D
   
   ؘ੉ఠ
   
   
   ࢥ٬
   ࠙૘҅Ѿҗ
   
   
   SBXEBUBJOTFSU ࢲ࠺झ૑಴ 6717
   
   0SBDMF
   पदр௑బஎ௿ܼ
   दр߹ੌ߹ߓ஖
   

   View Slide

10. ਃҳࢎ೦
    
    
    ௑బஎా҅ী׮ରਗ࠙ࢳ୶о
    

    View Slide

11. ਃҳࢎ೦ ௑బஎా҅
    
    ؘ੉ఠ઺р੷੢ࣗ۽,BGLBܳഝਊೞӝद੘
    
    
    &MBTUJDTFBSDIܳࢎਊೞৈ׮ରਗী؀ೠ࠙ࢳਃҳࢎ೦੉೧ࣗؽ
    
    
    67૘҅ࣘب੷ೞޙઁо)ZQFS-PH-PH )--
    ۽೧Ѿ
    
    
    2VFSZद5PQ/߂઺୏"HHSFHBUJPO੉૑ਗ
    
    
    &4ীपदр੸੤ܳਤ೧"QBDIF4UPSN࠙࢑दझమਸࢎਊೞӝद੘
    पदр௑బஎ௿ܼ
    
    
    ׮ରਗ࠙ࢳ
    
    

    View Slide

12. ਃҳࢎ೦
    
    
    উ੿੸ੋदझమҳઑѐࢶ
    
    
    "E
    -
    )PD2VFSZਃ୒؀਽
    

    View Slide

13. ਃҳࢎ೦ दझమҳઑѐࢶ
    
    BQBDIF
    
    
    NPEVMF
    
    GJMFT ࠙
    दр؀߹૘҅
    
    
    ׮নೠରਗ૘҅ ࢲ࠺झ૑಴
    0SBDMF
    ܻನ౴ప੉࠶
    ,FUUMF &5-ో
    
    ೞنীؘ੉ఠܳࠁҙೞҊ)JWF૘҅ܳా೧ഛ੢ࢿҗࣘببѐࢶ
    
    
    )JWFח׮নೠ૘҅୊ܻооמೞ૑݅߈਽ࣘبоו۰"E
    -
    )PD࠙ࢳਸਤ೧Ӓܽ೒ۢبੑ
    
    
    ׮নೠ૘҅୊ܻী؀ೠ'-08ҙܻܳਤ೧&5-ోਸبੑ
    
    
    

    View Slide

14. .11 .BTTJWF1BSBMMFM1SPDFTTJOH
    
    4.1ױੌݠन
    .11׮઺ݠन
    .11ߑध਷ഛ੢ࢿ੉ਊ੉ೞৈ0-"1ജ҃ীࢲࣘبо݆੉ѐࢶؽ
    

    View Slide

15. ਃҳࢎ೦
    
    
    पदр࠙ࢳ੄ਃҳ
    
    
    ׮ରਗ࠙ࢳী؀ೠਃҳ
    

    View Slide

16. %SVJE
    
    
    ׮ରਗ࠙ࢳী୭੸ചغয੓Ҋ3PMMVQҳઑܳా೧ࡅܲѾҗܳ঳ਸࣻ੓঻णפ׮
    
    
    )--߂5PQ/ਸ૑ਗೞৈ׮ରਗ࠙ࢳदࡅܲࣘبઁҕ
    
    
    ؘ੉ఠܳೞنীউ੹ೞҊࠁҙೡࣻ੓Ҋࢿמ੷ೞद੢࠺ૐࢸ੉ਊ੉ೠҳઑ
    
    
    
    ׮ରਗ࠙ࢳਸਤೠҊ޹
    *NQBMB1SFTUP
    
    
    ੢ӝрؘ੉ఠ࠙ࢳदܻࣗझܳҗبೞѱࢎਊೞৈ੸׼ೞ૑ঋওणפ׮
    ࣘب৬ഛ੢ࢿਸхউೞৈ%SVJEӝ߈ਵ۽ҳࢿѾ੿
    &MBTUJDTFBSDI
    
    
    ׮ରਗ࠙ࢳ੉оמೞҊରਗ೙٘੄୶ооਬোೠѪ੉੢੼੉঻णפ׮
    
    
    ೞ૑݅੢ӝрؘ੉ఠ࢝ੋदؘ੉ఠࢎ੉ૉоցޖழ૑Ҋ੤୊ܻоਊ੉ೞ૑ঋওणפ׮
    
    
    
    

    View Slide

17. ਃҳࢎ೦ ҳࢿ
    
    4QSJOH
    
    
    8FCGMVY
    
    ࢲ࠺झ૑಴
    ؘ੉ఠ୊ܻী-BNEB"SDIJUFDUVSFܳبੑ
    
    
    4UPSN؀न'MJOLܳࢎਊೞৈOBUJWFTUSFBNJOH੸ਊ &YBDUMZ
    -
    PODF
    
    
    
    %SVJEبੑਵ۽पदр߂׮ରਗ࠙ࢳѾҗઁҕ
    पदр
    ߓ஖ 4QBSL
    
    

    View Slide

18. ׮ରਗदпചోѐߊ
    %SVJEী୭੸ചػदпചో੉೙ਃ
    
    
    4VQFSTFU੉ա.FUBCBTF৬э਷ో੉੉޷੓঻૑݅
    
    
    ࢲ࠺झী୭੸ചػѐߊਸਤ೧য়೑ࣗझӝ߈ਵ۽੗୓ѐߊ
    

    View Slide

19. ਃҳࢎ೦
    
    
    1SPEVDU"OBMZUJDT5PPMী؀ೠਃҳ
    
    
    ࢎਊ੗೯క࠙ࢳী؀ೠҊبച
    (PPHMF"OBMZUJDT৬э਷ోѐߊ
    

    View Slide

20. ׮दೠߣࣁࠗ੸ੋਃҳࢎ೦ਸࠇद׮
    4FHNFOU
    'VOOFM 'MPX
    3FUFOUJPO
    %BTICPBSE,1* 6TFS
    &YQMPSBUPSZ 8IBU8IZ)PX "#5FTU
    3FBM
    -
    UJNF 'BTU 4DBMBCMF
    ੉۠ӝמҳഅ੉೙ਃ೤פ׮
    

    View Slide

21. ӝ߈%BUBCBTFઑࢎ
    %SVJE
    
    
    ũ׮ରਗ࠙ࢳ੉оמೞҊ׮নೠदпചోਸࢎਊ੉оמ
    
    
    ũࡅܲ௪ܻࣘب৬֢٘ૐࢸ੉ਊ੉
    
    
    ũ૘҅ػѾҗܳ੷੢ೞחҳઑৈࢲࢎਊ੗ױਤ੄࠙ࢳ੉য۰਑
    
    
    
    $MJDLIPVTF
    
    
    ũ૘҅ػѾҗоইצ3"8ࣻળ੄ؘ੉ఠܳ੷੢ೞৈࢎਊ੗ױਤ࠙ࢳ੉оמ
    
    
    ũࡅܲ௪ܻࣘب৬֢٘ૐࢸ੉оמ
    
    
    ũ'VOOFM 'MPX 3FUFOUJPO١׮নೠೣࣻઁҕ
    10$Ѿҗ$MJDLIPVTFӝ߈ਵ۽ҳࢿѾ੿
    

    View Slide

22. $MJDLIPVTFࣗѐ
    DMJDLIPVTFDPN
    য়೑ࣗझ
    
    
    IUUQT
    HJUIVCDPN$MJDL)PVTF$MJDL)PVTF
    
    
    
    $PMVNO
    -
    0SJFOUFE.11EBUBCBTF
    
    
    'BTU 'MFYJCMF 4DBMBCMF
    
    
    $PNQSFTTJPOBOEDPEFDTUPSFEVDF*0
    
    
    7FDUPSJ[FERVFSZFYFDVUJPO
    
    
    #VJMU
    -
    JOBOBMZUJDTDBQBCJMJUJFT
    

    View Slide

23. $MJDLIPVTFܳాೠਃҳࢎ೦ҳഅ
    

    View Slide

24. ࣁӒݢ౟࠙ࢳ
    

    View Slide

25. ࣁӒݢ౟࠙ࢳ
    ࣁӒݢ౟ۆ
    
    
    ౠ੿ઑѤਸо૑Ҋ੓חࢎਊ੗૘ױ
    Ѩ࢝ਬੑࢎਊ੗
    ߓցਬੑࢎਊ੗
    ৻ࠗਬੑࢎਊ੗
    যڃࢎਊ੗ҵ੉ࢲ࠺झীਬ੄޷ೠ૑଺חؘب਑੉ؾפ׮
    

    View Slide

26. ࣁӒݢ౟࠙ࢳ (PPHMF"OBMZUJDT
    
    
    

    View Slide

27. ࣁӒݢ౟࠙ࢳ $MJDLIPVTF
    
    ࢎਊ੗*%о೙ਃೞ޲۽ؘ੉ఠ੷੢दਗࠄӒ؀۽੷੢
    
    
    ࢎਊ੗*%ܳ೧यೞৈࢲߡ߹۽࠙࢑ప੉࠶ী੷੢
    
    
    ࣁӒݢ౟࠙ࢳ਷ѐ߹ࢎਊ੗֢٘ীࢲ߽۳୊ܻറܻఢ
    
    
    ஂ೤֢٘ীࢲ઺рѾҗ۽୭ઙ҅࢑
    
    
    Ѿҗ੸ਵ۽ѐ߹֢٘੄ࣘبঌ౵੿ب੄दр੉ࣗਃؽ
    /PEF /PEF /PEF
    *OJUJBUPS/PEF
    TFMFDUDPVOU EJTUJODUVTFSJE
    BTVW
    
    
    GSPNMPH
    
    
    XIFSFVTFSJEJO
    
    
    TFMFDUVTFSJEGSPNMPH@TIBSEXIFSF
    
    
    
    
    
    
    TFMFDUDPVOU EJTUJODUVTFSJE
    BTVW
    
    
    GSPNMPH
    
    
    XIFSFVTFSJEJO
    
    
    TFMFDUVTFSJEGSPNMPHXIFSF
    
    
    
    
    <࠙࢑ప੉࠶ࢎਊ>
    ࣻୌরѤؘ੉ఠীࢲࣁӒݢ౟࠙ࢳदಣӐࣻୡ੉ղ୊ܻоמ
    

    View Slide

28. ಌօ࠙ࢳ
    

    View Slide

29. ಌօ࠙ࢳ
    ಌօ࠙ࢳ਷઱۽੹ജ࠙ࢳীഝਊ೤פ׮
    
    

    View Slide

30. ಌօ࠙ࢳਃҳࢎ೦
    ಌօઑѤਸ׮নೞѱࣇ౴ೡࣻ੓যঠೣ
    
    
    पदрਵ۽࠙ࢳ੉оמ೧ঠೣ
    
    
    ࣁ࣌ۨ߰ীࢲदр੄൒ܴীٮܲ੹ജ҅࢑
    
    
    ׮নೠಁఢী؀ೠ୊ܻооמ "#$
    
    
    
    
    "#"$
    
    
    
    "##$
    

    View Slide

31. ಌօ࠙ࢳ $MJDLIPVTF
    
    XJOEPX'VOOFMೣࣻ۽рױ൤ҳഅоמ
    
    
    +0*/ 9
    
    
    
    XJUIWJTJUPSTBT
    
    
    TFMFDU
    
    
    VTFSJE
    
    
    NJO EBUF@JE
    BTNJO@EBUFJE
    
    
    GSPNMPHXIFSFOBNF)PNF
    
    
    HSPVQCZ
    
    
    IBWJOHNJO EBUF@JE
    CFUXFFOBOE
    
    
    
    
    
    
    TJHOVQTBT
    
    
    TFMFDU
    
    
    MVTFSJE NJO EBUF@JE
    BTNJO@EBUFJE
    
    
    GSPNWJTJUPSTW
    
    
    JOOFSKPJOMPHMPOMVTFSJEWVTFSJEBOEMEBUFJEWNJO@EBUFJE
    
    
    XIFSFMOBNFTJHOVQ
    
    
    HSPVQCZ
    
    
    
    
    
    
    BDUJWBUJPOTBT
    
    
    TFMFDU
    
    
    MVTFSJE
    
    
    GSPNTJHOVQTT
    
    
    JOOFSKPJOMPHMPOMVTFSJETVTFSJEBOEMEBUFJETNJO@EBUFJE
    
    
    XIFSFMOBNFBDUJWBUJPO
    
    
    HSPVQCZ
    
    
    
    
    
    
    TFMFDU)PNFBTTUFQ $06/5
    GSPNWJTJUPSTVOJPOBMM
    
    
    TFMFDU4JHO6QBTTUFQ $06/5
    GSPNTJHOVQTVOJPOBMM
    
    
    TFMFDU"DUJWBUFBTTUFQ $06/5
    GSPNBDUJWBUJPOT
    
    
    PSEFSCZDPVOUEFTD
    IUUQT
    QPQTRMDPNTRM
    -
    UFNQMBUFTNBSLFUJOHSVOOJOH
    -
    B
    -
    GVOOFM
    -
    BOBMZTJT
    TFMFDU
    
    
    MFWFM DPVOU
    "4D
    
    
    GSPN
    
    
    
    
    TFMFDU
    
    
    VTFSJE
    
    
    XJOEPX'VOOFM
    UJNFTUBNQ OBNF)PNF OBNFTJHOVQ OBNFBDUJWBUJPO
    "4MFWFM
    
    
    GSPNMPH
    
    
    XIFSFEBUF@JECFUXFFOBOE
    
    
    HSPVQCZVTFSJE
    
    
    
    
    
    
    HSPVQCZMFWFM
    
    
    PSEFSCZMFWFM
    <ӝઓ%#ߑध>
    <$MJDLIPVTF>
    

    View Slide

32. '-08࠙ࢳ
    

    View Slide

33. 'MPX࠙ࢳ
    
    '-08࠙ࢳ਷ࢎਊ੗੄੉ز൒ܴਸदпചೞৈ
    
    
    ࢲ࠺झղ੉ززࢶਸ୭੸ചೞחؘഝਊ೤פ׮
    

    View Slide

34. '-08࠙ࢳҳഅदয۰਍੉ਬ
    ࢎਊ੗'-08ח߸ࣻա҃਋੄ࣻоݒ਋݆ইࢎ੹૘҅оࠛоೣ
    
    
    ౠ੿ҳрীࢲ੄੹റоইצࣁ࣌ղ൒ܴਸ੹୓੸ਵ۽҅࢑റदпചܳ૓೯೧ঠೣ
    
    
    ࣁӒݢ౟աୡӝઑѤ١੄೙ఠ݂ઑѤਸ֍ਸࣻ੓যঠೣ
    
    
    ઺рਬੑژח੉ఎೞח҃਋ী؀ೠҊ۰
    
    
    

    View Slide

35. '-08࠙ࢳ $MJDLIPVTF
    
    TFRVFODF/FYU/PEFೣࣻ۽рױ൤ҳഅоמ୶о২࣌ਵ۽׮নೠઑѤࢶఖоמ
    4&-&$5
    
    
    GMPX@OFYU VOJR TFTTJPO@JE
    BTTFTTJPOT
    
    
    '30.
    
    
    
    
    4&-&$5
    
    
    TFTTJPO@JE
    
    
    TFRVFODF/FYU/PEF GPSXBSE IFBE
    UJNFTUBNQ QBHF QBHF)PNF
    "4GMPX@OFYU
    
    
    '30.MPH
    
    
    8)&3&EBUF@JE
    
    
    (3061#:TFTTJPO@JE
    
    
    
    
    
    
    (3061#:GMPX@OFYU
    
    
    03%&3#:TFTTJPO%&4$
    
    
    -*.*5
    TFRVFODF/FYU/PEF EJSFDUJPO CBTF
    UJNFTUBNQ FWFOU@DPMVNO CBTF@DPOEJUJPO FWFOU FWFOU FWFOU
    
    EJSFDUJPO'MPXоGPSXBSEੋ૑CBDLXBSEੋ૑Ѿ੿
    
    
    CBTF'MPX੄द੘੼ਸࢶఖ IFBE UBJM GJSTU@NBUDI MBTU@NBUDI
    
    
    
    FWFOU@DPMVNO'MPX࠙ࢳदࢎਊೡஸۢ ઱۽QBHFݺژחঘ࣌ݺ
    
    
    
    CBTF@DPOEJUJPOୡӝद੘ઑѤ
    
    
    FWFOU FWFOUѾҗ૒੹ઑѤ
    
    
    

    View Slide

36. "#5FTU
    

    View Slide

37. "#5FTU
    HPPEVJPSHMFBLTMJTU
    >
    "#5FTUחࢲ࠺झ੄૑ࣘ੸ੋѐࢶਸਤ೧ԙ೙ਃೠӝמੑפ׮
    
    
    അ੤஠஠য়ীࢲب׮নೠࢲ࠺झীࢲഝߊೞѱഝਊ઺ী੓णפ׮
    

    View Slide

38. "#5FTU $MJDLIPVTF
    
    $MJDLIPVTFܳా೧प೷Ѿҗܳपदрਵ۽҅࢑೧ࢲઁҕ೤פ׮
    
    
    ੉ܳా೧प೷࠙ࢳद૑಴ܳࡅܰѱഛੋೡࣻ੓णפ׮ ࣻୡ੉ղоמ
    
    
    
    प೷ҙ۲ೠ׮নೠ࠙ࢳѾҗب୶о۽ഛੋ੉оמ೤פ׮
    

    View Slide

39. ݃ޖܻ
    

    View Slide

40. ೞܖরѤ੿ب੄౟ې೗ਸ୊ܻೞחࣻળীࢲ
    
    
    ਘࣻୌরѤਸ࠙ࢳೞח೒ۖಬਵ۽ߊ੹೮णפ׮
    

    View Slide

41. хࢎ೤פ׮
    

    View Slide