Upgrade to Pro — share decks privately, control downloads, hide ads and more …

생성부터 활용까지, 게임데이터 Flow 따라가기

kakao
December 09, 2022

생성부터 활용까지, 게임데이터 Flow 따라가기

#DataLake

카카오게임즈의 모바일 게임 로그 데이터가 어떻게 생성되고 수집되는지, 이 수집된 데이터를 어떻게 처리하고 활용하는지에 대한 전체적인 과정을 소개합니다.

발표자 : kyle.l
카카오게임즈 BI팀 / DataLake TFT에서 ETL 및 데이터 엔지니어링 업무를 맡고 있는 kyle입니다

kakao

December 09, 2022
Tweet

More Decks by kakao

Other Decks in Programming

Transcript

  1. (BNF -PH 4FSWJDF -PH 1MBUGPSN 
 -PH BDUJPO JUFN QVSDIBTFj

    BVUI MPHJO IFBSUCFBUj ࢎ੹৘ড ࢸޙઑࢎj ۽Ӓؘ੉ఠ੄ઙܨ
  2. (BNF -PH 4FSWJDF -PH 1MBUGPSN -PH ੹୓ড5# ೞܖড(#ঀૐо BDUJPO JUFN

    QVSDIBTFj BVUI MPHJO IFBSUCFBUj ࢎ੹৘ড ࢸޙઑࢎj ۽Ӓؘ੉ఠ੄ઙܨ
  3. -BNCEB ,JOFTJT %BUB4USFBN ,JOFTJT 'JSFIPTF 4 *OHFTUJPO j JGDPEFBDUJPO PVUQVU"DUJPO-JTUBQQFOE

    HFU@T@EFGBVMU MPH@CPEZMPH#PEZ GBJMFE@SFDPSET DIFDL@BOE@GMVTI UBSHFU@MJTUPVUQVU"DUJPO-JTU EFMJWFSZ@TUSFBN@OBNFEML - SFBM - BDUJPO FMJGDPEFJUFN PVUQVU*UFN-JTUBQQFOE HFU@T@EFGBVMU MPH@CPEZMPH#PEZ GBJMFE@SFDPSET DIFDL@BOE@GMVTI UBSHFU@MJTUPVUQVU*UFN-JTU EFMJWFSZ@TUSFBN@OBNFEML - SFBM - JUFN FMJGDPEFrSFTPVSDF PVUQVU*UFN-JTUBQQFOE HFU@T@EFGBVMU MPH@CPEZMPH#PEZ GBJMFE@SFDPSET DIFDL@BOE@GMVTI UBSHFU@MJTUPVUQVU*UFN-JTU EFMJWFSZ@TUSFBN@OBNFEML - SFBM - SFTPVSDF j
  4. &YUFSOBM%BUB*OHFTUJPO *OHFTUJPO4FSWFS 1FOUBIP )BEPPQ "1* ,BGLB ,BLBP;POF "1* ജਯ ҟҊؘ੉ఠj

     1VCMJD;POF ,BLBPHBNFT;POF .8"" 5SJHHFS 4 *OHFTUJPO  .BOBHFE8PSLGMPXGPS"QBDIF"JSGMPX
  5. 1ZUIPO0QFSBUPS 44)0QFSBUPS #BTI0QFSBUPS j 4 "OBMZTJT 4 *OHFTUJPO 3FE4IJGU .BSU

    0QFSBUPS 4UFQ 4BWFSFQSPDFTTEBUFUJNF $SFBUFUBTLHSPVQ 3FGSFTIDVCF .8"" 4 "SUJGBDUT %BTI#PBSE #*4 'BDUPSZ 8PSLGMPX &.3 $MVTUFS j (JU)VC &OUFSQSJTF +FOLJOT
  6. .8"" 4 "OBMZTJT 4 "SUJGBDUT &.3 $MVTUFS (JU)VC &OUFSQSJTF 4

    *OHFTUJPO 3FE4IJGU .BSU +FOLJOT %BTI#PBSE #*4 'BDUPSZ 8PSLGMPX 1ZUIPO0QFSBUPS 44)0QFSBUPS #BTI0QFSBUPS j 0QFSBUPS 4UFQ 4BWFSFQSPDFTTEBUFUJNF $SFBUFUBTLHSPVQ 3FGSFTIDVCF j
  7. 4 *OHFTUJPO .8"" 4 "SUJGBDUT (JU)VC &OUFSQSJTF +FOLJOT 4 "OBMZTJT

    &.3 $MVTUFS 3FE4IJGU .BSU %BTI#PBSE #*4 1ZUIPO0QFSBUPS 44)0QFSBUPS #BTI0QFSBUPS j 0QFSBUPS 4UFQ 4BWFSFQSPDFTTEBUFUJNF $SFBUFUBTLHSPVQ 3FGSFTIDVCF 'BDUPSZ 8PSLGMPX j
  8. ৘द DPEFrSFTPVSDFs \BQQ*Et QMBZFS*Eĉ  BNPVOU DIBSBDUFS*Eĉ  DIBSBDUFS-W 

    DIBSBDUFS/Nĉ  DPVOUSZ58 EFMUB HBNF8PSMEĉXPSME NPE5JNF  NPE5ZQFBEE PT8JOEPXT QBJEV QMBZFS-W S$VSSFODZ(PME SFBTPO"@26&45  SFTPVSDF"UUS TVC3FBTPO&MJUF%VOHFPO MBOH[I - IBOU TFTTJPO*E  DMJFOU*Qu  NBSLFUVOLOPXO DPEFSFTPVSDF QVCMJTI5JNF MPH*Eĉ     ^ \BQQ*Et QMBZFS*E  BNPVOU DIBSBDUFS*E  DIBSBDUFS-W  DIBSBDUFS/N  DPVOUSZ,3 EFMUB HBNF8PSMEĉXPSME NPE5JNF  NPE5ZQFBEE PT8JOEPXT QBJEV QMBZFS-W S$VSSFODZ(PME SFBTPO"@1-": SFTPVSDF"UUS  TVC3FBTPO'JFME MBOHLP TFTTJPO*E DMJFOU*Q  NBSLFU VOLOPXO DPEFSFTPVSDF QVCMJTI5JNF MPH*Eĉ     ^
  9. .8"" 4 "SUJGBDUT (JU)VC &OUFSQSJTF +FOLJOT 4 "OBMZTJT &.3 $MVTUFS

    3FE4IJGU .BSU %BTI#PBSE #*4 4 *OHFTUJPO 1ZUIPO0QFSBUPS 44)0QFSBUPS #BTI0QFSBUPS j 0QFSBUPS 4UFQ 4BWFSFQSPDFTTEBUFUJNF $SFBUFUBTLHSPVQ 3FGSFTIDVCF 'BDUPSZ 8PSLGMPX j
  10. QMBZFSJE HET@DE STO@DE BNU TFSWFS  HPME "@1-":  XPSME

     HPME "@26&45  XPSME  HPME "@1-":  XPSME  HPME "@26&45  XPSME  HPME "@1-":  XPSME  HPME "@1-":  XPSME  HPME "@26&45  XPSME  HPME "@26&45  XPSME  HPME "@26&45  XPSME  HPME "@1-":  XPSME %BUB8BSFIPVTF HET@DE STO@DE TFSWFS DOU TVN HPME "@1-": XPSME   HPME "@1-": XPSME   HPME "@1-": XPSME   HPME "@26&45 XPSME   HPME "@26&45 XPSME   4VNNBSZ%BUB
  11. 3FE4IJGU .BSU %BTI#PBSE #*4 .8"" +FOLJOT 4 "SUJGBDUT (JU)VC &OUFSQSJTF

    4 "OBMZTJT &.3 $MVTUFS 4 *OHFTUJPO 'BDUPSZ 8PSLGMPX 1ZUIPO0QFSBUPS 44)0QFSBUPS #BTI0QFSBUPS j 0QFSBUPS 4UFQ 4BWFSFQSPDFTTEBUFUJNF $SFBUFUBTLHSPVQ 3FGSFTIDVCF j
  12. 3FE4IJGU .BSU HET@DE STO@DE TFSWFS DOU TVN HPME "@1-": XPSME

      HPME "@1-": XPSME   HPME "@1-": XPSME   HPME "@26&45 XPSME   HPME "@26&45 XPSME   3FTPVSDF 4VNNBSZ%BUB *UFN "DUJPO 3PVOE 1VSDIBTF *EQ-PHJO j j 4 "OBMZTJT .8"" %BTI#PBSE #*4 4QFDUSVN
  13. $POOFDUPS PO&$ ,BGLB $POOFDUPS PO&$ "VUP4DBMJOH(SPVQ 4 *OHFTUJPO ,JOFTJT 'JSFIPTF

    "CVTJOH %FUFDUJPO 3FBMUJNF"CVTJOH%FUFDUJPO 3.4ZTUFN "UIFOB
  14.          

         য࠭૚ߊࢤ  ੿೧૓3VMFী੄೧ࢲ੉࢚ਬ੷ܳఐ૑  ઱۽؀दࠁ٘ীࢲয࠭૚ਸ౵ঈ  ঌۈ ੗زࠁഐઑ஖ *1ରױ 71/ "4/١ 3VMF - CBTFE"CVTJOH%FUFDUJPO 3.