Cookpad and Prometheus

https://prometheus.connpass.com/event/127574/ での発表資料です

Transcript

1. $PPLQBEBOE1SPNFUIFVT
   ؙحؙػحس吳䒭⠓爡䪮遭鿇43&ؚٕ٦ف
   し䊛畆㣕 !SSSFFFZZZ
   
   1SPNFUIFVT5PLZP.FFUVQ
   ]:PTIJLBXB3ZPUB !SSSFFFZZZ
   
   

   View Slide

2. !SSSFFFZZZ
   !SSSFFFZZZ
   IUUQTSSSFFFZZZDPN
   :PTIJLBXB3ZPUB
   .F
   ˖ :PTIJLBXB3ZPUB !SSSFFFZZZ[reɪ]
   
   ˖ ؙحؙػحس吳䒭⠓爡 ։
   
   ˖ 䪮遭鿇43&ؚٕ٦ف
   ˖ 莆㄂걄㚖
   ˖ 0CTFSWBCJMJUZ 5JNFTFSJFTEBUBCBTF
   ˖ 馯㄂
   ˖ QVZP FPS[FB MFBHVFPGMFHFOET
   ˖ TFJZV SFTUBHF XVH
   1SPNFUIFVT5PLZP.FFUVQ
   ]:PTIJLBXB3ZPUB !SSSFFFZZZ
   
   

   View Slide

3. 1SPNFUIFVT5PLZP.FFUVQ
   ]:PTIJLBXB3ZPUB !SSSFFFZZZ
   
   

   View Slide

4. !
   1SPNFUIFVT5PLZP.FFUVQ
   ]:PTIJLBXB3ZPUB !SSSFFFZZZ
   
   

   View Slide

5. $PPLQBEBOE1SPNFUIFVT
   ˖ 䎃ּ׵ְַ׵䖚ղחⵃ欽׾㨣׭גְ׷
   ˖ EBTICPBSEה׃גכ(SBGBOB׾⢪׏גְ׷
   ˖ "84ך&$؎ٝأةٝأ♳ח㾜Ꟛ
   ˖ ٔ٦آّٝ׀הח1SPNFUIFVT؟٦غָ〴ٙٝإحز׆א֮׷
   ˖ ➙ך䨽BQOPSUIFBTUהVTFBTUח〴׆א
   ˖ OPEF D"EWJTPS FOWPZ NUBJM IBQSPYZ FMBTUJDTFBSDI WBSOJTI VFOUE BQQ
   ˖ *P5堣㐻זוך湊鋔ח׮⢪׻׸כׄ׭גְ׷
   1SPNFUIFVT5PLZP.FFUVQ
   ]:PTIJLBXB3ZPUB !SSSFFFZZZ
   
   

   View Slide

6. 1SPNFUIFVT5PLZP.FFUVQ
   ]:PTIJLBXB3ZPUB !SSSFFFZZZ
   
   

   View Slide

7. 1SPNFUIFVT5PLZP.FFUVQ
   ]:PTIJLBXB3ZPUB !SSSFFFZZZ
   
   

   View Slide

8. 1SPNFUIFVT5PLZP.FFUVQ
   ]:PTIJLBXB3ZPUB !SSSFFFZZZ
   
   

   View Slide

9. 1SPNFUIFVT5PLZP.FFUVQ
   ]:PTIJLBXB3ZPUB !SSSFFFZZZ
   
   

   View Slide

10. 1SPNFUIFVTך⢪׻׸倯
    ˖ ؝ٝذشװىسٕؐؑ،ךٔا٦أ׾鋅׷
    ˖ (SBGBOBדتحءُن٦س׾⡲䧭׃גꠘ鋮דֹ׷״ֲח׃גְ׷
    ˖ ؝ٝذش橆㞮Ⱏ鸐דך،ٓ٦ز׾㹀纏׃גꟚ涪罏ח㾈ֽ׷
    ˖ Ꟛ涪罏ָ铩ד׮㹀纏׃׋׶㢌刿׃׋׶ׅ׷ֿהָדֹ׷朐䡾ח׃גְ׷
    ˖ ،فٔ؛٦ءّٝ㔿剣ךًزؙٔأ׾⡲׏ג湊鋔ׅ׷
    ˖ Ꟛ涪罏ָ荈ⴓך،فٔ؛٦ءّٝד䗳銲זًزؙٔأ׾FYQPSUׅ׷
    ˖ 7J[DFSBMזו׾⢪׏גو؎ؙٗ؟٦ؽأךزٓؿ؍حؙךⰋ⡤⫷׾然钠ׅ׷
    1SPNFUIFVT5PLZP.FFUVQ
    ]:PTIJLBXB3ZPUB !SSSFFFZZZ
    
    

    View Slide

11. 1SPNFUIFVT5PLZP.FFUVQ
    ]:PTIJLBXB3ZPUB !SSSFFFZZZ
    
    

    View Slide

12. 1SPNFUIFVT5PLZP.FFUVQ
    ]:PTIJLBXB3ZPUB !SSSFFFZZZ
    
    

    View Slide

13. 1SPNFUIFVT5PLZP.FFUVQ
    ]:PTIJLBXB3ZPUB !SSSFFFZZZ
    
    

    View Slide

14. 麊欽דך䊨㣗
    1SPNFUIFVT5PLZP.FFUVQ
    ]:PTIJLBXB3ZPUB !SSSFFFZZZ
    
    

    View Slide

15. 1SPNFUIFVT5PLZP.FFUVQ
    ]:PTIJLBXB3ZPUB !SSSFFFZZZ
    
    

    View Slide

16. 4FSWJDFEJTDPWFSZ
    ˖ ؎ٝأةٝأך湊鋔דכec2_sd_config׾兛鸐חⵃ欽׃גְ׷
    ˖ &$4ך؝ٝذشזוך湊鋔דכ؟٦ؽأؕةؚٗ׾荈⡲׃גTE׃גְ׷
    ˖ file_sd_configך䕎䒭׾鵤ׅIUUQؒٝسه؎ٝز׾欽䠐׃ג㹀劍涸ח《׶ח遤׏גְ׷
    4PNF4%NFDIBOJTNTIBWFSBUFMJNJUTUIBUNBLFUIFNDIBMMFOHJOHUPVTF"TBO
    FYBNQMFXFIBWFVOGPSUVOBUFMZIBEUPSFKFDU"NB[PO&$4TFSWJDFEJTDPWFSZEVFUPUIF
    SBUFMJNJUTCFJOHTPMPXUIBUJUXPVMEOPUCFVTBCMFGPSBOZUIJOHCFZPOETNBMMTFUVQT
    IUUQTHJUIVCDPNQSPNFUIFVTQSPNFUIFVTCMPCCBGDFCFBEFEDG
    EJTDPWFSZ3&"%.&NEPUIFSJNQMFNFOUBUJPODPOTJEFSBUJPOT
    1SPNFUIFVT5PLZP.FFUVQ
    ]:PTIJLBXB3ZPUB !SSSFFFZZZ
    
    

    View Slide

17. exporter_proxy
    ˖ IUUQTHJUIVCDPNSSSFFFZZZFYQPSUFS@QSPYZ
    ˖ :".-ד䭷㹀׃׋ػأ׾「ֽג㼎䘔ׅ׷63-חفٗؗءׅ׷׌ֽך׮ך
    ˖ &$؎ٝأةٝأזוך湊鋔דכexporter_proxyהְֲٔغ٦أفٗؗء׾饯⹛׃גְ׷
    ˖ 饯⹛ׅ׷FYQPSUFS׋׍כMPDBMדMJTUFO׃גexporter_proxy׾穗歋׃ג،ؙإأׁ׸׷
    ˖ FYQPSUFS׀החⵃ欽ׅ׷ه٦زָ麩ֲךד鿪䏝THזו׾㢌刿ׅ׷ךָ꬗⦜٥ٔأָؙ֮׷
    ˖ IUUQTHJUIVCDPNQSPNFUIFVTQSPNFUIFVTXJLJ%FGBVMUQPSUBMMPDBUJPOT
    ˖ /HJOYזוד׮葺ְָ؟٦ؽأד⢪׏גְ׷׮ךהٌصةؚٔٝ欽ך׮ך׾ⴓֽ׋ַ׏׋
    1SPNFUIFVT5PLZP.FFUVQ
    ]:PTIJLBXB3ZPUB !SSSFFFZZZ
    
    

    View Slide

18. exporter_proxyך鏣㹀
    listen: 0.0.0.0:9099
    exporters:
    statsd_exporter:
    url: http://localhost:9102/metrics
    path: "/statsd_exporter/metrics"
    cadvisor:
    url: http://localhost:9103/metrics
    path: "/cadvisor/metrics"
    node_exporter:
    url: http://localhost:9100/metrics
    path: "/node_exporter/metrics"
    error_log:
    path: "/var/log/exporter_proxy.log"
    1SPNFUIFVT5PLZP.FFUVQ
    ]:PTIJLBXB3ZPUB !SSSFFFZZZ
    
    

    View Slide

19. 1SPNFUIFVT5PLZP.FFUVQ
    ]:PTIJLBXB3ZPUB !SSSFFFZZZ
    
    

    View Slide

20. 1SPNFUIFVTך3VMFך盖椚
    ˖ 1SPNFUIFVTַ׵،ٓ٦زׅ׷׋׭ך3VMF׾+TPOOFU׾欽ְג()&♳ד盖椚׃גְ׷
    ˖ FYBNQMFIUUQTHJUIVCDPNSSSFFFZZZEPDLFSQSPNFUIFVTNJYJO
    ˖ 13ָو٦آׁ׸׷ה$*ָذأزװDPOHUFTU׾׃׋♳ד+TPOOFUַ׵:".-ח㢌䳔׃ג4ח縧ַ׸׷
    ˖ 1SPNFUIFVT؟٦غכ㹀劍涸ח4׾鋅ח遤׏ג刿倜ָ֮׸ל《䖤׃גSFMPBEׅ׷
    ˖ ז׈+TPOOFUזךַ
    ˖ 湊鋔鏣㹀׾ׅ׷ꥷחذٝفٖ٦ز⻉װ꠬⦼זוך㢌侧ך⢪ְ㔐׃׾遤ְ׋ַ׏׋
    ˖ &$4ך㛇湍דכ؝ٝذشך؟٦ؽأ㹀纏׾+TPOOFUד鎸鶢ׅ׷ךדꟚ涪罏ח׮꼧厩׫ָ֮׷
    ˖ 湊鋔ך孖⚺⻉ך׋׭ח׮ז׷ץֻ꼧厩׫ך֮׷圓俑׾䱰欽׃׋ַ׏׋
    ˖ IUUQTHJUIVCDPNQSPNFUIFVTQSPNFUIFVTQVMMדⰕ䒭ח׮䲿周ׁ׸גְ׷
    ˖ 鎸岀׾קה׿וֿ׸ח䲧ִגְ׷ךד獳遤׃״ֲה䙼ִל獳遤׮דֹ׉ֲ
    1SPNFUIFVT5PLZP.FFUVQ
    ]:PTIJLBXB3ZPUB !SSSFFFZZZ
    
    

    View Slide

21. 1SPNFUIFVT5PLZP.FFUVQ
    ]:PTIJLBXB3ZPUB !SSSFFFZZZ
    
    

    View Slide

22. MBCFMTBOOPUBUJPOTך崞欽
    ˖ BOOPUBUJPOTח،ٓ٦زחꟼ鸬ׅ׷䞔㜠׾Ⰵ׸׷ֿהָדֹ׷
    ˖ SVOCPPLך״ֲז،ظذ٦ءّٝח63-׾Ⰵ׸גֶֻ
    ˖ ،ٓ٦زך㼎䘔倯岀׾鎸׃׋سًُؗٝز׾剅ֻ
    ˖ ،ٓ٦زך鸐濼儗ח׮⦼ָ床׏גֻ׷ךד鸐濼חⰅ׸׵׸׷
    ˖ ➭ח׮،ٓ٦ز涪欰儗ח㹋遤׃גק׃ְ؝وٝس׾剅ֻBOOPUBUJPO׾Ⰵ׸ג׫׋׶
    ˖ ،ٓ٦زך♧如荈⹛㼎䘔זוד嗚鎢דֹ׉ֲ
    ˖ ،ٓ٦زָ涪欰׃׋׵"MFSUNBOBHFSָ8FCIPPL׾굲ל׃ג؝وٝس׾㹋遤ׅ׷暟׾⡲׸׉ֲ
    IUUQTHJUMBCDPNHJUMBCDPNSVOCPPLT
    1SPNFUIFVT5PLZP.FFUVQ
    ]:PTIJLBXB3ZPUB !SSSFFFZZZ
    
    

    View Slide

23. 1SPNFUIFVT5PLZP.FFUVQ
    ]:PTIJLBXB3ZPUB !SSSFFFZZZ
    
    

    View Slide

24. 1SPNFUIFVT5PLZP.FFUVQ
    ]:PTIJLBXB3ZPUB !SSSFFFZZZ
    
    

    View Slide

25. "MFSUNBOBHFSך鏣㹀
    ˖ 1SPNFUIFVTך3VMFהずֻׄ+TPOOFU׾欽ְג()&♳ד盖椚׃גְ׷
    ˖ ずֻׄ13ָو٦آׁ׸׷ה+TPOOFU:".-חז׶4ח縧ַ׸׷
    ˖ "MFSUNBOBHFSכ㹀劍涸ח4׾鋅ח遤ֹ刿倜ָ֮׸לSFMPBEׅ׷
    ˖ 鸐濼ד⢪ֲUFNQMBUFזו׮()&♳ד盖椚׃גְגずׄ➬穈׫דرفٗ؎ׁ׸׷
    ˖ SPVUJOHָוֲ遤׻׸׷ַ罋ִ׷ךָ㼰׃ꨇ׃ְָؔٝٓ؎ٝخٔ٦ؒر؍ةָ֮׷ךד⢪ֲה⤑ⵃ
    ˖ IUUQTQSPNFUIFVTJPXFCUPPMTBMFSUJOHSPVUJOHUSFFFEJUPS
    ˖ 4MBDL鸐濼ך鏣㹀׾⡲׶׋ְהֹכQSPNTMBDLהְֲ8FC؟؎زָ֮׷ךד⢪ֲה⤑ⵃ
    ˖ IUUQTKVMJVTWDPNQSPNTMBDL
    ˖ <⡭锑>"MFSUNBOBHFSך鏣㹀כسًُؗٝزָ㼰זְ孡ָ׃גְגⰅꟌ1SPNFUIFVTָ♧殢鑫׃ְ孡ָׅ׷
    1SPNFUIFVT5PLZP.FFUVQ
    ]:PTIJLBXB3ZPUB !SSSFFFZZZ
    
    

    View Slide

26. ؝ٝذش㛇湍הך鸬䵿
    ˖ Ꟛ涪罏ָⵃ欽ׅ׷؝ٝذش㛇湍Ⰻ⡤דⰟ鸐ך،ٓ٦ز׾㹀纏׃㨣׭גְ׷
    ˖ ؝ٝذش荈⡤ךًٌٔⵃ欽桦 ؟؎سؕ٦&OWPZךDJSDVJUCSFBLFSך⦼
    ˖ ؝ٝذش㹀纏ך⚥ד䭁䓸圓俑ה׃ג،ٓ٦زך鸐濼⯓׾剅ֽ׷״ֲח׃גְ׷
    ˖ ؝ٝذش㹀纏ח剅ַ׸׋ثٍٝطٕח،ٓ٦زָ鸐濼ׁ׸׷״ֲחז׏גְ׷
    ˖ ؝ٝذش㹀纏ָ刿倜ׁ׸׷ה"MFSUNBOBHFSך鏣㹀׮荈⹛ד刿倜ׁ׸׷״ֲז׃ֻ׫
    ˖ +TPOOFUזךדGPSד㔐׃׋׶׃ג荈⹛ד㹀纏דֹ׷״ֲחז׏גְ׷
    ˖ ׮׃ֻכ"MFSUNBOBHFSךUFNQMBUFד갹䓸׷ֿהדずׄ״ֲז➬穈׫כ㹋植דֹ׉ֲ
    1SPNFUIFVT5PLZP.FFUVQ
    ]:PTIJLBXB3ZPUB !SSSFFFZZZ
    
    

    View Slide

27. 1SPNFUIFVT5PLZP.FFUVQ
    ]:PTIJLBXB3ZPUB !SSSFFFZZZ
    
    

    View Slide

28. 1SPNFUIFVT5PLZP.FFUVQ
    ]:PTIJLBXB3ZPUB !SSSFFFZZZ
    
    

    View Slide

29. תה׭
    ˖ ؙحؙػحسדך1SPNFUIFVTך鋉垷װ⢪׻׸倯װ麊欽倯岀׾稱➜
    ˖ exporter_proxyזו׾欽ְג醱侧ךFYQPSUFS׾盖椚׃גְ׷
    ˖ +TPOOFU׾欽ְג厫鮾ח鏣㹀׾剅ֽ׷״ֲח׃גְ׷
    ˖ 1SPNFUIFVTךSVMF "MFSUNBOBHFSך鏣㹀
    ˖ ؝ٝذش㹀纏זוה鸬䵿׃ג،ٓ٦زך鸐濼⯓׾鏣㹀דֹ׷״ֲח׃גְ׷
    ˖ -POHUFSNTUPSBHFזות׌ת׌׍ׯ׿ה׃׋ְ堣腉ְָ׹ְ׹
    1SPNFUIFVT5PLZP.FFUVQ
    ]:PTIJLBXB3ZPUB !SSSFFFZZZ
    
    

    View Slide

30. 8FBSFIJSJOH
    ˖ IUUQTDPPLQBEKPCT
    ˖ IUUQTDPPLQBEXPSLBCMFDPN
    1SPNFUIFVT5PLZP.FFUVQ
    ]:PTIJLBXB3ZPUB !SSSFFFZZZ
    
    

    View Slide