Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Cookpad and Prometheus

28e154e6e0351c70091997d2f574295a?s=47 rrreeeyyy
June 03, 2019
Technology
6
18k

Cookpad and Prometheus

https://prometheus.connpass.com/event/127574/ での発表資料です

28e154e6e0351c70091997d2f574295a?s=128

rrreeeyyy

June 03, 2019
Tweet

More Decks by rrreeeyyy

See All by rrreeeyyy
SRE の歩き方・進め方 / sre-walk-through-procedure
28e154e6e0351c70091997d2f574295a?s=48 rrreeeyyy
0
2.7k
「信頼性」を保ちつつ大規模サービスをリニューアルする / cookpad-tech-kitchen-service-embedded-sres
28e154e6e0351c70091997d2f574295a?s=48 rrreeeyyy
11
9.4k
SRE-Lounge-8-Cookpad-Microservice-Architecture-Overview
28e154e6e0351c70091997d2f574295a?s=48 rrreeeyyy
5
4.3k
A survey of anomaly detection methodologies for web system
28e154e6e0351c70091997d2f574295a?s=48 rrreeeyyy
5
800
エンジニアリングをちゃんとやる あるいは 人類の平和 について / wsa02-rrreeeyyy
28e154e6e0351c70091997d2f574295a?s=48 rrreeeyyy
13
2.6k
「自立」したWebシステムを創る。自分の好きなことをする世界を目指して。/ ipsj-one-2018-rrreeeyyy
28e154e6e0351c70091997d2f574295a?s=48 rrreeeyyy
3
1.5k
Web サービスの信頼性と運用の自動化について / iot40-rrreeeyyy
28e154e6e0351c70091997d2f574295a?s=48 rrreeeyyy
12
6.8k
SRE at Cookpad
28e154e6e0351c70091997d2f574295a?s=48 rrreeeyyy
1
980
Prometheus 実践入門 #hbstudy 79 / introduction-to-prometheus-practice
28e154e6e0351c70091997d2f574295a?s=48 rrreeeyyy
16
2.7k

Other Decks in Technology

See All in Technology
Scrum Fest Osaka 2022 段階的スクラムマスターのススメ
68073cc248e24e0b94cc6895e5c4710f?s=48 orimomo
0
780
What's new in Vision
53e2d354b3299d64a54af680865516d5?s=48 satotakeshi
0
210
Introduction To Technical Writing
E7bc9823fd0076b90769b25f1caf54b6?s=48 olawanle_joel
0
100
Custom GitHub Actions by Java
E68f2e8b47dc1769380a1fa8181df3dd?s=48 kazamori
0
290
ノーコードで Stripeを使いこなす３つの方法 / jp-stripes-online-vol-4
E77ca94266ffd3d69f8aee91f7468264?s=48 stripehideokamoto
0
260
スタートアップと技術選定と AWS
Bf5ee9059859ed5d855b5ff4680e63e2?s=48 track3jyo
PRO
2
340
モブに早く慣れたい人のためのガイド / A Guide to Getting Started Quickly with Mob Programming
A97eee01397705443a72a48ce29d3e19?s=48 cybozuinsideout
PRO
2
1.8k
プログラマがオブジェクト指向しても幸せになれない理由
Bf7fe621f4fe1615c228ef8a79b87282?s=48 shirayanagiryuji
0
140
リファインメントは楽しいかね？
F4ea0f5f6211de72f79576d020308de5?s=48 kitamu_mu
1
440
Azure Arc Virtual MachineとAzure Arc Resource Bridge / VM provisioning through Azure portal on Azure Stack HCI (preview)
D99b8f4147592e467fa5e778d45734e7?s=48 sashizaki
0
150
OpsJAWS Meetup21 システム運用アンチパターンのすすめ
96c31fe94f5e9b0eef4a606eaadcbc04?s=48 yoshiiryo1
0
1.5k
機械学習システムアーキテクチャ入門 #1
8fa31051503b09846584c49cd53d2f80?s=48 asei
3
1.2k

Featured

See All Featured
Making Projects Easy
C4de88ea47538e4594750e3861a341c8?s=48 brettharned
98
4.3k
A Modern Web Designer's Workflow
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
689
180k
Optimizing for Happiness
25c7c18223fb42a4c6ae1c8db6f50f9b?s=48 mojombo
365
63k
JavaScript: Past, Present, and Future - NDC Porto 2020
3ab1249be442027903e1180025340b3f?s=48 reverentgeek
37
3.3k
Gamification - CAS2011
4394ceb8b277f35ee3da7030384efb5d?s=48 davidbonilla
75
3.9k
Robots, Beer and Maslow
9375a9529679f1b42b567a640d775e7d?s=48 schacon
152
7.1k
Distributed Sagas: A Protocol for Coordinating Microservices
9128d500301ae51524e887bb680f471d?s=48 caitiem20
315
19k
From Idea to $5000 a Month in 5 Months
E4f5d494ebdc9e7cce1aecf3ce3e8bc1?s=48 shpigford
373
44k
JazzCon 2018 Closing Keynote - Leadership for the Reluctant Leader
3ab1249be442027903e1180025340b3f?s=48 reverentgeek
172
8.4k
The Web Native Designer (August 2011)
0bce06bd06ee7a2c4f5500f25dcf7f18?s=48 paulrobertlloyd
74
1.9k
Scaling GitHub
78b475797a14c84799063c7cd073962f?s=48 holman
451
140k
How STYLIGHT went responsive
F716e5f737fcfb03f2cf8d1a184f1dbe?s=48 nonsquared
85
3.9k

Transcript

  1. $PPLQBEBOE1SPNFUIFVT ؙحؙػحس吳䒭⠓爡䪮遭鿇43&ؚٕ٦ف し䊛畆㣕 !SSSFFFZZZ 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  2. !SSSFFFZZZ !SSSFFFZZZ IUUQTSSSFFFZZZDPN :PTIJLBXB3ZPUB .F ˖ :PTIJLBXB3ZPUB !SSSFFFZZZ[reɪ] ˖ ؙحؙػحس吳䒭⠓爡

    ։ ˖ 䪮遭鿇43&ؚٕ٦ف ˖ 莆㄂걄㚖 ˖ 0CTFSWBCJMJUZ 5JNFTFSJFTEBUBCBTF ˖ 馯㄂ ˖ QVZP FPS[FB MFBHVFPGMFHFOET ˖ TFJZV SFTUBHF XVH 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  3. 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  4. ! 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  5. $PPLQBEBOE1SPNFUIFVT ˖ 䎃ּ׵ְַ׵䖚ղחⵃ欽׾㨣׭גְ׷ ˖ EBTICPBSEה׃גכ(SBGBOB׾⢪׏גְ׷ ˖ "84ך&$؎ٝأةٝأ♳ח㾜Ꟛ ˖ ٔ٦آّٝ׀הח1SPNFUIFVT؟٦غָ〴ٙٝإحز׆א֮׷ ˖

    ➙ך䨽BQOPSUIFBTUהVTFBTUח〴׆א ˖ OPEF D"EWJTPS FOWPZ NUBJM IBQSPYZ FMBTUJDTFBSDI WBSOJTI VFOUE BQQ ˖ *P5堣㐻זוך湊鋔ח׮⢪׻׸כׄ׭גְ׷ 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  6. 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  7. 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  8. 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  9. 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  10. 1SPNFUIFVTך⢪׻׸倯 ˖ ؝ٝذشװىسٕؐؑ،ךٔا٦أ׾鋅׷ ˖ (SBGBOBדتحءُن٦س׾⡲䧭׃גꠘ鋮דֹ׷״ֲח׃גְ׷ ˖ ؝ٝذش橆㞮Ⱏ鸐דך،ٓ٦ز׾㹀纏׃גꟚ涪罏ח㾈ֽ׷ ˖ Ꟛ涪罏ָ铩ד׮㹀纏׃׋׶㢌刿׃׋׶ׅ׷ֿהָדֹ׷朐䡾ח׃גְ׷ ˖

    ،فٔ؛٦ءّٝ㔿剣ךًزؙٔأ׾⡲׏ג湊鋔ׅ׷ ˖ Ꟛ涪罏ָ荈ⴓך،فٔ؛٦ءّٝד䗳銲זًزؙٔأ׾FYQPSUׅ׷ ˖ 7J[DFSBMזו׾⢪׏גو؎ؙٗ؟٦ؽأךزٓؿ؍حؙךⰋ⡤⫷׾然钠ׅ׷ 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  11. 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  12. 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  13. 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  14. 麊欽דך䊨㣗 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  15. 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  16. 4FSWJDFEJTDPWFSZ ˖ ؎ٝأةٝأך湊鋔דכec2_sd_config׾兛鸐חⵃ欽׃גְ׷ ˖ &$4ך؝ٝذشזוך湊鋔דכ؟٦ؽأؕةؚٗ׾荈⡲׃גTE׃גְ׷ ˖ file_sd_configך䕎䒭׾鵤ׅIUUQؒٝسه؎ٝز׾欽䠐׃ג㹀劍涸ח《׶ח遤׏גְ׷ 4PNF4%NFDIBOJTNTIBWFSBUFMJNJUTUIBUNBLFUIFNDIBMMFOHJOHUPVTF"TBO FYBNQMFXFIBWFVOGPSUVOBUFMZIBEUPSFKFDU"NB[PO&$4TFSWJDFEJTDPWFSZEVFUPUIF SBUFMJNJUTCFJOHTPMPXUIBUJUXPVMEOPUCFVTBCMFGPSBOZUIJOHCFZPOETNBMMTFUVQT

    IUUQTHJUIVCDPNQSPNFUIFVTQSPNFUIFVTCMPCCBGDFCFBEFEDG EJTDPWFSZ3&"%.&NEPUIFSJNQMFNFOUBUJPODPOTJEFSBUJPOT 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  17. exporter_proxy ˖ IUUQTHJUIVCDPNSSSFFFZZZFYQPSUFS@QSPYZ ˖ :".-ד䭷㹀׃׋ػأ׾「ֽג㼎䘔ׅ׷63-חفٗؗءׅ׷׌ֽך׮ך ˖ &$؎ٝأةٝأזוך湊鋔דכexporter_proxyהְֲٔغ٦أفٗؗء׾饯⹛׃גְ׷ ˖ 饯⹛ׅ׷FYQPSUFS׋׍כMPDBMדMJTUFO׃גexporter_proxy׾穗歋׃ג،ؙإأׁ׸׷ ˖

    FYQPSUFS׀החⵃ欽ׅ׷ه٦زָ麩ֲךד鿪䏝THזו׾㢌刿ׅ׷ךָ꬗⦜٥ٔأָؙ֮׷ ˖ IUUQTHJUIVCDPNQSPNFUIFVTQSPNFUIFVTXJLJ%FGBVMUQPSUBMMPDBUJPOT ˖ /HJOYזוד׮葺ְָ؟٦ؽأד⢪׏גְ׷׮ךהٌصةؚٔٝ欽ך׮ך׾ⴓֽ׋ַ׏׋ 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  18. exporter_proxyך鏣㹀 listen: 0.0.0.0:9099 exporters: statsd_exporter: url: http://localhost:9102/metrics path: "/statsd_exporter/metrics" cadvisor:

    url: http://localhost:9103/metrics path: "/cadvisor/metrics" node_exporter: url: http://localhost:9100/metrics path: "/node_exporter/metrics" error_log: path: "/var/log/exporter_proxy.log" 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  19. 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  20. 1SPNFUIFVTך3VMFך盖椚 ˖ 1SPNFUIFVTַ׵،ٓ٦زׅ׷׋׭ך3VMF׾+TPOOFU׾欽ְג()&♳ד盖椚׃גְ׷ ˖ FYBNQMFIUUQTHJUIVCDPNSSSFFFZZZEPDLFSQSPNFUIFVTNJYJO ˖ 13ָو٦آׁ׸׷ה$*ָذأزװDPOHUFTU׾׃׋♳ד+TPOOFUַ׵:".-ח㢌䳔׃ג4ח縧ַ׸׷ ˖ 1SPNFUIFVT؟٦غכ㹀劍涸ח4׾鋅ח遤׏ג刿倜ָ֮׸ל《䖤׃גSFMPBEׅ׷ ˖

    ז׈+TPOOFUזךַ ˖ 湊鋔鏣㹀׾ׅ׷ꥷחذٝفٖ٦ز⻉װ꠬⦼זוך㢌侧ך⢪ְ㔐׃׾遤ְ׋ַ׏׋ ˖ &$4ך㛇湍דכ؝ٝذشך؟٦ؽأ㹀纏׾+TPOOFUד鎸鶢ׅ׷ךדꟚ涪罏ח׮꼧厩׫ָ֮׷ ˖ 湊鋔ך孖⚺⻉ך׋׭ח׮ז׷ץֻ꼧厩׫ך֮׷圓俑׾䱰欽׃׋ַ׏׋ ˖ IUUQTHJUIVCDPNQSPNFUIFVTQSPNFUIFVTQVMMדⰕ䒭ח׮䲿周ׁ׸גְ׷ ˖ 鎸岀׾קה׿וֿ׸ח䲧ִגְ׷ךד獳遤׃״ֲה䙼ִל獳遤׮דֹ׉ֲ 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  21. 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  22. MBCFMTBOOPUBUJPOTך崞欽 ˖ BOOPUBUJPOTח،ٓ٦زחꟼ鸬ׅ׷䞔㜠׾Ⰵ׸׷ֿהָדֹ׷ ˖ SVOCPPLך״ֲז،ظذ٦ءّٝח63-׾Ⰵ׸גֶֻ ˖ ،ٓ٦زך㼎䘔倯岀׾鎸׃׋سًُؗٝز׾剅ֻ ˖ ،ٓ٦زך鸐濼儗ח׮⦼ָ床׏גֻ׷ךד鸐濼חⰅ׸׵׸׷ ˖

    ➭ח׮،ٓ٦ز涪欰儗ח㹋遤׃גק׃ְ؝وٝس׾剅ֻBOOPUBUJPO׾Ⰵ׸ג׫׋׶ ˖ ،ٓ٦زך♧如荈⹛㼎䘔זוד嗚鎢דֹ׉ֲ ˖ ،ٓ٦زָ涪欰׃׋׵"MFSUNBOBHFSָ8FCIPPL׾굲ל׃ג؝وٝس׾㹋遤ׅ׷暟׾⡲׸׉ֲ IUUQTHJUMBCDPNHJUMBCDPNSVOCPPLT 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  23. 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  24. 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  25. "MFSUNBOBHFSך鏣㹀 ˖ 1SPNFUIFVTך3VMFהずֻׄ+TPOOFU׾欽ְג()&♳ד盖椚׃גְ׷ ˖ ずֻׄ13ָو٦آׁ׸׷ה+TPOOFU:".-חז׶4ח縧ַ׸׷ ˖ "MFSUNBOBHFSכ㹀劍涸ח4׾鋅ח遤ֹ刿倜ָ֮׸לSFMPBEׅ׷ ˖ 鸐濼ד⢪ֲUFNQMBUFזו׮()&♳ד盖椚׃גְגずׄ➬穈׫דرفٗ؎ׁ׸׷ ˖

    SPVUJOHָוֲ遤׻׸׷ַ罋ִ׷ךָ㼰׃ꨇ׃ְָؔٝٓ؎ٝخٔ٦ؒر؍ةָ֮׷ךד⢪ֲה⤑ⵃ ˖ IUUQTQSPNFUIFVTJPXFCUPPMTBMFSUJOHSPVUJOHUSFFFEJUPS ˖ 4MBDL鸐濼ך鏣㹀׾⡲׶׋ְהֹכQSPNTMBDLהְֲ8FC؟؎زָ֮׷ךד⢪ֲה⤑ⵃ ˖ IUUQTKVMJVTWDPNQSPNTMBDL ˖ <⡭锑>"MFSUNBOBHFSך鏣㹀כسًُؗٝزָ㼰זְ孡ָ׃גְגⰅꟌ1SPNFUIFVTָ♧殢鑫׃ְ孡ָׅ׷ 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  26. ؝ٝذش㛇湍הך鸬䵿 ˖ Ꟛ涪罏ָⵃ欽ׅ׷؝ٝذش㛇湍Ⰻ⡤דⰟ鸐ך،ٓ٦ز׾㹀纏׃㨣׭גְ׷ ˖ ؝ٝذش荈⡤ךًٌٔⵃ欽桦 ؟؎سؕ٦&OWPZךDJSDVJUCSFBLFSך⦼ ˖ ؝ٝذش㹀纏ך⚥ד䭁䓸圓俑ה׃ג،ٓ٦زך鸐濼⯓׾剅ֽ׷״ֲח׃גְ׷ ˖ ؝ٝذش㹀纏ח剅ַ׸׋ثٍٝطٕח،ٓ٦زָ鸐濼ׁ׸׷״ֲחז׏גְ׷

    ˖ ؝ٝذش㹀纏ָ刿倜ׁ׸׷ה"MFSUNBOBHFSך鏣㹀׮荈⹛ד刿倜ׁ׸׷״ֲז׃ֻ׫ ˖ +TPOOFUזךדGPSד㔐׃׋׶׃ג荈⹛ד㹀纏דֹ׷״ֲחז׏גְ׷ ˖ ׮׃ֻכ"MFSUNBOBHFSךUFNQMBUFד갹䓸׷ֿהדずׄ״ֲז➬穈׫כ㹋植דֹ׉ֲ 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  27. 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  28. 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  29. תה׭ ˖ ؙحؙػحسדך1SPNFUIFVTך鋉垷װ⢪׻׸倯װ麊欽倯岀׾稱➜ ˖ exporter_proxyזו׾欽ְג醱侧ךFYQPSUFS׾盖椚׃גְ׷ ˖ +TPOOFU׾欽ְג厫鮾ח鏣㹀׾剅ֽ׷״ֲח׃גְ׷ ˖ 1SPNFUIFVTךSVMF "MFSUNBOBHFSך鏣㹀

    ˖ ؝ٝذش㹀纏זוה鸬䵿׃ג،ٓ٦زך鸐濼⯓׾鏣㹀דֹ׷״ֲח׃גְ׷ ˖ -POHUFSNTUPSBHFזות׌ת׌׍ׯ׿ה׃׋ְ堣腉ְָ׹ְ׹ 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ 

  30. 8FBSFIJSJOH ˖ IUUQTDPPLQBEKPCT ˖ IUUQTDPPLQBEXPSLBCMFDPN 1SPNFUIFVT5PLZP.FFUVQ  ]:PTIJLBXB3ZPUB !SSSFFFZZZ