Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up for free
Cookpad and Prometheus
rrreeeyyy
June 03, 2019
Technology
6
18k
Cookpad and Prometheus
https://prometheus.connpass.com/event/127574/
での発表資料です
rrreeeyyy
June 03, 2019
Tweet
Share
More Decks by rrreeeyyy
See All by rrreeeyyy
SRE の歩き方・進め方 / sre-walk-through-procedure
rrreeeyyy
0
2.7k
「信頼性」を保ちつつ大規模サービスをリニューアルする / cookpad-tech-kitchen-service-embedded-sres
rrreeeyyy
11
9.4k
SRE-Lounge-8-Cookpad-Microservice-Architecture-Overview
rrreeeyyy
5
4.3k
A survey of anomaly detection methodologies for web system
rrreeeyyy
5
800
エンジニアリングをちゃんとやる あるいは 人類の平和 について / wsa02-rrreeeyyy
rrreeeyyy
13
2.6k
「自立」したWebシステムを創る。自分の好きなことをする世界を目指して。/ ipsj-one-2018-rrreeeyyy
rrreeeyyy
3
1.5k
Web サービスの信頼性と運用の自動化について / iot40-rrreeeyyy
rrreeeyyy
12
6.8k
SRE at Cookpad
rrreeeyyy
1
980
Prometheus 実践入門 #hbstudy 79 / introduction-to-prometheus-practice
rrreeeyyy
16
2.7k
Other Decks in Technology
See All in Technology
Scrum Fest Osaka 2022 段階的スクラムマスターのススメ
orimomo
0
780
What's new in Vision
satotakeshi
0
210
Introduction To Technical Writing
olawanle_joel
0
100
Custom GitHub Actions by Java
kazamori
0
290
ノーコードで Stripeを使いこなす3つの方法 / jp-stripes-online-vol-4
stripehideokamoto
0
260
スタートアップと技術選定と AWS
track3jyo
PRO
2
340
モブに早く慣れたい人のためのガイド / A Guide to Getting Started Quickly with Mob Programming
cybozuinsideout
PRO
2
1.8k
プログラマがオブジェクト指向しても幸せになれない理由
shirayanagiryuji
0
140
リファインメントは楽しいかね?
kitamu_mu
1
440
Azure Arc Virtual MachineとAzure Arc Resource Bridge / VM provisioning through Azure portal on Azure Stack HCI (preview)
sashizaki
0
150
OpsJAWS Meetup21 システム運用アンチパターンのすすめ
yoshiiryo1
0
1.5k
機械学習システムアーキテクチャ入門 #1
asei
3
1.2k
Featured
See All Featured
Making Projects Easy
brettharned
98
4.3k
A Modern Web Designer's Workflow
chriscoyier
689
180k
Optimizing for Happiness
mojombo
365
63k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
37
3.3k
Gamification - CAS2011
davidbonilla
75
3.9k
Robots, Beer and Maslow
schacon
152
7.1k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
315
19k
From Idea to $5000 a Month in 5 Months
shpigford
373
44k
JazzCon 2018 Closing Keynote - Leadership for the Reluctant Leader
reverentgeek
172
8.4k
The Web Native Designer (August 2011)
paulrobertlloyd
74
1.9k
Scaling GitHub
holman
451
140k
How STYLIGHT went responsive
nonsquared
85
3.9k
Transcript
$PPLQBEBOE1SPNFUIFVT ؙحؙػحس吳䒭⠓爡䪮遭鿇43&ؚٕ٦ف し䊛畆㣕 !SSSFFFZZZ 1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
!SSSFFFZZZ !SSSFFFZZZ IUUQTSSSFFFZZZDPN :PTIJLBXB3ZPUB .F ˖ :PTIJLBXB3ZPUB !SSSFFFZZZ[reɪ] ˖ ؙحؙػحس吳䒭⠓爡
։ ˖ 䪮遭鿇43&ؚٕ٦ف ˖ 莆걄㚖 ˖ 0CTFSWBCJMJUZ 5JNFTFSJFTEBUBCBTF ˖ 馯 ˖ QVZP FPS[FB MFBHVFPGMFHFOET ˖ TFJZV SFTUBHF XVH 1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
! 1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
$PPLQBEBOE1SPNFUIFVT ˖ 䎃ְַּ䖚ղחⵃ欽㨣גְ ˖ EBTICPBSEה׃גכ(SBGBOB⢪גְ ˖ "84ך&$؎ٝأةٝأ♳ח㾜 ˖ ٔ٦آّٝ׀הח1SPNFUIFVT؟٦غָ〴ٙٝإحز׆א֮ ˖
➙ך䨽BQOPSUIFBTUהVTFBTUח〴׆א ˖ OPEF D"EWJTPS FOWPZ NUBJM IBQSPYZ FMBTUJDTFBSDI WBSOJTI VFOUE BQQ ˖ *P5堣㐻זוך湊鋔ח⢪כׄגְ 1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
1SPNFUIFVTך⢪倯 ˖ ؝ٝذشװىسٕؐؑ،ךٔا٦أ鋅 ˖ (SBGBOBדتحءُن٦س⡲䧭׃גꠘ鋮דֹ״ֲח׃גְ ˖ ؝ٝذش橆㞮Ⱏ鸐דך،ٓ٦ز㹀纏׃ג涪罏ח㾈ֽ ˖ 涪罏ָ铩ד㹀纏׃㢌刿׃ֿׅהָדֹ朐䡾ח׃גְ ˖
،فٔ؛٦ءّٝ㔿剣ךًزؙٔأ⡲ג湊鋔ׅ ˖ 涪罏ָ荈ⴓך،فٔ؛٦ءّٝד䗳銲זًزؙٔأFYQPSUׅ ˖ 7J[DFSBMזו⢪גو؎ؙٗ؟٦ؽأךزٓؿ؍حؙךⰋ⡤⫷然钠ׅ 1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
麊欽דך䊨㣗 1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
4FSWJDFEJTDPWFSZ ˖ ؎ٝأةٝأך湊鋔דכec2_sd_config兛鸐חⵃ欽׃גְ ˖ &$4ך؝ٝذشזוך湊鋔דכ؟٦ؽأؕةؚٗ荈⡲׃גTE׃גְ ˖ file_sd_configך䕎䒭鵤ׅIUUQؒٝسه؎ٝز欽䠐׃ג㹀劍涸ח《ח遤גְ 4PNF4%NFDIBOJTNTIBWFSBUFMJNJUTUIBUNBLFUIFNDIBMMFOHJOHUPVTF"TBO FYBNQMFXFIBWFVOGPSUVOBUFMZIBEUPSFKFDU"NB[PO&$4TFSWJDFEJTDPWFSZEVFUPUIF SBUFMJNJUTCFJOHTPMPXUIBUJUXPVMEOPUCFVTBCMFGPSBOZUIJOHCFZPOETNBMMTFUVQT
IUUQTHJUIVCDPNQSPNFUIFVTQSPNFUIFVTCMPCCBGDFCFBEFEDG EJTDPWFSZ3&"%.&NEPUIFSJNQMFNFOUBUJPODPOTJEFSBUJPOT 1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
exporter_proxy ˖ IUUQTHJUIVCDPNSSSFFFZZZFYQPSUFS@QSPYZ ˖ :".-ד䭷㹀׃ػأ「ֽג㼎䘔ׅ63-חفٗؗءֽׅךך ˖ &$؎ٝأةٝأזוך湊鋔דכexporter_proxyהְֲٔغ٦أفٗؗء饯⹛׃גְ ˖ 饯⹛ׅFYQPSUFSכMPDBMדMJTUFO׃גexporter_proxy穗歋׃ג،ؙإأׁ ˖
FYQPSUFS׀החⵃ欽ׅه٦زָ麩ֲךד鿪䏝THזו㢌刿ׅךָ⦜٥ٔأָؙ֮ ˖ IUUQTHJUIVCDPNQSPNFUIFVTQSPNFUIFVTXJLJ%FGBVMUQPSUBMMPDBUJPOT ˖ /HJOYזוד葺ְָ؟٦ؽأד⢪גְךהٌصةؚٔٝ欽ךךⴓַֽ 1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
exporter_proxyך鏣㹀 listen: 0.0.0.0:9099 exporters: statsd_exporter: url: http://localhost:9102/metrics path: "/statsd_exporter/metrics" cadvisor:
url: http://localhost:9103/metrics path: "/cadvisor/metrics" node_exporter: url: http://localhost:9100/metrics path: "/node_exporter/metrics" error_log: path: "/var/log/exporter_proxy.log" 1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
1SPNFUIFVTך3VMFך盖椚 ˖ 1SPNFUIFVTַ،ٓ٦زׅך3VMF+TPOOFU欽ְג()&♳ד盖椚׃גְ ˖ FYBNQMFIUUQTHJUIVCDPNSSSFFFZZZEPDLFSQSPNFUIFVTNJYJO ˖ 13ָو٦آׁה$*ָذأزװDPOHUFTU׃♳ד+TPOOFUַ:".-ח㢌䳔׃ג4ח縧ַ ˖ 1SPNFUIFVT؟٦غכ㹀劍涸ח4鋅ח遤ג刿倜ָ֮ל《䖤׃גSFMPBEׅ ˖
ז+TPOOFUזךַ ˖ 湊鋔鏣㹀ׅꥷחذٝفٖ٦ز⻉װ꠬⦼זוך㢌侧ך⢪ְ㔐׃遤ְַ ˖ &$4ך㛇湍דכ؝ٝذشך؟٦ؽأ㹀纏+TPOOFUד鎸鶢ׅךד涪罏ח꼧厩ָ֮ ˖ 湊鋔ך孖⚺⻉ךחזץֻ꼧厩ך֮圓俑䱰欽׃ַ ˖ IUUQTHJUIVCDPNQSPNFUIFVTQSPNFUIFVTQVMMדⰕ䒭ח䲿周ׁגְ ˖ 鎸岀קהוֿח䲧ִגְךד獳遤׃״ֲה䙼ִל獳遤דֲֹ 1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
MBCFMTBOOPUBUJPOTך崞欽 ˖ BOOPUBUJPOTח،ٓ٦زחꟼ鸬ׅ䞔㜠Ⰵֿהָדֹ ˖ SVOCPPLך״ֲז،ظذ٦ءّٝח63-Ⰵגֶֻ ˖ ،ٓ٦زך㼎䘔倯岀鎸׃سًُؗٝز剅ֻ ˖ ،ٓ٦زך鸐濼儗ח⦼ָ床גֻךד鸐濼חⰅ ˖
➭ח،ٓ٦ز涪欰儗ח㹋遤׃גק׃ְ؝وٝس剅ֻBOOPUBUJPOⰅג ˖ ،ٓ٦زך♧如荈⹛㼎䘔זוד嗚鎢דֲֹ ˖ ،ٓ٦زָ涪欰׃"MFSUNBOBHFSָ8FCIPPL굲ל׃ג؝وٝس㹋遤ׅ暟⡲ֲ IUUQTHJUMBCDPNHJUMBCDPNSVOCPPLT 1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
"MFSUNBOBHFSך鏣㹀 ˖ 1SPNFUIFVTך3VMFהずֻׄ+TPOOFU欽ְג()&♳ד盖椚׃גְ ˖ ずֻׄ13ָو٦آׁה+TPOOFU:".-חז4ח縧ַ ˖ "MFSUNBOBHFSכ㹀劍涸ח4鋅ח遤ֹ刿倜ָ֮לSFMPBEׅ ˖ 鸐濼ד⢪ֲUFNQMBUFזו()&♳ד盖椚׃גְגずׄ➬穈דرفٗ؎ׁ ˖
SPVUJOHָוֲ遤ַ罋ִךָ㼰׃ꨇ׃ְָؔٝٓ؎ٝخٔ٦ؒر؍ةָ֮ךד⢪ֲה⤑ⵃ ˖ IUUQTQSPNFUIFVTJPXFCUPPMTBMFSUJOHSPVUJOHUSFFFEJUPS ˖ 4MBDL鸐濼ך鏣㹀⡲ְהֹכQSPNTMBDLהְֲ8FC؟؎زָ֮ךד⢪ֲה⤑ⵃ ˖ IUUQTKVMJVTWDPNQSPNTMBDL ˖ <⡭锑>"MFSUNBOBHFSך鏣㹀כسًُؗٝزָ㼰זְ孡ָ׃גְגⰅ1SPNFUIFVTָ♧殢鑫׃ְ孡ָׅ 1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
؝ٝذش㛇湍הך鸬䵿 ˖ 涪罏ָⵃ欽ׅ؝ٝذش㛇湍Ⰻ⡤דⰟ鸐ך،ٓ٦ز㹀纏׃㨣גְ ˖ ؝ٝذش荈⡤ךًٌٔⵃ欽桦 ؟؎سؕ٦&OWPZךDJSDVJUCSFBLFSך⦼ ˖ ؝ٝذش㹀纏ך⚥ד䭁䓸圓俑ה׃ג،ٓ٦زך鸐濼⯓剅ֽ״ֲח׃גְ ˖ ؝ٝذش㹀纏ח剅ַثٍٝطٕח،ٓ٦زָ鸐濼ׁ״ֲחזגְ
˖ ؝ٝذش㹀纏ָ刿倜ׁה"MFSUNBOBHFSך鏣㹀荈⹛ד刿倜ׁ״ֲז׃ֻ ˖ +TPOOFUזךדGPSד㔐׃׃ג荈⹛ד㹀纏דֹ״ֲחזגְ ˖ ׃ֻכ"MFSUNBOBHFSךUFNQMBUFד갹䓸ֿהדずׄ״ֲז➬穈כ㹋植דֲֹ 1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
תה ˖ ؙحؙػحسדך1SPNFUIFVTך鋉垷װ⢪倯װ麊欽倯岀稱➜ ˖ exporter_proxyזו欽ְג醱侧ךFYQPSUFS盖椚׃גְ ˖ +TPOOFU欽ְג厫鮾ח鏣㹀剅ֽ״ֲח׃גְ ˖ 1SPNFUIFVTךSVMF "MFSUNBOBHFSך鏣㹀
˖ ؝ٝذش㹀纏זוה鸬䵿׃ג،ٓ٦زך鸐濼⯓鏣㹀דֹ״ֲח׃גְ ˖ -POHUFSNTUPSBHFזותתׯה׃ְ堣腉ְְָ 1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ
8FBSFIJSJOH ˖ IUUQTDPPLQBEKPCT ˖ IUUQTDPPLQBEXPSLBCMFDPN 1SPNFUIFVT5PLZP.FFUVQ ]:PTIJLBXB3ZPUB !SSSFFFZZZ