Mackerel Meetup #7 - Speaker Deck

Slide 1

Slide 1 text

mackerel.io mackerel.io The server monitoring platform we always wanted Mackerel Meetup #7 12 May 2016 AWS Integration with Mackerel Hatena Co., Ltd. Hiromichi Sugiyama

Slide 2

Slide 2 text

Hiromichi Sugiyama / ਿࢁ ޿௨ 株式会社はてなサービス開発本部 Mackerelチームプロデューサー経歴 - 某大手製造業のIT事業会社 - 大規模環境でのインフラエンジニア - オープンソースのモニタリングツール - ITILベースのサービスマネジメント - SaaSシステム（ITサービス管理） - はてなでMackerel事業へ携わる id:sugiyama88

Slide 3

Slide 3 text

1 Mackerel Overview & Recent Topics

Slide 4

Slide 4 text

Mackerelͱ͸ʁ • "SaaSܕ"αʔόʔ؂ࢹαʔϏε • ΤϯδχΞ͕ཉ͔ͬͨ͠zϫΫϫΫz͢ΔΑ ͏ͳػೳΛఏڙ͠ɺѹ౗తͳzޮ཰ԽzΛ࣮ݱ • ͸ͯͳͷओྗαʔϏεΛ͑͞͞ଓ͚͖ͯͨ ʢ࠷ߴͷυοάϑʔσΟϯάʣ • 2014.9.17ਖ਼ࣜϦϦʔεʢ1೥8ϱ݄ʣ

Slide 5

Slide 5 text

ΞʔΩςΫνϟʔ • Mackerelから外部サービスへの直接監視 ΤʔδΣϯτ͔Β ϝτϦοΫΛ౤ߘ )5514 3&45"1*

Slide 6

Slide 6 text

௚ײతͳϢʔβʔମݧ

Slide 7

Slide 7 text

؆୯ʹ௚͙͸͡ΊΒΕΔ • ΨΠυʹै͏͚ͩ • ͨͬͨ਺෼ mackerel-agent written in Golang

Slide 8

Slide 8 text

࠷খͷϧʔϧ͕࠷ߴͷརศੑΛ • ΤʔδΣϯτΛ্ཱͪ͛Δ͚ͩͰ • ࣗಈతʹ؂ࢹ͕࢝·Γ • ಉ͡ϩʔϧͷϗετ͸ಉ͡άϥϑ΁

Slide 9

Slide 9 text

ৗʹਐԽ͠ଓ͚ΔαʔϏε 毎週新機能のリリースを継続中陳腐化せず常に進化 ̕ि࿈ଓ

Slide 10

Slide 10 text

બ͹ΕΔཧ༝ • ಋೖʗUI͕؆୯Ͱ෼͔Γ΍͍͢ • ։ൃεϐʔυ • ϚϧνΫϥ΢υͰ࢖͑Δ • ೔ຊޠαϙʔτ͕ॆ࣮ • NewRelicͱͷซ༻

Slide 11

Slide 11 text

Standardϓϥϯվగ Discount↓ Upgrade↑

Slide 12

Slide 12 text

OSS΁ͷίϯτϦϏϡʔτ • Golang https://go-review.googlesource.com/#/c/21190/

Slide 13

Slide 13 text

OSS΁ͷίϯτϦϏϡʔτ • Graphite https://github.com/graphite-project/carbon/pull/535 https://github.com/graphite-project/whisper/pull/162

Slide 14

Slide 14 text

OSS΁ͷίϯτϦϏϡʔτ • Graphite https://github.com/graphite-project/graphite-web/pull/1492 https://github.com/graphite-project/graphite-web/pull/1447

Slide 15

Slide 15 text

2 Mackerel Feature Recommendations (5)

Slide 16

Slide 16 text

1.Ξϥʔτ௨஌ʹάϥϑ • Slack, HipChat, TypeTalk, Yammer

Slide 17

Slide 17 text

2.URL֎ܗ؂ࢹ • ར༻ऀࢹ఺ͷHTTP/HTTPS؂ࢹ • ֎෦͔ΒͷϨεϙϯελΠϜΛՄࢹԽ • εςʔλείʔυɾϨεϙϯελΠϜͰΞϥʔτ • ΩʔϫʔυͷଘࡏνΣοΫ • SSLূ໌ॻͷ༗ޮظݶΛνΣοΫ Web Service URL

Slide 18

Slide 18 text

3.؂ࢹϧʔϧͷίʔυԽ • zInfrastructure as Codez • mkr monitor diff/pull/push • JSONܗࣜͰϧʔϧΛѻ͏

Slide 19

Slide 19 text

؂ࢹϧʔϧΛGitͰ؅ཧ

Slide 20

Slide 20 text

4.ϝτϦοΫΛࣜͰܭࢉɾՄࢹԽ 差分前週との重ねあわせ最大最大・平均・最小合計

Slide 21

Slide 21 text

5.͓ؾʹೖΓొ࿥ • େن໛؀ڥͰͷར༻ʹ࠷ద • Ϣʔβʔ͝ͱʹΑ͘ར༻͢ΔαʔϏ ε΍ΧελϜμογϡϘʔυΛొ࿥

Slide 22

Slide 22 text

3 AWS Integration

Slide 23

Slide 23 text

AWS Integration • AWS CloudWatch API͔Β༷ʑͳϝ τϦοΫ΍ΠϕϯτΛऔಘ͠ՄࢹԽ • 1୆ͷϗετͱͯ͠؅ཧ • ELBɺRDS͔Βॱ֦࣍େ • Standardϓϥϯ API Amazon CloudWatch Amazon RDS Amazon ELB

Slide 24

Slide 24 text

ෳ਺ͷΞΧ΢ϯτ΍Ϧʔδϣϯ΁΋ରԠ

Slide 25

Slide 25 text

؆୯ͳొ࿥͚ͩͰOK

Slide 26

Slide 26 text

RDSϗετৄࡉ

Slide 27

Slide 27 text

RDSΠϕϯτ΋ՄࢹԽ

Slide 28

Slide 28 text

ELBϗετৄࡉ

Slide 29

Slide 29 text

αʔϏεμ΢ϯ࣌ʹ͸Ξϥʔτ

Slide 30

Slide 30 text

αʔϏεʗϩʔϧʗϗετͰ؅ཧ

Slide 31

Slide 31 text

ಛ௃ • αʔϏεશମΛ၆ᛌͯ͠؅ཧ • AWSΞΧ΢ϯτ΍Ϧʔδϣϯ੍໿ͳ͠ • ؆୯ͳઃఆͷΈʢཁΩʔొ࿥ʣ • த௕ظతͳ෼ੳ • ϚϧνΫϥ΢υ

Slide 32

Slide 32 text

͓͢͢Ίͷ؂ࢹߏ੒ • URL֎ܗ؂ࢹ ར༻ऀࢹ఺ͰϨεϙϯελΠϜ΍ূ໌ॻͷ༗ޮظݶΛ؂ࢹ • ΤʔδΣϯτ/ϓϥάΠϯ؂ࢹ EC2Πϯελϯε΍ίϯςφͷৄࡉϝτϦοΫ΍֤छͷ νΣοΫ؂ࢹ • AWSΠϯςάϨʔγϣϯ CloudWatch APIͰ͔͠औಘͰ͖ͳ͍֤छͷϝτϦοΫ΍Π ϕϯτΛ؂ࢹ • DBϓϥάΠϯ؂ࢹ RDSͷMySQLͳͲʢ΋͏͙͢ผϗετ͔Βऔಘͨ͠ϝτ ϦοΫΛࣝผՄೳʹͳΔʣ

Slide 33

Slide 33 text

4 Mackerel Vision

Slide 34

Slide 34 text

Ϋϥ΢υԽͷྲྀΕ • ։ൃπʔϧ͸Ϋϥ΢υ΁ • svn/git → GitHub (GitHub Enterprise) • Jenkins → TravisCI, CircleCI • ࣮ߦ؀ڥ΋Ϋϥ΢υ΁ • ΦϯϓϨ → AWS, GCP, Azure

Slide 35

Slide 35 text

Mackerel΁ͷྲྀΕ • ӡ༻πʔϧ΋Ϋϥ΢υ΁ • Zabbix, Nagios → Cloudwatch, NewRelic and Mackerel !! • ࢖͍΍͍͢UIʹΑΔɺΑΓ҆ఆͨ͠ӡ༻Λ

Slide 36

Slide 36 text

Infrastructure as Code • ϗετઃఆΛίʔυԽ ʢChef/puppetʣ • Mackerelͷઃఆ΋CodeͰ؅ཧ • ؂ࢹϧʔϧ/μογϡϘʔυͷίʔυԽ • ॱ࣍ɺAPIԽΛਪਐ

Slide 37

Slide 37 text

Mackerelͷະདྷ • All-in-OneαʔϏεͰ͸ͳ͍ • ༷ʑͳπʔϧ/αʔϏεͱͷ࿈ܞ • Slack/GitHub/Reactio • γεςϜ؅ཧͷίΞπʔϧͱͯ͠ͷ Mackerel

Slide 38

Slide 38 text

DevOpsͷத֩ͱͯ͠ • ϥΠϑαΠΫϧશମͷޮ཰ԽΛଅਐ %FW 0QT

Slide 39

Slide 39 text

৬ਓܳΛΞϧΰϦζϜͰࢧԉ 過去の傾向から将来を予測して警告 $SJUJDBM 将来 5SFOET ϱ݄લ 現在 ۙ೔ ϦϦʔε