Mackerel Meetup #11

Transcript

1. 1.

   .FFUVQ
    5IF
   
   .BDLFSFM
   1SPEVDU
   3PBENBQ 
   'FC
    )JSPNJDIJ 4VHJZBNB

2. 2.

   Hiromichi Sugiyama / ਿࢁ ޿௨ גࣜձࣾ͸ͯͳ αʔϏεɾγεςϜ։ൃຊ෦ .BDLFSFMνʔϜ ϓϩσϡʔαʔ .BDLFSFM
   1SPEVDU
   .BOBHFS

   ܦྺ  େن໛؀ڥͰͷΠϯϑϥΤϯδχΞ  ΦʔϓϯιʔεͷϞχλϦϯάπʔϧ  4BB4γεςϜ  *5*-ϕʔεͷαʔϏεϚωδϝϯτ  ͸ͯͳͰ.BDLFSFMࣄۀ΁ܞΘΔ TVHJZBNB!IBUFOBOFKQ
3. 3.

   1 ֓ཁͱ࠷ۙͷτϐοΫ

4. 4.

   Mackerelͱ͸ʁ • 4BB4ܕαʔόʔ؂ࢹαʔϏε • ΤϯδχΞ͕ཉ͔ͬͨ͠zϫΫϫΫz͢ΔΑ ͏ͳػೳΛఏڙ͠ɺѹ౗తͳzޮ཰ԽzΛ࣮ݱ • ͸ͯͳͷओྗαʔϏεΛ͑͞͞ଓ͚͖ͯͨ ʢ࠷ߴͷυοάϑʔσΟϯάʣ

5. 5.

   ΞʔΩςΫνϟʔ • ΤʔδΣϯτ͔Β ϝτϦοΫΛ౤ߘ )5514 3&45
   "1*

6. 6.

   ௚ײతͳϢʔβʔମݧ

7. 7.

   ؆୯ʹ௚͙͸͡ΊΒΕΔ • ΨΠυʹै͏͚ͩ • ͨͬͨ਺෼ʢϫϯϥΠφʔʣ    
   
   

   
     
8. 8.

   ࠷খͷϧʔϧ͕࠷ߴͷརศੑΛ • ΤʔδΣϯτΛ্ཱͪ͛Δ͚ͩͰ • ࣗಈతʹ؂ࢹ͕࢝·Γ • ಉ͡ϩʔϧͷϗετ͸ಉ͡άϥϑ΁

9. 9.

   ৗʹਐԽ͠ଓ͚ΔαʔϏε ຖि৽ػೳͷϦϦʔεΛܧଓத ௠෗ԽͤͣৗʹਐԽ ि࿈ଓ ܧ ଓ த

10. 10.

    બ͹ΕΔཧ༝ • ಋೖʗ6*͕؆୯Ͱ෼͔Γ΍͍͢ • ։ൃεϐʔυʢຖिϦϦʔεʣ • ϚϧνΫϥ΢υͰ࢖͑Δ • ೔ຊޠαϙʔτ͕ॆ࣮ •

    ૊Έ߹Θͤͯ%FW0QTͷத֩ͱͯ͠׆༻Ͱ͖Δ
11. 11.

    αʔϏεϓϥϯ 460

12. 12.

    ελʔτΞοϓࢧԉϓϥϯ։࢝ •  4UBSUVQTͷఏܞελʔτΞοϓࣄۀΛࢧԉ • ظؒݶఆͰ.BDLFSFMͷಛผσΟεΧ΢ϯτఏڙ

13. 13.

    Cloud ProviderΠϯςάϨʔγϣϯ • Ϋϥ΢υࣄۀऀͷ؂ࢹγεςϜͱͯ͠ɺ.BDLFSFM Λ؆୯ʹ૊ΈࠐΊΔ࿈ܞ༻"1*Λఏڙ ςφϯτ" ςφϯτ# ςφϯτ$ ςφϯτ% ςφϯτ&

    ςφϯτ' 03(" 03(# 03($ 03(% 03(& 03(' $MPVE
    1SPWJEFS ج൫γεςϜ ࿈ܞ༻"1*
14. 14.

    ࣌ܥྻσʔλͷ֦ॆʢStandard Planʣ • 1෼ཻ౓ͷอ࣋ظؒ 1೔ → 460೔ • άϥϑදࣔظؒ 400೔

    → 460೔ 441ഒʂ
15. 15.

    2 ࠷ۙϦϦʔεͨ͠ Φεεϝػೳʢ5બʣ

16. 16.

    1. ΞΫγϣϯػೳʢࣗಈԽࢧԉʣ • $IFDLϓϥάΠϯͷ࣮ߦ݁Ռʹج͖ͮɺ೚ҙͷίϚϯυΛ࣮ߦ • ϓϩηε࠶ىಈͳͲɺ༷ʑͳΦϖϨʔγϣϯࣗಈԽͷଅਐΛࢧԉ MACKEREL_STATUS MACKEREL_PREVIOUS_STATUS OK WARNING

    CRITICAL OK STATUS Time Line Environment variable Action Example: sudo systemctl restart nginx.service
17. 17.

    2. ϓϥάΠϯɾϨδετϦ • ެࣜಠࣗ։ൃ1MVHJOΛ(JU)VC͔Β؆୯ʹΠϯετʔϧ • ެࣜͷ1MVHJO
    3FHJTUSZ΁ొ࿥͞ΕͨϦϙδτϦ͸ϓϥάΠϯ ໊ͷΈͰΠϯετʔϧՄೳ • ϓϥάΠϯ։ൃʢެ։΍ϝϯςφϯεͳͲʣΛɺΑΓॊೈʹ mkr

    plugin install <plugin_name>[@<release_tag>] <owner>/<repo>[@<release_tag>] ᶃ ᶄ ᶃ mackerelio Plugin Registry ᶄ owner repo Source
18. 18.

    3. Πϕϯτ௨஌ • 4MBDL΍8FCIPPLͳͲͷ௨஌νϟϯωϧ΁ϗετొ࿥΍ε ςʔλεมߋͳͲͷΠϕϯτ௨஌ʹରԠ • ؂ࢹΞϥʔτ͚ͩͰͳ༷͘ʑͳΠϕϯτΛՄࢹԽ͠΍͘͢

19. 19.

    4. ΩʔϘʔυγϣʔτΧοτ • 8FC 6*ʢάϥϑૢ࡞ͳͲʣΛΑΓ௚ײతʹར༻Ͱ͖ΔΑ͏ʹ • ʮ ʯͰϔϧϓ͕දࣔ͞Ε·͢

20. 20.

    5. ެ։άϥϑ • .BDLFSFMΞΧ΢ϯτΛ͍࣋ͬͯͳͯ͘΋ެ։άϥϑͷӾཡ ʢJGSBNFɺը૾ɺ47(ͳͲʣ͕Մೳʹ • JGSBNFͰࣾ಺αΠτ΁ຒΊࠐΊ͹શࣾһ΁άϥϑڞ༗Մೳ Your Internal Web

    Site
21. 21.

    3 The Product Roadmap 2018

22. 22.

    2017೥ϦϦʔεͷৼฦΓ 㾎ϝτϦοΫσʔλʢཻ౓΍ظؒͷ֦ॆʣ 㾎ݎ࿚ͳΞʔΩςΫνϟʔ΁ͷҠߦ 㾎Πϕϯτػೳͷ֦ॆ 㾎ϝλσʔλϓϥάΠϯʢϓϥάΠϯαϙʔτɺϨδετϦʣ 㾎AzureΠϯςάϨʔγϣϯ 㾎ioυϝΠϯ୤ग़ 㾎ΞΫγϣϯػೳ 㾎άϥϑϘʔυ

23. 23.

    The Product Roadmap 2018 • ਐԽͷ଎͍ΠϯϑϥετϥΫνϟʔ • ͦΕʹ൐͏ސ٬՝୊΍χʔζͷมԽ • ৗʹਐԽ͢ΔαʔϏεͱͯ͠ɺ࠷దղ

    Λఏڙ͠ଓ͚Δඞཁੑ • Product Roadmap ≒ ࠷৽ͷ։ൃํ਑
24. 24.

    • Ұఆ࣌ؒ಺ͷΞϥʔτΛϢʔβࢦఆͷ୯ҐͰάϧʔϐϯά • άϧʔϓ୯ҐͰͷΞϥʔτ௨஌ • େྔΞϥʔτ௨஌͔Βͷ։์ʢݟམͱ͠ͷ཈੍ͳͲʣ Ξϥʔτ άϧʔϓ Service Role

    Role Host Host Host Host Host Host Time Line ❕ ❕ ❕ ❕ 㾎 㾎 㾎 㾎 㾎 ❕ ❕ ❕ ❕ ❕ 㾎 㾎 㾎 㾎 㾎 ❕ ❕ ❕ ❕ ❕ 㾎 㾎 㾎 㾎 㾎 ❕ ❕ 㾎 㾎 ❕ Alert Open Alert Close Alert Group - Org - Service - Role - Host - Monitor Setting ❕ 㾎 ❕ 㾎 ❕ 㾎 ❕ 㾎 ❕ 㾎 ❕ 㾎 ❕ 㾎 ❕ 㾎 #1
25. 25.

    • Mackerelͷ֓೦ͱͯ͠ίϯςφΛදݱ • ΑΓίϯςφΛ׆༻͠΍͍͢؀ڥΛఏڙ ίϯςφͷਖ਼ࣜαϙʔτ Service Role Host Host Container

    Container Container Role Role Container Container Host Host Host Containers Hosts #2
26. 26.

    ΧελϜ μογϡϘʔυ V2 • ΑΓ௚ײతͰ෼͔Γ΍͍͢ɺϞμϯͳΧ ελϜμογϡϘʔυΛఏڙ #3

27. 27.

    ϞχλϦϯάʹ͓͚Δػցֶशͷ׆༻ • ϞχλϦϯάʹ͓͚Δ՝୊ • ؂ࢹϧʔϧͷϝϯςφϯε͸ॏཁ͕ͩख͕͔͔ؒΔ • ੩తͳᮢ஋ͷ؂ࢹ͚ͩͰ͸ݕग़͕೉͍͠ঢ়گ΋͋Δ • ؂ࢹϧʔϧΛద੾ʹઃఆ͢ΔͨΊʹɺ͋Δఔ౓ͷ஌ࣝʢϛυϧ΢ΣΞͳ Ͳʣ͕ඞཁ

    • ػցֶशʢҟৗݕ஌ʣͷར఺ • ࣌ܥྻσʔλΛֶश͠ɺࣗಈతʹ؂ࢹϧʔϧΛܾΊͯΞϥʔτ͢Δ • ଟ਺ͷ؂ࢹϧʔϧ͕ɺҟৗݕ஌ͷ؂ࢹϧʔϧͭͰରԠͰ͖Δ͜ͱ΋ • ಛԽͨ͠؂ࢹ஌͕ࣝແͯ͘΋ɺԿ͔͕͓͔͍͠ࣄΛ஌Δ͜ͱ͕ग़དྷΔ #4
28. 28.

    ϞχλϦϯάʹ͓͚Δػցֶशͷ׆༻ • ׆༻ͷ೉͠͞ • શͯͷέʔεʹ౰ͯ͸·Δzۜͷ஄ؙzͰ͸ͳ͍ • ػցֶशΞϧΰϦζϜͷదੑΛཧղͯ͠ɺݸผʹ౰ͯ͸ΊΔඞ ཁ͕͋Δ • .BDLFSFMͰ͸ʁ

    • جຊ֓೦ʢ4FSWJDF 3PMF )PTUʣʹ౰ͯ͸Ίͯ؅ཧ͢Δ͜ͱͰɺ ػցֶशʢ·ͣ͸ҟৗݕ஌ʣػೳͷԸܙ͕ಘ΍͍͢ػೳΛఏڙ ͢Δ #4
29. 29.

    ҟৗݕ஌ʢػցֶशʣ • .BDLFSFMͷػցֶशػೳɺୈҰ஄ͱ͠ ͯϦϦʔε • ؆୯Ͱ࢖͍΍͍͢ख๏Λ࠾༻ • ϩʔϧ಺ͷҟৗϗετΛֶश͠ݕग़ • ෳ਺ϝτϦοΫʢ$16

    .FNPSZͳͲʣ ͷ૊Έ߹Θ ֶͤͯश͠ҟৗݕ஌ #4
30. 30.

    • ҰఆྔͷσʔλΛֶशޙɺִͨΓͷେ͖ͳσʔλΛҟৗ஋ ͱͯ͠ݕ஌ • ໿ͷγεςϜϝτϦοΫΛ૊Έ߹Θͤ༧ఆʢ࣍ݩʣ • Լਤ͸෼͔Γ΍࣍͘͢ݩͰهࡌ ࠞ߹Ψ΢ε෼෍Λར༻ͨ͠ҟৗݕ஌ ฏ೔Λத৺ͱͨ͠ൺֱ తෛՙͷߴ͍έʔε

    ٳ೔΍໷ؒ౳ൺֱత ෛՙͷ௿͍έʔε ҟৗ൑ఆ͞ΕΔ έʔε #4
31. 31.

    OSS Monitoring Affinityͷ֦ॆ Check-Plugin Format Metrics-Plugin Format What’s Next ?

    #5
32. 32.

    Prometheus Affinity Prometheus Check-Plugin Format Metrics-Plugin Format Next! #5

33. 33.

    • Exporter΍Discovery׆༻ʹΑΓɺ؍ଌൣғΛେ͖֦͘େʢ஫1ʣ • ඪ४Խ΁޲͔͏Exportion Formatsʢ஫2ʣ ͸ɺKubernetes΍ FreeBSDͳͲͰͷαϙʔτ͕ਐΜͰ͍Δ Prometheus Affinityͷར఺ʢҰྫʣ •

    ଟ࣍ݩσʔλϞσϧʢ஫3ʣ • ࣌ܥྻσʔλ΁೚ҙͷϥϕϧ ʢKey-ValueʣΛ෇༩͠ɺ༷ʑͳ੾ ΓޱͰॊೈͳ෼ੳΛ࣮ݱ Time URL Method HTTP Response Time ஫1 https://prometheus.io/docs/instrumenting/exporters/ ஫2 https://prometheus.io/docs/instrumenting/exposition_formats/ ஫3 https://prometheus.io/docs/concepts/data_model/ #5
34. 34.

    • DiscoveryͰऔಘͨ͠৘ใΛݩʹmackerel-agent͕ ExporterΛScraping͠ɺऔಘͨ࣌͠ܥྻσʔλΛ Mackerel΁ू໿ Prometheus Affinity Exporter Exporter Exporter Exporter

    Discovery Scraping Exporter Exporter Exporter Exporter mackerel-agent Discovery Scraping #5
35. 35.

    4 Ϗδϣϯ

36. 36.

    MackerelͷϏδϣϯ ΤϯδχΞΛϫΫϫΫͤ͞Δ ʮ௚ײతαʔόʔ؂ࢹαʔϏεʯ

37. 37.

    DevOpsͷத֩ͱͯ͠ • ϥΠϑαΠΫϧશମͷޮ཰ԽΛଅਐ %FW 0QT

38. 38.

    ͍͞͝ʹ

39. 39.

    We are Hiring • .BDLFSFM
    $3&ʢ$VTUPNFS
    3FMJBCJMJUZ
    &OHJOFFSʣ • ΞϓϦέʔγϣϯΤϯδχΞ • 8FCΦϖϨʔγϣϯΤϯδχΞ

40. 40.

    mackerel.io