$30 off During Our Annual Pro Sale. View Details »

SRE定例やその辺の取り組みをアプリケーションエンジニア目線で語る / "Observe" about SRE Meeting by Application Engineer

mackee
October 20, 2023

SRE定例やその辺の取り組みをアプリケーションエンジニア目線で語る / "Observe" about SRE Meeting by Application Engineer

mackee

October 20, 2023
Tweet

More Decks by mackee

Other Decks in Programming

Transcript

  1. SREఆྫ΍ͦͷลͷऔΓ૊Έ
    ΛΞϓϦέʔγϣϯΤϯδχ
    Ξ໨ઢͰ஻Δ
    ૊৫֦େͱڞʹൃੜ͢Διϑτ΢ΣΞ඼࣭ͷ՝୊ͱཪ࿩LT@໨ࠇ
    ໘ന๏ਓΧϠοΫ @macopy 2023-10-20

    View Slide

  2. ୭ʁ
    • ໘ന๏ਓΧϠοΫ


    • GCࣄۀ෦Tonamel


    • ݩιγϟή԰


    • αʔόʔαΠυΤϯδχΞ


    • ISUCON11༏উ👑


    • ISUCON12ग़୊📔

    View Slide

  3. Tonamel
    • 2016೥ʹαʔϏε։࢝


    • 6೥໨


    • TCGɾ֨ήʔͳͲͷେձɾΠϕϯτ
    ӡӦͷͨΊͷαʔϏε


    • τʔφϝϯτදߏஙɾਐߦͳͲ

    View Slide

  4. ΧϠοΫͷαʔϏε։ൃελΠϧ
    • ։ൃͨ͠ਓ͕ӡ༻΋΍Δ ΞϥʔτରԠ΋΍Δ


    • ྺ࢙తʹΠϯϑϥߏங΋αʔόʔαΠυΤϯδχΞͷྖ෼


    • ͱ͸͍͑ਓͦΕͧΕಘҙɾෆಘҙ͸͋Δ


    • αʔϏεͷ਺΍छྨ͕ଟ͍


    • WebαʔϏεɾήʔϜɾΩϟϯϖʔϯαΠτetc…

    View Slide

  5. ͱ͸͍͑։ൃ΋΍Δਓ͕ӡ༻Λ΍Δͱ
    • ʮͲͪΒ͔͕͓Ζ͔ͦʹͳΔʯ


    • αʔϏε։ൃνʔϜ͸αʔϏε։ൃͷํʹҙ͕ࣝ޲͍͍ͯΔͷͰɺ৽
    ͘͠ੵΉ෦෼ΑΓɺੲੵΜͰٺ͍ͪͯ͘ํʹҙ͕ࣝ૬ରతʹ޲͔ͳ͍


    • Ұൠతʹҡ࣋͢Δ࢓ࣄΑΓ৽͘͠࡞Δ࢓ࣄͷ΄͏͕ධՁ͞Ε͕ͪ


    • (ྑ͍ѱ͍͸͜͜Ͱ͸࿦͡ͳ͍)

    View Slide

  6. खΛ෇͚ͳ͚Ε͹͍͚ͳ͍͕ޙճ͠ʹ͕ͪ͠ͳ
    ͜ͱ͕ཷ·Δ
    • ϥΠϒϥϦɾϛυϧ΢ΣΞͷEoLରԠ


    • ΞϥʔτͷৼΓฦΓ


    • CVEͷରԠ

    View Slide

  7. Αͬ͠ΌɺSREνʔϜ͕͍Δ͔Β


    ೚ͤΑ͏ʂ...Ͱ͸ͳ͍

    View Slide

  8. ΧϠοΫͷSREνʔϜ
    • ʮ໨ඪ͸SREνʔϜͷ࢓ࣄΛͳ͘͢͜ͱʯ


    • खΛಈ͔͢ͷ͸جຊతʹ͸αʔϏεଆͷΤϯδχΞ͕ͩ…


    • ਓʹΑͬͯಘҙɾෆಘҙ͸͋Δ


    • SREνʔϜ͕ࣾ಺Ͱԣஅతʹಘͨ஌ݟ΍πʔϧΛαʔϏεଆʹల։͢Δ
    ͜ͱͰαʔϏεӡ༻Λྑ͘͢Δ


    • Մ༻ੑʹϑΥʔΧε͍ͯ͠Δ => αʔϏεଆΤϯδχΞͱ͸ࢹ఺͕ҧ͏

    View Slide

  9. Ͳ͏΍ͬͯSREνʔϜʹ


    པΔ͔


    ͜ͷ࿩͸αʔϏεଆΤϯδχΞࢹ఺Ͱ͢

    View Slide

  10. αʔϏεͷΤϯδχΞͱSREͱͰ


    ຖिSREఆྫΛ΍͍ͬͯ·͢

    View Slide

  11. SREఆྫͰ֬ೝ͍ͯ͠Δ͜ͱ
    • αʔϏεଆΤϯδχΞ͕ࠓि΍ͬͨ͜ͱɾདྷि΍Δ͜ͱ


    • SREͷλεΫ֬ೝ


    • EoLͩͬͨΓϝϯςφϯεͳͲͷ֬ೝ


    • SLI/SLO΍Ξϥʔτͷ֬ೝ


    • Πϯϑϥίετͷ֬ೝ

    View Slide

  12. αʔϏεଆͷΤϯδχΞ͕Կ΍͍ͬͯΔ͔ΛԿ
    ނݴ͏͔
    • Ͳ͏͍͏։ൃ͕ਐߦ͍͍͙ͯͯͭ͠Β͍ʹग़Δͷ͔ͱ͔Λ͜͜Ͱಉظ
    ΛऔΔ


    • جຊతʹ৽ػೳͱ͸Մ༻ੑΛଛͳ͏ํ޲ʹಇ͘


    • Մ༻ੑʹӨڹ͕ग़ΔΑ͏ͳ࡞ΓํΛ͜͜Ͱࢦఠͯ͠΋Β͏


    • ϝτϦοΫ΍ΞϥʔτͷҙຯΛ஌Δʹ͸ΞϓϦέʔγϣϯͷڍಈ΍
    ෛՙ͕དྷΔ࣌ؒଳͳͲΛ஌Βͳ͚Ε͹͍͚ͳ͍

    View Slide

  13. EoL΍Ξϥʔτͷ֬ೝ
    • ԿΛ΍Ε͹͍͍͔ΛνʔϜશମͰಉظΛऔΔ


    • ໰୊ҙࣝͷڞ༗


    • AWS Health Dashboardʹ·ͱ·͍ͬͯΔͷͰͦΕΛօͰಡΉ


    • ಡΜͩ݁ՌɺωΫετΞΫγϣϯ͕ඞཁ͔ɺඞཁͳΒ୭͕΍Δ͔ɺ
    Ͳ͏΍Δ͔ΛܾΊΔ issueΛཱͯͨΓͳͲ͢Δ


    • ؆୯ͳ࡞ۀͳΒmeetsͰөͯͦ͠ͷ৔Ͱ΍Δ

    View Slide

  14. ೔ʑൃੜ͢ΔΞϥʔτͷ֬ೝ

    View Slide

  15. SREఆྫͰେࣄͩͱࢥ͍ͬͯΔ͜ͱ
    • ৘ใΛಥ͖߹Θͤͯਅ࣮ʹۙͮ͘


    • ݟ͍ͯΔ΋ͷɾࢤ޲͕ҧ͏ਓ͕ू·Δͱɺ΋ͷͷݟํ͕ଟ໘తʹͳΔ


    • ಉ͡Ξϥʔτ΍ϝτϦοΫͰ΋ҧ͏ݟํΛ͢Δ͜ͱ͕͋Δ


    • ΞϓϦέʔγϣϯͷڍಈ΍υϝΠϯ஌ࣝ͸αʔϏεଆͷΤϯδχΞ
    ͷ΄͏͕ৄ͍͠


    • Πϯϑϥʹର͢Δ஌ࣝ͸ଞͷαʔϏε΋ݟ͍ͯΔSREͷ΄͏͕஌ݟ
    ͕͋Δ

    View Slide

  16. ҙݟΛ࣋ͪدΔͱ۩ମతͳΞΫγϣϯʹͭͳ͛
    ΒΕΔ
    • ಉظతίϛϡχέʔγϣϯͷԸܙ


    • ඇಉظͩͱ஦ʹු͖͕ͪ


    • Ͱ΋EoLͷରॲͱ͔͸஦ʹු͍ͯ΋Βͬͯ͸ࠔΔ


    • ໰୊ҙࣝͷڞ༗


    • ςΩετͰඇಉظతʹ౤͛ΒΕΔΑΓಉظతʹݴΘΕͨ΄͏͕໰୊
    ҙࣝΛڞ༗Ͱ͖Δ

    View Slide

  17. ఆظతʹ࿩͢৔͕͋Δͱ


    ෺ࣄ͕લʹਐΈ΍͍͢


    ͱࢥ͏

    View Slide

  18. ୭͕EoLʹରॲ͢Δ͔
    • جຊతʹ͸΍ͬͨ͜ͱ͕ͳ͍ਓ͕΍ͬͯΈΔ


    • όε܎਺Λߴ͘͢Δ


    • ͨͩҰൠతʹ͸΍ͬͨ͜ͱ͕ͳ͍͜ͱͬͯऔΓ૊Ήͷ͕೉͍͠


    • աڈͷࣅͨΑ͏ͳ΍ͭͷखॱॻΛൃ۷͢Δͷ΋SREఆྫͰ΍Γ͕ͪ


    • ͱΓ͋͑ͣͲ͏͍͏͜ͱΛ΍Ε͹͍͍͔͸ͦΕͰ෼͔Δ


    • ୭΋΍ͬͨ͜ͱ͕ͳ͍͜ͱ͸SRE΍ಘҙͳਓ͕΍Δ


    • …ͱ͍͏จԽৢ੒Λͯ͠ΈΜͳΠϯϑϥ৮ΕΔͧͱ͍͏ײ͡ʹ͢Δ

    View Slide

  19. ෆศΛޱʹग़͢ͱ͍͍͜ͱ͕͋Δ
    • ʮ͜Ε͸΍Γʹ͍͘ʯʮ͜Ε͸໘౗ʯͱ͍͏੠͕SREఆྫͰग़Δ


    • Πϯϑϥ࡞ۀͰ͋ͬͨΓɺΞϓϦέʔγϣϯͷ։ൃ্ͷো֐ͩͬͨΓ


    • ࣍ͷिʹͦ͏͍ͬͨෆศΛղফ͢Δൿີฌث͕SREͰ࡞੒͞Ε͍ͯͨΓ
    ͢Δ


    • ΧϠοΫSREνʔϜ͸τΠϧΛࣗಈԽ΍πʔϧԽͰͳ͘͢จԽͳͷ
    Ͱɺͦ͏͍͏จԽΛར༻ͯ͠։ൃνʔϜ΋ޮ཰ԽͰ͖Δ

    View Slide

  20. ҧ͏ࢹ఺ΛࠞͥΔ͜ͱͰ


    αʔϏεΛ͍͍ײ͡ʹ


    ӡ༻Ͱ͖͍ͯΔͷͰ͸ʁ


    ͱ͍͏ؾ͖ͮͰͨ͠

    View Slide

  21. View Slide