SRE定例やその辺の取り組みをアプリケーションエンジニア目線で語る / "Observe" about SRE Meeting by Application Engineer

https://connpass.com/event/298302/

Transcript

1. SREఆྫ΍ͦͷลͷऔΓ૊Έ
   ΛΞϓϦέʔγϣϯΤϯδχ
   Ξ໨ઢͰ஻Δ
   ૊৫֦େͱڞʹൃੜ͢Διϑτ΢ΣΞ඼࣭ͷ՝୊ͱཪ࿩LT@໨ࠇ
   ໘ന๏ਓΧϠοΫ @macopy 2023-10-20
   

   View Slide

2. ୭ʁ
   • ໘ന๏ਓΧϠοΫ
   
   
   • GCࣄۀ෦Tonamel
   
   
   • ݩιγϟή԰
   
   
   • αʔόʔαΠυΤϯδχΞ
   
   
   • ISUCON11༏উ👑
   
   
   • ISUCON12ग़୊📔
   

   View Slide

3. Tonamel
   • 2016೥ʹαʔϏε։࢝
   
   
   • 6೥໨
   
   
   • TCGɾ֨ήʔͳͲͷେձɾΠϕϯτ
   ӡӦͷͨΊͷαʔϏε
   
   
   • τʔφϝϯτදߏஙɾਐߦͳͲ
   

   View Slide

4. ΧϠοΫͷαʔϏε։ൃελΠϧ
   • ։ൃͨ͠ਓ͕ӡ༻΋΍Δ ΞϥʔτରԠ΋΍Δ
   
   
   • ྺ࢙తʹΠϯϑϥߏங΋αʔόʔαΠυΤϯδχΞͷྖ෼
   
   
   • ͱ͸͍͑ਓͦΕͧΕಘҙɾෆಘҙ͸͋Δ
   
   
   • αʔϏεͷ਺΍छྨ͕ଟ͍
   
   
   • WebαʔϏεɾήʔϜɾΩϟϯϖʔϯαΠτetc…
   

   View Slide

5. ͱ͸͍͑։ൃ΋΍Δਓ͕ӡ༻Λ΍Δͱ
   • ʮͲͪΒ͔͕͓Ζ͔ͦʹͳΔʯ
   
   
   • αʔϏε։ൃνʔϜ͸αʔϏε։ൃͷํʹҙ͕ࣝ޲͍͍ͯΔͷͰɺ৽
   ͘͠ੵΉ෦෼ΑΓɺੲੵΜͰٺ͍ͪͯ͘ํʹҙ͕ࣝ૬ରతʹ޲͔ͳ͍
   
   
   • Ұൠతʹҡ࣋͢Δ࢓ࣄΑΓ৽͘͠࡞Δ࢓ࣄͷ΄͏͕ධՁ͞Ε͕ͪ
   
   
   • (ྑ͍ѱ͍͸͜͜Ͱ͸࿦͡ͳ͍)
   

   View Slide

6. खΛ෇͚ͳ͚Ε͹͍͚ͳ͍͕ޙճ͠ʹ͕ͪ͠ͳ
   ͜ͱ͕ཷ·Δ
   • ϥΠϒϥϦɾϛυϧ΢ΣΞͷEoLରԠ
   
   
   • ΞϥʔτͷৼΓฦΓ
   
   
   • CVEͷରԠ
   

   View Slide

7. Αͬ͠ΌɺSREνʔϜ͕͍Δ͔Β
   
   
   ೚ͤΑ͏ʂ...Ͱ͸ͳ͍
   

   View Slide

8. ΧϠοΫͷSREνʔϜ
   • ʮ໨ඪ͸SREνʔϜͷ࢓ࣄΛͳ͘͢͜ͱʯ
   
   
   • खΛಈ͔͢ͷ͸جຊతʹ͸αʔϏεଆͷΤϯδχΞ͕ͩ…
   
   
   • ਓʹΑͬͯಘҙɾෆಘҙ͸͋Δ
   
   
   • SREνʔϜ͕ࣾ಺Ͱԣஅతʹಘͨ஌ݟ΍πʔϧΛαʔϏεଆʹల։͢Δ
   ͜ͱͰαʔϏεӡ༻Λྑ͘͢Δ
   
   
   • Մ༻ੑʹϑΥʔΧε͍ͯ͠Δ => αʔϏεଆΤϯδχΞͱ͸ࢹ఺͕ҧ͏
   

   View Slide

9. Ͳ͏΍ͬͯSREνʔϜʹ
   
   
   པΔ͔
   
   
   ͜ͷ࿩͸αʔϏεଆΤϯδχΞࢹ఺Ͱ͢
   

   View Slide

10. αʔϏεͷΤϯδχΞͱSREͱͰ
    
    
    ຖिSREఆྫΛ΍͍ͬͯ·͢
    

    View Slide

11. SREఆྫͰ֬ೝ͍ͯ͠Δ͜ͱ
    • αʔϏεଆΤϯδχΞ͕ࠓि΍ͬͨ͜ͱɾདྷि΍Δ͜ͱ
    
    
    • SREͷλεΫ֬ೝ
    
    
    • EoLͩͬͨΓϝϯςφϯεͳͲͷ֬ೝ
    
    
    • SLI/SLO΍Ξϥʔτͷ֬ೝ
    
    
    • Πϯϑϥίετͷ֬ೝ
    

    View Slide

12. αʔϏεଆͷΤϯδχΞ͕Կ΍͍ͬͯΔ͔ΛԿ
    ނݴ͏͔
    • Ͳ͏͍͏։ൃ͕ਐߦ͍͍͙ͯͯͭ͠Β͍ʹग़Δͷ͔ͱ͔Λ͜͜Ͱಉظ
    ΛऔΔ
    
    
    • جຊతʹ৽ػೳͱ͸Մ༻ੑΛଛͳ͏ํ޲ʹಇ͘
    
    
    • Մ༻ੑʹӨڹ͕ग़ΔΑ͏ͳ࡞ΓํΛ͜͜Ͱࢦఠͯ͠΋Β͏
    
    
    • ϝτϦοΫ΍ΞϥʔτͷҙຯΛ஌Δʹ͸ΞϓϦέʔγϣϯͷڍಈ΍
    ෛՙ͕དྷΔ࣌ؒଳͳͲΛ஌Βͳ͚Ε͹͍͚ͳ͍
    

    View Slide

13. EoL΍Ξϥʔτͷ֬ೝ
    • ԿΛ΍Ε͹͍͍͔ΛνʔϜશମͰಉظΛऔΔ
    
    
    • ໰୊ҙࣝͷڞ༗
    
    
    • AWS Health Dashboardʹ·ͱ·͍ͬͯΔͷͰͦΕΛօͰಡΉ
    
    
    • ಡΜͩ݁ՌɺωΫετΞΫγϣϯ͕ඞཁ͔ɺඞཁͳΒ୭͕΍Δ͔ɺ
    Ͳ͏΍Δ͔ΛܾΊΔ issueΛཱͯͨΓͳͲ͢Δ
    
    
    • ؆୯ͳ࡞ۀͳΒmeetsͰөͯͦ͠ͷ৔Ͱ΍Δ
    

    View Slide

14. ೔ʑൃੜ͢ΔΞϥʔτͷ֬ೝ
    

    View Slide

15. SREఆྫͰେࣄͩͱࢥ͍ͬͯΔ͜ͱ
    • ৘ใΛಥ͖߹Θͤͯਅ࣮ʹۙͮ͘
    
    
    • ݟ͍ͯΔ΋ͷɾࢤ޲͕ҧ͏ਓ͕ू·Δͱɺ΋ͷͷݟํ͕ଟ໘తʹͳΔ
    
    
    • ಉ͡Ξϥʔτ΍ϝτϦοΫͰ΋ҧ͏ݟํΛ͢Δ͜ͱ͕͋Δ
    
    
    • ΞϓϦέʔγϣϯͷڍಈ΍υϝΠϯ஌ࣝ͸αʔϏεଆͷΤϯδχΞ
    ͷ΄͏͕ৄ͍͠
    
    
    • Πϯϑϥʹର͢Δ஌ࣝ͸ଞͷαʔϏε΋ݟ͍ͯΔSREͷ΄͏͕஌ݟ
    ͕͋Δ
    

    View Slide

16. ҙݟΛ࣋ͪدΔͱ۩ମతͳΞΫγϣϯʹͭͳ͛
    ΒΕΔ
    • ಉظతίϛϡχέʔγϣϯͷԸܙ
    
    
    • ඇಉظͩͱ஦ʹු͖͕ͪ
    
    
    • Ͱ΋EoLͷରॲͱ͔͸஦ʹු͍ͯ΋Βͬͯ͸ࠔΔ
    
    
    • ໰୊ҙࣝͷڞ༗
    
    
    • ςΩετͰඇಉظతʹ౤͛ΒΕΔΑΓಉظతʹݴΘΕͨ΄͏͕໰୊
    ҙࣝΛڞ༗Ͱ͖Δ
    

    View Slide

17. ఆظతʹ࿩͢৔͕͋Δͱ
    
    
    ෺ࣄ͕લʹਐΈ΍͍͢
    
    
    ͱࢥ͏
    

    View Slide

18. ୭͕EoLʹରॲ͢Δ͔
    • جຊతʹ͸΍ͬͨ͜ͱ͕ͳ͍ਓ͕΍ͬͯΈΔ
    
    
    • όε܎਺Λߴ͘͢Δ
    
    
    • ͨͩҰൠతʹ͸΍ͬͨ͜ͱ͕ͳ͍͜ͱͬͯऔΓ૊Ήͷ͕೉͍͠
    
    
    • աڈͷࣅͨΑ͏ͳ΍ͭͷखॱॻΛൃ۷͢Δͷ΋SREఆྫͰ΍Γ͕ͪ
    
    
    • ͱΓ͋͑ͣͲ͏͍͏͜ͱΛ΍Ε͹͍͍͔͸ͦΕͰ෼͔Δ
    
    
    • ୭΋΍ͬͨ͜ͱ͕ͳ͍͜ͱ͸SRE΍ಘҙͳਓ͕΍Δ
    
    
    • …ͱ͍͏จԽৢ੒Λͯ͠ΈΜͳΠϯϑϥ৮ΕΔͧͱ͍͏ײ͡ʹ͢Δ
    

    View Slide

19. ෆศΛޱʹग़͢ͱ͍͍͜ͱ͕͋Δ
    • ʮ͜Ε͸΍Γʹ͍͘ʯʮ͜Ε͸໘౗ʯͱ͍͏੠͕SREఆྫͰग़Δ
    
    
    • Πϯϑϥ࡞ۀͰ͋ͬͨΓɺΞϓϦέʔγϣϯͷ։ൃ্ͷো֐ͩͬͨΓ
    
    
    • ࣍ͷिʹͦ͏͍ͬͨෆศΛղফ͢Δൿີฌث͕SREͰ࡞੒͞Ε͍ͯͨΓ
    ͢Δ
    
    
    • ΧϠοΫSREνʔϜ͸τΠϧΛࣗಈԽ΍πʔϧԽͰͳ͘͢จԽͳͷ
    Ͱɺͦ͏͍͏จԽΛར༻ͯ͠։ൃνʔϜ΋ޮ཰ԽͰ͖Δ
    

    View Slide

20. ҧ͏ࢹ఺ΛࠞͥΔ͜ͱͰ
    
    
    αʔϏεΛ͍͍ײ͡ʹ
    
    
    ӡ༻Ͱ͖͍ͯΔͷͰ͸ʁ
    
    
    ͱ͍͏ؾ͖ͮͰͨ͠
    

    View Slide

21. View Slide