Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Who owns the Service Level?

Who owns the Service Level?

Takeshi Kondo

May 15, 2022
Tweet

More Decks by Takeshi Kondo

Other Decks in Technology

Transcript

  1. Who owns the Service Level?
    Takeshi Kondo / @chaspy


    2022/05/15


    SRE NEXT 2022

    View full-size slide

  2. Who am I
    chaspy chaspy_
    Engineering Manager, Site Reliability

    at Recruit Co., Ltd.
    Takeshi Kondo
    https://chaspy.me

    View full-size slide

  3. લఏɿϓϩμΫτ঺հ - ελσΟα
    ϓϦ

    View full-size slide

  4. Hello, again! SRE NEXT

    View full-size slide

  5. ࠓ೔࿩͢͜ͱ


    SRE Λ࣮ݱ͢ΔͨΊʹඞཁͳ͜ͱ

    View full-size slide

  6. Tl;dr / SRE Λ࣮ݱ͢ΔͨΊʹඞཁͳ͜ͱ
    • ࢦඪΛݩʹվળ͠ଓ͚ΔจԽ


    • ࣗݾ׬݁ԽΛࢧ͑Δ Platform


    • ༏ઌॱҐΛมߋ͢ΔͨΊͷٕज़ઓུ

    View full-size slide

  7. Agenda
    • લఏɿSRE Λ࣮ݱ͢Δͱ͸Ͳ͏͍͏͜ͱ͔


    • ྺ࢙͔ΒৼΓฦΔʰελσΟαϓϦʱࣄۀʹ͓͚Δ SRE


    • 2020೥ʮSLO ReviewʯͰͷֶͼͱࣦഊ


    • SRE ͱٕज़ઓུ


    • ·ͱΊͱࠓޙ

    View full-size slide

  8. Agenda
    • લఏɿSRE Λ࣮ݱ͢Δͱ͸Ͳ͏͍͏͜ͱ͔


    • ྺ࢙͔ΒৼΓฦΔʰελσΟαϓϦʱࣄۀʹ͓͚Δ SRE


    • 2020೥ʮSLO ReviewʯͰͷֶͼͱࣦഊ


    • SRE ͱٕज़ઓུ


    • ·ͱΊͱࠓޙ

    View full-size slide

  9. લఏ෦෼͸3݄ͷ6ࣾ߹ಉษڧձͱಉ͡಺༰Ͱ͓͞Β͍͠·͢

    View full-size slide

  10. SRE Λ࣮ݱ͢Δͱ͸

    View full-size slide

  11. ։ൃνʔϜ͕৴པੑΛ


    ίϯτϩʔϧ͢Δ
    Capability Λ


    ਎ʹ͚͍ͭͯΔ͜ͱ

    View full-size slide

  12. ͦ΋ͦ΋ Site Reliability Engineering ͱ͸: Not like this
    • αʔϏε͕ʮߴ͍৴པੑ (ʹ100%)ʯΛอ͍ͬͯΔ͜ͱ


    • SLI/SLO ΛकΕ͍ͯΔ͜ͱ


    • ΦϯίʔϧϩʔςʔγϣϯΛ։ൃνʔϜͰߦ͏͜ͱ
    https://github.com/twitter/twemoji

    View full-size slide

  13. ͦ΋ͦ΋ Site Reliability Engineering ͱ͸: Like this!
    • αʔϏε͕ʮϢʔβ͕ظ଴͢Δ৴པੑʯΛอ͍ͬͯΔ͜ͱ


    • SLI/SLO Λઃఆ͠ɺඇػೳཁ݅ͱػೳཁ݅ͷ༏ઌ౓ܾఆͷ
    ࢦඪͱͯ͠׆༻͍ͯ͠Δ


    • SLO ҧ൓͕ൃੜͨ͠ͱ͖ʹద੾ʹରॲͰ͖ΔΑ͏ͳϞχλ
    Ϧϯάํ๏ͱϙϦγʔ͕νʔϜͰಉҙ͞Ε͍ͯΔ


    • ্ه͕ఆظతʹݟ௚͞Ε͍ͯΔ
    https://github.com/twitter/twemoji

    View full-size slide

  14. ։ൃνʔϜ͕৴པੑΛίϯτϩʔϧ͢Δ Capability Λ਎ʹ͚ͭΔ: Like this!
    SRE
    ։ൃ
    νʔϜ
    ։ൃνʔϜͷ৴པੑʹ
    ؔ͢Δ Capability औಘ
    Λࢧԉ͢Δ
    ࣗ෼ͨͪͷαʔϏεͷ
    ৴པੑΛࣗ෼ͨͪͰί
    ϯτϩʔϧͰ͖͍ͯΔ

    View full-size slide

  15. Team Topologies
    • 4ͭͷνʔϜύλʔϯ


    • Stream Aligned


    • Platform


    • Enabling


    • Complicated Subsystem


    • 3ͭͷίϛϡχέʔγϣϯύλʔϯ


    • Collaboration


    • X as a Service


    • Facilitation
    https://pub.jmam.co.jp/book/b593881.html

    View full-size slide

  16. ։ൃνʔϜ͕৴པੑΛίϯτϩʔϧ͢Δ Capability Λ਎ʹ͚ͭΔ: Like this!
    SRE
    ։ൃ
    νʔϜ
    ։ൃνʔϜͷࣗݾ׬݁ԽΛ
    ࢧ͑ΔϓϥοτϑΥʔϜͱ
    จԽΛ࡞Δ
    Platform Team


    Enabling Team
    Stream Aligned Team
    ࣗ෼ͨͪͰඞཁͳ΋ͷΛ


    ࣗ෼ͨͪͰ༻ҙͰ͖Δ


    = self-contained / ࣗݾ׬݁Խ

    View full-size slide

  17. • ࢧԉ͸Ұ࣌తͰɺ௕ظԽͤͯ͞͸ͳΒͳ͍
    ༨ஊ: Enabling ͱ͍͏୯ޠʹ͸ϙδςΟϒɾωΨςΟϒ྆໘͋Δ
    https://ja.wikipedia.org/wiki/%E3%82%A4%E3%83%8D%E3%83%BC%E3%83%96%E3%83%AA%E3%83%B3%E3%82%B0

    View full-size slide

  18. SRE Team ͷ Vision / Mission / Values
    https://blog.studysapuri.jp/entry/sre-vision-mission-values

    View full-size slide

  19. Mission


    ࣗݾ׬݁νʔϜ͕ϓϩμΫ
    τΛૉૣ҆͘શʹಧ͚ଓ͚
    ΔͨΊͷϓϥοτϑΥʔϜ
    ͱจԽΛ࡞Δ

    View full-size slide

  20. ͳͥࣗݾ׬݁Խ͕ॏཁ͔
    SRE
    ։ൃ
    νʔϜ
    ։ൃνʔϜͷࣗݾ׬݁ԽΛ
    ࢧ͑ΔϓϥοτϑΥʔϜͱ
    จԽΛ࡞Δ
    Platform Team


    Enabling Team
    Stream Aligned Team
    ࣗ෼ͨͪͰඞཁͳ΋ͷΛ


    ࣗ෼ͨͪͰ༻ҙͰ͖Δ


    = self-contained / ࣗݾ׬݁Խ

    View full-size slide

  21. ͳͥࣗݾ׬݁Խ͕ॏཁ͔: Not “VS”, but “And”
    • Dev vs and Ops


    • Ϣʔβ͔Βߴ଎ʹϑΟʔυόοΫΛಘΔ (DevOps)


    • Dev vs and Infrastructure


    • ηϧϑαʔϏεͰߏஙͯ͠ϦʔυλΠϜ୹ॖ


    • Productivity vs and Reliability


    • ੜ࢈ੑͱ৴པੑ͸૬ޓʹґଘ͢Δ

    View full-size slide

  22. ͳͥࣗݾ׬݁Խ͕ॏཁ͔
    • ࣗݾ׬݁νʔϜͳΒ


    • ຊ൪؀ڥ͔ΒϑΟʔυόοΫΛಘଓ͚ΒΕΔ


    • ࠷খݶͷίϛϡχέʔγϣϯͰߴ଎ͳҙࢥܾఆ͕Ͱ͖Δ


    • ػೳཁٻ͚ͩͰͳ͘ඇػೳཁٻʹ΋Ԡ͑Δ͜ͱ͕Ͱ͖Δ

    View full-size slide

  23. • ։ൃνʔϜ͕৴པੑΛίϯτϩʔϧ͢Δ Capability Λ਎ʹ͚ͭͯ
    ͍Δ͜ͱ


    • ։ൃνʔϜ͕”ࣗݾ׬݁Խ”͍ͯ͠Δঢ়ଶ


    • SRE νʔϜ͸͜ΕΛϓϥοτϑΥʔϜͱจԽৢ੒Ͱࢧ͑Δ


    • ͜ΕΛ࣮ݱ͢Δʹ͸ϓϩμΫτ։ൃʹด͡ͳ͍ଟ༷ͳࢹ఺͕ඞཁ


    • Ϣʔβͷظ଴஋Λ஌Δ / Product Management


    • ߴ͍։ൃੜ࢈ੑ / Development Skills


    • ඇػೳཁٻʹͲΕ͚ͩίετΛ͔͚Δ͔ / Business Development
    ·ͱΊɿSRE Λ࣮ݱ͢Δͱ͸

    View full-size slide

  24. Agenda
    • લఏɿSRE Λ࣮ݱ͢Δͱ͸Ͳ͏͍͏͜ͱ͔


    • ྺ࢙͔ΒৼΓฦΔʰελσΟαϓϦʱࣄۀʹ͓͚Δ SRE


    • 2020೥ʮSLO ReviewʯͰͷֶͼͱࣦഊ


    • SRE ͱٕज़ઓུ


    • ·ͱΊͱࠓޙ

    View full-size slide

  25. ྺ࢙͔ΒৼΓฦΔʰελσΟαϓϦʱSRE ~ @chaspy ೖࣾޙ
    • 2018: @chaspy ೖࣾ


    • 2019: Application Platform Λ Kubernetes ΁Ҡ؅


    • 2020: Microservices Readiness ͷ੔උ


    • αʔϏεΦʔφʔγοϓͷࡦఆ


    • Design Doc / Production Readiness Checklist


    • Self-services Infrastructure (terraform monorepo)


    • SLI/SLO


    • 2021: SLI/SLO ӡ༻Λ։ൃνʔϜʹ׬શҠৡ
    Platform Team ͱͯ͠ Platform Λ࡞͍ͬͯΔ
    Enabling Team ͱͯ͠
    ։ൃ૊৫ʹ SLI/SLO
    ͳͲͷΧϧνϟʔৢ੒

    View full-size slide

  26. ྺ࢙͔ΒৼΓฦΔʰελσΟαϓϦʱSRE ~ 2021೥
    • COVID-19 ྲྀߦɺΞΫηε਺૿େ


    • Platform ͷਐԽ


    • Terraform monorepo


    • Loadtest Platform


    • GitHub Actions ʹΑΔ monorepo CI ෼཭


    • ૊৫ͷมԽ


    • ٕज़ઓུάϧʔϓൃ଍


    • ࣄۀҠ؅ʹΑΓϦΫϧʔτ΁స੶ɺQuipper ೔ຊࢧళਫ਼ࢉ


    • chaspy EM ೚༻

    View full-size slide

  27. ྺ࢙͔ΒৼΓฦΔʰελσΟαϓϦʱSRE ~ 2022೥
    • ৽͍͠ SRE ࣮ફͷܗ


    • Partially Embedded SRE


    • Partially Enabling SRE in development team

    View full-size slide

  28. ૊৫ن໛ͷਪҠ

    ։ൃऀ 35 53 54 73 114
    43& 4 5 7 7 7
    ։ൃऀ͸ελσΟαϓϦɾQuipper ྆ํͷɺWeb Engineer (frontend&backend) ͷ਺ɻNative ͸আ֎͍ͯ͠Δɻ


    2022೥͔Β͸ۀ຿ҕୗͷํ΋Χ΢ϯτ͍ͯ͠Δɻ2021೥Ҏલ΋ۀ຿ҕୗͷํͱ࢓ࣄ͸͍ͯͨ͠ɻ

    View full-size slide

  29. ྺ࢙͔ΒৼΓฦΔʰελσΟαϓϦʱSRE
    • ͍ͣΕͷ࣌୅΋ Platform Team ͱ Enabling Team ͷৼΔ෣
    ͍Λ͍ͯ͠Δ


    • ಛʹ2019೥͔Β͸ʮࣗݾ׬݁ԽʯΛςʔϚʹɺ͓ئ͍͞Ε
    Δ͜ͱΛۃྗݮΒͤΔ Platform Λ࡞͖ͬͯͨ


    • ಉ࣌ʹ։ൃνʔϜͷʮจԽΛͭ͘Δʯ͜ͱʹ౿ΈࠐΈɺSLI/
    SLO Λݟ͍ͯ͘จԽΛ૊৫ʹৢ੒ͨ͠


    • →ʮSLO Reviewʯat SRE NEXT 2020

    View full-size slide

  30. Agenda
    • લఏɿSRE Λ࣮ݱ͢Δͱ͸Ͳ͏͍͏͜ͱ͔


    • ྺ࢙͔ΒৼΓฦΔʰελσΟαϓϦʱࣄۀʹ͓͚Δ SRE


    • 2020೥ʮSLO ReviewʯͰͷֶͼͱࣦഊ


    • SRE ͱٕज़ઓུ


    • ·ͱΊͱࠓޙ

    View full-size slide

  31. ʮSLO Reviewʯat SRE NEXT 2020
    • ։ൃ૊৫ʹ SLO Λ Review ͍ͯ͘͠จԽΛ࡞ͬͨऔΓ૊Έ


    • 2 Product, 15 Team ʹϘτϜΞοϓͰಋೖ


    • ొΓํͷ4εςοϓ


    • γεςϜͱ૊৫ͷΦʔφʔγοϓΛܾΊΔ


    • 1ਓͰϓϩηεΛ·Θ͠ɺ࣮ݱํ๏Λཱ֬͢Δ


    • Developer ͱҰॹʹ SLI/SLO Λఆٛ͠ɺϓϩηεΛ·Θ͢


    • Error Budget Policy Λఆٛͯ͠ߦಈ͢Δ(ະ࣮ݱ)


    • ಘֶͨͼ


    • ඪ४Խ͞Εͨ SLI Λఏڙ͢Δ


    • ઃఆ͸ૣ͍ஈ֊ͰίʔυԽ͢Δ


    • ֶशۂઢΛٸޯ഑ʹ͢Δ
    https://blog.studysapuri.jp/entry/2020/01/30/slo-review

    View full-size slide

  32. Α͔ͬͨ఺
    • ։ൃ૊৫ʹ SLO Λ Review ͍ͯ͘͠จԽΛ࡞ͬͨऔΓ૊Έ


    • 2 Product, 15 Team ʹϘτϜΞοϓͰಋೖ


    • ొΓํͷεςοϓ


    • γεςϜͱ૊৫ͷΦʔφʔγοϓΛܾΊΔ


    • 1ਓͰϓϩηεΛ·Θ͠ɺ࣮ݱํ๏Λཱ֬͢Δ


    • Developer ͱҰॹʹ SLI/SLO Λఆٛ͠ɺϓϩηεΛ·Θ͢


    • Error Budget Policy Λఆٛͯ͠ߦಈ͢Δ(ະ࣮ݱ)


    • ಘֶͨͼ


    • ඪ४Խ͞Εͨ SLI Λఏڙ͢Δ


    • ઃఆ͸ૣ͍ஈ֊ͰίʔυԽ͢Δ


    • ֶशۂઢΛٸޯ഑ʹ͢Δ
    https://blog.studysapuri.jp/entry/2020/01/30/slo-review
    ։ൃνʔϜͷೝ஌ෛՙΛపఈత
    ʹԼ͛Δ͜ͱʹͩ͜Θͬͨ
    ໨తෆ࣮֬ੑͷ௿ݮͷͨΊ
    ϑΟʔυόοΫαΠΫϧΛճͨ͠

    View full-size slide

  33. Α͘ͳ͔ͬͨ఺ʁ
    • ։ൃ૊৫ʹ SLO Λ Review ͍ͯ͘͠จԽΛ࡞ͬͨऔΓ૊Έ


    • 2 Product, 15 Team ʹϘτϜΞοϓͰಋೖ


    • ొΓํͷεςοϓ


    • γεςϜͱ૊৫ͷΦʔφʔγοϓΛܾΊΔ


    • 1ਓͰϓϩηεΛ·Θ͠ɺ࣮ݱํ๏Λཱ֬͢Δ


    • Developer ͱҰॹʹ SLI/SLO Λఆٛ͠ɺϓϩηεΛ·Θ͢


    • Error Budget Policy Λఆٛͯ͠ߦಈ͢Δ(ະ࣮ݱ)


    • ಘֶͨͼ


    • ඪ४Խ͞Εͨ SLI Λఏڙ͢Δ


    • ઃఆ͸ૣ͍ஈ֊ͰίʔυԽ͢Δ


    • ֶशۂઢΛٸޯ഑ʹ͢Δ
    https://blog.studysapuri.jp/entry/2020/01/30/slo-review
    ͳͥ͏·͍͔͘ͳ
    ͔ͬͨͷ͔ʁ

    View full-size slide

  34. ʢ࠶ܝʣSRE Λ࣮ݱ͢Δͱ͸Կ͔
    • ։ൃνʔϜ͕৴པੑΛίϯτϩʔϧ͢Δ Capability Λ਎ʹͭ
    ͚͍ͯΔ͜ͱ


    • ʮࢦඪΛݩʹߦಈ͕Ͱ͖Δʯ͜ͱ
    https://blog.studysapuri.jp/entry/2020/01/30/slo-review
    4-*4-0
    &SSPS#VEHFU
    1PMJDZ
    ։ൃνʔϜ
    ఆٛ͢Δ / ఆظతʹݟ௚͢
    Policy ʹैͬͯߦಈ͢Δ

    View full-size slide

  35. ʢ࠶ܝʣSRE Λ࣮ݱ͢Δͱ͸Կ͔
    • ։ൃνʔϜ͕৴པੑΛίϯτϩʔϧ͢Δ Capability Λ਎ʹͭ
    ͚͍ͯΔ͜ͱ


    • ʮࢦඪΛݩʹߦಈ͕Ͱ͖Δʯ͜ͱ
    https://blog.studysapuri.jp/entry/2020/01/30/slo-review
    4-*4-0
    &SSPS#VEHFU
    1PMJDZ
    ։ൃνʔϜ
    ఆٛ͢Δ / ఆظతʹݟ௚͢
    Policy ʹैͬͯߦಈ͢Δ
    Ͱ͖ͨ

    View full-size slide

  36. ʢ࠶ܝʣSRE Λ࣮ݱ͢Δͱ͸Կ͔
    • ։ൃνʔϜ͕৴པੑΛίϯτϩʔϧ͢Δ Capability Λ਎ʹͭ
    ͚͍ͯΔ͜ͱ


    • ʮࢦඪΛݩʹߦಈ͕Ͱ͖Δʯ͜ͱ
    https://blog.studysapuri.jp/entry/2020/01/30/slo-review
    4-*4-0
    &SSPS#VEHFU
    1PMJDZ
    ։ൃνʔϜ
    ఆٛ͢Δ / ఆظతʹݟ௚͢
    Policy ʹैͬͯߦಈ͢Δ
    ͏·͍͔͘ͳ͔ͬͨ

    View full-size slide

  37. ͳͥ”ߦಈ͢Δ”·ͰࢸΒͳ͔ͬͨͷ͔
    • ౰࣌ɺSLO ҧ൓࣌ͷΞΫγϣϯ͸ Product Manager / Team ʹҠৡ͍ͯͨ͠


    • ·ͬͨ͘Կ΋Ͱ͖ͳ͔ͬͨΘ͚Ͱ͸ͳ͍


    • ΋ͱ΋ͱνʔϜʹ༧ࢉͷ͋ΔɺվળͷͨΊͷ࣌ؒͰͰ͖Δ͜ͱ͔͠Ͱ͖ͳ͔ͬͨʢִि1೔ʣ


    • QB Day ͱݺ͹ΕΔ


    • Τϥʔʹର͢Δ௚઀తͳରॲɺܰඍͳ Performance վળͳͲ


    • ΞʔΩςΫνϟมߋɺΠϯϑϥ෼཭ͳͲɺ௕ظతɾࠜຊతରॲ͸೉͔ͬͨ͠


    • ʮࢦඪΛݩʹػೳཁٻͱඇػೳཁٻͷ༏ઌ౓൑அ͕Ͱ͖Δʯ·Ͱ౸ୡ͠ͳ͔ͬͨ


    • ༏ઌ౓൑அʹ໾ʹཱͨͳ͍ͷͰ͋Ε͹ɺ։ൃνʔϜʹͱͬͯ΍Δ͜ͱ͕૿͚͑ͨͩͱ΋ݴ͑Δ

    View full-size slide

  38. ͳͥ”ߦಈ͢Δ”·ͰࢸΒͳ͔ͬͨͷ͔
    • ৴པੑͷ໰୊(ඇػೳཁٻ)ʹରॲ͢Δݖݶɾ༧ࢉෆ଍


    • ػೳ։ൃͷ༏ઌ౓͕ߴ͔ͬͨ

    View full-size slide

  39. SLO ҧ൓ͨ͠Β“ϦϦʔεετοϓ”ͱ͍͏ݬ૝
    • SLO ҧ൓ͨ͠Βશͯͷ։ൃΛࢭΊͯͦͷमਖ਼Λߦ͏ͷ͸ݱ࣮
    తͰ͸ͳ͍


    • ͦΕΛߦ͏ͨΊʹ͸ࣄۀ੹೚ऀ͕͜ͷӡ༻ʹ߹ҙ͢Δඞཁ͕͋Δ


    • ͦΕΛߦ͏ͨΊʹ͸”׬ᘳͳSLI/SLO”͕ඞཁ͕ͩɺ”׬ᘳͳSLI/SLO”͸
    ଘࡏ͠ͳ͍


    • ૊৫͕֦େ͠ɺBiz Dev / Product / CS ͱ੹຿Λ෼୲͍ͯ͠Δঢ়گͰɺ
    ݱ৔൑அͰ౎౓͜ΕΛ΍Δͷ͸ίϛϡχέʔγϣϯίετ͕ߴ͗͢Δ

    View full-size slide

  40. SLI/SLO ӡ༻ͷཧ૝: ͱ͋Δ Developer ͷίϝϯτ

    View full-size slide

  41. ʮSLO Reviewʯat SRE NEXT 2020 ͦͷޙͷ·ͱΊ
    • ʮ৴པੑࢦඪΛఆΊɺ؍࡯͢ΔʯจԽΛ࡞ͬͨ͜ͱʹ͸Ձ஋͕͋ͬͨ


    • ࣄۀઓ্ུͷҙࢥܾఆʹ໾ʹཱͭࢦඪʹҭͭ·Ͱʹ͸ࢸΒͳ͔ͬͨ


    • ཧ༝1. ඇػೳཁٻͱػೳཁٻͷόϥϯεΛม͑Δҙࢥܾఆݖݶɾ༧ࢉ͕ϓϩμΫτ
    ։ൃνʔϜʹͳ͔ͬͨ


    • ৽نػೳ։ൃͷΠϯηϯςΟϒ͕େ͖͍ঢ়گ


    • ͦͷΑ͏ͳٕज़ઓུ/ٕज़౤ࢿΛϓϩμΫτ All Ͱߦ͑Δ࢓૊Έ͕ͳ͔ͬͨ


    • ཧ༝2. ৴པੑࢦඪ͕ Biz/Dev/SRE શһ͕ཧղ͠΍͍͢ࢦඪͰ͸ͳ͔ͬͨ


    • backend API ͷ SLI ͸ϢʔβମݧΛ௚઀ද͓ͯ͠ΒͣɺLatency ʹؔ͢Δରॲ͸ TPM ΁ͷઆ໌΋೉͍͠

    View full-size slide

  42. Agenda
    • લఏɿSRE Λ࣮ݱ͢Δͱ͸Ͳ͏͍͏͜ͱ͔


    • ྺ࢙͔ΒৼΓฦΔʰελσΟαϓϦʱࣄۀʹ͓͚Δ SRE


    • 2020೥ʮSLO ReviewʯͰͷֶͼͱࣦഊ


    • SRE ͱٕज़ઓུ


    • ·ͱΊͱࠓޙ

    View full-size slide

  43. 2021೥


    ελσΟαϓϦ


    খதߴϓϩμΫτ։ൃ෦


    ٕज़ઓུάϧʔϓൃ଍

    View full-size slide

  44. ελσΟαϓϦখֶɾதֶɾߴߍɾେֶडݧߨ࠲
    ελσΟαϓϦ For TEACHERS
    ελσΟαϓϦ For SCHOOL
    ݱঢ়ͷ૊৫ਤ: খதߴϓϩμΫτ։ൃ෦ ҎԼ17άϧʔϓ
    TPM
    BtoB TPM
    BtoC TPM
    ForSCHOOL TPM
    ԣஅ
    BtoC
    BtoB
    QA
    ։ൃࢧԉ
    SRE
    ٕज़ઓུ
    ίʔνϯά ৽ن։ൃ1
    Τϯϋϯε
    ֶशࢧԉ
    Native
    iOS
    Android
    ৽ن։ൃ2
    ਐ࿏ओମੑ
    ίϛϡχέʔγϣϯࢧԉ
    ForSCHOOLϞόΠϧ

    View full-size slide

  45. Disclaimer
    • ٕज़ઓུάϧʔϓͷ্ཱͪ͛͸લ೚Ϛωʔδϟ͕ߦͬͨ΋ͷ


    • ࡢ೥࣌఺Ͱ͸ @chaspy ͸ DevOps WG ͷ Lead -> EM/Lead


    • લ೚ͷୀ৬ʹ൐͍ٕज़ઓུάϧʔϓͷ EM ͸෦௕͕݉೚ͭ͠
    ͭɺଞ਺໊ͷ EM ͱҰॹʹӡӦ͍ͯ͠Δ


    • SLO ҧ൓ͷରॲ͕Ͱ͖ͳ͍͜ͱ͕ཧ༝Ͱ্ཱ͕ͪͬͨΘ͚Ͱ
    ͸ͳ͍

    View full-size slide

  46. ٕज़ઓུͱ͸


    ϓϩμΫτ։ൃ૊৫ʹ͓͍ͯ


    ԿΛ΍Δ͔ɺԿΛ΍Βͳ͍͔

    View full-size slide

  47. ͳٕͥज़ઓུ͕ඞཁ͔
    • Ϗδωεͷ଎౓ʹ௥ਵ͢ΔͨΊ


    • มߋΛ͠΍͍͢γεςϜɾίʔυɾ૊৫ʹ͢Δ


    • มߋ଎౓Λ๦͛ΔཁҼ͸ઌճΓͯ͠ରॲ͢Δ(ٕज़తෛ࠴ͷฦࡁ)


    • ͦͷঢ়ଶΛ௕ظతʹҡ࣋Ͱ͖ΔೳྗΛಘΔ

    View full-size slide

  48. ͳٕͥज़ઓུ”άϧʔϓ”͕ඞཁ͔
    • ٕज़ઓུͷܾΊํ͸૊৫ʹΑͬͯҟͳΔ


    • 1ਓͷ CTO ͕τοϓμ΢ϯͰܾΊͯ΋͍͍


    • ϘτϜΞοϓͰશһ߹ٞͰܾΊͯ΋͍͍


    • ͦͷதؒͰ΋͍͍


    • ελσΟαϓϦখதߴ։ൃ૊৫͸ٕज़ઓུΛ1ਓʹґଘ͠ͳ͍࢓૊ΈΛ
    ࡞Δ͜ͱʹ௅ઓ͍ͯ͠Δ

    View full-size slide

  49. ٕज़ઓུάϧʔϓͱ͸
    • ໨త


    • ϓϩμΫτ։ൃ૊৫ͱͦͷγεςϜΛΑΓมԽʹڧ͘͢Δ


    • ໨ඪ


    • ٕज़తͳϏδϣϯͱํ਑ͷࡦఆ


    • ٕज़త՝୊ɾෛ࠴ΛίϯτϩʔϧԼʹஔ͘


    • վળαΠΫϧͷཱ֬ͱࣗݾ਍அೳྗͷ֫ಘ

    View full-size slide

  50. ࠷ॳͷ1೥Ͱ΍ͬͨ͜ͱ
    • ৽ن։ൃɿΤϯϋϯεɿٕज़తෛ࠴ղফ = 1:1:1 ͷ༧ࢉએݴ


    • ٕज़తෛ࠴ղফҊ݅ΛܾΊͯ։ൃϩʔυϚοϓʹ૊ΈࠐΉ


    • ٕज़՝୊ͷ؅ཧํ๏ͱൃੜ࣌ͷτϦΞʔδํ๏ͷܾఆ

    View full-size slide

  51. SLO ҧ൓࣌ͷΞΫγϣϯ͕औΕΔΑ͏ʹ࢓૊Έ͕Ͱ͖ͨ
    • Ұఆඇػೳཁٻʹ༧ࢉ͕౰ͯΒΕɺൃੜٕͨ͠ज़՝୊Λ؅ཧ
    ͠ɺ࣮ߦͰ͖Δମ੍͕੔ͬͨ


    • SLO ҧ൓ͨ͠ࡍʹ࣮ࢪ͢Δ͜ͱ͕೉͔ٕͬͨ͠ज़՝୊Λܭը
    ʹ૊ΈࠐΊΔΑ͏ʹͳͬͨ

    View full-size slide

  52. ׆ಈମ
    • ໨త


    • ϓϩμΫτ։ൃ૊৫ͱͦͷγεςϜΛΑΓมԽʹڧ͘͢Δ


    • ໨ඪ


    • ٕज़తͳϏδϣϯͱํ਑ͷࡦఆ


    • ٕज़త՝୊ɾෛ࠴ΛίϯτϩʔϧԼʹஔ͘


    • վળαΠΫϧͷཱ֬ͱࣗݾ਍அೳྗͷ֫ಘ
    DevOps WG
    ԣஅWG


    Backend WG


    Frontend WG

    View full-size slide

  53. ׆ಈମ
    • ໨త


    • ϓϩμΫτ։ൃ૊৫ͱͦͷγεςϜΛΑΓมԽʹڧ͘͢Δ


    • ໨ඪ


    • ٕज़తͳϏδϣϯͱํ਑ͷࡦఆ


    • ٕज़త՝୊ɾෛ࠴ΛίϯτϩʔϧԼʹஔ͘


    • վળαΠΫϧͷཱ֬ͱࣗݾ਍அೳྗͷ֫ಘ
    DevOps WG
    ԣஅWG


    Backend WG


    Frontend WG

    View full-size slide

  54. ٕज़త՝୊ɾෛ࠴ΛίϯτϩʔϧԼʹஔ͘
    • ٕज़՝୊Λ౤͛ࠐΊΔ৔ॴɾ࢓૊ΈΛ࡞Δ


    • ٕज़՝୊ͷ༏ઌ౓Λ͚ͭΔ


    • དྷظͷ։ൃϩʔυϚοϓʹ઀ଓ͢Δ

    View full-size slide

  55. ٕज़՝୊Λ౤͛ࠐΊΔ৔ॴɾ࢓૊ΈΛ࡞Δ
    ୭Ͱ΋ٕज़՝୊Λ౤͛ࠐΊΔ
    spreadsheet
    reacji Ͱؾܰʹ౤͛ࠐΊΔ

    View full-size slide

  56. ౤͛ࠐ·Εͨ՝୊ͷ re
    fi
    nement
    ͭΒ͞ = ϖΠϯΛݴޠԽ
    ݱ࣌఺Ͱු͔Ϳ How Λهࡌ


    (༏ઌ౓͕͚ͭΒΕΕ͹͍͍ͷͰɺ͜ͷཝ͸ optional)

    View full-size slide

  57. ՝୊ͷ༏ઌॱҐ෇͚
    ϖΠϯͷස౓ͱڧ౓ͰϚοϐϯά


    ٕज़՝୊ͷ૬ରධՁΛ͚ͭΔ

    View full-size slide

  58. དྷظͷ։ൃϩʔυϚοϓʹ઀ଓ͢Δ
    ϖΠϯͷ਺஋Խ
    ։ൃϩʔυϚοϓ઀ଓঢ়گ

    View full-size slide

  59. ΋ͪΖΜɺ׬ᘳͰ͸ͳ͍
    • ٕज़՝୊͸ස౓ͱڧ౓ͰଌΕΔ΋ͷͰ͸ͳ͍


    • ఆੑతͰ͋Δ


    • ࢀՃϝϯόʔͷภΓ͕͋Δ͔΋


    • ෳ਺ member ͷ vote ݁Ռͷॏ৺ʹஔ͍͍ͯΔͷͰਫ਼౓ʹٙ໰


    • ։ൃϦιʔεɺٕज़త೉қ౓ɺϦεΫʹΑ͙ͬͯ͢ʹऔΓ͔͔Εͳ
    ͍՝୊΋͋Δ


    • ՝୊ͷ༏ઌ౓෇͚ʹ͕͔͔࣌ؒΔ


    • etc…

    View full-size slide

  60. ͔͠͠ɺಛఆͷਓʹґଘ͠ͳ͍ελʔτϥΠϯʹཱͬͨ
    • ୭Ͱ΋ٕज़՝୊Λද໌͢Δ͜ͱ͕Ͱ͖Δ


    • ද໌ͨ͠՝୊͸ඞͣऔΓѻΘΕΔ


    • શһͰ໰୊ʹ޲͖߹͑Δ - ໰୊ vs ࢲͨͪ


    • ௕ظతͳ৴པੑͷ Controlability ୲อʹ໾ཱͭ

    View full-size slide

  61. ׆ಈମ
    • ໨త


    • ϓϩμΫτ։ൃ૊৫ͱͦͷγεςϜΛΑΓมԽʹڧ͘͢Δ


    • ໨ඪ


    • ٕज़తͳϏδϣϯͱํ਑ͷࡦఆ


    • ٕज़త՝୊ɾෛ࠴ΛίϯτϩʔϧԼʹஔ͘


    • վળαΠΫϧͷཱ֬ͱࣗݾ਍அೳྗͷ֫ಘ
    DevOps WG
    ԣஅWG


    Backend WG


    Frontend WG

    View full-size slide

  62. DevOps WG ͷ໨తͱ׆ಈ
    • ໨తɿʢ։ൃνʔϜͷʣࣗݾ਍அೳྗͷ֫ಘͷͨΊʹઃஔ


    • ϝϯόʔ͸ ྖҬ͝ͱͷ WebDev / QA / SRE


    • ׆ಈ಺༰


    • όϦϡʔετϦʔϜϚοϐϯάͷ࣮ࢪ


    • ީิͱͳΔ Metrics / Indicator ͷચ͍ग़͠ͱܭଌ


    • DX Criteria ͷ࣮ࢪ


    • όϦϡʔετϦʔϜΛ્֐͢ΔཁҼͷղܾ(e.g. E2E Automation)


    • ϓϩμΫτ։ൃ෦֎΁ͷ޿ใ׆ಈ


    • ·ͣ͸༗ޮͦ͏ͳ metrics ΍ΞηεϝϯτΛݕূͨ͠

    View full-size slide

  63. όϦϡʔετϦʔϜϚοϐϯά
    Meta Issue (Epic) ࡞੒~ ։ൃ

    View full-size slide

  64. όϦϡʔετϦʔϜϚοϐϯά
    ։ൃ׬ྃ ~ εϓϦϯτϨϏϡʔ
    QA ~ ຊ൪ϦϦʔε

    View full-size slide

  65. ީิͱͳΔ Metrics / Indicator ͷચ͍ग़͠ͱܭଌ
    όϦϡʔετϦʔϜϚοϐ
    ϯάΛΠϯϓοτʹɺվ
    ળͨ͠৔߹ͷϝϦοτͷ
    Ծઆ΍ɺͦΕΛ્֐ͯ͠
    ͍Δ໰୊ΛϐοΫΞοϓ

    View full-size slide

  66. Q
    https://blog.studysapuri.jp/entry/2020/08/17/dx-criteria-system

    View full-size slide

  67. ϓϩμΫτ։ൃ෦֎Ͱͷ޿ใ׆ಈ: BtoC All Hands Ͱͷൃද
    https://blog.studysapuri.jp/entry/2020/08/17/dx-criteria-system
    • ॴଐάϧʔϓΛ௒͑ͨࣄۀঢ়گΛ஌Δ৔


    • Ϛʔέοτχϡʔε


    • ࣄۀঢ়گ


    • ϓϩμΫτ KPI


    • SLI / ։ൃऀੜ࢈ੑ


    • ͦͷଞτϐοΫ͞·͟·


    • SRE ͱ͸ͳʹʁ


    • ϚΠΫϩαʔϏεͬͯͳʹʁ͏Ε͍͠ͷʁ

    View full-size slide

  68. ϓϩμΫτ։ൃ෦֎Ͱͷ޿ใ׆ಈ: BtoC All Hands Ͱͷൃද
    • “͸͡Ίͯͷ SRE” ͱ୊ͯ͠։ൃ෦Ҏ֎ͷํ޲͚ʹൃද

    View full-size slide

  69. ϓϩμΫτ։ൃ෦֎Ͱͷ޿ใ׆ಈ: BtoC All Hands Ͱͷൃද
    • “͸͡Ίͯͷ SRE” ͱ୊ͯ͠։ൃ෦Ҏ֎ͷํ޲͚ʹൃද

    View full-size slide

  70. DevOps WG ͷ໨తͱ׆ಈ
    • ໨తɿʢ։ൃνʔϜͷʣࣗݾ਍அೳྗͷ֫ಘͷͨΊʹઃஔ


    • ʢ։ൃνʔϜ͕ʣࢦඪΛݩʹߦಈ͢ΔจԽΛ࡞Ζ͏ͱ͍ͯ͠Δ


    • SLI/SLO Λݟͯ৴པੑΛ؍࡯͍ͯ͘͜͠ͱͱಉ͡Ͱ͸…?

    View full-size slide

  71. SRE ͱٕज़ઓུ
    • DevOps WG ͷ׆ಈ͸ ʮSRE ͷ࣮ݱʯͷจԽ໘Ͱͷ֦ு


    • զʑ͕ݟΔ΂͖ࢦඪ͸γεςϜͷ৴པੑࢦඪ͚ͩͰ͸ͳ͍


    • ͋ΒΏΔ΋ͷΛࢦඪΛݟͯɺҙࢥܾఆ͢Δ


    • ࠓޙ͸͜ͷจԽৢ੒ͦͷ΋ͷͷվળαΠΫϧΛճ͢


    • 1. ީิͱͳΔ metrics ͷ༗ޮੑ͕໌Β͔ʹͳΓɺ਺஋Խ͢Δ


    • 2. ։ൃνʔϜ͕ͦΕΛݟͯɺΞΫγϣϯΛߟ͑Δ͜ͱ͕Ͱ͖Δ


    • 3. ։ൃνʔϜ͕ΞΫγϣϯ->վળͷαΠΫϧΛճ͢


    • 4. 1-3 ͦΕࣗମ͕͏·͍͍ͬͯ͘Δ͔ΛධՁ͢Δ

    View full-size slide

  72. SRE ͱٕज़ઓུ: ·ͱΊ
    • SRE Λ࣮ݱ͢ΔͨΊʹ͸ɺSLO ҧ൓Λͨ࣌͠ʹߦಈͰ͖Δ༧ࢉͱݖݶ
    ͕ඞཁ


    • ͦͷ্Ͱɺٕज़՝୊Λղܾ͢Δ༏ઌॱҐΛ͚ͭΒΕΔٕज़ઓུ͕ඞཁ


    • ʰελσΟαϓϦʱখதߴϓϩμΫτ։ൃ෦Ͱ͸͜ͷٕज़ઓུΛ1ਓ
    ʹґଘͤͣɺάϧʔϓͰ࣮ݱ͢Δ͜ͱʹ௅ઓ͍ͯ͠Δ


    • ͋ΒΏΔ΋ͷΛࢦඪͰݟ͍ͯ͘จԽ͕৴པੑͷͨΊʹॏཁ

    View full-size slide

  73. Agenda
    • લఏɿSRE Λ࣮ݱ͢Δͱ͸Ͳ͏͍͏͜ͱ͔


    • ྺ࢙͔ΒৼΓฦΔʰελσΟαϓϦʱࣄۀʹ͓͚Δ SRE


    • 2020೥ʮSLO ReviewʯͰͷֶͼͱࣦഊ


    • SRE ͱٕज़ઓུ


    • ·ͱΊͱࠓޙ

    View full-size slide

  74. ·ͱΊ / SRE Λ࣮ݱ͢ΔͨΊʹඞཁͳ͜ͱ
    • ࢦඪΛݩʹվળ͠ଓ͚ΔจԽ


    • ࣗݾ׬݁ԽΛࢧ͑Δ Platform


    • ༏ઌॱҐΛมߋ͢ΔͨΊͷٕज़ઓུ

    View full-size slide

  75. SRE Λ࣮ݱ͢Δͱ͸

    View full-size slide

  76. ։ൃνʔϜ͕৴པੑΛ


    ίϯτϩʔϧ͢Δ
    Capability Λ


    ਎ʹ͚͍ͭͯΔ͜ͱ

    View full-size slide

  77. SRE “NEXT” in ʰελσΟαϓϦʱ
    • “৴པੑ” ʹؔͯ͠͸ Enabling Team ͱͯ͠ͷ SRE Team ͸໾
    ׂΛՌͨͭͭ͋͠Δ


    • SRE Team ͷࠓޙ


    • ΑΓ૊৫Λ Sustainable / Scalable ʹ͢ΔͨΊʹɺPlatform ʹؔ͢Δ
    ΦϯϘʔσΟϯάͷ֦ॆ΍ɺ։ൃνʔϜ͕ࣗ཯తʹ৴པੑʹؔ͢Δ
    Capability शಘΛ൑அͰ͖ΔΞηεϝϯτΛఏڙ͢Δ


    • ৴པੑ͚ͩͰ͸ͳ͍ɺ։ൃੜ࢈ੑΛՌͨͤΔ Platform ։ൃʹ஫ྗ͢Δ

    View full-size slide

  78. Who owns the Service Level?
    • Service Level ͸ϓϩμΫτʹؔΘΔશһͷ΋ͷ


    • શһ͕ؔ৺Λ࣋ͯΔΑ͏ͳ৴པੑࢦඪʹਐԽͤ͞·͠ΐ͏


    • ϢʔβମݧΛ௚઀తʹද͢ Client-side(WebFrontend/Native) Ͱͷ SLI/SLO Λ௥͏


    • ʮࢦඪΛݟͯߦಈ͢Δʯͦͷ΋ͷͷվળαΠΫϧΛճ͠·͠ΐ͏

    View full-size slide

  79. Thank you!
    chaspy chaspy_
    Engineering Manager, Site Reliability

    at Recruit Co., Ltd.
    Takeshi Kondo
    https://chaspy.me

    View full-size slide