Web サービスの信頼性と運用の自動化について / iot40-rrreeeyyy

第40回インターネットと運用技術研究発表会の招待講演で『Web サービスの信頼性と運用の自動化について』というタイトルで発表しました。

Transcript

1. Web αʔϏεͷ৴པੑͱ
   ӡ༻ͷࣗಈԽʹ͍ͭͯ
   ΫοΫύουגࣜձࣾ ΠϯϑϥετϥΫνϟʔ෦ SRE άϧʔϓ
   ٢઒ ཽଠ ( @rrreeeyyy )
   ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 1
   

   View Slide

2. Agenda
   • Site Reliability Engineering (SRE) ʹ͍ͭͯ
   • SRE ͱ͸
   • ӡ༻ͷݱ৔ͱӡ༻ٕज़ݚڀ
   • ӡ༻ͷࣗಈԽʹ͍ͭͯ
   • ࣌ܥྻσʔλͷॲཧͱҟৗݕ஌ʹ͍ͭͯ
   ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 2
   

   View Slide

3. Me
   !SSSFFFZZZ
   !SSSFFFZZZ
   IUUQTSSSFFFZZZDPN
   :PTIJLBXB3ZPUB
   ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 3
   

   View Slide

4. Me
   • Yoshikawa Ryota ( @rrreeeyyy [reɪ] )
   • ిؾ௨৴େֶ (2010/04 ʙ 2014/03)
   • ৘ใཧ޻ֶ෦ ৘ใɾ௨৴޻ֶՊ
   • גࣜձࣾϋʔτϏʔπ (2010/11ʙ2016/12)
   • MSP ࣄۀ෦ ӡ༻ελοϑɾӡ༻ΤϯδχΞ
   • ΫοΫύουגࣜձࣾ (2017/01 ʙ)
   • ΠϯϑϥετϥΫνϟʔ෦ SRE άϧʔϓ
   ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 4
   

   View Slide

5. Me
   • ిؾ௨৴େֶ (2010/04 ʙ 2014/03)
   • mruby Λ༻͍ͨLinux ϩʔυόϥϯαΠϯλϑΣʔεͷ࣮૷Ͱଔۀ
   • גࣜձࣾϋʔτϏʔπ (2010/11ʙ2016/12)
   • ਺୆ʙ਺ઍ୆ن໛ͷӡ༻ɾߏஙɾ؅ཧΛܦݧ
   • ϝσΟΞɾήʔϜɾEC ౳ͷ༷ʑͳ෼໺ͷӡ༻Λܦݧ
   • ΫοΫύουגࣜձࣾ (2017/01 ʙ)
   • ΠϯϑϥετϥΫνϟʔ෦ SRE άϧʔϓ
   • ਺ઍ୆ن໛ͷγεςϜͷ৴པੑʹؔΘΔ෦෼શͯΛ୲౰
   ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 5
   

   View Slide

6. ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 6
   

   View Slide

7. Site Reliability Engineering ͱ͸
   • αΠτͷ৴པੑͷશͯʹ੹೚ൣғΛ࣋ͭɺͱ͢ΔΤϯδχΞϦϯάख๏
   • ಛʹɺιϑτ΢ΣΞɾγεςϜΤϯδχΞϦϯάΛ༻͍ͯ՝୊Λղܾ͢Δ
   • ྫ͑͹ɺύϑΥʔϚϯε
   • ύϑΥʔϚϯεʹ໰୊͕͋Δίʔυ͸ SRE ࣗ਎͕ίʔυΛॻ͍ͯमਖ਼͢Δ
   • ྫ͑͹ɺεέʔϥϏϦςΟɾΞϕΠϥϏϦςΟ
   • ਓؒʹΑΔखಈͷ࡞ۀΛίʔυʹΑΓࣗಈԽ͢Δ
   • ن໛΍ΞΫηε͕૿େͯ͠΋҆ఆͯ͠αʔϏεΛఏڙͰ͖Δঢ়ଶʹ͢Δ
   • ΠϯϑϥΤϯδχΞͷ੹೚ൣғ͕૿େͨ͠தͰ͋Δछɺ৬੹Λ࠶ఆٛͨ͠෺ͱଊ͍͑ͯΔ
   ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 7
   

   View Slide

8. SRE ͷ׆ಈ
   SRE ͷ׆ಈ͸େ͖͘෼͚ͯ࣍ͷ 4 ͭʹ෼ྨͰ͖Δͱ͞Ε͍ͯΔ
   • So#ware Engineering
   • Systems Engineering
   • Toil
   • Overhead
   ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 8
   

   View Slide

9. SRE ͷ׆ಈ
   • So#ware Engineering
   • ίʔυͷ࡞੒΍मਖ਼, ͦΕʹؔ࿈͢Δઃܭ΍υΩϡϝϯςʔγϣϯͷ࡞ۀͳͲ
   • ࣗಈԽεΫϦϓτͷ࡞੒, πʔϧ΍ϑϨʔϜϫʔΫͷ࡞੒ ...
   • αʔϏε΁ͷ৴པੑΛߴΊΔػೳͷ௥Ճ ...
   • Systems Engineering
   • 1 ճͷ࡞ۀͰӬଓతͳվળΛੜΉ࣍ͷΑ͏ͳ࡞ۀ
   • ຊ൪γεςϜͷઃఆมߋ ...
   • ։ൃνʔϜͷαʔϏεΞʔΩςΫνϟઃܭ ...
   ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 9
   

   View Slide

10. SRE ͷ׆ಈ
    • Toil
    • αʔϏεΛՔಇͤ͞ΔͨΊ͚ͩʹ܁Γฦ͠ߦΘΕΔखಈͰͷ࡞ۀ
    • ௕ظతͳՁ஋Λ࣋ͨͳ͍, αʔϏεͷ੒௕ʹରͯ͠ O(n) Ͱ͋Δ ...
    • ͭ·Βͳ͍࢓ࣄͰ΋௕ظతͳՁ஋͕͋Ε͹ Toil Ͱ͸ͳ͍
    • Overhead
    • αʔϏεΛՔಇͤ͞Δ͜ͱʹ௚݁͠ͳ͍؅ཧతͳ࡞ۀ
    • ࠾༻, ϛʔςΟϯά, ධՁ, τϨʔχϯά ...
    ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 10
    

    View Slide

11. ӡ༻ͷݱ৔ͱӡ༻ٕज़ݚڀ
    • ΤϯδχΞϦϯάΛͪΌΜͱ΍Δࣄ͕ݱ৔ϨϕϧͰ΋ධՁ͞ΕΔΑ͏ʹ
    • ͜ͷจ຺ͷҰͭͱͯ͠ SRE ͷΑ͏ͳख๏ɾ৬छ͕ग़͖ͯͨͱ͍͏ཧղ
    • ࿦จΛॻ͍ͨΓಡΜͰཧղɾ࣮૷͢Δࣄ͕ධՁ͞ΕΔΑ͏ʹͳ͖ͬͯͨ
    • ࣮ࡍͷӡ༻ͷݱ৔Ͱ΋ಡΜͰཧղ͢Δࣄ͸ඞཁʹͳ͖ͬͯͨ
    • ٕज़બఆͷࢦඪͷҰͭͱͯ͠΍ϛυϧ΢ΣΞͷڍಈͷཧղͳͲ
    • ͍ΘΏΔݚڀ։ൃͷΑ͏ͳ෦໳Ͱͳͯ͘΋೔ৗతʹߦ͏Α͏ʹ
    • ଟ͘ͷٕज़اۀͰӡ༻ɾϛυϧ΢ΣΞ౳ͷ࿦จ͕ଟ͘ग़ͯ͘ΔΑ͏ʹ
    ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 11
    

    View Slide

12. େखΫϥ΢υϕϯμ౳ͷ࿦จ
    • Google, Amazon, Facebook, Ne3lix...
    • ଞʹ΋େখؔΘΒ༷ͣʑͳاۀ͔Β࿦จ͕ग़͍ͯΔ
    • USENIX ͷΧϯϑΝϨϯε౳Ͱٕज़اۀ͕ੵۃతʹൃද
    • FAST, OSDI, Security ...
    • Ϋϥ΢υαʔϏεͷ಺෦࣮૷΍಺੡ϛυϧ΢ΣΞؔΘΒͣ
    • Ϋϥ΢υαʔϏεͷڍಈΛਖ਼͘͠ཧղ͢ΔͨΊʹ࿦จΛಡΉ
    • ৽͍͠ΞʔΩςΫνϟɾϛυϧ΢ΣΞͷબఆͷͨΊʹ࿦จΛಡΉ
    ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 12
    

    View Slide

13. ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 13
    

    View Slide

14. ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 14
    

    View Slide

15. ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 15
    

    View Slide

16. ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 16
    

    View Slide

17. ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 17
    

    View Slide

18. ࿦จͷ಺༰Λ࣮ӡ༻Ͱ࢖͑Δϛυϧ΢ΣΞ΁
    • HashiCorp
    • Vagrant, Terraform ౳Λ࡞͍ͬͯΔϕϯνϟʔ
    • ࿦จͷ಺༰Λ࣮ӡ༻Ͱ࢖͍΍͍͢ܗʹམͱ͠ࠐΜͰ͍Δ
    • Serf, Consul, Vault ౳
    • ͜ΕΒͷϛυϧ΢ΣΞΛਖ਼͘͠ཧղͯ͠ӡ༻͢ΔͨΊʹ࿦จΛಡΉ
    • ͳͥ Consul ͷϊʔυ͸࠷௿ 3 ୆ඞཁͳͷ͔ʁ
    ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 18
    

    View Slide

19. ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 19
    

    View Slide

20. ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 20
    

    View Slide

21. ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 21
    

    View Slide

22. ΫοΫύουʹ͓͚Δ SRE ͷ׆ಈ
    ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 22
    

    View Slide

23. ΫοΫύουʹ͓͚Δ SRE ͷ׆ಈ
    • SRE ͱͯ͠ͷ׆ಈΛΫοΫύου಺Ͱ΋༷ʑߦ͍ͬͯΔ
    • ΫοΫύουͷ SRE ͷ׆ಈΛ͍͔ͭ͘঺հ
    • ৽نαʔϏεʹର͢Δ SRE ͷಈ͖
    • ϞχλϦϯάͷվળ
    • ϩʔυόϥϯγϯάͷվળ
    • ৽ଔݚम
    • ...
    ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 23
    

    View Slide

24. ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 24
    

    View Slide

25. ΫοΫύουʹ͓͚Δ SRE ͷ׆ಈ
    • SRE ͱͯ͠ͷ׆ಈΛΫοΫύου಺Ͱ΋༷ʑߦ͍ͬͯΔ
    • ΫοΫύουͷ SRE ͷ׆ಈΛ͍͔ͭ͘঺հ
    • ৽نαʔϏεʹର͢Δ SRE ͷಈ͖
    • ϞχλϦϯάͷվળ
    • ϩʔυόϥϯγϯάͷվળ
    • ৽ଔݚम
    • ...
    ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 25
    

    View Slide

26. ϞχλϦϯάͷվળ
    • େྔͷσʔλΛ౤ೖɾॲཧ͢ΔΑ͏ͳ࣌ܥྻσʔλϕʔεͷج൫͸੔͖ͬͯͨ
    • ΫοΫύουͰ͸ Prometheus Λ TSDB ͱͯ͠࠾༻
    • Long-term storage ͱͯ͠͸ S3 ΛόοΫΤϯυͱͯ͠ݕ౼த
    • औಘͰ͖ΔϝτϦΫεͷղ૾౓ͷ޲্ɾछྨͷ૿ڧ
    • 15 ඵ୯ҐͷϝτϦΫεऔಘ͕ग़དྷΔΑ͏ʹͳ͍ͬͯΔ
    • ϚΠΫϩαʔϏεͷαʔϏεؒͷ࿈ܞͷ༷ࢠ΋ՄࢹԽΛݕ౼த
    ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 26
    

    View Slide

27. ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 27
    

    View Slide

28. ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 28
    

    View Slide

29. ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 29
    

    View Slide

30. ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 30
    

    View Slide

31. ࣌ܥྻσʔλͷॲཧʹ͍ͭͯ
    • ͜Ε·Ͱ͸΄ͱΜͲ੩తͳᮢ஋ͰԿͱ͔͍ͯͨ͠ঢ়ଶ
    • ͜Ε͔Β͸࣌ܥྻσʔλʹ؆୯ͳ౷ܭతॲཧ͕ࢪͤΔΑ͏ʹ
    • ઢܗճؼ, ࢦ਺ฏ׈Խ, ҠಈฏۉͳͲ...
    • ࣄલʹى͖͏Δҟৗ͕෼͔͍ͬͯΔ࣌ʹ͸Α͘ಈ͘
    • Πϯγσϯτ΍ো֐ͷ "ੵΈॏͶ" Ͱݕ஌Ͱ͖ΔΑ͏ʹ
    • ࣮ࡍʹ͸औΕΔϝτϦΫε͕૿͑ҟৗ࣌ʹͲ͏ͳΔ͔༧ଌࠔ೉ͳࣄ΋
    ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 31
    

    View Slide

32. ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 32
    

    View Slide

33. ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 33
    

    View Slide

34. ࣌ܥྻσʔλͱҟৗݕ஌
    • ࣌ܥྻσʔλͷҟৗ(֎Ε஋)ݕ஌͸༷ʑͳख๏͕طʹݚڀ͞Ε͖͍ͯͯΔ
    • Gaussian Mixture Model, Isola5on forest ͳͲͳͲ...
    • ࣮ࡍͷӡ༻Ͱग़ݱ͢ΔϝτϦΫεͰ͸ඇઢܗͳཁૉ͕ଟ͘ग़ݱ͢Δ
    • ैདྷͷख๏͸ෳࡶͳඇઢܗม׵ͳͲͷදݱʹऑ͍͜ͱ͕͋ͬͨ
    • ࠷ۙͷख๏Ͱ͸ CNN Λ༻͍ͯҟৗݕ஌ߦ͏Α͏ͳख๏͕ొ৔ͨ͠
    • ෳ਺ͷೖྗ͕͋ΔΑ͏ͳ૬ؔҟৗͰ΋ൺֱత؆୯ʹ༧ଌ͢Δࣄ͕Մೳ
    ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 34
    

    View Slide

35. ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 35
    

    View Slide

36. ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 36
    

    View Slide

37. ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 37
    

    View Slide

38. LSTM ʹΑΔ࣌ܥྻσʔλͷҟৗݕ஌
    • LSTM Λ༻͍ͯਖ਼ৗͳ࣌ܥྻσʔλͷֶशΛߦ͏
    • ߦֶͬͨशʹج͍ͯɺ࣍ͷσʔλͷ༧ଌΛߦ͏
    • ࣮ࡍͷσʔλͱ༧ଌ஋Λൺֱ͢Δ͜ͱͰҟৗ౓Λଌఆ͢Δ
    • ֶश͢Δσʔλͷೖྗ૚ͱͯ͠ϝτϦΫεҎ֎ʹαʔόͷίϯςΩετΛೖΕΔ
    • ྫ͑͹σϓϩΠதɾόον࣮ߦதɾΦʔτεέʔϧத...
    • ͦͷ࣌ͷαʔόͷίϯςΩετΛؚΊͯ༧ଌ஋Λ࡞ΕΔ
    • ΑΓαʔόͷঢ়گΛՃຯͨ͠ҟৗ౓ΛଌΔ͜ͱ͕ग़དྷΔ
    ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 38
    

    View Slide

39. ༧ଌର৅ʹͳΔ࣌ܥྻσʔλͷྫ
    timestamp,cpu,deploying,autoscaling,batching
    2018-03-05 12:00:00,80,1,0,0
    2018-03-05 12:00:15,81,1,0,0
    2018-03-05 12:00:30,82,1,0,0
    2018-03-05 12:00:45,82,1,1,0
    2018-03-05 12:01:00,75,1,1,0
    2018-03-05 12:01:15,60,1,1,0
    2018-03-05 12:01:30,55,1,1,0
    2018-03-05 12:01:45,40,0,1,0
    2018-03-05 12:02:00,35,0,0,0
    • ࣮ࡍʹ͸ Prometheus ͷϥϕϧػೳΛ༻্͍ͯهͷίϯςΩετΛೖྗ
    ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 39
    

    View Slide

40. Keras Λ༻͍࣮ͨ૷ɾ࣮ݧ
    • ϊΠζΛؚ·ͤͨਖ਼ݭ೾Λ LSTM Ͱֶशͤ͞Δ
    • ݩͱͳͬͨਖ਼ݭ೾ʹҟৗΛؚ·ͤΔ
    • ҟৗͷ͋Δ೾ܗͱֶशࡁΈͷϞσϧ͔Βੜ੒͞Εͨ೾ܗͷೋ৐ޡࠩΛऔΔ
    • ߋʹ࣮ࡍʹલϖʔδͷ࣌ܥྻσʔλΛֶशͯ͠༧ଌ஋Λग़ͯ͠ΈΔ
    • ࣮ࡍͷσʔλʹݶΓͳ͍ۙ͘ܗͷ toy-data ͱͯ͠ར༻
    • CPU ࢖༻཰ʹؔͯ͠͸ 0-1 ͷൣғʹਖ਼نԽֶͯ͠शΛऩଋͤ͞Δ
    • ز͔ͭͷ CPU ࢖༻཰ɾσϓϩΠपظͷϞσϧΛֶशͤͯ͞༧ଌͤͯ͞ΈΔ
    ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 40
    

    View Slide

41. ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 41
    

    View Slide

42. ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 42
    

    View Slide

43. ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 43
    

    View Slide

44. ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 44
    

    View Slide

45. ·ͱΊ
    • SRE ͱ͍͏ΤϯδχΞϦϯάख๏ʹ͍ͭͯ঺հ
    • ΠϯϑϥΤϯδχΞͷ৬੹͕޿͕͖ͬͯͨ
    • αΠτͷ৴པੑࣗମʹ৬੹Λ࣋ͭ͜ͱΛ໌֬ʹ͢Δ SRE ͕ొ৔
    • αΠτͷ৴པੑΛकΔͨΊʹ͸ "ਖ਼͘͠ΤϯδχΞϦϯάΛ͢Δ" ࣄ͕ॏཁ
    • ΫοΫύουͰͷ SRE ͷऔΓ૊Έͱͯ͠ϞχλϦϯάͷվળΛ঺հ
    • ࣌ܥྻσʔλΛର৅ʹอଘɾղੳ͕ߦ͑Δج൫͕੔͖ͬͯͨ
    • ࣍ͳΔεςʔδͱͯ࣌͠ܥྻσʔλͷҟৗݕ஌ʹ͍༷ͭͯʑͳख๏Λ໛ࡧத
    ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 45
    

    View Slide

46. ࢀߟࢿྉ
    • h#ps:/
    /landing.google.com/sre/book.html
    • h#ps:/
    /www.allthingsdistributed.com/files/p1041-verbitski.pdf
    • h#p:/
    /lamport.azurewebsites.net/tla/formal-methods-amazon.pdf
    • h#ps:/
    /staAc.googleusercontent.com/media/research.google.com/en/
    /archive/spanner-osdi2012.pdf
    • h#p:/
    /techlife.cookpad.com/entry/Ameseries-database-001
    • h#p:/
    /www.vldb.org/pvldb/vol8/p1816-teller.pdf
    • h#ps:/
    /qiita.com/rrreeeyyy/items/6bbd1f09c96e2af4a8ce
    • h#p:/
    /ramcloud.stanford.edu/raH.pdf
    • h#p:/
    /www.cs.cornell.edu/~asdas/research/dsn02-swim.pdf
    • h#ps:/
    /speakerdeck.com/rrreeeyyy/jK-2017-site-reliability-engineering
    • h#ps:/
    /speakerdeck.com/yuukit/the-study-of-Ame-series-database-for-server-monitoring
    • h#ps:/
    /speakerdeck.com/rrreeeyyy/introducAon-to-prometheus-pracAce
    • h#ps:/
    /github.com/NeKlix/vizceral
    • h#ps:/
    /github.com/nghialv/promviz
    ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 46
    

    View Slide

47. PR
    ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 47
    

    View Slide

48. We are hiring!
    • ΫοΫύουͰ͸ຊ೔঺հͨ͠Α͏ͳऔΓ૊ΈΛߦ͍ͬͯ·͢
    • ·ͩ·ͩղܾ͍ͨ͠໰୊ɾऔΓ૊Έ͍ͨ՝୊͕ͨ͘͞Μ͋Δ
    • ָ͠Έͳ͕ΒҰॹʹ΍ΕΔϝϯόʔΛืू͍ͯ͠·͢
    → h$ps:/
    /cookpad.jobs
    ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 48
    

    View Slide