Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up for free
Web サービスの信頼性と運用の自動化について / iot40-rrreeeyyy
rrreeeyyy
March 08, 2018
Technology
12
6.8k
Web サービスの信頼性と運用の自動化について / iot40-rrreeeyyy
第40回インターネットと運用技術研究発表会の招待講演で『Web サービスの信頼性と運用の自動化について』というタイトルで発表しました。
rrreeeyyy
March 08, 2018
Tweet
Share
More Decks by rrreeeyyy
See All by rrreeeyyy
「信頼性」を保ちつつ大規模サービスをリニューアルする / cookpad-tech-kitchen-service-embedded-sres
rrreeeyyy
11
9.2k
Cookpad and Prometheus
rrreeeyyy
6
18k
SRE-Lounge-8-Cookpad-Microservice-Architecture-Overview
rrreeeyyy
5
4.2k
A survey of anomaly detection methodologies for web system
rrreeeyyy
5
780
エンジニアリングをちゃんとやる あるいは 人類の平和 について / wsa02-rrreeeyyy
rrreeeyyy
13
2.6k
「自立」したWebシステムを創る。自分の好きなことをする世界を目指して。/ ipsj-one-2018-rrreeeyyy
rrreeeyyy
3
1.5k
SRE at Cookpad
rrreeeyyy
1
970
Prometheus 実践入門 #hbstudy 79 / introduction-to-prometheus-practice
rrreeeyyy
16
2.7k
Web サービスの信頼性を守るための取り組み / jtf-2017-site-reliability-engineering
rrreeeyyy
10
8.3k
Other Decks in Technology
See All in Technology
SRE_チーム立ち上げから1年_気づいたら_SRE_っぽくない仕事まで貢献しちゃってる説
bitkey
PRO
0
1.2k
ITエンジニアを取り巻く環境とキャリアパス / A career path for Japanese IT engineers
takatama
0
510
mROS 2のススメ
takasehideki
0
280
Adopting Kafka for the #1 job site in the world
ymyzk
1
210
エンジニアインターンの採用〜実際の開発への関与について for EM meetup#10
dmiyamoto
1
250
AWS Control TowerとAWS Organizationsを活用した組織におけるセキュリティ設定
fu3ak1
2
580
Steps toward self-service operations in eureka
fukubaka0825
0
340
220428event_ogura_part
caddi_eng
0
170
目と耳を持った自然言語処理 - スタートアップにおける価値創出のために
yag_ays
PRO
0
490
Motto Go Forward スライドトップと Goを支える文化とコミュニティ してご利用ください 〜なぜ我々はコミュニティにコントリ ビュートするのか〜
luccafort
0
120
[SRE NEXT 2022]ヤプリのSREにおけるセキュリティ強化の取り組みを公開する
mmochi23
1
150
一人から始めるプロダクトSRE / How to start SRE in a product team, all by yourself
vtryo
3
1.7k
Featured
See All Featured
Pencils Down: Stop Designing & Start Developing
hursman
112
9.8k
The World Runs on Bad Software
bkeepers
PRO
56
5.2k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
237
19k
Building Applications with DynamoDB
mza
83
4.6k
Mobile First: as difficult as doing things right
swwweet
212
7.5k
Why Our Code Smells
bkeepers
PRO
324
54k
Unsuck your backbone
ammeep
659
55k
Reflections from 52 weeks, 52 projects
jeffersonlam
337
17k
Infographics Made Easy
chrislema
233
17k
Java REST API Framework Comparison - PWX 2021
mraible
PRO
11
4.6k
The MySQL Ecosystem @ GitHub 2015
samlambert
238
11k
Bash Introduction
62gerente
596
210k
Transcript
Web αʔϏεͷ৴པੑͱ ӡ༻ͷࣗಈԽʹ͍ͭͯ ΫοΫύουגࣜձࣾ ΠϯϑϥετϥΫνϟʔ෦ SRE άϧʔϓ ٢ ཽଠ (
@rrreeeyyy ) ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 1
Agenda • Site Reliability Engineering (SRE) ʹ͍ͭͯ • SRE ͱ
• ӡ༻ͷݱͱӡ༻ٕज़ݚڀ • ӡ༻ͷࣗಈԽʹ͍ͭͯ • ࣌ܥྻσʔλͷॲཧͱҟৗݕʹ͍ͭͯ ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 2
Me !SSSFFFZZZ !SSSFFFZZZ IUUQTSSSFFFZZZDPN :PTIJLBXB3ZPUB ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) |
Yoshikawa Ryota ( @rrreeeyyy ) 3
Me • Yoshikawa Ryota ( @rrreeeyyy [reɪ] ) • ిؾ௨৴େֶ
(2010/04 ʙ 2014/03) • ใཧֶ෦ ใɾ௨৴ֶՊ • גࣜձࣾϋʔτϏʔπ (2010/11ʙ2016/12) • MSP ࣄۀ෦ ӡ༻ελοϑɾӡ༻ΤϯδχΞ • ΫοΫύουגࣜձࣾ (2017/01 ʙ) • ΠϯϑϥετϥΫνϟʔ෦ SRE άϧʔϓ ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 4
Me • ిؾ௨৴େֶ (2010/04 ʙ 2014/03) • mruby Λ༻͍ͨLinux ϩʔυόϥϯαΠϯλϑΣʔεͷ࣮Ͱଔۀ
• גࣜձࣾϋʔτϏʔπ (2010/11ʙ2016/12) • ʙઍنͷӡ༻ɾߏஙɾཧΛܦݧ • ϝσΟΞɾήʔϜɾEC ͷ༷ʑͳͷӡ༻Λܦݧ • ΫοΫύουגࣜձࣾ (2017/01 ʙ) • ΠϯϑϥετϥΫνϟʔ෦ SRE άϧʔϓ • ઍنͷγεςϜͷ৴པੑʹؔΘΔ෦શͯΛ୲ ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 5
ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy )
6
Site Reliability Engineering ͱ • αΠτͷ৴པੑͷશͯʹൣғΛ࣋ͭɺͱ͢ΔΤϯδχΞϦϯάख๏ • ಛʹɺιϑτΣΞɾγεςϜΤϯδχΞϦϯάΛ༻͍ͯ՝Λղܾ͢Δ • ྫ͑ɺύϑΥʔϚϯε
• ύϑΥʔϚϯεʹ͕͋Δίʔυ SRE ͕ࣗίʔυΛॻ͍ͯमਖ਼͢Δ • ྫ͑ɺεέʔϥϏϦςΟɾΞϕΠϥϏϦςΟ • ਓؒʹΑΔखಈͷ࡞ۀΛίʔυʹΑΓࣗಈԽ͢Δ • نΞΫηε͕૿େͯ҆͠ఆͯ͠αʔϏεΛఏڙͰ͖Δঢ়ଶʹ͢Δ • ΠϯϑϥΤϯδχΞͷൣғ͕૿େͨ͠தͰ͋Δछɺ৬Λ࠶ఆٛͨ͠ͱଊ͍͑ͯΔ ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 7
SRE ͷ׆ಈ SRE ͷ׆ಈେ͖͚ͯ࣍͘ͷ 4 ͭʹྨͰ͖Δͱ͞Ε͍ͯΔ • So#ware Engineering •
Systems Engineering • Toil • Overhead ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 8
SRE ͷ׆ಈ • So#ware Engineering • ίʔυͷ࡞मਖ਼, ͦΕʹؔ࿈͢ΔઃܭυΩϡϝϯςʔγϣϯͷ࡞ۀͳͲ • ࣗಈԽεΫϦϓτͷ࡞,
πʔϧϑϨʔϜϫʔΫͷ࡞ ... • αʔϏεͷ৴པੑΛߴΊΔػೳͷՃ ... • Systems Engineering • 1 ճͷ࡞ۀͰӬଓతͳվળΛੜΉ࣍ͷΑ͏ͳ࡞ۀ • ຊ൪γεςϜͷઃఆมߋ ... • ։ൃνʔϜͷαʔϏεΞʔΩςΫνϟઃܭ ... ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 9
SRE ͷ׆ಈ • Toil • αʔϏεΛՔಇͤ͞ΔͨΊ͚ͩʹ܁Γฦ͠ߦΘΕΔखಈͰͷ࡞ۀ • ظతͳՁΛ࣋ͨͳ͍, αʔϏεͷʹରͯ͠ O(n)
Ͱ͋Δ ... • ͭ·Βͳ͍ࣄͰظతͳՁ͕͋Ε Toil Ͱͳ͍ • Overhead • αʔϏεΛՔಇͤ͞Δ͜ͱʹ݁͠ͳ͍ཧతͳ࡞ۀ • ࠾༻, ϛʔςΟϯά, ධՁ, τϨʔχϯά ... ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 10
ӡ༻ͷݱͱӡ༻ٕज़ݚڀ • ΤϯδχΞϦϯάΛͪΌΜͱΔࣄ͕ݱϨϕϧͰධՁ͞ΕΔΑ͏ʹ • ͜ͷจ຺ͷҰͭͱͯ͠ SRE ͷΑ͏ͳख๏ɾ৬छ͕ग़͖ͯͨͱ͍͏ཧղ • จΛॻ͍ͨΓಡΜͰཧղɾ࣮͢Δࣄ͕ධՁ͞ΕΔΑ͏ʹͳ͖ͬͯͨ •
࣮ࡍͷӡ༻ͷݱͰಡΜͰཧղ͢Δࣄඞཁʹͳ͖ͬͯͨ • ٕज़બఆͷࢦඪͷҰͭͱͯ͠ϛυϧΣΞͷڍಈͷཧղͳͲ • ͍ΘΏΔݚڀ։ൃͷΑ͏ͳ෦Ͱͳͯ͘ৗతʹߦ͏Α͏ʹ • ଟ͘ͷٕज़اۀͰӡ༻ɾϛυϧΣΞͷจ͕ଟ͘ग़ͯ͘ΔΑ͏ʹ ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 11
େखΫϥυϕϯμͷจ • Google, Amazon, Facebook, Ne3lix... • ଞʹେখؔΘΒ༷ͣʑͳاۀ͔Βจ͕ग़͍ͯΔ • USENIX
ͷΧϯϑΝϨϯεͰٕज़اۀ͕ੵۃతʹൃද • FAST, OSDI, Security ... • ΫϥυαʔϏεͷ෦࣮ϛυϧΣΞؔΘΒͣ • ΫϥυαʔϏεͷڍಈΛਖ਼͘͠ཧղ͢ΔͨΊʹจΛಡΉ • ৽͍͠ΞʔΩςΫνϟɾϛυϧΣΞͷબఆͷͨΊʹจΛಡΉ ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 12
ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy )
13
ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy )
14
ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy )
15
ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy )
16
ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy )
17
จͷ༰Λ࣮ӡ༻Ͱ͑ΔϛυϧΣΞ • HashiCorp • Vagrant, Terraform Λ࡞͍ͬͯΔϕϯνϟʔ • จͷ༰Λ࣮ӡ༻Ͱ͍͍͢ܗʹམͱ͠ࠐΜͰ͍Δ •
Serf, Consul, Vault • ͜ΕΒͷϛυϧΣΞΛਖ਼͘͠ཧղͯ͠ӡ༻͢ΔͨΊʹจΛಡΉ • ͳͥ Consul ͷϊʔυ࠷ 3 ඞཁͳͷ͔ʁ ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 18
ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy )
19
ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy )
20
ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy )
21
ΫοΫύουʹ͓͚Δ SRE ͷ׆ಈ ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota
( @rrreeeyyy ) 22
ΫοΫύουʹ͓͚Δ SRE ͷ׆ಈ • SRE ͱͯ͠ͷ׆ಈΛΫοΫύουͰ༷ʑߦ͍ͬͯΔ • ΫοΫύουͷ SRE ͷ׆ಈΛ͍͔ͭ͘հ
• ৽نαʔϏεʹର͢Δ SRE ͷಈ͖ • ϞχλϦϯάͷվળ • ϩʔυόϥϯγϯάͷվળ • ৽ଔݚम • ... ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 23
ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy )
24
ΫοΫύουʹ͓͚Δ SRE ͷ׆ಈ • SRE ͱͯ͠ͷ׆ಈΛΫοΫύουͰ༷ʑߦ͍ͬͯΔ • ΫοΫύουͷ SRE ͷ׆ಈΛ͍͔ͭ͘հ
• ৽نαʔϏεʹର͢Δ SRE ͷಈ͖ • ϞχλϦϯάͷվળ • ϩʔυόϥϯγϯάͷվળ • ৽ଔݚम • ... ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 25
ϞχλϦϯάͷվળ • େྔͷσʔλΛೖɾॲཧ͢ΔΑ͏ͳ࣌ܥྻσʔλϕʔεͷج൫͖ͬͯͨ • ΫοΫύουͰ Prometheus Λ TSDB ͱͯ͠࠾༻ •
Long-term storage ͱͯ͠ S3 ΛόοΫΤϯυͱͯ͠ݕ౼த • औಘͰ͖ΔϝτϦΫεͷղ૾ͷ্ɾछྨͷ૿ڧ • 15 ඵ୯ҐͷϝτϦΫεऔಘ͕ग़དྷΔΑ͏ʹͳ͍ͬͯΔ • ϚΠΫϩαʔϏεͷαʔϏεؒͷ࿈ܞͷ༷ࢠՄࢹԽΛݕ౼த ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 26
ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy )
27
ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy )
28
ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy )
29
ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy )
30
࣌ܥྻσʔλͷॲཧʹ͍ͭͯ • ͜Ε·Ͱ΄ͱΜͲ੩తͳᮢͰԿͱ͔͍ͯͨ͠ঢ়ଶ • ͜Ε͔Β࣌ܥྻσʔλʹ؆୯ͳ౷ܭతॲཧ͕ࢪͤΔΑ͏ʹ • ઢܗճؼ, ࢦฏԽ, ҠಈฏۉͳͲ... •
ࣄલʹى͖͏Δҟৗ͕͔͍ͬͯΔ࣌ʹΑ͘ಈ͘ • Πϯγσϯτোͷ "ੵΈॏͶ" ͰݕͰ͖ΔΑ͏ʹ • ࣮ࡍʹऔΕΔϝτϦΫε͕૿͑ҟৗ࣌ʹͲ͏ͳΔ͔༧ଌࠔͳࣄ ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 31
ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy )
32
ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy )
33
࣌ܥྻσʔλͱҟৗݕ • ࣌ܥྻσʔλͷҟৗ(֎Ε)ݕ༷ʑͳख๏͕طʹݚڀ͞Ε͖͍ͯͯΔ • Gaussian Mixture Model, Isola5on forest ͳͲͳͲ...
• ࣮ࡍͷӡ༻Ͱग़ݱ͢ΔϝτϦΫεͰඇઢܗͳཁૉ͕ଟ͘ग़ݱ͢Δ • ैདྷͷख๏ෳࡶͳඇઢܗมͳͲͷදݱʹऑ͍͜ͱ͕͋ͬͨ • ࠷ۙͷख๏Ͱ CNN Λ༻͍ͯҟৗݕߦ͏Α͏ͳख๏͕ొͨ͠ • ෳͷೖྗ͕͋ΔΑ͏ͳ૬ؔҟৗͰൺֱత؆୯ʹ༧ଌ͢Δࣄ͕Մೳ ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 34
ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy )
35
ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy )
36
ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy )
37
LSTM ʹΑΔ࣌ܥྻσʔλͷҟৗݕ • LSTM Λ༻͍ͯਖ਼ৗͳ࣌ܥྻσʔλͷֶशΛߦ͏ • ߦֶͬͨशʹج͍ͯɺ࣍ͷσʔλͷ༧ଌΛߦ͏ • ࣮ࡍͷσʔλͱ༧ଌΛൺֱ͢Δ͜ͱͰҟৗΛଌఆ͢Δ •
ֶश͢Δσʔλͷೖྗͱͯ͠ϝτϦΫεҎ֎ʹαʔόͷίϯςΩετΛೖΕΔ • ྫ͑σϓϩΠதɾόον࣮ߦதɾΦʔτεέʔϧத... • ͦͷ࣌ͷαʔόͷίϯςΩετΛؚΊͯ༧ଌΛ࡞ΕΔ • ΑΓαʔόͷঢ়گΛՃຯͨ͠ҟৗΛଌΔ͜ͱ͕ग़དྷΔ ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 38
༧ଌରʹͳΔ࣌ܥྻσʔλͷྫ timestamp,cpu,deploying,autoscaling,batching 2018-03-05 12:00:00,80,1,0,0 2018-03-05 12:00:15,81,1,0,0 2018-03-05 12:00:30,82,1,0,0 2018-03-05 12:00:45,82,1,1,0
2018-03-05 12:01:00,75,1,1,0 2018-03-05 12:01:15,60,1,1,0 2018-03-05 12:01:30,55,1,1,0 2018-03-05 12:01:45,40,0,1,0 2018-03-05 12:02:00,35,0,0,0 • ࣮ࡍʹ Prometheus ͷϥϕϧػೳΛ༻্͍ͯهͷίϯςΩετΛೖྗ ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 39
Keras Λ༻͍࣮ͨɾ࣮ݧ • ϊΠζΛؚ·ͤͨਖ਼ݭΛ LSTM Ͱֶशͤ͞Δ • ݩͱͳͬͨਖ਼ݭʹҟৗΛؚ·ͤΔ • ҟৗͷ͋ΔܗͱֶशࡁΈͷϞσϧ͔Βੜ͞ΕͨܗͷೋޡࠩΛऔΔ
• ߋʹ࣮ࡍʹલϖʔδͷ࣌ܥྻσʔλΛֶशͯ͠༧ଌΛग़ͯ͠ΈΔ • ࣮ࡍͷσʔλʹݶΓͳ͍ۙ͘ܗͷ toy-data ͱͯ͠ར༻ • CPU ༻ʹؔͯ͠ 0-1 ͷൣғʹਖ਼نԽֶͯ͠शΛऩଋͤ͞Δ • ز͔ͭͷ CPU ༻ɾσϓϩΠपظͷϞσϧΛֶशͤͯ͞༧ଌͤͯ͞ΈΔ ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 40
ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy )
41
ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy )
42
ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy )
43
ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy )
44
·ͱΊ • SRE ͱ͍͏ΤϯδχΞϦϯάख๏ʹ͍ͭͯհ • ΠϯϑϥΤϯδχΞͷ৬͕͕͖ͬͯͨ • αΠτͷ৴པੑࣗମʹ৬Λ࣋ͭ͜ͱΛ໌֬ʹ͢Δ SRE ͕ొ
• αΠτͷ৴པੑΛकΔͨΊʹ "ਖ਼͘͠ΤϯδχΞϦϯάΛ͢Δ" ࣄ͕ॏཁ • ΫοΫύουͰͷ SRE ͷऔΓΈͱͯ͠ϞχλϦϯάͷվળΛհ • ࣌ܥྻσʔλΛରʹอଘɾղੳ͕ߦ͑Δج൫͕͖ͬͯͨ • ࣍ͳΔεςʔδͱͯ࣌͠ܥྻσʔλͷҟৗݕʹ͍༷ͭͯʑͳख๏Λࡧத ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 45
ࢀߟࢿྉ • h#ps:/ /landing.google.com/sre/book.html • h#ps:/ /www.allthingsdistributed.com/files/p1041-verbitski.pdf • h#p:/ /lamport.azurewebsites.net/tla/formal-methods-amazon.pdf
• h#ps:/ /staAc.googleusercontent.com/media/research.google.com/en/ /archive/spanner-osdi2012.pdf • h#p:/ /techlife.cookpad.com/entry/Ameseries-database-001 • h#p:/ /www.vldb.org/pvldb/vol8/p1816-teller.pdf • h#ps:/ /qiita.com/rrreeeyyy/items/6bbd1f09c96e2af4a8ce • h#p:/ /ramcloud.stanford.edu/raH.pdf • h#p:/ /www.cs.cornell.edu/~asdas/research/dsn02-swim.pdf • h#ps:/ /speakerdeck.com/rrreeeyyy/jK-2017-site-reliability-engineering • h#ps:/ /speakerdeck.com/yuukit/the-study-of-Ame-series-database-for-server-monitoring • h#ps:/ /speakerdeck.com/rrreeeyyy/introducAon-to-prometheus-pracAce • h#ps:/ /github.com/NeKlix/vizceral • h#ps:/ /github.com/nghialv/promviz ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 46
PR ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy
) 47
We are hiring! • ΫοΫύουͰຊհͨ͠Α͏ͳऔΓΈΛߦ͍ͬͯ·͢ • ·ͩ·ͩղܾ͍ͨ͠ɾऔΓΈ͍ͨ՝͕ͨ͘͞Μ͋Δ • ָ͠Έͳ͕ΒҰॹʹΕΔϝϯόʔΛืू͍ͯ͠·͢ →
h$ps:/ /cookpad.jobs ୈ 40 ճΠϯλʔωοτͱӡ༻ٕज़ݚڀൃදձ (2018/03/05) | Yoshikawa Ryota ( @rrreeeyyy ) 48