Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up for free
SRE vs ラマダン
Takayuki WATANABE (渡辺 喬之)
October 14, 2017
Technology
0
190
SRE vs ラマダン
Lightning talk at chukenweb
Takayuki WATANABE (渡辺 喬之)
October 14, 2017
Tweet
Share
More Decks by Takayuki WATANABE (渡辺 喬之)
See All by Takayuki WATANABE (渡辺 喬之)
SRE NEXT 2022: Sensible Incident Management for Software Startups
takanabe
2
2.4k
SRE NEXT 2020 [C6] Designing fault-tolerant microservices with SRE and circuit breaker centric architecture
takanabe
1
5.6k
Challenges for Global Service from a Perspective of SRE 2nd season
takanabe
3
3.5k
Practical Approaches to Achieve Continuous Deployment with Kubernetes
takanabe
0
180
Challenges for Global Service from a Perspective of SRE
takanabe
3
2.5k
Building infrastructure on AWS with Ruby
takanabe
0
170
Other Decks in Technology
See All in Technology
The application of formal methods in Kafka reliability engineering
line_developers
PRO
0
150
2024卒_freee_エンジニア職(ポテンシャル採用)_説明資料
freee
0
190
GeoLocationAnchor and MKTileOverlay
toyship
0
110
220628 「Google AppSheet」タスク管理アプリをライブ作成 吉積情報伊藤さん
comucal
PRO
0
110
オンラインでのサーバー切替事例紹介/ColoplTech-05-01
colopl
0
170
Scrum Fest Osaka 2022 フルリモート下でのチームビルディング
moritamasami
2
1.1k
Persistence in Serverless Applications - ServerlessDays NYC
marcduiker
0
220
音のような言葉 〜ちゃちゃっとチャットで楽しむちょっとしたコツ〜 / words like sounds
satoryu
1
1.3k
UIKitのアップデート #WWDC22
akatsuki174
4
240
ソフトウェアライセンス 2022 / Software License 2022
cybozuinsideout
PRO
1
1k
Design for Humans: How to make better modernization decisions
indualagarsamy
2
120
UWBを使ってみた
norioikedo
0
400
Featured
See All Featured
Done Done
chrislema
174
14k
Debugging Ruby Performance
tmm1
65
10k
GraphQLの誤解/rethinking-graphql
sonatard
27
6.6k
Fireside Chat
paigeccino
11
1.3k
In The Pink: A Labor of Love
frogandcode
131
21k
Large-scale JavaScript Application Architecture
addyosmani
499
110k
Building Adaptive Systems
keathley
25
1.1k
Visualization
eitanlees
124
11k
Clear Off the Table
cherdarchuk
79
280k
Happy Clients
brianwarren
89
5.6k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
danielanewman
212
20k
Rebuilding a faster, lazier Slack
samanthasiow
62
7.2k
Transcript
43&WTϥϚμϯ DIVLFOXFC
• ลڤ೭ [Takayuki Watanabe] • takanabe • @takanabe_w • ΫοΫύουגࣜձࣾ
• ΠϯϑϥετϥΫνϟʔ෦ SRE άϧʔϓ • ओʹGlobal αʔϏεͷΠϯϑϥͷ։ൃͱӡ༻Λ୲ ࣗݾհ
ΫοΫύουͷάϩʔόϧల։ʹͯ SRE ͕ܦݧͨ͠ ”ϥϚμϯ”ͱ͍͏Πϕϯτ͕ΫοΫύουͷαʔϏε Πϯϑϥʹ༩͑ΔӨڹʹ͍ͭͯ ࠓͷ͓
None
https://cookpad.com ࠃͷΫοΫύουͷτοϓϖʔδ
(MPCBMαʔϏεͷઆ໌
(MPCBMαʔϏεͷઆ໌ ΫοΫύουͷ Global αʔϏε (ҎԼ Global αʔϏε)
(MPCBMαʔϏεͷઆ໌ 21 ݴޠɾ67 ΧࠃҎ্Λରʹ αʔϏεΛల։ https://cookpad.com/us https://cookpad.com/id ɾ ɾ ɾ
(MPCBMαʔϏεͷઆ໌ ੈքதͷΠϕϯτͷӨڹΛड͚Δ
(MPCBMαʔϏεͷઆ໌ Global αʔϏεʹͱͬͯҰେΠϕϯτ ͷҰͭʹͳ͍ͬͯΔͷ͕ɺ
Ramadan
ϥϚμϯͬͯͳʹʁ • ώδϡϥྐྵͱΠεϥϜࣾձͰΘΕΔྺ๚ • ϥϚμϯώδϡϥྐྵʹ͓͚Δ9݄ͷ͜ͱ • அ৯ͷ͜ͱͰͳ͍ • ϥϚμϯظؒத ͷग़͔Β·ͰͷؒɺϜεϦϜ
ͷٛͷҰͭͱͯ͠அ৯͕ߦΘΕΔ • ΠεϥϜྐྵଠӄྐྵ • ϥϚμϯଠཅྐྵ͔ΒݟΔͱຖ11΄Ͳૣ·Δ
ϥϚμϯظؒதͷϢʔβϦΫΤετͷมԽ
ظؒதͷϦΫΤετͷมԽ ϥϚμϯظؒதͷϢʔβϦΫΤετͷมԽ !!
ΫοΫύουʹͱͬͯͷϥϚμϯ • ϥϚμϯظؒதɺޙՈͰීஈΑΓྉཧΛ͢Δਓ͕૿͑Δ • ΫοΫύουΛΒͳ͍ΠεϥϜݍͷਓʑ͕αʔϏεΛར༻ • ৽نϢʔβ֫ಘͷػձ • ΞΫςΟϒϢʔβ૿Ճ •
ϨγϐͷӾཡɾߘ͕૿Ճ • ϓϥοτϑΥʔϜͱͯ͠ͷັྗUP • ϓϨϛΞϜαʔϏεར༻ऀͷ૿Ճ • ऩӹͷ૿Ճ
43&ʹͱͬͯͷϥϚμϯ • զʑஅ৯Λ͠ͳ͍ • Ϣʔβ͔ΒͷϦΫΤετ͕͋ΔಥવഒʹͳΓͦΕ͕Ұϲ݄ଓ͘ • αʔόͷෛՙ૿Ճ • ීஈఆ͍ͯ͠ͳ͍ࣄͷൃੜ •
ෛՙ͕֬อ͍ͯ͠ΔαʔόϦιʔεΛ৯͍ਚ͘͢ • αʔόͷϩά͕ٸ૿ͯ͠σΟεΫΛຒΊਚ͘͢ • ීஈͳ͍εϩʔΫΤϦͰDB͕٧·Δ • etc …
ීஈൃੜ͠ͳ͍αʔόΞϥʔτ͕ൃੜ͕ͪ͠
43&WTϥϚμϯ • ϥϚμϯΛ • Ұ෦ͷٕज़ελοΫͷೖΕସ͑ • खಈͰରԠ͍ͯͨ͠ΦϖϨʔγϣϯΛࣗಈԽ • αʔό܈ͷΩϟύγςΟͷݟ͠ •
ܭըతʹϓϩμΫτ։ൃνʔϜͱ࿈ܞ • ύϑΥʔϚϯεͷվળґཔ • ظؒதʹ࣮ࢪ͢Δ͖ΘͲ͍ࢪࡦͷαϙʔτ • Ϣʔβʹීஈͱಉ͡ʹΑ͏ʹαʔϏεΛఏڙ͢ΔͨΊʹͨ͜͠ͱ • ͜ΕΒΛ࣮ࢪ͢Δ͜ͱͰظؒதͷ on call ରԠΛݮΒ͢
Ұ෦ͷٕज़ελοΫͷೖΕସ͑ • Database • MySQL on Amazon RDS (Magnetic) ͔ΒAmazon
Aurora ʹશ໘ೖΕସ͑ • CDN • Akamai͔Β Fastly ͷΓସ͑ • ΞϓϦέʔγϣϯͷ։ൃڥ • ৽نΞϓϦͷ։ൃ Docker + ECS Λར༻ ˠαʔϏεͷϨεϙϯελΠϜՄ༻ੑͷվળ
ΦϖϨʔγϣϯͷࣗಈԽ • αʔόϦιʔεͷෆΛճආ͢Δ • ΦʔτεέʔϧରͷαʔόΛ֦େ • ෛՙʹԠͯࣗ͡ಈతʹαʔόΛεέʔϧΞτ • haproxy
nginx ͳͲͷίϯϑΟάαʔόͷݱঢ়ʹ ߹Θͤͯࣗಈߋ৽(consul + consul-template) • ϩάͷٸ૿ʹΑΔσΟεΫͷṧഭͱͦͷରԠΛճආ • logrotate ΛͬͯσΟεΫʹϩάΛͣ͞ɺ࣌Ͱ S3 ʹ͢ ͙ʹόοΫΞοϓ͢ΔํࣜΛ࠾༻
αʔό܈ͷΩϟύγςΟͷݟ͠
ϓϩμΫτ։ൃνʔϜͱͷ࿈ܞ
ϓϩμΫτ։ൃνʔϜͱͷ࿈ܞ • ύϑΥʔϚϯεͷϘτϧωοΫΛੳͯ͠վળ • μογϡϘʔυͷڞ༗ • ίʔυϨϕϧͰϘτϧωοΫͷڞ༗ɺվળ
ظؒதʹ࣮ࢪ͢Δ͖ΘͲ͍ࢪࡦͷαϙʔτ • ྫ͑ɺങऩͨ͠αΠτͷσʔλΛΫοΫύουͷσʔλϕʔεʹϝ ϯςφϯεແ͠ͰϚΠάϨʔγϣϯ͢Δ࣌ • 2016͜ΕʹΑΓϥϚμϯظؒதʹ࣌ؒͷαʔϏεఀࢭ͕2 ճൃੜ • ࠓϥϚμϯظؒʹσʔλϚΠάϨʔγϣϯͷ༧ఆ͕͋ͬͨ •
σʔλҠߦํ๏ͷܭըίʔυϨϏϡʔʹࢀՃ • αʔόϦιʔεεϩʔΫΤϦϩάͳͲͷ֤छใΛϞχλϦϯ ά͢ΔμογϡϘʔυͷఏڙ 4FFBMTPIUUQTXXXZPVUVCFDPNXBUDI WQ&9;QV),Z+D
43&WTϥϚμϯͷ݁Ռ
43&WTϥϚμϯͷ݁Ռ େ͖ͳͳ͘ϥϚμϯظؒऴྃ!
ॴײ • ϥϚμϯΛ࢝Ίͱͯ͠αʔϏεͷ Global ల։ͳΒͰͷ՝ ໘ന͞ͱૺ۰͢Δ • େมͳ͜ͱଟ͍͕ɺֶͼଟ͍ • ָ͠Έͳ͕ΒΓӽ͍͑ͨ
• XXX ʹ͚ͯΩϟύγςΟͷݟ͕͠ඞཁΈ͍ͨͳՔಇ͕ ൃੜ͠ͳ͍Α͏ʹγεςϜΛߏஙɾվળ͍ͯ͘͜͠ͱ͕ٻ ΊΒΕ͍ͯΔ(ͨΓલ͕ͩ)
·ͱΊ • GlobalαʔϏεʹͱͬͯϥϚμϯେࣄͳΠϕϯτ • ීஈͱൺֱͯ͠ഒͷنͰϢʔβ͕૿͑Δ • SRE1ϲ݄ଓ͘ߴෛՙΛΓΔͨΊͷࢪࡦΛଧͭ • ෆ͍ͯ͠ΔϦιʔε͢ •
ࣗಈԽ • ϓϩμΫτ։ൃνʔϜͱͷ࿈ܞ • ࠓޙಛʹରࡦΛ͠ͳ͍ͰΓΕΔΑ͏ʹ͢Δͷ͕ॏཁ