Share
Embed
Reading "The Site Reliability Workbook"
SRE Lounge #6
https://sre-lounge.connpass.com/event/108054/
Takeshi Kondo
November 28, 2018
Transcript
44 slides
-
2VJQQFS43&5FBN w .FNCFS w .JTTJPO w 5PNBLF4UVEZ4BQVSJ2VJQQFSTUBCMFBOESFMJBCMF w 3FTQPOTJCJMJUZ w
'JYFTTFSWFSJOTUBCJMJUZGBJMVSF w 3FTQPOTFUP!TSFJOTMBDLHJUIVC w 1SPBDUJWFBQQSPBDIGPSTUBCJMJUZXJUINPOJUPSJOHTFSWJDF -POEPO $50&OHJOFFSJOH.BOBHFS 5PLZP .BOJMB -
2VJQQFS43&5FBN w .FNCFS w .JTTJPO w 5PNBLF4UVEZ4BQVSJ2VJQQFSTUBCMFBOESFMJBCMF w 3FTQPOTJCJMJUZ w
'JYFTTFSWFSJOTUBCJMJUZGBJMVSF w 3FTQPOTFUP!TSFJOTMBDLHJUIVC w 1SPBDUJWFBQQSPBDIGPSTUBCJMJUZ -POEPO $50&OHJOFFSJOH.BOBHFS 5PLZP .BOJMB -
1PTJUJPOPGUIJTCPPL The Site Reliability Workbook is the hands-on companion to
the bestselling Site Reliability Engineering book and uses concrete examples to show how to put SRE principles and practices to work. This book contains practical examples from Google’s experiences and case studies from Google’s Cloud Platform customers. IUUQTMBOEJOHHPPHMFDPNTSFCPPLT -
(PBMPGUIJTCPPL The purpose of this second SRE book is (a)
to add more implementation detail to the principles outlined in the first volume, and (b) to dispel the idea that SRE is implementable only at “Google scale” or in “Google culture.” 5IF4JUF3FMJBCJMJUZ8PSLCPPL1SFGBDF -
1BSU1SBDUJDFT w 0O$BMM w *ODJEFOU3FTQPOTF w 1PTUNPSUFN$VMUVSF-FBSOJOHGSPN'BJMVSF w .BOBHJOH-PBE w
*OUSPEVDJOH/PO"CTUSBDU-BSHF4ZTUFN%FTJHO w %BUB1SPDFTTJOH1JQFMJOFT w $POpHVSBUJPO%FTJHOBOE#FTU1SBDUJDFT w $POpHVSBUJPO4QFDJpDT w $BOBSZJOH3FMFBTFT -
1BSU1SBDUJDFT w 0O$BMM w *ODJEFOU3FTQPOTF w 1PTUNPSUFN$VMUVSF-FBSOJOHGSPN'BJMVSF w .BOBHJOH-PBE w
*OUSPEVDJOH/PO"CTUSBDU-BSHF4ZTUFN%FTJHO w %BUB1SPDFTTJOH1JQFMJOFT w $POpHVSBUJPO%FTJHOBOE#FTU1SBDUJDFT w $POpHVSBUJPO4QFDJpDT w $BOBSZJOH3FMFBTFT ৫αʔϏε͕֦େ͢Δʹैͬ ͯߟ͑Δඞཁ͕͋ΔτϐοΫ -
1BSU1SPDFTTFT w *EFOUJGZJOHBOE3FDPWFSJOHGSPN0WFSMPBE w 43&&OHBHFNFOU.PEFM w 43&3FBDIJOH#FZPOE:PVS8BMMT w 43&5FBN-JGFDZDMFT w
0SHBOJ[BUJPOBM$IBOHF.BOBHFNFOUJO43& 43&νʔϜͱͯ͜͠Ε·Ͱͷ༰ ΛͲ͏࣮ߦ͍͔ͯ͘͠ -
1BSU1SBDUJDFT w 0O$BMM w *ODJEFOU3FTQPOTF w 1PTUNPSUFN$VMUVSF-FBSOJOHGSPN'BJMVSF w .BOBHJOH-PBE w
*OUSPEVDJOH/PO"CTUSBDU-BSHF4ZTUFN%FTJHO w %BUB1SPDFTTJOH1JQFMJOFT w $POpHVSBUJPO%FTJHOBOE#FTU1SBDUJDFT w $POpHVSBUJPO4QFDJpDT w $BOBSZJOH3FMFBTFT ʢݸਓతʹʣ໘ന͔ͬͨ UPQJDΛհ -
8IBUJTl/PO"CTUSBDU-BSHF4ZTUFN%FTJHOz w Մ༻ੑͷߴ͍ࢄγεςϜΛઃܭ͢Δख๏ w େنγεςϜΛઃܭ͢Δ43&ʹෆՄܽͳεΩϧ w ҎԼͷཁૉΛΈ߹Θ͍ͤͯΔ w ΩϟύγςΟϓϥϯχϯά w
ίϯϙʔωϯτ w γεςϜͷ҆શͳॖখ w ϗϫΠτϘʔυΛͬͨ෮తͳΞϓϩʔν w ԾઆͱධՁΛ܁Γฦ͢ -
5XP1IBTFBOE'PVS2VFTUJPOT w #BTJDEFTJHOQIBTF w *TJUQPTTJCMF ཧతʹेՄೳ͔ʁ w $BOXFEPCFUUFS ΑΓΑ͘Ͱ͖Δ͔ʁ w
4DBMFVQQIBTF w *TJUGFFTJCMF ίετ)8੍ԽͰ࣮ݱՄೳ͔ʁ w *TJUSFTJMJFOU EPXOͯ͑͠ΒΕΔ͔ w $BOXFEPCFUUFS ΑΓΑ͘Ͱ͖Δ͔ʁ -
(PPHMF"E8BSETFYBNQMF w (PPHMF8FC4FBSDIʹςΩετࠂΛࡌͤΔγεςϜ w ͲͷݕࡧΫΤϦͰදࣔ͞Ε͔ͨͱΫϦοΫΛΒͤΔ w ݕࡧγεςϜͱࠂγεςϜʹϩάͱͯ͢͠ w ཁ݅ w
ຖඵճͷࠂΫϦοΫ w ඵ͋ͨΓ݅ͷݕࡧΫΤϦΛఆ w 4-0 w PGEBTICPBSERVFSJFTDPNQMFUFJOTFDPOE w PGUIFUJNF UIF$53EBUBEJTQMBZFEJTMFTTUIBO NJOVUFTPME -
(PPHMF"E8BSETFYBNQMF w ͷϚγϯͰߟ͑Δ w વͳ͕Β༷ʑͳ41P'͕͋Γɺ࣮ݱ͍͠ w ͕ͩ͜ͷεςοϓ͕ඇৗʹॏཁ w ෳͷϚγϯͰࢄγεςϜΛߟ͑Δ w
.BQ3FEVDF w -PH+PJOFS w 4IBSEFE-PH+PJOFS w .VMUJ%BUBDFOUFS -
4FQBSBUJOH1IJMPTPQIZBOE.FDIBOJDT w 1IJMPTPQIZ w ઃఆͦͷͷ͚ͩʹ w ਖ਼͘͠நԽ͢Δ w ଟ༷ͳϢʔεέʔεΛαϙʔτ͢Δ w
.FDIBOJDT w ݴޠઃܭɺσϓϩΠઓུɺଞͱͷ࿈ܞ w Ͳ͏ઃఆ͢Δ͔ɺͲ͏ద༻͢Δ͔ -
$POpHVSBUJPO1IJMPTPQIZ w ཧͷ$POpHVSBUJPOҰ$POpHVSBUJPO͞Εͳ͍͜ͱ w $POpHVSBUJPOϢʔβʹ࣭Λ͢Δ w Ϣʔβͷඪʹ͍࣭ۙΛ͢Δ w গͳ͍ઃఆ߲ͰϢʔβͷඪΛ͑Δ w
Ͱ͖Δ͚ͩSFRVJSFΛΒ͠ɺPQUJPOBMΛ૿͢ w ͦͷͨΊʹ҆શͳEFGBVMU͕ඞཁ w ͍͍ͨͯTUBUJD͕ͩɺEZOBNJDʹܾΊΔ͜ͱ͋Δ -
$POpHVSBUJPO.FDIBOJDT w Ϣʔβ͕Ͳ͏ͬͯઃఆΛมߋ͢Δ͔ w $POpHVSBUJPOͱ%BUBͨ͠΄͏͕ྑ͍ w %BUBੳʹ͑Δ w πʔϧॏཁɺҎԼͷཁૉ͕͋Δͱ͍͍ w
4FNBOUJDWBMJEBUJPO w จ๏͕͍͋ͬͯͯແҙຯͳઃఆ͕͋Δ͔͠Εͳ͍ w $POpHVSBUJPOTZOUBY w TZOUBYIJHIMJHIU w MJOUFS w BVUPNBUJDTZOUBYGPSNBUUFS -
4BGF$POpHVSBUJPO$IBOHF"QQMJDBUJPO w ঃʑʹσϓϩΠͰ͖ΔΑ͏ʹ͠ɺBMMPSOPUIJOHͳมߋ Λආ͚Δ w ͷఀࢭΛආ͚ΔͨΊ w JF,VCFSOFUFST͕QPEΛSPMMJOHVQEBUF w ةݥͰ͋Δ͜ͱ͕໌ͨ͠ΒมߋΛϩʔϧόοΫ͢Δ
w Πϯγσϯτͷܧଓ࣌ؒΛॖ͢ΔͨΊ w มߋʹΑͬͯΦϖϨʔλ੍ޚ͕ࣦΘΕͨ߹ɺࣗಈϩʔ ϧόοΫ͢Δʢ͋Δ͍࠷ͰɺਐߦΛఀࢭ͢Δʣ -
·ͱΊ w ֦େɾ࣋ଓՄೳͳγεςϜʹ͢ΔͨΊʹɺ1IJMPTPQIZ ͱ.FDBOJDTΛͯ͠ߟ͑Δ w 1IJMPTPQIZ w ϢʔβͷೝෛՙΛ͋͛ͳ͍ w ઃఆ߲ΛͰ͖Δ͚ͩݮΒ͢
w .FDIBOJDT w Ϣʔβ͕ઃఆมߋલʹςετ͕Ͱ͖ΔΑ͏ʹ͢Δ w ঃʑʹద༻͠ɺةݥͳͱ͖ϩʔϧόοΫ͢Δ -
2VJQQFSͰͷߏཧ w ͍ͬͯΔϛυϧΣΞɾπʔϧ w Πϯϑϥ΄΅͕ίʔυԽ w 3FWFSTF1SPYZʹ/HJOY w ΞϓϦέʔγϣϯج൫,VCFSOFUFT w
,VCFBXT $MPVE'PSNBUJPO w ,VCFSOFUFTNBOJGFTU w σϓϩΠ$JSDMF$*ͰࣗಈԽ w ҆શͳߏมߋͷͨΊʹ w εςʔδϯάʹઌʹ͋ͯΔ w ·͔ͣͬͨΒ͙͢ʹϩʔϧόοΫͰ͖Δ -
4JUF3FMJBCJMJUZ8PSLCPPL$PODMVTJPO w 43& *OTFSU0UIFS%JTDJQMJOF w 43&ݪଇΛଞͷʹద༻Ͱ͖Δͷ͔Ͳ͏͔Λࡧ͍ͯ͠Δ w ຊॻࣥච࣌Ͱ%FW4FD0QTͱ͍͏ݴ༿͕ొ͍ͯ͠Δ w հͨ͠ݪଇͱ࣮ફଞͰՁ͕͋Δͱ৴͍ͯ͡Δ
w 43&#FMPOHTUP"--PG6T w ࠷ॳͷຊͰ43&Λઆ໌͢Δ͜ͱ͕ಈػͩͬͨ w 43&ݱࡏHPPHMFҎ֎Ͱ͕͍ͬͯΔίϛϡχςΟ w 43&DPO NFFUVQT ຊͳͲޓ͍ʹֶͿػձ͕ͨ͘͞Μ͋Δ w ͜ͷຊ͕͞ΒʹձΛ͛ͯ͘ΕΔ͜ͱΛئ͍ͬͯΔ -
͓ΘΓʹ w ຊॻඞͣ͋ͳͨͷڵຯ͕͋ΔτϐοΫ͕͋Δͣͳͷ ͰɺಡΜͰΈΑ͏ͱࢥ͏͖͔͚ͬʹͳΕ͍Ͱ͢ w Ҿ͖ଓ͖֤ষ͝ͱʹϒϩάʹϝϞ͍ͯ͜͠͏ͱࢥ͍·͢ w ॻ੶հCMPHͷ΄͏͕͍͍ͯΔʜ w ߟ͑ɾݪଇΛֶͿ͜ͱͱɺ࣮ࡍʹखΛಈ͔͢͜ͱ྆ํ
େࣄ w ཁ݅Λ۩ମԽ͢Δ͜ͱܦݧʹཪଧͪ͞ΕͨεΩϧ w Ҿ͖ଓ͖ຏ͍͍͖ͯ·͠ΐ͏ -
༨ஊɿຊΛಡΉͱʁ w ʮಡΜͩʯͱʮಡΜͰͳ͍ʯΛͬ ͖Γ۠ผͰ͖ͳ͍ w ڭཆ͋Δਓ͕ؒΖ͏ͱͭͱΊΔ ͖ɺ͞·͟·ͳॻͷ͍͋ͩ ͷʮ࿈བྷʯʮଓʯͰ͋ͬͯɺ ݸผͷॻͰͳ͍ w
ڭཆͱ͍͏؍Ͱʮશମͷݟ Β͠ʯͱ͍͏ߟ͕͑ॏཁ -
ຊޠͰӳޠͰಉ͡ w ຊޠͩͱzಡΊΔzͷͰ௨ಡͰ͖Δ͕ɻɻɻ w ຊޠͷٕज़ॻͰҎԼͷಡΈํͰ͖Δ w ʮຊͷํੑͱཱͪҐஔʯΛ͑ w ಡΈ͍ͨͱ͜Ζ͚ͩΛಡΉ w
ʢӳޠ͕ۤखͳͻͱʹͱͬͯʣ௨ಡ͕͍͔͠Βͦ͜ɺ ͜ͷಡΈํΛੵۃతʹ͖͢Ͱ