高度に発達したシステムの異常は神の怒りと見分けがつかない / IPSJ-ONE 2017 y_uuki

IPSJ-ONE 2017 スライド。

Transcript

1. ߴ౓ʹൃୡͨ͠
   γεςϜͷҟৗ͸
   ਆͷౖΓͱ
   ݟ෼͚͕͔ͭͳ͍
   Πϯλʔωοτͱӡ༻ٕज़ݚڀձਪન
   גࣜձࣾ͸ͯͳ ௶಺༎थ
   

   View Slide

2. શࣗಈ
   γεςϜ
   

   View Slide

3. શࣗಈ
   γεςϜ
   

   View Slide

4. 24࣌ؒ
   365೔
   

   View Slide

5. ౒ྗ
   

   View Slide

6. Infrastructure
   as Code
   Ϋϥ΢υʹ͓͚Δαʔ
   ό؅ཧͷݪଇͱϓϥΫ
   ςΟε
   Photo by O’reilly Media / CC by 3.0
   https://www.oreilly.co.jp/books/9784873117966/ https://creativecommons.org/licenses/by/3.0/deed
   

   View Slide

7. Kief Morris ஶ ٶԼ ߶ี ؂༁ ௕ඌ ߴ߂ ༁
   ʰInfrastructure As Code Ϋϥ΢υʹ͓͚Δαʔό؅ཧͷݪଇͱϓϥΫςΟεʱΑΓ
   Φʔτϝʔγϣϯπʔϧ͕Ͳ͏
   ͍͏݁ՌΛੜΉ͔ʹ͍ͭͯࣗ৴
   ͕࣋ͯͳ͍ͨΊɺΦʔτϝʔγϣ
   ϯπʔϧʹ೚͖ͤΓʹͳΔͷ͸
   ා͔ͬͨɻ
   1.3.5 Φʔτϝʔγϣϯڪා঱
   

   View Slide

8. ൑அ
   

   View Slide

9. ߴ౓ʹൃୡ
   

   View Slide

10. ࣗવք
    

    View Slide

11. ҟৗ
    

    View Slide

12. ະ஌
    

    View Slide

13. ਆͷౖΓ
    

    View Slide

14. ؍ଌ
    

    View Slide

15. ؂ࢹ
    Monitoring
    

    View Slide

16. ϔϞάϩϏϯ ੺݂ٿ਺
    ϔϚτΫϦοτ
    ന݂ٿ਺ ݂খ൘਺
    ݂ਗ਼Χϧγ΢Ϝ
    .$7 .$)
    .$)$
    ૯ίϨεςϩʔϧ
    )%-ίϨεςϩʔϧ
    -%-ίϨεςϩʔϧ
    தੑࢷ๱
    ۭෲ݂࣌౶
    ऩॖظ݂ѹ
    ֦ுظ݂ѹ
    ೘ͨΜͺ͘
    ೘જ݂
    ೘ૉ஠ૉ
    ΫϨΞνχϯ
    ೘જ݂
    ;55
    "45
    "-5
    Ѝ(51
    "-1
    ૯ϏϦϧϏϯ
    ೘΢ϩϏϦϊʔήϯ
    ૯ͨΜͺ͘
    Ξϧϒϛϯ
    )#T߅ମ
    )#T߅ݪ
    )$7߅ମ
    Ξϛϥʔθ
    $31
    Ϧ΢ϚτΠυҼࢠ
    ݈߁਍அ
    

    View Slide

17. JOUFSGBDFFUIUY#ZUFT
    pMFTZTUFNYWEBVTFE
    MPBEBWH DQVVTFS
    DQVJEMF DQVTUFBM
    NFNPSZVTFE
    MJOVYTT4:/3&$7
    MJOVY5*.&@8"*5 MJOVY6/$0//
    MJOVYTT'*/8"*5
    MJOVY$-04&8"*5
    MJOVY-*45&/
    JOPEFYWEBUPUBM
    DQVOJDF
    DQVTZTUFN
    DQVHVFTU
    NFNPSZCV⒎FST
    MJOVY$-04*/(
    MJOVY-"45"$,
    MJOVYTT'*/8"*5
    NFNPSZGSFF
    JOUFSGBDFFUISY#ZUFT
    NFNPSZTXBQ@VTFE
    MJOVYDPOUFYU@TXJUDIFT
    MJOVYGPSLT
    MJOVY6/,08/
    MJOVY-*45&/
    MJOVYTT4:/4&/5
    MJOVYTT&45"#
    NFNPSZDBDIFE
    DQVJPXBJU
    DQVTPGUJSR
    DQVIBSEJSR
    NFNPSZTXBQ@UPUBM
    NFNPSZUPUBM
    EJTLYWEBSFBET
    EJTLYWEBXSJUFT
    pMFTZTUFNYWEBTJ[F
    JOPEFYWEBGSFF
    ݈߁਍அ
    

    View Slide

18. σʔλ
    ϕʔε
    

    View Slide

19. ੑೳ VS ͓ۚ
    

    View Slide

20. )%%
    44%
    ϝϞϦ
    

    View Slide

21. )%%
    44%
    ϝϞϦ
    ଎͍
    ;ͭ͏
    ஗͍
    

    View Slide

22. )%%
    44%
    ϝϞϦ
    ߴ͍
    ;ͭ͏
    ͍҆
    

    View Slide

23. ݹ͍σʔλ͸
    ΄ͱΜͲΞΫηε
    ͞Εͳ͍ͷͰ
    ஗ͯ͘Α͍
    

    View Slide

24. )%%
    44%
    ϝϞϦ
    ݹ͍
    ৽͍͠
    ଎͍
    ͍҆
    

    View Slide

25. )%%
    44%
    ϝϞϦ
    ݹ͍
    ৽͍͠
    ౷
    ߹
    

    View Slide

26. DiamonDB
    https://github.com/yuuki/diamondb
    

    View Slide

27. ؂ࢹ޲͚σʔλϕʔε͸ੈͷதʹͨ͘
    ͞Μ͋Δ
    Facebook΋͍ͭͬͯ͘Δ
    ΞΠσΞࣗମ͸ݹయత
    ͔͠͠ɺ
    ؂ࢹ޲͚σʔλϕʔεʹద
    ༻͍ͯ͠Δྫ͸ͳ͍
    

    View Slide

28. ͸ͯͳͷݱߦσʔλϕʔε
    ͱൺֱ͠
    100+ഒ
    ͷσʔλྔͷอ͕࣋ݱ࣮త
    ͳίετͰՄೳ
    

    View Slide

29. ࣮ݧ
    

    View Slide

30. “PRINCIPLES OF CHAOS ENGINEERING”,
    http://principlesofchaos.org/ ΑΓ
    Chaos Engineering is the
    discipline of experimenting on
    a distributed system in order to
    build confidence in the
    system’s capability to withstand
    turbulent conditions in
    production.
    

    View Slide

31. Θ͟ͱ
    ҟৗΛى͜͢
    

    View Slide

32. ؍ଌ
    ࣮ݧ
    γεςϜ
    Ϟσϧ
    

    View Slide

33. ؍ଌͱ࣮ݧʹΑΓ
    γεςϜಛੑΛ
    ֶश͠ͳ͕Β
    ࣗ཯ಈ࡞͢ΔγεςϜ
    

    View Slide

34. γεςϜ؅ཧऀΛ
    ະ஌΁ͷڪΕ͔Β
    ղ์͍ͨ͠
    

    View Slide