Upgrade to Pro — share decks privately, control downloads, hide ads and more …

AWSの既存サービスを活用して、
障害検知・復旧を迅速化するカラクリ / JAWS-UG Kanazawa x OpsJAWS

AWSの既存サービスを活用して、
障害検知・復旧を迅速化するカラクリ / JAWS-UG Kanazawa x OpsJAWS

JAWS-UG金沢 #36 x OpsJAWS! AWS運用・監視についてのクロスイベント!

Kentaro Matsushita

November 23, 2018
Tweet

More Decks by Kentaro Matsushita

Other Decks in Programming

Transcript

  1. %..DPNϓϥοτϑΥʔϜࣄۀຊ෦ϝϯόʔγοϓαʔϏε෦দԼ݈ଠ࿠
    +"846(ۚ୔Y0QT+"84ʂ"84ӡ༻ɾ؂ࢹʹ͍ͭͯͷΫϩεΠϕϯτʂ
    "84ͷطଘαʔϏεΛ׆༻ͯ͠ɺ

    ো֐ݕ஌ɾ෮چΛਝ଎Խ͢ΔΧϥΫϦ

    View full-size slide

  2. © DMM.com
    ࣗݾ঺հ
    2
    দԼ݈ଠ࿠
    w ߹ಉձࣾ%..DPNϓϥοτϑΥʔϜࣄۀຊ෦
    w ೥৽ଔೖࣾ
    w %..αʔϏεͰར༻͞ΕΔೝূج൫ͷ։ൃ͓Αͼӡ༻Λ୲౰
    w ޷͖ͳ"84ͷαʔϏε͸"84$MPVE'PSNBUJPO
    (JU)VCLFOUBSPNɹ5XJUUFS@LFOUBSP@N

    View full-size slide

  3. © DMM.com
    w γεςϜো֐ͱͷ޲͖߹͍ํ
    w ਝ଎ରԠΛࢧ͑ΔΧϥΫϦͷ঺հ
    w ো֐ݕ஌
    w ো֐෮چ
    ຊ೔ͷΞδΣϯμ
    3

    View full-size slide

  4. © DMM.com
    w γεςϜো֐ͱͷ޲͖߹͍ํ
    w ਝ଎ରԠΛࢧ͑ΔΧϥΫϦͷ঺հ
    w ো֐ݕ஌
    w ো֐෮چ
    ຊ೔ͷΞδΣϯμ
    4

    View full-size slide

  5. © DMM.com
    γεςϜͷӡ༻ͰΤϯδχΞΛ೰·ͤΔ໰୊
    5
    aಥવͷγεςϜো֐

    View full-size slide

  6. © DMM.com
    γεςϜͷӡ༻ͰΤϯδχΞΛ೰·ͤΔ໰୊
    6
    aಥવͷγεςϜো֐
    Φϖϛε
    όά
    Ϋϥ΢υαʔϏε
    ো֐
    αΠόʔ߈ܸ

    View full-size slide

  7. © DMM.com
    w ϓϩμΫτͷ඼࣭Λ୲อ͢Δ࢓૊Έͷಋೖ
    w ࣗಈςετ Ϣχοτςετɾ&&ςετ

    w ਓతϛεΛݮΒͨ͢ΊͷΦϖϨʔγϣϯͷࣗಈԽ
    w Πϯϑϥߏ੒ͷίʔυԽ "84$MPVE'PSNBUJPO࢖༻

    γεςϜো֐Λى͜͞ͳ͍ͨΊͷରࡦ
    7
    ༷ʑͳࢪࡦΛ࣮ࢪͯ͠΋ɺγεςϜো֐Λ׬શʹ๷͙ͷ͸ࠔ೉

    View full-size slide

  8. © DMM.com
    ো֐ͱͷ޲͖߹͍ํͰେࣄͳ͜ͱ
    8
    γεςϜো֐͸ى͖Δ΋ͷͱߟ͑ɺ
    ࣄલʹඋ͓͑ͯ͘

    View full-size slide

  9. © DMM.com
    ো֐ͱͷ޲͖߹͍ํͰେࣄͳ͜ͱ
    9
    ඵͰ΋ૣ͍ݕ஌ͱ෮چͷ࣮ݱʹ஫ྗ͢Δ
    ʢϢʔβʔΑΓ΋ૣ͘໰୊ʹؾ͍ͮͯ௚͢ʣ

    View full-size slide

  10. © DMM.com
    w γεςϜো֐ͱͷ޲͖߹͍ํ
    w ਝ଎ରԠΛࢧ͑ΔΧϥΫϦͷ঺հ
    w ো֐ݕ஌
    w ো֐෮چ
    ຊ೔ͷΞδΣϯμ
    10

    View full-size slide

  11. © DMM.com
    w ΞϓϦέʔγϣϯͷΤϥʔϩάʹ஫໨
    w ো֐ൃੜ࣌ʹݪҼΛ୳Δख͕͔ΓͱͳΔ΋ͷ
    w Τϥʔϩάͷ௨஌ɾӾཡͷ࢓૊Έͷଘࡏ
    w ։ൃऀ͕ো֐ஹީʹ͍ͪૣ͘ؾ͚ͮΔͱߟ͑ͨ
    ΞϓϦέʔγϣϯͷΤϥʔϩάͰো֐ஹީʹؾͮ͘
    11
    Τϥʔ͕ൃੜ͢Δͨͼʹ4MBDLʹ௨஌͢Δ࢓૊ΈΛߏங

    View full-size slide

  12. © DMM.com
    ϩά௨஌
    4MBDLʹΤϥʔ௨஌Λ͢Δ࢓૊ΈΛߏங
    12
    JOTUBODF
    CVDLFU
    'MVFOUE
    QMVHJO
    ϩάӾཡ
    ϩά
    ഑ૹ
    ϩά
    ग़ྗ
    ΞϓϦ
    αʔόʔ

    View full-size slide

  13. © DMM.com
    4MBDLʹΤϥʔ௨஌Λ͢Δ࢓૊ΈΛߏங
    13
    JOTUBODF "NB[PO&4 ,JCBOB
    UPQJD
    -BNCEB
    GVODUJPO 4MBDL
    'MVFOUE
    QMVHJO
    %FWFMPQFST
    Ӿཡ
    ௨஌
    ϩά
    "NB[PO&4ͱ,JCBOBͰ

    ϩάӾཡج൫Λ੔උ

    View full-size slide

  14. © DMM.com
    4MBDLʹΤϥʔ௨஌Λ͢Δ࢓૊ΈΛߏங
    14
    JOTUBODF "NB[PO&4 ,JCBOB
    CVDLFU
    UPQJD
    -BNCEB
    GVODUJPO 4MBDL
    'MVFOUE
    QMVHJO
    %FWFMPQFST
    ΞʔΧΠϒ
    Ӿཡ
    ௨஌
    ϩά
    ϩάΛ"NB[PO4ʹ

    165͢ΔΠϕϯτΛτϦΨʔʹ௨஌

    View full-size slide

  15. © DMM.com
    ίϯτϩʔϧͰ͖͍ͯͳ͍Τϥʔ௨஌͸ΦΦΧϛগ೥Խ͢Δ
    15
    ͲͷΤϥʔΛ௨஌͢Δ͔ɺͲ͏΍ͬͯ௨஌͢Δ͔Λߟྀ͠ͳ͍ͱɺ

    ͍͟ͱ͍͏ͱ͖ʹো֐ʹؾ͚ͮͳ͍
    ͍ͭ΋ͷΤϥʔ௨஌Ͱ͠ΐ͏ɻ
    ແࢹ͍͍ͯ͠΍ͭͩΑɻ
    ˞΍ΓऔΓ͸ΠϝʔδͰ͢

    View full-size slide

  16. © DMM.com
    ᮢ஋௨஌
    ҰఆظؒʹಛఆͷϝοηʔδΛؚΉΤϥʔ͕

    ࣄલʹઃఆͨ݅͠਺Λ௒͑ͯൃੜͨ͠λΠϛϯάͰ௨஌͠·͢ɻ
    શ݅௨஌ Τϥʔ͕ൃੜͨ͠λΠϛϯάͰ௨஌͠·͢ɻ
    छྨͷ௨஌৚݅ͰΤϥʔΛ௨஌͢Δ
    16

    View full-size slide

  17. © DMM.com
    ᮢ஋௨஌
    ෆఆظʹ୯ൃͰൃੜ͢Δ෼ʹ͸ଈ࣌ରԠ͠ͳ͍͕ɺ
    ଟൃ͢Δͱௐ͕ࠪඞཁͳΤϥʔ
    FHωοτϫʔΫλΠϜΞ΢τΤϥʔ౳
    શ݅௨஌
    ͙͢ʹௐ͕ࠪඞཁͳΤϥʔ

    ಺༰Λ֬ೝͯ͠ɺରԠํ਑ΛܾΊΔ

    FH"1*ॲཧΤϥʔ౳
    Τϥʔͷछྨ͝ͱʹ௨஌Λ෼ذͤ͞Δ
    17

    View full-size slide

  18. © DMM.com
    શ݅௨஌ͷ࢓૊Έ
    4MBDL
    -BNCEB
    GVODUJPO
    -BNCEB
    GVODUJPO
    CVDLFU UPQJD
    4MBDLʹ௨஌͢Δࡍͷ

    ϝοηʔδͷϑΥʔϚοτΛ੔͑Δ
    4MBDL΁ϝοηʔδΛૹ৴
    18

    View full-size slide

  19. © DMM.com
    w Τϥʔൃੜޙɺʙ෼Ͱ4MBDLʹ௨஌͞ΕΔ
    w ௨஌ϝοηʔδͷ,JCBOBͷϦϯΫ͔ΒτϥϯβΫγϣϯ͝ͱʹ

    ΤϥʔϩάΛ֬ೝ͢Δ͜ͱ͕Մೳ
    શ݅௨஌ͷ࢓૊Έ
    19

    View full-size slide

  20. © DMM.com
    ᮢ஋௨஌ͷ࢓૊Έ
    4MBDL
    UPQJD
    BMBSN
    -BNCEB
    GVODUJPO
    -BNCEB
    GVODUJPO
    CVDLFU UPQJD
    DPOTPMFMPHͰΤϥʔϩάΛग़ྗ͠ɺ
    $MPVE8BUDI-PHTͰॲཧ
    ϝτϦΫεϑΟϧλͰΤϥʔ݅਺Λ

    Χ΢ϯτ
    20

    View full-size slide

  21. © DMM.com
    w ࣄલʹઃఆͨ͠ᮢ஋Λ௒͑ͯΤϥʔ͕ൃੜͨ͠৔߹ʹ4MBDLʹ௨஌͞ΕΔ
    w DG෼ؒʹzωοτϫʔΫλΠϜΞ΢τΤϥʔz͕݅Ҏ্ൃੜͰ௨஌
    ᮢ஋௨஌ͷ࢓૊Έ
    21
    ᮢ஋
    ࣮ଌ஋

    View full-size slide

  22. © DMM.com
    w ௨஌ର৅Τϥʔϝοηʔδ͝ͱʹ$MPVE8BUDIϝτϦΫεϑΟϧλΛ࡞੒
    ᮢ஋௨஌ͷ࢓૊Έ
    22
    ूܭର৅ͷจࣈྻΛࢦఆ

    View full-size slide

  23. © DMM.com
    w "NB[PO4/4ͱ࿈ܞ͢Δ$MPVE8BUDIΞϥʔϜΛ࡞੒
    w ؂ࢹର৅ͷϝτϦΫεϑΟϧλʔɺ؂ࢹظؒɺᮢ஋Λઃఆ
    w "NB[PO4/4Ͱ͸4MBDLʹΤϥʔ௨஌͢Δ-BNCEBΛݺͼग़͢
    ᮢ஋௨஌ͷ࢓૊Έ
    23
    ᮢ஋Λઃఆ

    View full-size slide

  24. © DMM.com
    ΤϥʔͷछྨʹԠͯ͡ద੾ͳ௨஌Λߦ͏Α͏ʹͨ݁͠Ռ
    24
    ো֐ஹީΛݟಀͣ͞ʹଈ࣌ରԠΛ࣮ݱ
    νʔϜϝϯόʔͷΤϥʔʹର͢Δվળҙ͕ࣝ޲্

    View full-size slide

  25. © DMM.com
    w γεςϜো֐ͱͷ޲͖߹͍ํ
    w ਝ଎ରԠΛࢧ͑ΔΧϥΫϦͷ঺հ
    w ো֐ݕ஌
    w ো֐෮چ
    ຊ೔ͷΞδΣϯμ
    25

    View full-size slide

  26. © DMM.com
    w γεςϜো֐͸͍ͭى͖Δ͔෼͔Βͳ͍
    w ֎ग़ઌͰରԠ͢ΔͨΊͷ1$͕ͳ͍ͱ͖΋͋Δ
    w 4MBDL͸ωοτʹܨ͕Δ؀ڥ͕͋Ε͹ɺεϚϗ͔Βૢ࡞Մೳ
    w ࠷௿ݶͷಈ࡞֬ೝͱؔ܎ઌ΁ͷো֐ൃੜใࠂΛ͍ͨ͠
    w ศར͞͸ڗड͍͕ͨ͠ɺෳࡶͳΞϓϦέʔγϣϯ͸࡞Γͨ͘ͳ͍
    4MBDLͷ׆༻ͰॳಈΛૣ͘͢Δ
    26
    4MBDLͷεϥογϡίϚϯυͰো֐ରԠʹ໾ཱͭ࢓૊ΈΛߏங

    View full-size slide

  27. © DMM.com
    w ࣮ࡍͷΞΧ΢ϯτΛ࢖༻ͯ͠ɺϩάΠϯͰ͖Δ͔Λςετ
    w ςετ݁ՌͰϢʔβӨڹͷ༗ແΛ֬ೝ
    εϞʔΫςετͰػೳͷ࠷௿ݶͷಈ࡞֬ೝΛ͢Δ
    27
    ςετ࣮ߦ
    ςετ݁Ռ

    View full-size slide

  28. © DMM.com
    w ো֐ൃੜ࣌ࠁͱো֐಺༰ΛؚΊͨใࠂ༻ϝοηʔδΛࣗಈੜ੒
    w ؔ܎ઌ΁ͷૉૣ͍ো֐ใࠂΛ࣮ݱ
    w ো֐ൃੜ࣌ࠁͱো֐಺༰ΛεϥογϡίϚϯυͷҾ਺ʹ౉͢
    ؔ܎ઌ΁ͷো֐ใࠂ༻ͷϝοηʔδΛੜ੒
    28

    View full-size slide

  29. © DMM.com
    4MBDLͷεϥογϡίϚϯυͷߏங
    4MBDL
    -BNCEB
    GVODUJPO
    %FWFMPQFS
    ίϚϯυ໊Ҿ਺ Ҿ਺

    ͱ͍͏ϑΥʔϚοτͰίϚϯυ࣮ߦ
    ࣮ߦ͍ͤͨ͞ॲཧΛهࡌ
    29

    View full-size slide

  30. © DMM.com
    w ࡞ۀࣗಈԽʹ͖ͭ·ͱ͏αʔόʔ؅ཧ໰୊΋αʔόʔϨεߏ੒Ͱ
    ߟྀෆཁ
    w "84-BNCEBͰ͸TMBDLFDIPDPNNBOEͱ͍͏#MVF1SJOU͕͋Δ
    w #MVF1SJOUΛ࢖༻͢Δ͜ͱͰ"84ͱ4MBDL͕؆୯ʹ࿈ܞՄೳ
    w 4MBDLͷ࢓༷ͰϦΫΤετ͔ΒඵҎ಺ʹԠ౴Λฦ͢ඞཁ͕͋Δ
    w ࣌ؒͷ͔͔ΔॲཧΛಈ͔͢৔߹͸ඇಉظ࣮ߦ͕ඞཁ
    4MBDLͷεϥογϡίϚϯυͷߏங
    30

    View full-size slide

  31. © DMM.com
    4MBDLͷ4MBTIίϚϯυΛಋೖͨ݁͠Ռ
    31
    ։ൃɾӡ༻ίετΛ΄ͱΜͲ͔͚ͣʹ

    ো֐ରԠ࣌ͷوॏͳ෼ඵΛखʹೖΕͨ

    View full-size slide

  32. © DMM.com
    ͋Δ೔ͷো֐ରԠࣄྫ
    32
    ։ൃऀ͕Τϥʔൃੜʹؾͮ͘

    View full-size slide

  33. © DMM.com
    ͋Δ೔ͷো֐ରԠࣄྫ
    33
    ো֐ରԠͰ΍Δ΂͖ϦετΛੜ੒ ݕ஌͔Βඵ

    View full-size slide

  34. © DMM.com
    ͋Δ೔ͷো֐ରԠࣄྫ
    34
    εϞʔΫςετͰಈ࡞֬ೝ ݕ஌͔Β෼

    View full-size slide

  35. © DMM.com
    ͋Δ೔ͷো֐ରԠࣄྫ
    35
    ใࠂϝοηʔδੜ੒શࣾো֐νϟϯωϧʹ࿈བྷ ݕ஌͔Β෼

    View full-size slide

  36. © DMM.com
    w γεςϜো֐ͱͷ޲͖߹͍ํ
    w ͍͔ʹૣ͘ো֐Λݕ஌͠ɺ෮چͤ͞Δ͔ʹ஫ྗ͢Δ
    w ো֐ݕ஌
    w Τϥʔͷछྨ͝ͱʹద੾ͳ௨஌Λߦ͍ɺো֐ஹީͷݕ஌Λ࣮ݱ
    w ো֐෮چ
    w ಈ࡞֬ೝ΍ؔ܎ઌใࠂͷ4MBTIίϚϯυΛ੔උ͠ɺো֐෮چͷॳಈΛ࣮ݱ
    ·ͱΊ
    36
    "84ͷطଘαʔϏεͷ׆༻ͷΈͰɺ
    γεςϜো֐ʹ͢͹΍͘ରԠ͢Δ࢓૊ΈΛ࡞Δ͜ͱ͕Ͱ͖ͨ

    View full-size slide

  37. © DMM.com
    ͍͞͝ʹ
    37
    ࣭໰΍վળͷΞΠσΞͳͲ͕͋Ε͹ɺ

    ͜ͷ͋ͱڭ͍͚͑ͯͩΔͱخ͍͠Ͱ͢ɻ
    5XJUUFS@LFOUBSP@N

    View full-size slide