【JAWS-UG大阪＆JAWS-UG関西女子会合同企画「AWSのおJAWSな使い方」】ストレージのごっつはまるポイント

Transcript

1. 2016.7.26 JAWS-UGେࡕˍJAWS-UGؔ੢ঁࢠձ߹ಉاը ʮAWSͷ͓JAWSͳ࢖͍ํʯɹ#jawsug #jawsugkgirls ǏǞȂ✣ǎƑŷƆƇƒơƮdzƺȉǞ
   ʙ4UPSBHF
   JT
   HPUT
   IBNBSV
   QPJOUʙ

2. #jawsug #jawsugkgirls ཬਟ
   ཭἗
   ŶƓƧź
   ƂŮƫź
   ᇩൔ߶ഠNj✣Ǧ✣ȅ✣DžǏ
   ǓȀǻ✣ǍǽȉƸ✣ǃǜDžǞ`
   !LPCB@UBLB
   ݺŰƍ"84Nj✣ǩǏ
   
   
   
   
   
   
   $MPVE4FBSDI
   

   
   
   
   
   
   &MBTUJDTFBSDI
   4FSWJDF
   
   
   
   
   
   
   
   
   
   
   
   
   8IP
   JT
   

3. #jawsug #jawsugkgirls ຊ೔ͷϙέϞϯGoঢ়گ • 19:30͔ΒGPS͕ར༻Ͱ͖ͳ͍ঢ়ଶʹ • iPhoneΛ࠶ىಈͯ͠΋վળͤͣ • ॿ͚͍ͯͩ͘͞…

4. #jawsug #jawsugkgirls ƾȉǕ✣ǭǿƺǐƵᇏྏƎഠ` ǭȃǎƽDžǞƑẹೆ⻎Ὥ`¸୍ᄅଌℭׄ Ọࣘ
   
   նፘ
   
   ڞ἖
   
   ༶෻ "1/
   1SFNJFS
   $POTVMUJOH
   1BSUOFS "84Ǝห߄źƂƺȉǜdžȂ✣Ǖ

5. #jawsug #jawsugkgirls ЧರƒǦǙǟǤƼǥƼƊż

6. #jawsug #jawsugkgirls ǏǞȂ✣ǎ

7. #jawsug #jawsugkgirls ǦǙǟǤƼǥƼ
   €
   ǏǞȂ✣ǎ

8. #jawsug #jawsugkgirls ૝૾ͯ͠Έ͍ͯͩ͘͞

9. #jawsug #jawsugkgirls

10. #jawsug #jawsugkgirls ŸƉa⇀⻎ƎଢƵМŴŽƎྛŰơźƪũ

11. #jawsug #jawsugkgirls ЧರƒƇƑǦǙǟǤƼǥƼƵℚࢺźơż &#4
    €
    LJ✣Ǐ
    "VSPSB
    €
    LJ✣Ǐ "VSPSB

12. #jawsug #jawsugkgirls EBSॳظԽ όουέʔε ͦͷ1

13. #jawsug #jawsugkgirls EBSॳظԽʹ͍ͭͯ͝ଘ஌ͷ͔ͨʁ

14. #jawsug #jawsugkgirls EBSॳظԽ • ৽͍͠ EBS ϘϦϡʔϜ͸ɺར༻ՄೳʹͳΔͱ͙͢ʹ࠷େͷύϑΥʔ ϚϯεΛൃش͠ɺॳظԽ (Ҏલ͸ࣄલ΢Υʔϛϯάͱݺ͹Ε·ͨ͠) Λඞཁͱ͠·ͤΜɻͨͩ͠ɺεφοϓγϣοτ͔Β෮ݩ͞ΕͨϘ

    ϦϡʔϜͷετϨʔδϒϩοΫ͸ɺΞΫηε͢ΔͨΊʹ͸ࣄલʹॳ ظԽ͢Δඞཁ͕͋Γ·͢ (Amazon S3 ͔Βϓϧμ΢ϯͯ͠ϘϦϡʔ Ϝʹॻ͖ࠐΈ·͢)ɻ

15. #jawsug #jawsugkgirls έʔε • 14TiBͷEBS(PIOPS)Λར༻ͷϚγϯ • Snapshot͔ΒϦΧόϦ • ϦΧόϦޙ͸i/Oੑೳ͕ஶ͘͠ྼԽ •

    320MB/sఔ౓༧ఆͷI/O͕໿50MB/s • ໿85%ఔ౓ͷI/OੑೳྼԽ

16. #jawsug #jawsugkgirls ॳظԽରԠ • fio΍ddΛར༻͠શͯͷϒϩοΫΛಡΈࠐΈ fio --filename=/dev/xvdf --bs=4k --direct=1 --ioengine=libaio

    -- clocksource=clock_gettime --randrepeat=0 --iodepth=32 --rw=read: 508k --name=volume-initialize • S3ΑΓॳճ࣌ͷಡΈࠐΈΛ࣮ࢪ

17. #jawsug #jawsugkgirls • 14TiBΛ50MiB/sͰॳظԽ • 14000000(MiB) / 50(MiB/s) = 280000(s)

    • ໿70࣌ؒఔ౓ඞཁ (280000(s)/3600 = 77.7(h)) • ΄΅3೔͔͔Δܭࢉʹɻɻ ͔͠͠..ʁ

18. #jawsug #jawsugkgirls ⻻ㅁҦ cƕƂżƬրƇ
    c 4OBQTIPUŮƬƑἋჭᗥaǦǙDždžǿƼȉǟƊℭᾇƵŮŴƉ䪎Ƣ䴘ơƯơżb
    c൙భƎсေƍℭᾇƵᾖᄀźƉԚ௹߄Ƶ⻎ീżƮ
    c ಸਈƎㅁŻƉℭᾇůŮŮƮƂƤa൙భƎсေℭᾇƑίෘƵźƉŭŲ
    c"DUJWF
    €
    "DUJWFƊƑDžǿǏǕἧӮƥॉ⁒żƮ
    

    c %3Ⴈ๯ƊնŰƍ4OBQTIPUŮƬƑȀǏǞƸ≓ႨƵ㙽ⅯŸƯƉŧƮLJ✣Ǐ
    c żųƎ*0ůсေƍṳކaDžǿǏǕἧӮƥ㙽Ⅿůсေ

19. #jawsug #jawsugkgirls Next Bad Case…

20. #jawsug #jawsugkgirls MBR GPTࣄ݅ όουέʔε ͦͷ2

21. #jawsug #jawsugkgirls έʔε • WindowsͰϑΝΠϧαʔόʔΛ • 2TiBఔ౓Ͱӡ༻ • ༰ྔ͕ރׇ͖ͯͨ͠ •

    EBSͳΒ༰қʹ֦ுͰ͖..

22. #jawsug #jawsugkgirls ͓΍‥ʁ • 2TiBҎ্͕ೝࣝ͞Εͳ͍ • ֦ுखॱ͸ؒҧ͍ͬͯͳ͍ • ·͔͞..

23. #jawsug #jawsugkgirls MBR / GPT • σΟεΫͷϑΥʔϚοτ࣌ʹࢦఆ͢Δܗࣜ • Windows ServerͰ͸EC2configͷڍಈͰ2TiBҎԼͷEBS

    ʹ͍ͭͯ͸ɺMBRϑΥʔϚοτͰࣗಈతʹϚ΢ϯτ • EC2࡞੒࣌ʹAttachͨ͠EBSͰ༰ྔ2TiBҎԼͷEBS͕ର৅

24. #jawsug #jawsugkgirls ରԠࡦ • EC2configͷڍಈͷͨΊɺEC2 launch࣌ʹ͸֦ு σΟεΫ͸Attach͠ͳ͍ • EC2ىಈޙɺEBSΛ௥ՃAttach͠ɺGPTͰϑΥʔ ϚοτΛ࣮ࢪ͢Δ

25. #jawsug #jawsugkgirls Next Bad Case..

26. #jawsug #jawsugkgirls Aurora ΠϯελϯεετϨʔδރׇࣄ݅ όουέʔε ͦͷ3

27. #jawsug #jawsugkgirls "VSPSBƑȂǏdzȉǏůㆮŧ c ᇷźŲ"VSPSBƑȂǏdzȉǏůㆮŧ
    c ࢤ䌺ƾǿ✣ů₹㻂
    c ᄜఏọٳųƬŧ䌂ἾźƉƥBWBJMBCMFƎƍƬƍŧ

28. #jawsug #jawsugkgirls ݪҼ • AuroraͷϞχλϦϯάΛ֬ೝ͢Δͱ • Free Local Storage͕ރׇ͍ͯ͠Δ •

    AuroraͬͯσΟεΫ͕ࣗಈ֦ுͰ͸.. • Free Local Storageͱ͸..

29. #jawsug #jawsugkgirls Aurora Free Local Storage • ΠϯελϯελΠϓ͝ͱʹ༻ҙ͞Ε͍ͯΔΠϯελϯεετϨʔδ • ༰ྔ͸ΠϯελϯελΠϓʹԠͯ͡ҟͳΔ

    • ࣗಈ֦ு͠ͳ͍ • tableྖҬͷͨΊɺඪ४Ͱ͸general log΍slow query͕อଘର৅

30. #jawsug #jawsugkgirls ⻻ㅁҦ • log_output = TABLE Ͱར༻͍ͯ͠Δ৔߹ɺgeneral logɺslow query

    ͷอଘظؒͷ੍ݶ͕ͳ͍ • ݱঢ়ɺϩʔςʔτΛ࣮ࢪ͢Δํ๏͕ͳ͍ঢ়ଶ • ͜ͷڍಈ͸কདྷमਖ਼༧ఆͱͷ͜ͱ ※2016೥7݄ݱࡏ • ϩάग़ྗΛ࣮ࢪ͢Δࡍ͸log_output = FILEʹมߋ

31. #jawsug #jawsugkgirls ·ͱΊ • AWSͷετϨʔδ͸ศར • গ͠ϋϚϦϙΠϯτ͕͋Δ • ϋϚͬͯ͸͡Ίͯ෼͔Δ͜ͱ΋ •

    όουϊ΢ϋ΢ΛͲΜͲΜڞ༗͠Α͏

32. #jawsug #jawsugkgirls ťƭůƋũŷŹŧơźƂĆ