Amazon S3標準/ S3 Tables/S3 Express One Zoneを使ったログ分析

AWS Summit Japan 2025での登壇資料

Transcript

1. "NB[PO
   4ඪ४ 4
   5BCMFT4
   &YQSFTT
   0OF
   ;POF Λ࢖ͬͨϩά෼ੳ 4BOTBO
   גࣜձࣾ 4IJHFSV
   0EB "84
   4VNNJU
   +BQBO
    $PNNVOJUZ
   4UBHF
    %BZ
   
   
2. 4IJHFSV
   0EB !0VUQVU4FR 4BOTBOגࣜձࣾ ϓϩμΫτΠϯϑϥΤϯδχΞ ςΫχΧϧϦʔυ ೥݄ʹ4BOTBOגࣜձࣾʹKPJO Ӧۀ%9αʔϏε 4BOTBOͷΠϯϑϥߏஙɾӡ༻ʹैࣄ "84
   $PNNVOJUZ͸+"84
   6(ॳ৺ऀࢧ෦ΛӡӦ ೥͔Β"84
   $PNNVOJUZ
   )FSP
   ͱͯ͠ೝఆ
3. ຊ೔ͷΰʔϧ "NB[PO
   4
   5BCMFT
   
   4
   &YQSFTT
   0OF
   ;POF ΛγεςϜʹऔΓೖΕΔબ୒ࢶͷҰͭʹऔΓೖΕͯ΋Β͏
4. ϩάΛอଘ͍ͯ͠·͔͢ʁ ηΩϡϦςΟɺ௨৴ɺ؂ࠪɺΞϓϦέʔγϣϯɺ౳ʑ
5. ʲ࣭໰ʳ ϩά͸ͳͥอଘ͍ͯ͠·͔͢ʁ อଘ͞Εͨϩά͸ݟ͍ͯ·͔͢ʁ ͲͷΑ͏ͳ໨తͰ֬ೝ͍ͯ͠·͔͢ʁ
6. ʲ࣭໰ʳ ϩά͸ͳͥอଘ͍ͯ͠·͔͢ʁ อଘ͞Εͨϩά͸ݟ͍ͯ·͔͢ʁ ͲͷΑ͏ͳ໨తͰ֬ೝ͍ͯ͠·͔͢ʁ ҟৗݕ஌Λ͢ΔͨΊʹݟ͍ͯΔ 4-"ʗ4-0ʗ4-*؅ཧͷͨΊʹݟ͍ͯΔ ϏδωεࢦඪͷͨΊʹݟ͍ͯΔ ๏ྩɾࣾ಺ϧʔϧͷͨΊʹอଘ͠ɺ؂ࠪͰݟ͍ͯΔ
7. γεςϜߏ੒
9. 異常検知の場合
10. SLA／SLO／SLI管理の場合 ビジネス指標の場合
11. ๏ྩɾࣾ಺ϧʔϧͷͨΊʹอଘ
12. લఏ ̍ϩά  #ZUFT ೔͋ͨΓສͷϩά͕ൃੜ (#EBZɺ(#NPOUIɺ(#ZFBS "SDIJWFʹ͸ൃੜ೥ޙʹભҠɺ೥อଘ
14. "NB[PO
    "UIFOBͰ "NB[PO
    4ʹΞΫηε͢Δ৔߹ ԿΛݕ౼͢΂͖͔
15. ΞΫηε͸௚ۙσʔλʹूத͢Δ ೥݄ ೥݄ ೥݄
16. "NB[PO
    4
    ͷ QFSGPSNBODF͸4DBMF͢Δ ೥݄ ೥݄ ೥݄ ޙ൒ ೥݄ લ൒ ˡ
    ෼ׂ ˠ
17. 4
    QFSGPNBDF   SFRVFTUTTFD
    
    165$01:1045%&-&5&
      SFRVFTUTFD
    
    (&5)&"% QFS
    QSFpY
18. 4
    QFSGPSNBODF
    ͱ QSFpY BXTTVNNJUKBQBO 2025 05 06 25 26 25 26 BXTTVNNJUKBQBOͰͷ(&5
    SFRVFUT߹ܭͷτϥϯβΫγϣϯ͸  
    º 
    
     514
    ͱͳΔ
19. QSFpYͷݕ౼
20. ˙BXTTVNNJUKBQBO ˙BXTTVNNJUKBQBOZFBS ˙BXTTVNNJUKBQBOZFBSNPOUI ˙BXTTVNNJUKBQBOZFBSNPOUIEBZ ˙BXTTVNNJUKBQBOZFBSNPOUIEBZIPVS ˙BXTTVNNJU KBQBOZFBSNPOUIEBZIPVSNJOVUFT
21. ˙BXTTVNNJUKBQBO 
    ԯ݅ɺ(#
    ʜ
    ೥ܦաޙ ˙BXTTVNNJUKBQBOZFBS 
    ԯ݅ɺ(# ˙BXTTVNNJUKBQBOZFBSNPOUI 
     ສ݅ɺ(# ˙BXTTVNNJUKBQBOZFBSNPOUIEBZ 
    ສ݅ɺ(# ˙BXTTVNNJUKBQBOZFBSNPOUIEBZIPVS 
    ສ݅ɺ.# ˙BXTTVNNJU KBQBOZFBSNPOUIEBZIPVSNJOVUFT 
    ݅ɺ.# લఏ ɾ݅ʹΦϒδΣΫτ ɾ̍݅ʹ όΠτ ɾ̍೔Ͱສ݅ ɾඇѹॖͰࢉग़
22. ݕ౼؍఺ (&5ͷ؍఺  QSFpYͷ֊૚͕ઙ͍৔߹ɺେྔσʔλͷΞΫηεͱͳΔ  ੑೳྼԽ΍αʔόʔΤϥʔ 165ͷ؍఺  ೥݄೔ͰQSFpYΛ੾ͬͨ৔߹ɺ೔Λލ͍ͩॠؒʢ࣌ʣʹ৽نͰ࡞ ੒͞ΕΔ೔෇͸εέʔϧ͞Ε͍ͯͳ͍  ੑೳྼԽ΍αʔόʔΤϥʔ
23. 
    4FSWJDF
    5FNQPSBSJMZ
    6OBWBJMBCMF ʢαʔϏεҰ࣌తʹར༻ෆՄʣ
24. QSFpYͷݕ౼ʢରԠʣ
25. ˙BXTTVNNJUKBQBOIBTIYYYY 
    ԯϨίʔυɺ(#
    ʜ
    ೥ܦաޙ ˙BXTTVNNJUKBQBOIBTIYYYYZFBS 
    ԯϨίʔυɺ(# ˙BXTTVNNJUKBQBOIBTIYYYYZFBSNPOUI 
     ສϨίʔυɺ(# ˙BXTTVNNJUKBQBOIBTIYYYYZFBSNPOUIEBZ 
    ສϨίʔυɺ(# ˙BXTTVNNJU KBQBOIBTIYYYYZFBSNPOUIEBZIPVS 
    ສϨίʔυɺ.# ˙BXTTVNNJU KBQBOIBTIYYYYZFBSNPOUIEBZIPVSNJOVUF T 
    Ϩίʔυɺ.#
26. "NB[PO
    "UIFOB
    5BCMFఆٛ
27. 2VFSZྫ
28. Ͱ͸IBTIͰ େྔʹ1BSUJUJPOΛ੾Δͷ͕ྑ͍ͷ͔
29. "UIFOBݕࡧͷཧ૝ͷ1BSUJUJPO਺  ݕࡧͰͷ1BSUJUJPO͸ ະຬ   Ҏ্͸5JNF0VUΛൃੜ͢ΔՄೳੑ͕͋Δ  NFUB
    EBUBऔಘɾॲཧͰ2VFSZͷ1MBO࡞੒͕࣌ؒ஗͘ͳΔ  ॻ͖ࠐΈͰͷ1BSUJUJPO্ݶ͸  ॻ͖ࠐΈͰɺҰ౓ʹ࡞੒Ͱ͖Δ1BSUJUJPO਺͸  $5"4ʢ$SFBUF
    5BCMF
    "T
    4FMFDUʣ  *OTFSU
    *OUP  ա৒ʹ෼ׂ͠ͳ͍ɺύʔςΟγϣϯ਺ΛݮΒ͢ͷ͕ྑ͍
30. 'JMF'PSNBUɺਪ঑αΠζ͸ʁ
31. 'JMF'PSNBUʢKTPOɺ1BSRVFUɺ03$ʣ  جຊతʹ͸൚༻తɺߴ଎ɺѹॖޮ཰ͷྑ͍1BSRVFU͕ਪ঑  03$͸1BSRVFUΑΓ΋ߴѹॖ  03$ɿ࠷େѹॖɺ1BSRVFUɿѹॖ  "QBDIF
    )JWFʢ%8)ʣͰ͸03$ར༻͕ਪ঑͞Ε͍ͯΔ  "QBDIF
    )JWFར༻͕ϝΠϯͰ͋ΔͳΒ03$  KTPO͸σόοάɺ1P$ͳͲɺ&EJUPS্ͰݟΔʹ͸࠷ڧ  ഁյతͳεΩʔϚมߋͰ΋ରԠ͠΍͍͢  %FW؀ڥʢσʔλ͕গͳ͍ʣͳΒɺσόοά໨తͰผ4ʹKTPO Λ࢒͢Ҋ΋͋Γʁ  4&-&$5
    MFWFM
    '30.
    ͱΧϥϜΛߜͬͯ΋ɺશྻΛಡΈࠐΉͷ Ͱੑೳ͕ѱ͍
32. ਪ঑αΠζʢKTPOɺ1BSRVFUɺ03$ʣ  KTPO  ඇѹॖσʔλͰ͋Ε͹ɺPCKFDUΛฒྻॲཧΛߦ͏͜ͱ͕ग़དྷΔ  ѹॖσʔλͰ͋Ε͹ɺPCKFDUΛฒྻॲཧ͕ग़དྷͳ͍  ྫɿ(#ͷϑΝΠϧҎԼઃఆ৚݅Ͱݕࡧ  ඇѹॖͰ̍ϑΝΠϧ ɿ ඵ  ඇѹॖͰ ϑΝΠϧ ɿ 
    ඵ  ѹॖͰϑΝΠϧ ɿ 
    ඵ  ѹॖͰϑΝΠϧ ɿ 
    ඵ  IUUQTBXTBNB[PODPNKQCMPHTOFXTUPQQFSGPSNBODF UVOJOHUJQTGPSBNB[POBUIFOB
33. ਪ঑αΠζʢKTPOɺ1BSRVFUɺ03$ʣ  1BSRVFU  ҰൠతͳΨΠυϥΠϯͱͯ͠͸.#ʢඇѹॖ࣌ʣ  ΧϥϜ਺͕ଟ͍৔߹ʹ͸αΠζΞοϓ  03$  ҰൠతͳΨΠυϥΠϯͱͯ͠͸ .#ʢඇѹॖ࣌ʣ  ΧϥϜ਺͕ଟ͍৔߹ʹ͸αΠζΞοϓ
34. ࠶੔ཧ  ܗࣜ  1BSRVFU  ΦϒδΣΫτ୯ҐͷαΠζͱ݅਺  ඇѹॖ࣌  αΠζɿ.#ɺ݅਺ɿ ݅  ѹॖ࣌  αΠζɿ.#ʢʣɺ݅਺ɿ ݅  "NB[PO
    %BUB
    'JSFIPTFͰͷCV⒎FSઃఆ  TJ[Fɿ.#  JOUFSWBMɿඵʢ෼ʣ  ೔ͰΦϒδΣΫτ͕গͳ͘ͱ΋࡞੒͞ΕΔܭࢉ
35. 4
    QSFpYʢ1BSRVFUରԠҊʣ
36. ˙BXTTVNNJUKBQBOIBTIYYYY 
     ԯϨίʔυɺ(#
    ʜ
    ೥ܦաޙ 
     ΦϒδΣΫτɺ(#
    ʜ
    ೥ܦաޙ ˙BXTTVNNJUKBQBOIBTIYYYYZFBS 
    ԯϨίʔυɺ(# 
     ΦϒδΣΫτɺ(# ˙BXTTVNNJUKBQBOIBTIYYYYZFBSNPOUI 
     ສϨίʔυɺ(# 
     ΦϒδΣΫτɺ(# લఏ ɾ̍ΦϒδΣΫτʹ ݅ ɾѹॖࡁʢʣͰࢉग़ ɾ.#ʹͳΔ·ͰΩϟογϡ
37. ˙BXTTVNNJUKBQBOIBTIYYYYZFBSNPOUIEBZ 
    ສϨίʔυɺ(# 
    ΦϒδΣΫτɺ(# ˙BXTTVNNJU KBQBOIBTIYYYYZFBSNPOUIEBZIPVS 
    ສϨίʔυɺ.# 
    ΦϒδΣΫτɺ.# ˙BXTTVNNJU KBQBOIBTIYYYYZFBSNPOUIEBZIPVSNJOVUFT  
    Ϩίʔυɺ.# 
    ΦϒδΣΫτɺ.# લఏ ɾ̍ΦϒδΣΫτʹ ݅ ɾѹॖࡁʢʣͰࢉग़ ɾ.#ʹͳΔ·ͰΩϟογϡ
38. ݁࿦ʢࢲҊʣ  جຊ͸1SFpYΛIBTI ೥݄೔Ͱͷߏ੒ͱ͢Δ  ྫ 
    ෼ׂ  BXTTVNNJUKBQBOIBTIZFBSNPOUIEBZ  BXTTVNNJUKBQBOIBTI''ZFBSNPOUIEBZ  ϦΞϧλΠϜ෼ੳ͕͍ͨ͠৔߹ʹ͸IBTI ೥݄೔࣌Ͱͷߏ੒ͱ͢Δ  2VFSZͷݕࡧ৚͕݅࣌ؒ·Ͱࢦఆ͢Δ͜ͱ͕ଟ͍৔߹  1VU݅਺͕ඇৗʹଟ͍৔߹ʹ͸IBTI ೥݄೔࣌෼Ͱͷߏ੒ͱ͢Δ  1BSUJUJPO਺͕ଟ͍ͷͰ"UIFOBͰͷ෼ੳʹ͸஫ҙ
39. ͯ͞ɺΈͳ͞Μͷ৺ͷ੠Λฉ͍ͯΈΑ͏
40. QSFpYઃܭɺɺɺ໘౗͡Όͳ͍ʁ
41. "NB[PO
    4
    5BCMFT
42. "NB[PO
    4
    5BCMFT "QBDIF
    *DFCFSH
    ܗࣜͰσʔλΛ؅ཧͰ͖Δ4
    ετϨ ʔδػೳͰɺ"UIFOB
    ͳͲ͔Βߴੑೳ͔ͭॊೈʹΫΤ Ϧɾߋ৽͕Մೳɻ൚༻ 4
    όέοτʹอଘ͞Ε͍ͯΔ *DFCFSH
    ςʔϒϧͱൺֱͯ͠ɺ
    ඵ͋ͨΓ࠷େ 
    ഒͷ τϥϯβΫγϣϯΛ഑৴ "QBDIF
    *DFCFSHΛ࢖༻͢ΔϝϦοτ͸ ɾදݱྗ๛͔ͳ42- ɾ׬શͳεΩʔϚਐԽ ɾӅ͠ύʔςΟγϣϯ ɾλΠϜτϥϕϧͱϩʔϧόοΫ ɾσʔλѹॖ
44. ̍೔ͷ5SBOTBDUJPO਺
45. ѹॖػೳ
46. ϩά؅ཧ PO
    4
    5BCMFTͰͷϝϦοτ  4
    4UBOEBSEͱൺֱͯ͠  ࠷େ 
    ഒߴ଎ͳΫΤϦύϑΥʔϚϯε  ࠷େ 
    ഒͷτϥϯβΫγϣϯ  1SFpY෼ׂෆཁ  4
    5BCMFT͸4ͷQSFpYʹґଘͤͣʹ ϝλσʔλϨϕϧͰϑΝ ΠϧΛ؅ཧ  σΟϨΫτϦߏ଄΍IBTI෼ׂ͕ෆཁ
47. ϩά؅ཧ PO
    4
    5BCMFTͰͷϝϦοτ  ύʔςΟγϣϯࣗಈ؅ཧ  4
    4UBOEBUEͰ͸खಈߋ৽ɾΫϩʔϥʔ؅ཧ͕ඞཁͰ͋ͬͨ ͕ɺ4
    5BCMFTͰ͸ϝλσʔλ͸ࣗಈ؅ཧ  ίϯύΫγϣϯػೳ  "84
    (MVFͷػೳͰ খ͍͞ϑΝΠϧΛࣗಈతʹ݁߹  ϑΝΠϧ෼ׂʹؾΛ࢖͏ඞཁ͕ͳ͘ͳΔ
48. "NB[PO
    4
    &YQSFTT
    0OF
    ;POF
49. ؂ࠪରԠͰ೥લͷϩάσʔλΛௐ͍ࠪͨ͠ɻ ͱݴΘΕͨΒͲ͏͠·͢ʁ
50. "NB[PO
    4
    &YQSFTT
    0OF
    ;POF 4
    ඪ४ετϨʔδΫϥεͱൺֱͯ͠࠷େ 
    ഒͷύϑ ΥʔϚϯεΛ࣮ݱ͢ΔΑ͏ʹઃܭɻ
    ܻϛϦඵͷϨΠ ςϯγʔͰຖඵ਺ेສ݅ͷϦΫΤετΛॲཧͰ͖Δɻ
51. "NB[PO
    4
    &YQSFTT
    0OF
    ;POF
52. ؂ࠪରԠͰσʔλΛ෮چ
53. ؂ࠪରԠͰσʔλΛ෮چ
54. ؂ࠪରԠͰσʔλΛ෮چ
55. ؂ࠪରԠͰσʔλΛ෮چ 4
    4UBOEBSEʹ$PQZͨ͠৔߹  ߴ͍514ΛಘΔͨΊʹ͸ɺεέʔϧ͢Δ·Ͱֻ͕͔࣌ؒΔ  ؂ࠪ༻్Ͱσʔλ෮چͨ͠৔߹ ߴස౓ͰΞΫηε͞ΕΔՄೳੑ͕͋Γɺੑೳ͕ຬͨͤͳ͍Մೳੑ͕͋ Δ 4
    &YQSFTT
    0OF
    ;POFʹ$PQZͨ͠৔߹  QSFpYઃܭ͸ෆཁͰɺσΟϨΫτϦόέοτ୯ҐͰҎԼ514ΛಘΔ  (&5ʢಡΈऔΓʣ
    ࠷େ   
    514  4
    4UBOEBSE͸ 
    514  165ʢॻ͖ࠐΈʣ
    ࠷େ  
    514  4
    4UBOEBSE͸ 
    514  ߴස౓ͰΞΫηε͞ΕΔ৔߹ʹ΋ɺߴੑೳΛఏڙͰ͖Δ
56. ࠷ऴతͳγεςϜߏ੒
57. ࠷ऴతͳγεςϜߏ੒
58. ࠷ऴతͳγεςϜߏ੒
60. গ͠Ͱ΋ύϑΥʔϚϯεΛ্͛ͯ গ͠Ͱ΋ɺຊདྷ஫ྗ͢΂͖ࣄฑʹ࣌ؒΛׂͨ͘Ίʹ "NB[PO
    4
    5BCMFT
    
    4
    &YQSFTT
    0OF
    ;POF ͰγεςϜߏஙͯ͠Έ·ͤΜ͔ʁ
61. એ఻
63. એ఻
64. ʢ݄ɿॕ೔ʣ
     Ͱ 4
    5BCMFTͷߏ੒ΛؚΜͰʢ࡞੒தʣɺϋϯζΦϯΠϕϯτ
65. Ҿ༻ࢿྉɾࢀߟࢿྉ "UIFOB
    ͷύϑΥʔϚϯεΛ࠷దԽ͢Δ IUUQTEPDTBXTBNB[PODPNKB@KQBUIFOBMBUFTUVHQFSGPSNBODF UVOJOHIUNM "NB[PO
    "UIFOB
    ͷύϑΥʔϚϯενϡʔχϯά 5JQT
    τοϓ  IUUQTBXTBNB[PODPNKQCMPHTOFXTUPQQFSGPSNBODFUVOJOHUJQT GPSBNB[POBUIFOB ઃܭύλʔϯͷϕετϓϥΫςΟε
    "NB[PO
    4
    ͷύϑΥʔϚϯεͷ࠷దԽ IUUQTEPDTBXTBNB[PODPNKB@KQ"NB[PO4MBUFTUVTFSHVJEFPQUJNJ[JO HQFSGPSNBODFIUNM "84
    SF*OWFOU
    
     0QUJNJ[JOH
    TUPSBHF
    QFSGPSNBODF
    XJUI
    "NB[PO
    4
    45( IUUQTXXXZPVUVCFDPNXBUDI W%47K+53T[
66. Ҿ༻ࢿྉɾࢀߟࢿྉ )PX
    "NB[PO
    4
    5BCMFT
    VTF
    DPNQBDUJPO
    UP
    JNQSPWF
    RVFSZ
    QFSGPSNBODF
    CZ
    VQ
    UP
    
    UJNFT IUUQTBXTBNB[PODPNKQCMPHTTUPSBHFIPXBNB[POTUBCMFTVTF DPNQBDUJPOUPJNQSPWFRVFSZQFSGPSNBODFCZVQUPUJNFT "DDFMFSBUF
    RVFSJFT
    PO
    "QBDIF
    *DFCFSH
    UBCMFT
    UISPVHI
    "84
    (MVF
    BVUP
    DPNQBDUJPO IUUQTBXTBNB[PODPNKQCMPHTCJHEBUBBDDFMFSBUFRVFSJFTPO BQBDIFJDFCFSHUBCMFTUISPVHIBXTHMVFBVUPDPNQBDUJPO .POJUPSJOH
    "QBDIF
    *DFCFSH
    NFUBEBUB
    MBZFS
    VTJOH
    "84
    -BNCEB
    "84
    (MVF
    BOE
    "84
    $MPVE8BUDI IUUQTBXTBNB[PODPNKQCMPHTCJHEBUBNPOJUPSJOHBQBDIFJDFCFSH NFUBEBUBMBZFSVTJOHBXTMBNCEBBXTHMVFBOEBXTDMPVEXBUDI
67. (JUIVC
    
    IUUQTHJUIVCDPNTIJHFSV PEB 5IBOL
    ZPV 4BOTBO
    
    IUUQTBQTBOTBODPNWWDKBF SUVREFL[FEEIUXGOSFNVSN