Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up
for free
セキュリティログ分析基盤の構築 on AWS
Masayoshi Mizutani
May 16, 2018
Technology
10
6.2k
セキュリティログ分析基盤の構築 on AWS
2018.5.16 Security JAWS での発表資料です
Masayoshi Mizutani
May 16, 2018
Tweet
Share
More Decks by Masayoshi Mizutani
See All by Masayoshi Mizutani
mizutani
0
390
mizutani
0
500
mizutani
4
2k
mizutani
1
300
mizutani
1
4k
mizutani
3
2k
mizutani
4
1.8k
mizutani
3
2.6k
mizutani
3
1.6k
Other Decks in Technology
See All in Technology
chipstar_light
0
480
gunnargrosch
0
210
sat
1
270
lambda
0
230
tsuyo
0
490
prog893
0
140
recruitengineers
0
250
sei88888
5
450
kanaugust
PRO
0
210
tutsunom
1
330
miu_crescent
0
270
ishiitetsuji
0
110
Featured
See All Featured
schacon
147
6.7k
denniskardys
220
120k
erikaheidi
14
4.5k
jlugia
217
16k
skipperchong
8
780
hursman
107
9.3k
jacobian
257
20k
lynnandtonic
272
16k
jrom
116
7.2k
pedronauck
652
110k
reverentgeek
167
7.3k
tenderlove
54
3.5k
Transcript
ηΩϡϦςΟϩάੳج൫ͷߏங PO"84 ΫοΫύουגࣜձࣾΠϯϑϥετϥΫνϟʔ෦ ਫ୩ਖ਼ܚ 8FE
ࣗݾհˍൃද֓ཁ wਫ୩ਖ਼ܚ !N@NJ[VUBOJ w ຊ*#.ೖࣾ w ౦ژجૅݚڀॴ w ηΩϡϦςΟࣄۀ෦5PLZP40$
w ΫοΫύουגࣜձࣾೖࣾ w ΠϯϑϥετϥΫνϟʔ෦ηΩϡϦςΟνʔϜ wࠓͷൃද ݄ʹฐࣾ5FDI$POGͷ-5Ͱͨ͠༰ͷ࠷৽൛Ͱ͢
ηΩϡϦςΟϩάੳͱ͍͑4*&.ɺ͔͠͠Ϋϥυ্ͩͱʜ wϩάͷૹ৴ݩΛಈతʹ੍ޚͰ͖ͳ͍ w ૹ৴ݩʴϩάͷܗࣜͷΤϯτϦΛཧ͢Δ"1*͕ͳ͍ w Χλϩά্ࣗಈొ͢Δͱݴ͍ͬͯΔ͕͏·͘Ճ͞Εͳ͍ w ΠϯελϯεɾαʔϏεͷՃɾআʹରԠ͢Δͷ͕େม wશମߏΛؾܰʹ͍͡Εͳ͍ w
ߏ্εέʔϧΞτ͢Δ͕खಈˍࣦഊ͢Δͱഁ໓ w εέʔϧΞτͨ͠ͷͷதʹϩά͕ΔͷͰεέʔϧΠϯෆՄ w ϩά͕όʔετͨ͠ͱ͖ͷରԠ͕େม wϧʔϧͷςετ͕͍͠ w ςετͷͨΊʹෳߏ༻ҙ͢ΔPS࣮ڥͰΔ w "1*ͳͲͳ͍ͷͰɺવਓखͰؤுΔ w ΫΠοΫʹϧʔϧͷௐ͕Ͱ͖ͳ͍มߋʹΑΔαΠυΤϑΣΫτͰۤ࿑͢Δ ˞ҰൠԽ͞ΕͨͰͳ͘ɺͱ͋Δͷܦݧʹج͍ͮͨఆͰ͢
ઃܭཁ݅ wোͷੑ wੑೳɿඦ(#ͷྲྀྔˍ༰қͳεέʔϧΞτ͕Մೳ wมߋཤྺཧ w؇͍ϦΞϧλΠϜੑɿఔͷԆڐ༰ wঢ়گʹԠͨ͡ηΩϡϦςΟੳ w ύλʔϯ ৗతʹൃੜ͢ΔΞϥʔτͷੳ w
ύλʔϯ Πϯγσϯτൃੜ࣌ͷظੳ w ύλʔϯ ظؒͷ౷ܭใऔಘ wੳɾରԠͷࣗಈԽ
ΞʔΩςΫνϟ֓ཁ ϩάϑΝΠϧઃஔͷ ΠϕϯτΛݕग़ Lambda Lambda Lambda Kinesis Stream S3 S3
Athena ϧʔϧΛ༻͍ͨ Ξϥʔτͷݕ Ξϥʔτͷൃใ ϩάͷม EC2 Elasticsearch Service ߴͰΠϯλϥΫςΟϒͳ ظతϩάͷݕࡧ ظؒʹΘͨΔ ϩάͷݕࡧ GHE PagerDuty Slack Ξϥʔτͷൃใɾཧ Ξϥʔτͷௐࠪ CloudWatch Logs/Event, GuardDuty, CloudTrail EC2 instances ͦͷଞϓϩμΫτ Kinesis Stream Kinesis Stream ˞ࡉ͔͍ͱ͜Ζͪΐͬͱંͬͯ·͢
ΞʔΩςΫνϟ֓ཁ ύʔτ͚ ϩάϑΝΠϧઃஔͷ ΠϕϯτΛݕग़ Lambda Lambda Lambda Kinesis Stream S3
S3 Athena ϧʔϧΛ༻͍ͨ Ξϥʔτͷݕ Ξϥʔτͷൃใ ϩάͷม EC2 Elasticsearch Service ߴͰΠϯλϥΫςΟϒͳ ظతϩάͷݕࡧ ظؒʹΘͨΔ ϩάͷݕࡧ GHE PagerDuty Slack Ξϥʔτͷൃใɾཧ Ξϥʔτͷௐࠪ EC2 instances ͦͷଞϓϩμΫτ Kinesis Stream Kinesis Stream ϩάऩूύʔτ ϩάॲཧύʔτ Ξϥʔτॲཧύʔτ CloudWatch Logs/Event, GuardDuty, CloudTrail
ϩάॲཧύʔτ wϑΝΠϧੜΠϕϯτͷॲཧ 4ˠ-BNCEBˠ,JOFTJT4USFBN w 4ͷ$SFBUF0CKFDUΠϕϯτΛ-BNCEBͰड͚ͯ,JOFTJT4USFBNʹྲྀ͢ w -BNCEBʹϩάྲྀͣ͞ʹ4্ͷϑΝΠϧͷΩʔͳͲ࠷ݶͷ
ใ͚ͩΛྲྀ͢ w ,JOFTJT4USFBNͰΠϕϯτใΛड͚औͬͨޙଓͷ-BNCEB͕4ͷ ϑΝΠϧΛಡΈࠐΈϩάσʔλΛऔಘ͢Δ ϩάϑΝΠϧઃஔͷ ΠϕϯτΛݕग़ Lambda Lambda Kinesis Stream ϧʔϧΛ༻͍ͨ Ξϥʔτͷݕ ϩάͷม Kinesis Stream
ϩάॲཧύʔτ wϩάͷมUP(SBZMPH w ,JOFTJT4USFBN͔ΒϩάϑΝΠϧઃஔͷΠϕϯτΛड͚औͬͨޙɺ ϑΝΠϧΛ4͔ΒಡΈऔΔˠϩάͷύʔεˠ(SBZMPHసૹ w ύʔαࣗલͰ༻ҙ4ͷόέοτʴύεͰϑΥʔϚοτΛผ w (SBZMPHͷ(&-'ܗࣜʹมͨ͠ޙ5$1Ͱసૹ
wϩάͷมUP"UIFOB w -BNCEBͰ"UIFOBʹରԠͨ͠+40/ܗࣜʹม w (MVFΛͬͨมʹͰ͖ͳ͍͔ݕ౼த ϩάϑΝΠϧઃஔͷ ΠϕϯτΛݕग़ Lambda Lambda Kinesis Stream ϧʔϧΛ༻͍ͨ Ξϥʔτͷݕ ϩάͷม Kinesis Stream
Ξϥʔτॲཧύʔτ w(JU)VC&OUFSQSJTF ()& Λใूͷجʹ w Ξϥʔτ͕ݕ͞ΕͨΒ()&ʹ*TTVFΛͨͯͯɺͦ͜ʹؔ࿈ใΛί ϝϯτͱͯ͠ه͠ूதͤ͞Δ wؔ࿈ใͷࣗಈऩू w 7JSVT5PUBMͰͷݕࡧɺ(SBZMPHͰͷؔ࿈ϩάͷݕࡧͳͲఆܗ࡞ۀͳ
ͷͰࣗಈͰ()&ʹίϝϯτͤ͞Δ w௨ϝʔϧ 4MBDL w ηΩϡϦςΟάϧʔϓͰϩʔςʔγϣϯ Ξϥʔτͷൃใ GHE PagerDuty Slack Ξϥʔτͷௐࠪ Kinesis Stream
ӡ༻ͷ༷ࢠ
1BHFS%VUZ͕ൃใ ʢϝʔϧ4MBDLʣ
Ξϥʔτ()&ͷ *TTVFͱͯ͠ىථ
7JSVT5PUBMͷ ใࣗಈͰه
(SBZMPH͔ΒϩάΛநग़ ˍ ৽ͨͳϩάࢀরͰ͖ΔΑ ͏ʹΫΤϦ63-Λίϝϯτ
ඞཁʹԠͯ͡(SBZMPH ͰΞϥʔτͷৄࡉௐࠪ ·ͨ *OEJDBUPS͕ྲྀΕ͖ͯͨ ͱ͖ʹΫΠοΫʹௐࠪ
ௐࠪɾੳ݁ՌΛ ίϝϯτͱͯ͠ ॻ͖͢͜ͱͰ ݟΛڞ༗
Thank you