Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
ECS+S3でスクレイピングを試してみた
Search
sug1t0m0
July 05, 2019
Programming
0
1k
ECS+S3でスクレイピングを試してみた
sug1t0m0
July 05, 2019
Tweet
Share
More Decks by sug1t0m0
See All by sug1t0m0
単純パーセプトロンで遊んでみたかった
sug1t0m0
0
720
20181130.pdf
sug1t0m0
0
700
渡る世間はナベばかり」でカルタ遊びをしてみての感想(大津の手法で「ナベ」カードを検出してみた)
sug1t0m0
0
880
Other Decks in Programming
See All in Programming
C++20 射影変換
faithandbrave
0
560
Flutterで備える!Accessibility Nutrition Labels完全ガイド
yuukiw00w
0
140
システム成長を止めない!本番無停止テーブル移行の全貌
sakawe_ee
1
160
関数型まつりレポート for JuliaTokai #22
antimon2
0
160
すべてのコンテキストを、 ユーザー価値に変える
applism118
2
1.1k
PostgreSQLのRow Level SecurityをPHPのORMで扱う Eloquent vs Doctrine #phpcon #track2
77web
2
480
なぜ「共通化」を考え、失敗を繰り返すのか
rinchoku
1
620
Team operations that are not burdened by SRE
kazatohiei
1
290
High-Level Programming Languages in AI Era -Human Thought and Mind-
hayat01sh1da
PRO
0
710
新メンバーも今日から大活躍!SREが支えるスケールし続ける組織のオンボーディング
honmarkhunt
3
1.3k
CursorはMCPを使った方が良いぞ
taigakono
1
220
ruby.wasmで多人数リアルタイム通信ゲームを作ろう
lnit
3
350
Featured
See All Featured
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
233
17k
Unsuck your backbone
ammeep
671
58k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
281
13k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
PRO
20
1.3k
How to train your dragon (web standard)
notwaldorf
94
6.1k
Site-Speed That Sticks
csswizardry
10
680
A designer walks into a library…
pauljervisheath
207
24k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
48
5.4k
Learning to Love Humans: Emotional Interface Design
aarron
273
40k
KATA
mclloyd
30
14k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
chriscoyier
507
140k
Gamification - CAS2011
davidbonilla
81
5.3k
Transcript
ECS+S3Ͱ εΫϨΠϐϯάΛࢼͯ͠Έͨ @sug1t0m0_agrict
ࣗݾհ ΤϯδχΞྺ - ϑϩϯτΤϯυ : 1 झຯ - ͓ञ αοΧʔ
ྉཧ ͓ञ ਿࢁ ஐ @sug1t0m0_agrict
ૣɺຊʹ
Ϟνϕʔγϣϯ - PythonͰαΠτΛεΫϨΠϐϯά͢ΔΞϓϦέʔγϣϯΛ࡞ - PythonϩʔΧϧڥΛԚછ͢Δ(Πϝʔδ)ͳͷͰ։ൃڥʹDockerΛબ - Ϋϩʔϥͱͯ͠ϔουϨεϒϥβΛར༻͔ͨͬͨ͠ͷͰɺίϯςφؒ௨৴ ͷ؆୯ԽͷͨΊʹαʔϏεΛ·ͱΊΔ͜ͱʹ ↓ -
2ίϯςφͰ1αʔϏε - ఆظ࣮ߦͱ͔ࢼͯ͠Έ͍ͨ ↓ ECS(ىಈλΠϓFargate)ʹσϓϩΠ (ͨ͠Β͍͍Μ͡Όͳ͍͔ͱࢥͬͨ)
ཧͷܗ
ݱ࣮ͷ
ͬͨ͜ͱ - εΫϨΠϐϯάΞϓϦέʔγϣϯΛDockernize - Ϋϥελ͔Β্هͷDockerίϯςφΛىಈ͢ΔλεΫΛ࣮ߦ - ϩάΛCloudWatchʹग़ྗ - εΫϨΠϐϯάͷग़ྗ݁ՌΛS3ʹอଘ -λεΫͷఆظ࣮ߦ
ݱঢ়
ϋϚͬͨͱ͜Ζ
λεΫ࣮ߦϩʔϧͷϙϦγʔΛΞλονͰ͖ͳ͍ - νϡʔτϦΞϧ: Amazon ECS CLI Λ༻ͯ͠ Fargate λεΫͷΫϥελʔΛ࡞͢ΔΛࢀߟʹ࡞ۀΛਐΊͯ ͍͕ͨҎԼͷίϚϯυ͕͏·࣮͘ߦ͞Εͳ͔ͬͨ
aws iam --region us-west-2 attach-role-policy - -role-name ecsTaskExecutionRole --policy-arn arn:aws:iam::aws:policy/service-role/AmazonECSTaskExecutionRolePolicy
ίϯςφʹڥมΛ͢ - Ϋϥελઃఆը໘͔ΒλεΫఆٛΛબ͠ ͯλεΫΛબ͢Δͱ͖ʹʮίϯςφͷ্ॻ ͖ʯ͔ΒڥมΛઃఆՄೳ
ϓϩηε͕ࢮΜͰκϯϏΈ͍ͨʹ ίϯςφ্ཱ͕͕ͪΔ - αʔϏεΛఆٛ͢Δ͜ͱʹΑΓɺΦʔτε έʔϧίϯςφ͕͚ͨ͜߹ʹ࠶ىಈ͞Ε Δతͳ͜ͱ͕ॻ͍͕ͯ͋ͬͨ͜Ε͕ݪҼ?
ఆظ࣮ߦՄೳͩͬͨ - λεΫͷఆظ࣮ߦΫϥελͷઃఆը໘͔ ΒઃఆՄೳ - cronه๏༻Մೳ
Ռ
·ͱΊ
·ͱΊ - S3ͷΞΫηεΩʔΛڥมͱͯ͠ίϯςφʹ ͕ͨ͠, ͬͱ͍͍ํ๏͕͋Δͣ - 1λεΫͰىಈ͢ΔίϯςφΛ૿ͯ͠ίϯς φؒ௨৴Λࢼͯ͠Έ͍ͨ - ecs-cli
up ίϚϯυͰαϒωοτ͕2ͭఆٛ͞Ε ͨVPC͕ੜ͞ΕΔͷԿނͳͷ͔? (azʹґଘ͢ΔΒ͍͠ɺ࣭ٙԠͷ࣌ؒʹղܾ)