Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up for free
jaws-ug-asa-datasync-20220510
h-ashisan
May 10, 2022
Technology
0
520
jaws-ug-asa-datasync-20220510
h-ashisan
May 10, 2022
Tweet
Share
More Decks by h-ashisan
See All by h-ashisan
20220523_akibaaws-online-08-s3
hiashisan
0
110
jaws-ug-asa_ivs_20220129
hiashisan
1
470
20211206_jaws-ug_asa_backup
hiashisan
0
980
JAWS-UG_CLI_Setup_SSM_20211028
hiashisan
0
500
20210930_JAWS-UG朝会_AWS公式10分チュートリアルから始めるアウトプット〜AWS StepFunctions編〜
hiashisan
1
960
Other Decks in Technology
See All in Technology
信頼性の階層の一段目を積み上げる/Monitoring Dashboard
shonansurvivors
0
190
メタバースと経済圏
sbtechnight
0
110
BFFとmicroservicesアーキテクチャ
hirac1220
0
110
セマフォでタスクの同時実行数制限
hankehly
0
140
Stripe Search APIを利用した、LINEとStripeの顧客情報連携/line-dc-202205
stripehideokamoto
0
130
[SRE NEXT 2022]メルカリグループにおけるSREs
srenext
0
670
モダンデータスタックとかの話(データエンジニアのお仕事とは)
foursue
0
500
E2E自動テスト導入・運用をめぐる先入観と実際に起きたこと / Preconceptions and What Happened with E2E Testing
ak1210
6
1.4k
SRENEXT2022 組織にSREを実装していくまでの道のり
marnie0301
1
910
統計学と機械学習の違いと接点とは?
ueniki
0
260
⚡Lightdashを試してみた
k_data_analyst
0
220
toilを解消した話
asumaywy
0
220
Featured
See All Featured
Large-scale JavaScript Application Architecture
addyosmani
499
110k
ReactJS: Keep Simple. Everything can be a component!
pedronauck
655
120k
Bash Introduction
62gerente
596
210k
VelocityConf: Rendering Performance Case Studies
addyosmani
316
22k
KATA
mclloyd
7
8.6k
For a Future-Friendly Web
brad_frost
164
7.4k
Building Better People: How to give real-time feedback that sticks.
wjessup
343
17k
No one is an island. Learnings from fostering a developers community.
thoeni
9
1.1k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
119
28k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
15
920
Writing Fast Ruby
sferik
612
57k
Web development in the modern age
philhawksworth
197
9.3k
Transcript
AWS DataSyncΛߏங/ӡ༻ͯ͠Θ͔ͬͨ͜ͱ +"846(ேձ ͋͠͞Μ )JSPBLJ"TIJ[BXB
ࣗݾհ ͋͠͞Μ / Ἑত • ॴଐɿΫϥεϝιουגࣜձࣾ • Twitterɿ@ashi_ssan •
͖ͳαʔϏεɿ • AWS WAF • Media Services
"84%BUB4ZODʹ͍ͭͯ͠·͢
ຊ͢͜ͱ ɾAWS DataSyncͱʁ ɾߏஙͯ͠Έͯؾ͍ͮͨ͜ͱ ɾӡ༻ͯ͠ΈͯΘ͔ͬͨ͜ͱ ɾ·ͱΊ
AWS DataSyncͱʁ
"84%BUB4ZODͱʁ ҎԼΑ͏ͳσʔλసૹΛ؆୯ʹ࣮ߦͰ͖ΔαʔϏε - ΦϯϓϨϛε-AWSετϨʔδαʔϏεؒ - AWSετϨʔδαʔϏε-AWSετϨʔδαʔϏεؒ etc…
"84%BUB4ZODͷ͍͍ͱ͜Ζ ɾߴσʔλసૹ - Ϛϧνηογϣϯɺ௨৴σʔλѹॖɺϩʔυόϥϯε ɾ؆қͳૢ࡞ੑ - ΤʔδΣϯτɺ̏εςοϓઃఆɺεέδϡʔϧઃఆ ɾηΩϡΞͰߴ৴པͳ௨৴ -
TLS௨৴ɺอଘ࣌σʔλ҉߸Խ ɾίετ - సૹͨ͠σʔλྔͷΈʹ՝ۚ(౦ژɿ0.0125USD/GiB)
ྨࣅαʔϏεͱͷ͍͚ ɾDataSync - ΦϯϥΠϯͰେྔϑΝΠϧΛҠಈ ɾSnowball Edge(Snow Family) - ΦϑϥΠϯͰେྔͷϑΝΠϧΛҠಈ
ɾStorage Gateway - ΫϥυετϨʔδͷΞΫηεΛఏڙ
ྨࣅαʔϏεͱͷ͍͚
ӡ༻ͯ͠ΈͯΘ͔ͬͨ͜ͱ
ӡ༻ͯ͠ΈͯΘ͔ͬͨ͜ͱ ɾλεΫ࣮ߦ͕ࣦഊͯ͠௨͞Εͳ͍(͜ͱ͕͋Δ) - EventBridge + SNS(ϝʔϧ)ͰλεΫͷঢ়ଶࢹΛઃఆ ɿλεΫ࣮ߦεςʔλε=“Error”ͰτϦΨʔ - λεΫ͕ࣦഊ(ΤʔδΣϯτҟৗʹΑΔͷ)ͨ͠ͷʹ௨
͞Εͳ͍ࣄҊ͕ൃੜ → ͳͥͰ͠ΐ͏ʁ
Կ͕ى͖͍͔ͯͨ ɾެࣜυΩϡϝϯτʮλεΫ࣮ߦεςʔλε:Errorʯͷ߲ʹ ҎԼͱهड़͞Ε͍ͯͨ ͜ͷσʔλసૹ͕ࣦഊͨ͠ͱ͖ʹฦ͞Ε·͢ɻ 7FSJGZ.PEFΦϓγϣϯ͕ઃఆ͞Ε͍ͯͳ͍߹ɺ͜ͷεςʔλε <53"/4'&33*/( సૹத >ϑΣʔζͷޙʹੜ͡·͢ɻͦΕҎ֎ͷ ߹ɺ<7&3*':*/(
ݕূத >ϑΣʔζͷޙʹੜ͡·͢ɻ ࢀߟURLɿhttps://docs.aws.amazon.com/ja_jp/datasync/latest/userguide/working-with-task-executions.html
ʮ53"/4'&3*/(ʯϑΣʔζͱ
ʮ53"/4'&3*/(ʯϑΣʔζͱ ΤʔδΣϯτҟৗ͜͜ Ͱఆͯͦ͠͏
Ͳ͏ͬͯରॲ͔ͨ͠ ɾҎԼͷ̎Ͱݕ౼ - λεΫͷޭ(Success)Ͱ௨ͤ͞Δ - λεΫͷޭϝʔϧ͕དྷͳ͘ͳΔ͜ͱͰҟৗೝఆ͢Δ - ͦͷ··ʹ͢Δ -
ΤʔδΣϯτҟৗͷύλʔϯผ్ΤʔδΣϯτͷεςʔλεͰ௨ઃ ఆ͢Δ͜ͱͰΧόʔ → ޙऀΛબɻ - ͦͷଞࠓى͖͍ͯͳ͍ྫ֎௨͞Εͳ͍͜ͱΛڐ༰ͨ͠
ɾλεΫͷঢ়ଶࢹઃఆʹ͍ͭͯϒϩάʹ·ͱΊ·ͨ͠
·ͱΊ ɾDataSyncߴɾ؆୯ɾηΩϡΞʹΦϯϓϨϛε→AWSσʔλ Λૹ৴Ͱ͖ΔαʔϏε ɾλεΫͷ࣮ߦεςʔλεΛࢹ͢Δ߹ɺ௨Ͱ͖ͳ͍ύλʔ ϯʹ͍ͭͯϑΥϩʔͰ͖ΔΑ͏ʹઃܭ͠Α͏
ΧδϡΞϧ໘ஊͬͯ·͢ Ϋϥεϝιουࢲ(?)ʹڵຯͷ͋Δํɺ͓͠͠·͠ΐ͏
None