Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
最近やってる、サーバーレスでデータ分析基盤を構築している話 / 20230916-nds63
Search
kasacchiful
September 16, 2023
Programming
0
100
最近やってる、サーバーレスでデータ分析基盤を構築している話 / 20230916-nds63
第63回 長岡IT開発者勉強会 (NDS#63) で発表した資料。
https://sites.google.com/site/ndssite/no63
kasacchiful
September 16, 2023
Tweet
Share
More Decks by kasacchiful
See All by kasacchiful
dbt coreとFargateでデータ変換 / 20240928-jawsug-toyama-hokuriku-shinkansen
kasacchiful
1
29
What we keep in mind when migrating from Serverless Framework to AWS CDK and AWS SAM
kasacchiful
1
190
AWSでIcebergを使ってデータウェアハウスを構築してみる / 20240810-jawsug-akita
kasacchiful
0
22
サーバーレスパターンを元にAWS CDKでデータ基盤を構築する / 20240731_classmethod_odyssey_online_build_a_data_infrastructures_using_aws_cdk_based_on_serverless_patterns
kasacchiful
0
360
AWS IoT 1-clickがサービス終了するので、SORACOMに移行した話 / 20240518-jawsug-niigata-iotlt-niigata
kasacchiful
0
180
AWS Application Composerで始める、 サーバーレスなデータ基盤構築 / 20240406-jawsug-hokuriku-shinkansen
kasacchiful
1
490
AWSの各種サービス紹介と活用方法 − AI・ML活用デモを交えて − / 20231208aws-aiml-seminar
kasacchiful
0
480
Amazon Rekognition デモ / 20231208-aws_seminar-01-rekognition-demo
kasacchiful
0
490
Amazon Lookout for Vision デモ / 20231208-aws_seminar-02-lookout-vision-demo
kasacchiful
0
480
Other Decks in Programming
See All in Programming
Vue SFCのtemplateでTypeScriptの型を活用しよう
tsukkee
3
420
20241004 モノタロウ式~ドメインモデリングとリアーキテクチャ
monotaro
PRO
2
660
Folding Cheat Sheet #8
philipschwarz
PRO
0
130
組織に自動テストを書く文化を根付かせる戦略(2024秋版) / Building Automated Test Culture 2024 Autumn Edition
twada
PRO
8
3.5k
Honoの来た道とこれから
yusukebe
6
870
tc39 x jsconf.jp Panel Discussion 2024
yosuke_furukawa
PRO
0
110
文化が生産性を作る
jimpei
3
620
いかにして不足・不整合なくデータ移行したか
tjmtmmnk
1
850
Serverless renderování Webových komponent
rarous
PRO
0
130
Micro Frontends for Java Microservices - dev2next 2024
mraible
PRO
0
230
Memory API: Patterns, Use Cases, and Performance
josepaumard
2
200
画像でわかる北島直樹
naoki0917
0
110
Featured
See All Featured
Building Applications with DynamoDB
mza
90
6k
Build The Right Thing And Hit Your Dates
maggiecrowley
32
2.3k
How GitHub (no longer) Works
holman
311
140k
Imperfection Machines: The Place of Print at Facebook
scottboms
264
13k
What's in a price? How to price your products and services
michaelherold
243
11k
The Straight Up "How To Draw Better" Workshop
denniskardys
232
130k
Building Your Own Lightsaber
phodgson
102
6k
Making the Leap to Tech Lead
cromwellryan
131
8.9k
Navigating Team Friction
lara
183
14k
Principles of Awesome APIs and How to Build Them.
keavy
126
17k
Raft: Consensus for Rubyists
vanstee
136
6.6k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
46
2.1k
Transcript
࠷ۙͬͯΔɺαʔόʔϨεͰ σʔλੳج൫Λߏங͍ͯ͠Δ͓ ൛ ּݪ /%4
ࣗݾհ @kasacchiful @kasacchiful ּݪ wΫϥεϝιουגࣜձࣾσʔλΞφϦςΟΫεࣄۀຊ෦ w৽ׁݝ৽ׁࢢࡏॅ w͖ͳ"84αʔϏε4ɺ-BNCEBɺ4BHF.BLFS w+"846(৽ׁࢧ෦ʗ1ZUIPOػցֶशษڧձJO৽ׁʗ+B445৽ׁ ʗ48"/**ʗ$MPVE
fl BSF.FFUVQ/JJHBUBʗFUD w"84$PNNVOJUZ#VJMEFS+BQBO"84"MM $FSUJ fi DBUJPOT&OHJOFFS
࣍ wσʔλੳج൫ΛαʔόʔϨεͰ w࠷͓ۙؾʹೖΓͷαʔϏε w·ͱΊ
͢͜ͱ wσʔλΛੳ͢ΔͨΊͷલॲཧΛߦ͏ͨΊͷج൫࡞ͬͯ·͢ w΄ͱΜͲαʔόʔϨεߏͳͷͰɺͦΕΛ͝հʢྫ֎͋Γ w΄΅"84
σʔλੳج൫ΛαʔόʔϨεͰ
࠷ۙΑ͘͏αʔϏε 4 -BNCEB 4UFQ'VODUJPOT (MVF "UIFOB
*P5ηϯαʔσʔλϑΝΠϧΛ-BNCEBͰฒྻՃ
֤छ%#σʔλΛ(MVFͰऔಘͯ͠#JH2VFSZ
ػثใ%#͔ΒσʔλՃͯ͠ՄࢹԽ
ػثใ%#͔ΒσʔλՃͯ͠ՄࢹԽ
࿈ܞσʔλϑΝΠϧ͕དྷͨΒ(MVFˠ3FETIJGU
ߟ͍͑ͯΔ͜ͱɺ͍͍ͩͨҰॹ ͍ۙ༰͕"84#MPHʹࡌͬͨ IUUQTBXTBNB[PODPNKQCMPHTCJHEBUB CVJMEBOFUMQSPDFTTGPSBNB[POSFETIJGUVTJOHBNB[POTFWFOUOPUJ fi DBUJPOTBOEBXTTUFQGVODUJPOT
࠷͓ۙؾʹೖΓͷαʔϏε
(MVFGPS3BZʹظ IUUQTEFWDMBTTNFUIPEKQBSUJDMFTBXTHMVFGPSSBZHFOFSBMMZBWBJMBCMF
1BOEBTͱ΄ͱΜͲมΘΒͳ͍ײ͡Ͱฒྻࢄॲཧ
·ͩ71$ͷϓϥΠϕʔτଓͰ͖ͳ͍͚Ͳ IUUQTEFWDMBTTNFUIPEKQBSUJDMFTBXTHMVFGPSSBZHFOFSBMMZBWBJMBCMF
3FETIJGU"VSPSBͳΒɺ%BUB"1*͕͑Δ IUUQTEFWDMBTTNFUIPEKQBSUJDMFTUSZVTJOHSFETIJGUEBUBBQJPOHMVFGPSSBZ
"844%,GPS1BOEBT "848SBOHMFS ͏ͱ؆୯ IUUQTEFWDMBTTNFUIPEKQBSUJDMFTUSZVTJOHSFETIJGUEBUBBQJPOHMVFGPSSBZ
ެ։ࡁ %FWFMPQFST*0ϏσΦηογϣϯ Glue for Rayを使ってみよう 3435/7/5 データアナリティクス事業本部 笠原 宏
·ͱΊ
·ͱΊ w࠷ۙαʔόʔϨεͰσʔλੳج൫Λߏங͢Δػձ͕ଟ͍ Ͱ͢ w(MVFGPS3BZʹظͯ͠·͢
એ
+B445`/JJHBUB։࠵ w ۚ wਃࠐडऴྃ͠·ͨ͠
1ZUIPOػցֶशษڧձJO৽ׁۙ։࠵༧ఆ wळ w$IBU(15"1*Λͬͨੜ"*ϋϯζΦϯ