Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Lakehouseプラットフォームを 採用するまでの話/Lakehouse Platform ...
Search
Sponsored
·
Ship Features Fearlessly
Turn features on and off without deploys. Used by thousands of Ruby developers.
→
Masatoshi Shimada
May 26, 2021
Programming
1.1k
1
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Lakehouseプラットフォームを 採用するまでの話/Lakehouse Platform Adoption
Masatoshi Shimada
May 26, 2021
Transcript
12 slides
σʔλΣΞϋεੈผ -BLFIPVTFϓϥοτϑΥʔϜΛ ࠾༻͢Δ·Ͱͷ ౡాխ JEDAI ୈೋճ: DeltaΛ͍͓ͨͨ͠ײ
ࣗݾհ w ౡాխ!TNENUT w %8)ΞʔΩςΫτσʔλΞφϦετ w 4DBMBc1ZUIPOc+BWBc(PMBOHc%%% w
גࣜձࣾΤϒϦʔॴଐ w ։ൃຊ෦%"5""*άϧʔϓ.(3
࣍ dͷؒͰσʔλϨΠΫσʔλΣΞϋεͷ &5-&-5ॲཧΛ߹ܭճϦϑΝΫλϦϯά͍ͯ͠·͢ɻ -BLFIPVTFϓϥοτϑΥʔϜ࠾༻·ͰͷಓͷΓΛ͓͠͠·͢ɻ
ୈҰੈd&5- w &NCVML&.3Λར༻ͯ͠&5-ॲཧ͢ΔΈ w 1SPTൺֱతγϯϓϧͳσʔλϑϩʔ ҰఆֹۚͰεΩϟϯՄೳͳܭࢉج൫ͷఏڙ w $POT&NCVML.BQ3FEVDF&YFDVUPSͷকདྷੑʹෆ҆
ୈҰੈd%BTICPBSE w ߏԽσʔλͷશΠϕϯτϩάͷ3"8ςʔϒϧΛࢀর͢Δํࣜ w 1SPTҰͭͷςʔϒϧΛࢀর͢Εྑ͍ w $POT3"8ςʔϒϧංେԽʹΑΔίετͷઢܗ૿Ճ
ୈೋੈ&5- w "QBDIF4QBSL%BUBCSJDLTʹΑΔ&5-ॲཧͷಋೖ w 1SPTΠϯϑϥ؍Ͱͷ&5-ॲཧͷεέʔϧԽ σʔλϑϩʔ/PUFCPPLԽʹΑΔσόοάͷίετԽ w $POT+40/-1BSRVFUͷυϝΠϯࣝͷൃࢄʢڽूʣ &5-ॲཧதͷ614&35ܥॲཧ࣮͕ߴίετ
ୈೋੈ%BTICPBSE w ΠϕϯτςʔϒϧͷϑϧεΩϟϯΛ༰ೝ͢Δํࣜ w 1SPTΠϕϯτςʔϒϧͷυϝΠϯׂʹΑΔॲཧߴԽ ୳ࡧతσʔλੳՄೳͳνʔϜͷεέʔϧԽʢ1E.ɺ&OHɺ4BMFTʣ w $POTΠϕϯτςʔϒϧ૿ՃʹΑΔίετͷઢܗ૿Ճ
ୈࡾੈ&5- w %BUBCSJDLT%FMUBʹΑΔϝμϦΦϯΞʔΩςΫνϟͷಋೖ w 1SPT%FMUBʹΑΔ&5-ॲཧͷ࣮ίετͷίετԽ ɹɹɹɹɹϝμϦΦϯΞʔΩςΫνϟʹΑΔυϝΠϯࣝͷߴڽूԽͱૄ݁߹Խ σʔλαΠΤϯεͳͲͷυϝΠϯࣝར༻ͷεέʔϧԽ w $POTσʔλύΠϓϥΠϯͷߏෳࡶԽͱσʔλஔॴͷൃࢄ
ୈࡾੈ%BTICPBSE w ΠϕϯτςʔϒϧͷϑϧεΩϟϯΛ༰ೝ͢Δํࣜ w 1SPTΠϕϯτςʔϒϧͷυϝΠϯׂʹΑΔॲཧߴԽ ୳ࡧతσʔλੳՄೳͳνʔϜͷεέʔϧԽʢ1E.ɺ&OHɺ4BMFTʣ w $POTΠϕϯτςʔϒϧ૿ՃʹΑΔίετͷઢܗ૿Ճ ୈೋੈͱมߋແ͠
ୈ࢛ੈ&5- w -BLFIPVTFϓϥοτϑΥʔϜͷಋೖ w 1SPTϝμϦΦϯΞʔΩςΫνϟʹΑΔυϝΠϯࣝͷߴڽूૄ݁߹ͷଅਐ w $POT΄΅ແ͠
ୈ࢛ੈ %BTICPBSE w -BLFIPVTFϓϥοτϑΥʔϜ 42-"OBMZUJDTͷ࠾༻ʢ10$தʣ w 1SPTσʔλιʔεͷ΄΅શͳ4405Խ w $POTݱߦͱಉ͡ॲཧੑೳͱ͢Δʹڧ͍ΠϯελϯελΠϓ͕ඞཁ
͝ਗ਼ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠
More Decks by Masatoshi Shimada
See All by Masatoshi Shimada
データプラットフォーム技術におけるメダリオンアーキテクチャという考え方/DataPlatformWithMedallionArchitecture
smdmts
12
4.4k
Delta Lakeを用いた LLM処理基盤 / Delta Lake with LLM on Dataplatform
smdmts
3
9.4k
Sparkから利用するAirframe/Spark-With-Airframe
smdmts
0
1.9k
Redashで何をみるのか/What Do You Wanna See Redash?
smdmts
1
1.9k
DatabricksとSparkではじめる [ビッグデータETL処理/データ可視化] 実践入門 / Databricks and Spark with ETL and Visualization
smdmts
1
1.8k
DatabricksとSparkではじめる [データ分析/機械学習] 実践入門 / Databrick and Spark with Data Analyze and ML for newbie.
smdmts
6
2.5k
作らない分析基板のススメ/DWH For Startup With YAGNI
smdmts
1
850
エンジニアのためのドメイン駆動設計実践入門 / DDD for Engineer newbie
smdmts
18
4k
How to growth the delish kitchen team to data-driven team
smdmts
1
1.2k
Other Decks in Programming
See All in Programming
Goコンパイラを作ってGoをもっと理解する / Build a Go compiler to better understand Go
ikura_hamu
0
130
動画プレイヤーはなぜカクつくのか 〜Flutterのレンダリングとネイティブの境界を解剖する〜
naruogram
0
340
Kawaiicon: Kubernetes, it's no longer cool, but let's secure it anyway!
barnbarn
0
140
SODA - FACT BOOK(JP)
sodainc
1
40k
あなたはMCPの機能を、まだ知らない。
4geru
1
690
Spec-driven Development with AI
simas
PRO
0
2.3k
Distance field of Julia set
kinakomoti321
0
330
Crash Auto Pipelines
veronikapj
1
440
地方こそサーバーレス — 10年続けた、顔が見えるチームで確かな基盤を / Serverless Matters Most in Regional Areas — 10 Years of Building Reliable Foundations with Close-Knit Teams
seike460
PRO
2
500
AI時代のFlutter品質設計 — アプリ品質を守るQuality Layers
omatty198
0
390
Spec-Driven Development - Why Vaadin Is the Perfect Fit
simas
PRO
0
260
クラウドエージェントは、 何がそんなに便利なのか / what makes cloud agents so useful
rkaga
5
940
Featured
See All Featured
SEOcharity - Dark patterns in SEO and UX: How to avoid them and build a more ethical web
sarafernandez
0
340
Impact Scores and Hybrid Strategies: The future of link building
tamaranovitovic
0
490
Well, that’s weird…
csswizardry
1
110
Navigating Team Friction
lara
192
16k
Java REST API Framework Comparison - PWX 2021
mraible
34
9.8k
Designing for Performance
lara
612
70k
Breaking role norms: Why Content Design is so much more than writing copy - Taylor Woolridge
uxyall
2
540
Music & Morning Musume
bryan
48
7.5k
Data-driven link building: lessons from a $708K investment (BrightonSEO talk)
szymonslowik
1
1.4k
Gemini Prompt Engineering: Practical Techniques for Tangible AI Outcomes
mfonobong
2
640
世界の人気アプリ100個を分析して見えたペイウォール設計の心得
akihiro_kokubo
PRO
74
43k
Facilitating Awesome Meetings
lara
57
7.2k