$30 off During Our Annual Pro Sale. View Details »

Sparkから利用するAirframe/Spark-With-Airframe

Masatoshi Shimada
October 23, 2019
Technology
0
1k

 Sparkから利用するAirframe/Spark-With-Airframe

Masatoshi Shimada

October 23, 2019
Tweet

More Decks by Masatoshi Shimada

See All by Masatoshi Shimada
Lakehouseプラットフォームを 採用するまでの話/Lakehouse Platform Adoption
smdmts
0
430
Redashで何をみるのか/What Do You Wanna See Redash?
smdmts
1
1k
DatabricksとSparkではじめる [ビッグデータETL処理/データ可視化] 実践入門 / Databricks and Spark with ETL and Visualization
smdmts
0
1.2k
DatabricksとSparkではじめる [データ分析/機械学習] 実践入門 / Databrick and Spark with Data Analyze and ML for newbie.
smdmts
4
1.6k
作らない分析基板のススメ/DWH For Startup With YAGNI
smdmts
1
500
エンジニアのためのドメイン駆動設計実践入門 / DDD for Engineer newbie
smdmts
18
3.1k
How to growth the delish kitchen team to data-driven team
smdmts
1
930
etl-in-the-media-company
smdmts
7
5k
スケーラブルシステムの実現に向けて
smdmts
0
690

Other Decks in Technology

See All in Technology
SwiftUI in LINE LIVE iOS - Technology Selection and Implementation
techverse_2022
PRO
0
190
[CNDT2022] 実践！OpenTelemetry と OSS を使った Observability 基盤の構築
k6s4i53rx
1
180
はじめよう Kubernetes PersistentVolume のバックアップ
ysakashita
2
240
如何建立自己的開源專案
line_developers_tw
PRO
0
800
XP入門と私 / Introduction_of_extream_programming_and_I
fatsushi
0
200
ROS jp 2022/11/21 What's the zenoh?
s_hosoai
0
290
Web Runtime
dynamis
5
1.7k
いにしえのエンプラ情シスが内製化ではなくアーキテクトの「手の内化」を推進した話
minorun365
1
300
Flink@Data Platform - Ingestion Pipeline Redesign and Auto-scaling
techverse_2022
PRO
1
270
効率良く開発を進められる閉域 Azure Machine Learning 環境
shuntaito
1
260
Technologies that Support the Data Solution Business
techverse_2022
PRO
0
290
Kaggle Days Championship Final 2022 参加報告
dena_tech
PRO
0
390

Featured

See All Featured
The Web Native Designer (August 2011)
paulrobertlloyd
76
2.1k
The Art of Programming - Codeland 2020
erikaheidi
35
11k
Mobile First: as difficult as doing things right
swwweet
213
7.7k
Building an army of robots
kneath
301
40k
Imperfection Machines: The Place of Print at Facebook
scottboms
254
12k
Web Components: a chance to create the future
zenorocha
304
40k
What’s in a name? Adding method to the madness
productmarketing
11
1.8k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
danielanewman
215
20k
Reflections from 52 weeks, 52 projects
jeffersonlam
337
18k
WebSockets: Embracing the real-time Web
robhawkes
58
5.9k
Creatively Recalculating Your Daily Design Routine
revolveconf
207
11k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
37
3.5k

Transcript

  1. 4QBSLXJUI"JSGSBNF ౡాխ೥!TNENUT "JSGSBNF.FFUVQ

  2. ࣗݾ঺հ w ౡాխ೥!TNENUT w %8)ΞʔΩςΫτσʔλΞφϦετ w  4DBMBc1ZUIPOc+BWBc(PMBOHc%%%  w

    גࣜձࣾΤϒϦʔॴଐ w ։ൃ෦%"5""*νʔϜ.(3

  3. 4QBSLͰར༻͍ͯ͠Δɺ "JSGSBNFϞδϡʔϧͷ࿩Λ͠·͢ ΞδΣϯμ

  4. ຊ೔঺հ͢ΔϞδϡʔϧ BJSGSBNFNFUSJDT BJSGSBNFDPEFD BJSGSBNFDPOUSPM

  5. BJSGSBNFNFUSJDT ࣌ܥྻσʔλ͸૬ର࣌ؒΛѻ͏࣮૷͕සग़͢Δ KBWBUJNF͸ׂͱ໘౗ʢੲʹൺ΂ָʹͳͬͨͱ͸͍͑ʣ λΠϜκʔϯͷ࣮૷ϛεͳͲͰΤϯόά͢Δ͜ͱ͕͋Δ 4QBSL͸࣌ܥྻσʔλΛසൟʹѻ͏

  6. BJSGSBNFNFUSJDT 3FMBUJWF5JNF8JOEPXT 4QBSL42-Ͱ΋5%@*/5&37"-ͷΑ͏ͳ͜ͱ͕࣮૷Ͱ͖Δ

  7. BJSGSBNFDPEFD 4QBSLΫϥελؒͷ௨৴͸௨ৗετϦʔϛϯάͰߦ͏ ,JOFTJTͷ৔߹͸ɺ,$-Λར༻͢Δ͕4FS%F͕ඞཁ ௨ৗ͸4FS%Fʹ+40/Λར༻͢Δ͕ɺߴ଎ͩͱͳ͓ྑ͍ 4QBSLؒ௨৴Λߦ͍͍ͨ͜ͱ͕͋Δ

  8. BJSGSBNFDPEFD 1VCMJTIFSʢૹ৴ଆʣ 8PSLFSͷλεΫຖʹ,$-ΛΠϯελϯεԽ BJSGSBNFDPEFDͰγϦΞϥΠζ

  9. BJSGSBNFDPEFD $POTVNFSʢड৴ଆʣ BJSGSBNFDPEFDͰσγϦΞϥΠζ

  10. BJSGSBNFDPEFD WBMDPEFD .FTTBHF$PEFDPG<4FR<1VTI3FRVFTU>> 1VCMJTIFSʢૹ৴ଆʣ DPEFDUP.TH1BDL SPXTUP4FR  $POTVNFSʢड৴ଆʣ DPEFDVOQBDL.TH1BDL WHFU

     BT*OTUBODF0G<"SSBZ<#ZUF>> DBTFDMBTTͷ4FS%FΛࣗಈԽͯ͘͠ΕΔ .FTTBHF1BDLͷͨΊ+40/ͷ4FS%FΑΓߴ଎

  11. BJSGSBNFDPOUSPM 4QBSLΫϥελ͸֤ΫϥελͰ෼ࢄ࣮ߦ͢ΔͨΊɺ όοΫϓϨογϟͳͲͷྲྀྔ੍ޚ͕೉͍͠ ฐࣾͰ͸1VTIج൫ʹ(BVSVOΛ'BSHBUFͰར༻͍ͯ͠Δ (BVSVO͸ҰఆͷྲྀྔΛ௒͑Δͱ #BE3FRVFTU͕ฦ٫͞ΕΔ 4QBSL͔Β3&45αʔϏεΛݺͼ͍ͨ͜ͱ͕͋Δ

  12. BJSGSBNFDPOUSPM ٯઆతʹɺҎ֎ͷϨεϙϯε͕ൃੜͨ͠Β 'BSHBUF͕εέʔϧΞ΢τ͞ΕΔ·Ͱ଴ͪ࠶։͢Ε͹ྑ͍ +JUUFSʢ࣌ؒͷ༳Β͗ʣ෇͖ͷϦτϥΠϠΛར༻͢Ε͹ྑ͍ +JUUFSʹΑΓॴఆ࣌ؒ૭ͷେྔΞΫηεΛආ͚Δ͜ͱ͕ग़དྷΔ

  13. BJSGSBNFDPOUSPM 4QBSLΫϥελͷBJSGSBNFDPOUSPMʹΑΔ੍ޚͱ࿈ಈͯ͠ɺ (BVSVOPO'BSHBUF͕Φʔτεέʔϧͯ͠ॲཧ͍ͯ͠Δ༷ࢠ $16ར༻཰্͕͕Δ εέʔϧΞ΢τ͕࢝·Δ

  14. ·ͱΊ w"JSGSBNFͷ֤छϞδϡʔϧ͸ɺ4QBSL͔Β΋ศརʹར༻ग़དྷΔ BJSGSBNFNFUSJDʢ4QBSL42-ͷ࣌ܥྻॲཧʣ BJSGSBNFDPEFDʢΫϥελؒͷ4FS%Fॲཧʣ BJSGSBNFDPOUSPMʢ"84'BSHBUF੍ޚʣ

  15. ͝ਗ਼ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠