Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Sparkから利用するAirframe/Spark-With-Airframe

53c93eb80b5958590b18205dc5fd3634?s=47 Masatoshi Shimada
October 23, 2019
Technology
0
990

 Sparkから利用するAirframe/Spark-With-Airframe

53c93eb80b5958590b18205dc5fd3634?s=128

Masatoshi Shimada

October 23, 2019
Tweet

More Decks by Masatoshi Shimada

See All by Masatoshi Shimada
Lakehouseプラットフォームを 採用するまでの話/Lakehouse Platform Adoption
53c93eb80b5958590b18205dc5fd3634?s=48 smdmts
0
390
Redashで何をみるのか/What Do You Wanna See Redash?
53c93eb80b5958590b18205dc5fd3634?s=48 smdmts
1
960
DatabricksとSparkではじめる [ビッグデータETL処理/データ可視化] 実践入門 / Databricks and Spark with ETL and Visualization
53c93eb80b5958590b18205dc5fd3634?s=48 smdmts
0
1.2k
DatabricksとSparkではじめる [データ分析/機械学習] 実践入門 / Databrick and Spark with Data Analyze and ML for newbie.
53c93eb80b5958590b18205dc5fd3634?s=48 smdmts
4
1.5k
作らない分析基板のススメ/DWH For Startup With YAGNI
53c93eb80b5958590b18205dc5fd3634?s=48 smdmts
1
470
エンジニアのためのドメイン駆動設計実践入門 / DDD for Engineer newbie
53c93eb80b5958590b18205dc5fd3634?s=48 smdmts
18
3k
How to growth the delish kitchen team to data-driven team
53c93eb80b5958590b18205dc5fd3634?s=48 smdmts
1
910
etl-in-the-media-company
53c93eb80b5958590b18205dc5fd3634?s=48 smdmts
7
4.9k
スケーラブルシステムの実現に向けて
53c93eb80b5958590b18205dc5fd3634?s=48 smdmts
0
690

Other Decks in Technology

See All in Technology
Microsoft Build 2022 Recap Party!! Azure のデータ & 分析サービス 注目アップデート / microsoft-build-2022-recap-azure-data-and-analytics
22ac00b36d2057e61ee1c06f0f5dc6cb?s=48 nakazax
0
250
MRTK3 - DataBinding and Theming 入門
Fccbd625997f63e7b251d9725cb905a5?s=48 futo23
0
170
データエンジニアリングの潮流を俯瞰する
Cb7edd153cf503f44c727b73647558bf?s=48 tetsuroito
1
720
Azure Arc Virtual MachineとAzure Arc Resource Bridge / VM provisioning through Azure portal on Azure Stack HCI (preview)
D99b8f4147592e467fa5e778d45734e7?s=48 sashizaki
0
110
GeoLocationAnchor and MKTileOverlay
61a68b2172503ecdf7a7f7757df56071?s=48 toyship
0
110
The role of the data organization as a business progresses
A3966f193f4bef226a0d3e3c1f728d7f?s=48 line_developers
PRO
3
840
Custom AppをIP制限ありのままで審査に通す方法
Df8bc8c531e2c5c89c1a007db1cf79a3?s=48 yusuga
0
640
サーバレスECにおける Step Functions の使い方 〜ステートマシン全部見せます！〜
74cec195bfb6cb5165256d88cb7fcf0f?s=48 miu_crescent
0
180
スクラムのスケールとチームトポロジー / Scaled Scrum and Team Topologies
4dd89003cc8fe9f21d67b0c99b773436?s=48 daiksy
1
420
データエンジニアと作るデータ文化
465cba0ac1de7e490c6ea484da327572?s=48 yuki_saito
4
1.5k
History of the ML system in KARTE
290d6f09d5a1df2c2ecb6601011fe5c1?s=48 kargo113
0
600
JDK Flight Recorder入門
484571ccba0db66b69dc11761afdd0c4?s=48 chiroito
1
500

Featured

See All Featured
Product Roadmaps are Hard
7cbd3f5f922d798cc312eaf596de7ae6?s=48 iamctodd
34
6.5k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
5b9fe87ec1faa67a4599782930f45ec9?s=48 sstephenson
151
13k
It's Worth the Effort
Ba530e786553390f3fb271848485681c?s=48 3n
172
25k
What's in a price? How to price your products and services
Dad095ea7038f89f760419ce475d5d14?s=48 michaelherold
229
9.4k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
498
130k
Building Better People: How to give real-time feedback that sticks.
9952dfcd5d338f8a8e7175c8a8f65fb5?s=48 wjessup
344
17k
We Have a Design System, Now What?
95d9f37115fbb0d13135d0f77132f856?s=48 morganepeng
35
3k
The Invisible Side of Design
B3d6434763caa0ef5dc4b792662c49f7?s=48 smashingmag
290
48k
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
E425fe9f170efa0dfaf8ab69d7107418?s=48 aki_i
23
15k
The Illustrated Children's Guide to Kubernetes
0438ae60cde4c7add6f9da48f28c15cc?s=48 chrisshort
14
36k
How GitHub (no longer) Works
78b475797a14c84799063c7cd073962f?s=48 holman
296
140k
A Tale of Four Properties
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
149
21k

Transcript

  1. 4QBSLXJUI"JSGSBNF ౡాխ೥!TNENUT "JSGSBNF.FFUVQ

  2. ࣗݾ঺հ w ౡాխ೥!TNENUT w %8)ΞʔΩςΫτσʔλΞφϦετ w  4DBMBc1ZUIPOc+BWBc(PMBOHc%%%  w

    גࣜձࣾΤϒϦʔॴଐ w ։ൃ෦%"5""*νʔϜ.(3

  3. 4QBSLͰར༻͍ͯ͠Δɺ "JSGSBNFϞδϡʔϧͷ࿩Λ͠·͢ ΞδΣϯμ

  4. ຊ೔঺հ͢ΔϞδϡʔϧ BJSGSBNFNFUSJDT BJSGSBNFDPEFD BJSGSBNFDPOUSPM

  5. BJSGSBNFNFUSJDT ࣌ܥྻσʔλ͸૬ର࣌ؒΛѻ͏࣮૷͕සग़͢Δ KBWBUJNF͸ׂͱ໘౗ʢੲʹൺ΂ָʹͳͬͨͱ͸͍͑ʣ λΠϜκʔϯͷ࣮૷ϛεͳͲͰΤϯόά͢Δ͜ͱ͕͋Δ 4QBSL͸࣌ܥྻσʔλΛසൟʹѻ͏

  6. BJSGSBNFNFUSJDT 3FMBUJWF5JNF8JOEPXT 4QBSL42-Ͱ΋5%@*/5&37"-ͷΑ͏ͳ͜ͱ͕࣮૷Ͱ͖Δ

  7. BJSGSBNFDPEFD 4QBSLΫϥελؒͷ௨৴͸௨ৗετϦʔϛϯάͰߦ͏ ,JOFTJTͷ৔߹͸ɺ,$-Λར༻͢Δ͕4FS%F͕ඞཁ ௨ৗ͸4FS%Fʹ+40/Λར༻͢Δ͕ɺߴ଎ͩͱͳ͓ྑ͍ 4QBSLؒ௨৴Λߦ͍͍ͨ͜ͱ͕͋Δ

  8. BJSGSBNFDPEFD 1VCMJTIFSʢૹ৴ଆʣ 8PSLFSͷλεΫຖʹ,$-ΛΠϯελϯεԽ BJSGSBNFDPEFDͰγϦΞϥΠζ

  9. BJSGSBNFDPEFD $POTVNFSʢड৴ଆʣ BJSGSBNFDPEFDͰσγϦΞϥΠζ

  10. BJSGSBNFDPEFD WBMDPEFD .FTTBHF$PEFDPG<4FR<1VTI3FRVFTU>> 1VCMJTIFSʢૹ৴ଆʣ DPEFDUP.TH1BDL SPXTUP4FR  $POTVNFSʢड৴ଆʣ DPEFDVOQBDL.TH1BDL WHFU

     BT*OTUBODF0G<"SSBZ<#ZUF>> DBTFDMBTTͷ4FS%FΛࣗಈԽͯ͘͠ΕΔ .FTTBHF1BDLͷͨΊ+40/ͷ4FS%FΑΓߴ଎

  11. BJSGSBNFDPOUSPM 4QBSLΫϥελ͸֤ΫϥελͰ෼ࢄ࣮ߦ͢ΔͨΊɺ όοΫϓϨογϟͳͲͷྲྀྔ੍ޚ͕೉͍͠ ฐࣾͰ͸1VTIج൫ʹ(BVSVOΛ'BSHBUFͰར༻͍ͯ͠Δ (BVSVO͸ҰఆͷྲྀྔΛ௒͑Δͱ #BE3FRVFTU͕ฦ٫͞ΕΔ 4QBSL͔Β3&45αʔϏεΛݺͼ͍ͨ͜ͱ͕͋Δ

  12. BJSGSBNFDPOUSPM ٯઆతʹɺҎ֎ͷϨεϙϯε͕ൃੜͨ͠Β 'BSHBUF͕εέʔϧΞ΢τ͞ΕΔ·Ͱ଴ͪ࠶։͢Ε͹ྑ͍ +JUUFSʢ࣌ؒͷ༳Β͗ʣ෇͖ͷϦτϥΠϠΛར༻͢Ε͹ྑ͍ +JUUFSʹΑΓॴఆ࣌ؒ૭ͷେྔΞΫηεΛආ͚Δ͜ͱ͕ग़དྷΔ

  13. BJSGSBNFDPOUSPM 4QBSLΫϥελͷBJSGSBNFDPOUSPMʹΑΔ੍ޚͱ࿈ಈͯ͠ɺ (BVSVOPO'BSHBUF͕Φʔτεέʔϧͯ͠ॲཧ͍ͯ͠Δ༷ࢠ $16ར༻཰্͕͕Δ εέʔϧΞ΢τ͕࢝·Δ

  14. ·ͱΊ w"JSGSBNFͷ֤छϞδϡʔϧ͸ɺ4QBSL͔Β΋ศརʹར༻ग़དྷΔ BJSGSBNFNFUSJDʢ4QBSL42-ͷ࣌ܥྻॲཧʣ BJSGSBNFDPEFDʢΫϥελؒͷ4FS%Fॲཧʣ BJSGSBNFDPOUSPMʢ"84'BSHBUF੍ޚʣ

  15. ͝ਗ਼ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠