Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Realtime Data Platform: from Lakehouse to Strea...

Sponsored · SiteGround - Reliable hosting with speed, security, and support you can count on. →
Avatar for LINEヤフーTech (LY Corporation Tech) LINEヤフーTech (LY Corporation Tech) PRO
June 30, 2025
Technology
240
0

Realtime Data Platform: from Lakehouse to Streamhouse

Avatar for LINEヤフーTech (LY Corporation Tech)

LINEヤフーTech (LY Corporation Tech) PRO

June 30, 2025

More Decks by LINEヤフーTech (LY Corporation Tech)

See All by LINEヤフーTech (LY Corporation Tech)
Scaling Beyond the Exabyte: Lessons from Hadoop Integration and Operations at LY Corporation
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
0
54
多層防御と最⼩権限で実現する、安全なAIエージェント設計パターン
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
1
250
PM領域でのAI Agentの活用
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
0
290
AI駆動開発を組織で促すために
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
7
9.5k
検索技術知識0のエンジニアが広告検索システムを内製化して運用するまで
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
1
380
No More Log Digging 〜AIを一次調査係にする アラートレビュー改善〜
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
0
180
実践！既存 Project への AI-Driven Development 適用〜一ヶ月で Project 唯一のフロントエンドエンジニアを作り出せ〜
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
1
510
AIが実装を自走する時代の認知負債との戦い
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
3
1.3k
AIと1000本ノックしてたどり着いた、最速のプロダクト開発 ～toC向けAIエージェントUXを、動く選択肢とAIキャパシティで設計する～ 
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
1
240

Other Decks in Technology

See All in Technology
株式会社シーエーシー　エンジニア向け会社紹介資料
Avatar for 株式会社シーエーシー cac
0
57k
コスト最適化の「めんどくさい」を AWS FinOps Agent でチョット楽にする
Avatar for kaz classmethod_kaz
0
300
GuardDuty 検知対応を DevOps Agent で効率化しようとしている話 / GuardDuty Investigations with DevOps Agent
Avatar for MasahiroKawahara masahirokawahara
1
350
幾何アルゴリズムで なめらかなピン操作を / iOSDC Japan 2026 / smoothpin
Avatar for nade kazumanagano
0
250
Snowflakeのコスト最適化を支えるアーキテクチャ設計
Avatar for Tatsuya Koreeda ktatsuya
0
1.4k
こんなアーキテクチャ図は嫌だ BEYOND THE TIME: 半年後の自分へ贈る15のメッセージ / 15 of Anti-pattern in AWS Architecture Diagrams
Avatar for Naomi Yamasaki naospon
3
300
DEFCON34-Write-up_HYCu-MYCu
Avatar for okzkey daikiokazaki
0
140
なぜSRE・セキュリティは評価されないのか？守りの組織を事業成長エンジンに変えた実践
Avatar for サイバーセキュリティクラウド cscengineer
PRO
3
2.4k
2026-09-10 【Snowflake World Tour Tokyo 2026】dbt Core と Snowflake で実現する多層的なデータガバナンス / Multi-Layered Data Governance Powered by dbt Core and Snowflake
Avatar for civitaspo civitaspo
0
290
例外の正しい扱い方 そのエラー try-catchして大丈夫？
Avatar for Watanabe Jin jinwatanabe
3
440
Multica × 長期記憶：40個のミニプロジェクト管理
Avatar for eiei114 eiei114
1
230
Screen Lens - 今見てる画面を翻訳する
Avatar for komagata komagata
0
220

Featured

See All Featured
Redefining SEO in the New Era of Traffic Generation
Avatar for Szymon Słowik szymonslowik
1
410
Public Speaking Without Barfing On Your Shoes - THAT 2023
Avatar for David Neal reverentgeek
1
560
AI: The stuff that nobody shows you
Avatar for John Nunemaker jnunemaker
PRO
9
980
Amusing Abliteration
Avatar for ianozsvald ianozsvald
1
290
The Psychology of Web Performance [Beyond Tellerrand 2023]
Avatar for Tammy Everts tammyeverts
49
3.5k
Heart Work Chapter 1 - Part 1
Avatar for Lake Fama lfama
PRO
9
36k
Claude Code どこまでも/ Claude Code Everywhere
Avatar for nwiizo nwiizo
67
58k
Noah Learner - AI + Me: how we built a GSC Bulk Export data pipeline
Avatar for Tech SEO Connect techseoconnect
PRO
0
430
Ecommerce SEO: The Keys for Success Now & Beyond - #SERPConf2024
Avatar for Aleyda Solis aleyda
1
2.1k
SEOcharity - Dark patterns in SEO and UX: How to avoid them and build a more ethical web
Avatar for Sara Fernández Carmona sarafernandez
0
270
Marketing to machines
Avatar for Jono Alderson jonoalderson
1
5.8k
The Illustrated Guide to Node.js - THAT Conference 2024
Avatar for David Neal reverentgeek
1
470

Transcript

  1. 3FBMUJNF%BUB1MBUGPSN GSPN-BLFIPVTFUP4USFBNIPVTF -:$PSQPSBUJPO 9JBP;IJZBO

  2. 🎯 0QFOSFTFBSDI PO3FBMUJNF%BUB1MBUGPSN &YQMPSFUIFMBUFTUUFDIOPMPHJFTBOEBSDIJUFDUVSFTMJLF4USFBNIPVTF 🔒 /PU SFQSFTFOUBUJWFPGJOIPVTFQSPKFDUT BU-:$PSQPSBUJPO 4DPQF PGUIF4FTTJPO

    8IBUXFXJMMDPWFSUPEBZ

  3. ঻ ࢤ඙ 9JBP;IJZBO γϠ΢ ζ΢ΠΤϯ 🏠 தࠃॏܚ $IPOHRJOH $IJOB ","l%.BHJD$JUZz

    🎓 ߳ߓதจେֶ 5IF$IJOFTF6OJWFSTJUZPG)POH,POH .BUI*OGPSNBUJPO&OHJOFFSJOH 👨💻 4PGUXBSF&OHJOFFS!-:$PSQPSBUJPO %BUB&OHJOFFSJOH%BUB1JQFMJOF&OHJOFFSJOH*OHFTUJPO1SPDFTTJOH ✨ *NQSPWJOHCJHEBUB TZTUFNTXJUI3VTU 0QFO%BUB%SJWFODPNNVOJUZ 4USFBNIPVTF "*OBUJWF 3VTU BOENPSF "CPVU.F !9JBP;IJZBO

  4. 💻 4PGUXBSFJTFBUJOHUIFXPSME &WFSZCVTJOFTTCFDBNFBTPGUXBSFDPNQBOZ 🤖 "*JTFBUJOHTPGUXBSF 🚀 3FBMUJNFJTFBUJOHFWFSZUIJOHFMTF -JWFEBTICPBSET 3FBMUJNFBMFSUT 0OUIFGMZQFSTPOBMJ[BUJPO

    *OTUBOUGFFECBDLGSPN"*BHFOUT 🐢 .PTU%BUB1MBUGPSNTà /PUGVMMZTVQQPSUJOHSFBMUJNFTDFOBSJPT 🐇 3FBMUJNF%BUB1MBUGPSNà 4USFBNIPVTF 8IZ3FBMUJNF %BUB1MBUGPSN "MBSHFTIJGUIBQQFOJOHBSPVOEVT 🌏 ˠ💻 ˠ🤖 ˠ🚀

  5. %BUB8BSFIPVTFBOE%BUB-BLF 5IFFBSMZEBZTPG%BUB1MBUGPSNT 4USVDUVSFE%BUB 4FNJTUSVDUVSFE%BUB 6OTUSVDUVSFE%BUB &5- &5- %BUB8BSFIPVTF #*3FQPSUT %BUB-BLF

    )%'44 2VFSZ&OHJOF 4QBSL .- %BUB8BSFIPVTF %BUB-BLF %BUB5ZQF 4USVDUVSFE ✅ 4USVDUVSFE TFNJTUSVDUVSFE VOTUSVDUVSFE 4DBMBCJMJUZ %JGGJDVMUBOEFYQFOTJWF ✅ &BTZBUBMPXDPTU 5SBOTBDUJPO ✅ 4VQQPSUFE /PUTVQQPSUFE 2VFSZ1FSGPSNBODF ✅ )JHI -PX 🤔 $BOXFDPNCJOF UIFBEWBOUBHFT PGCPUITZTUFNTJOUPPOF

  6. -BLFIPVTF %BUB-BLF %BUB8BSFIPVTF 4USVDUVSFE%BUB 4FNJTUSVDUVSFE%BUB 6OTUSVDUVSFE%BUB &5- -BLFIPVTF5BCMF'PSNBU *DFCFSH #*3FQPSUT

    %BUB-BLF )%'44 2VFSZ&OHJOF 4QBSL .- -BLFIPVTF ,FZ1PJOU *OEFYEBUBGJMFTXJUITUBUTUPTQFFEVQRVFSJFT 5BCMF'PSNBUT "QBDIF*DFCFSH %FMUB-BLF "QBDIF)VEJ 1SPT ✅ 5SBOTBDUJPO IJHIRVFSZQFSGPSNBODF $POT 🚫 )JHIMBUFODZ NJOVUFT MPXUISPVHIQVUPGTUSFBNJOHXSJUF 🤔 )PXUPTVQQPSUMPXMBUFODZTUSFBNJOHQSPDFTTJOH

  7. -BNCEB "SDIJUFDUVSF #BUDI1JQFMJOF 4USFBNJOH1JQFMJOF %BUB4PVSDFT #BUDI1JQFMJOF 4QBSL -BLFIPVTF4UPSBHF *DFCFSH 2VFSZ&OHJOF

    %BUB6TFST 4USFBNJOH1JQFMJOF 'MJOL 4USFBNJOH4UPSBHF ,BGLB -BNCEB"SDIJUFDUVSF ,FZ1PJOU %VBMMBZFSEFTJHO CBUDI TUSFBNJOH 6TBHF .FSHFSFTVMUTPGCPUIMBZFSTBURVFSZTJEF 1SPT ✅ -PXMBUFODZTUSFBNJOHQSPDFTTJOH TVCTFDPOE $POT 🚫 $PNQMFYJUZ IJHIDPTU EFMBZJOIJTUPSJDBMEBUB NJOVUFT 🤔 *TJUGFBTJCMFUPVOJGZ UIFTFUXPEBUBQJQFMJOFT

  8. ,BQQB "SDIJUFDUVSF 6OJGZ#BUDIBOE4USFBNJOH1JQFMJOFT ˠ ,BGLB4PVSDFT 4USFBNJOH1JQFMJOF 'MJOL 4USFBNJOH4UPSBHF ,BGLB 2VFSZ&OHJOF

    %BUB6TFST ,BQQB"SDIJUFDUVSF ,FZ1PJOU "MMEBUBBTTUSFBNT IJTUPSJDBMEBUBCZSFQMBZJOH 1SPT ✅ 4JNQMJDJUZ MPXMBUFODZ TVCTFDPOE $POT 🚫 &YQFOTJWFSFQMBZJOH JOFGGJDJFOURVFSJFT 🤔 $BOXFJNQSPWF,BQQB "SDIJUFDUVSFXJUI-BLFIPVTF 4UPSBHF

  9. 6OJGJFE/FBS3FBMUJNF1JQFMJOF ,BGLBˠ1BJNPO %BUB4PVSDFT 6OJGJFE1JQFMJOF 'MJOL 2VFSZ&OHJOF %BUB6TFST 🤔 )PXEPFT1BJNPO TVQQPSUCPUI4USFBNJOH

    BOE-BLFIPVTF GFBUVSFT -BLFIPVTF4UPSBHF *DFCFSH NJOVUFT 4USFBNJOH4UPSBHF ,BGLB TVCTFDPOE 4USFBNJOHGJSTU-BLFIPVTF4UPSBHF 1BJNPO TVCNJOVUF

  10. "-JUUMF.PSFPO1BJNPO 4USFBNJOHGJSTU-BLFIPVTF5BCMF'PSNBU 🤔 $BOXFGVSUIFSJNQSPWF6OJGJFE1JQFMJOFUPBDIJFWFTVCTFDPOEMBUFODZ IUUQTQBJNPOBQBDIFPSHEPDTNBTUFSDPODFQUTCBTJDDPODFQUT *OEFYEBUBGJMFTXJUITUBUT TJNJMBSUP*DFCFSH 8SJUFUPNVMUJQMFCVDLFUT JOQBSBMMFM 3FBEDIBOHFMPHPG1,UBCMFT

    4USFBNJOHSFBE"QQFOEUBCMFT

  11. 6OJGJFE3FBMUJNF1JQFMJOF 1BJNPO 'MVTT %BUB4PVSDFT 6OJGJFE1JQFMJOF -BLFIPVTF4UPSBHF 1BJNPO TVCNJOVUF 2VFSZ&OHJOF %BUB6TFST

    4USFBNJOH4UPSBHF 'MVTT TVCTFDPOE ,BGLB 'MVTT %BUB'PSNBU #JOBSZ SPXCBTFE ✅ "QBDIF"SSPX DPMVNOCBTFE 4DIFNB &YUFSOBMSFHJTUSZ ✅ *OUFSOBMTDIFNB 1SPKFDUJPO1VTIEPXO /PUTVQQPSUFE ✅ 4VQQPSUFE 2VFSZ*OUFSGBDF $POTVNFS3&45 ✅ "SSPX'MJHIU IJHIQFSGPSNBODF 📝 -FU`TTVNNBSJ[F XIBUXFIBWFEJTDVTTFETPGBS

  12. 4USFBNIPVTF 6OJGJFE3FBMUJNF1JQFMJOF %BUB8BSFIPVTF %BUB-BLF -BNCEB -BLFIPVTF ,BQQB 1BJNPO 'MVTT

  13. ✨ 8FIBWFTFFOMBUFTU4USFBNIPVTF "SDIJUFDUVSFXJUI1BJNPOBOE'MVTT 🤔 "SFUIFSFBOZPUIFSQPUFOUJBMJNQSPWFNFOUTBT3FBMUJNF%BUB1MBUGPSN )PXUPPSDIFTUSBUJPOPGEBUBQJQFMJOFT )PXUPJNQSPWFJU 1PUFOUJBM*NQSPWFNFOUT

  14. %ZOBNJD %BUB'MPX 4UBUJD%BUB1JQFMJOFTˠ-JWFMZ$PNQPTBCMF%BUB'MPXT %BUB4PVSDFT *OHFTU 0%4 $MFBO %8% "HHSFHBUF %84

    $VTUPNJ[F "%4 %BUB'MPX :".- 3FVTBCMF%BUB"DUJPOT 42- 'MPX"DUJPO3FHJTUSZ 'MPX.BUFSJBMJ[FS 'MPX5SJHHFS

  15. "*OBUJWF $POUSPM1MBOF "VUPNBUFEˠ"VUPOPNPVT %BUB"DUJPO %BUB'MPX 'MPX"DUJPO3FHJTUSZ 'MPX5SJHHFS 'MPX1MBOOFS "DUJPO$PNQPTFS "HFOUJD"*

    6TFS1SPNQU 0SDIFTUSBUPS 'MPX.BUFSJBMJ[FS

  16. "*OBUJWF4USFBNIPVTF /FYUHFOFSBUJPO3FBMUJNF%BUB1MBUGPSN "*OBUJWF$POUSPM1MBOF %ZOBNJD%BUB'MPX 6OJGJFE3FBMUJNF1JQFMJOF

  17. ✨ 4USFBNIPVTF "SDIJUFDUVSFJTTUJMMRVJUFOFX 🧭 -FU`TTFFIPXJUDBOCSJOHSFBMWBMVF UPPVSCVTJOFTT 🚀 &YQMPSF CVJME BOETIBSF

    4USFBNIPVTFJNQMFNFOUBUJPOTUPHFUIFS 5IF3PBE"IFBE

  18.  -BNCEB"SDIJUFDUVSF IUUQOBUIBONBS[DPNCMPHIPXUPCFBUUIFDBQUIFPSFNIUNM  ,BQQB"SDIJUFDUVSF IUUQTXXXPSFJMMZDPNSBEBSRVFTUJPOJOHUIFMBNCEBBSDIJUFDUVSF  -BLFIPVTF IUUQTXXXEBUBCSJDLTDPNCMPHXIBUJTBEBUBMBLFIPVTFIUNM 

    4USFBNIPVTF IUUQTXXXWFSWFSJDBDPNCMPHTUSFBNIPVTFVOWFJMFE  "*/BUJWF IUUQTXXXTQMVOLDPNFO@VTCMPHMFBSOBJOBUJWFIUNM 3FMBUFE-JOLT

  19. '*/