Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Realtime Data Platform: from Lakehouse to Strea...

Avatar for LINEヤフーTech (LY Corporation Tech) LINEヤフーTech (LY Corporation Tech) PRO
June 30, 2025
Technology
230
0

Realtime Data Platform: from Lakehouse to Streamhouse

Avatar for LINEヤフーTech (LY Corporation Tech)

LINEヤフーTech (LY Corporation Tech) PRO

June 30, 2025

More Decks by LINEヤフーTech (LY Corporation Tech)

See All by LINEヤフーTech (LY Corporation Tech)
No More Log Digging 〜AIを一次調査係にする アラートレビュー改善〜
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
0
54
実践！既存 Project への AI-Driven Development 適用〜 一ヶ月で Project 唯一のフロントエンドエンジニアを作り出せ〜
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
0
380
AIが実装を自走する時代の認知負債との戦い
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
2
1.1k
AIと1000本ノックしてたどり着いた、最速のプロダクト開発 ～toC向けAIエージェントUXを、動く選択肢とAIキャパシティで設計する～ 
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
1
110
プライバシー保護の理論と実践
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
1
270
AIDLC_ヤフーショッピングの取り組み
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
0
680
Business ID Integration at LY Corporation : Phased Migration for a B2B authentication platform with Tens of Millions of Users
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
0
55
LINE Messaging: From Active-Standby to Active-Active Multi-DC Architecture
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
0
85
LY Corporation's implementation of Confidential VM ensuring privacy for AI features
Avatar for LINEヤフーTech (LY Corporation Tech) lycorptech_jp
PRO
0
97

Other Decks in Technology

See All in Technology
kaonavi Tech Night＃1
Avatar for 株式会社カオナビ kaonavi
0
150
CDKで書くECSのベストプラクティス、 改めて考え直す2026 #cdkconf2026
Avatar for maki makies
3
930
生成AI×AWS CDK×AWS FISで"振り返れる"ミニGameDayをつくろう
Avatar for yoshimi0227 yoshimi0227
2
530
“それは自分の仕事じゃない"を 越えて行け
Avatar for yuukiyo yuukiyo
1
520
OPENLOGI Company Profile for engineer
Avatar for OPENLOGI hr01
1
74k
AI Coding Agent時代のcdk-nagガードレール 〜組織ルールを強制CIで守り抜く設計の挑戦〜
Avatar for みずほリサーチ&テクノロジーズ株式会社 先端技術研究部 mhrtech
3
510
Vポイント分析基盤におけるデータモデリング20年史
Avatar for タロウ taromatsui_cccmkhd
4
710
AIが当たり前の組織で エンジニアはどう育つか
Avatar for Motoshi Nishihira nishihira
1
960
Oracle Exadata Database Service on Cloud@Customer X11M (ExaDB-C@C) サービス概要
Avatar for oracle4engineer oracle4engineer
PRO
2
8.5k
変更し続けられるシステムをどう保つか — AI時代のSSoTという設計原則
Avatar for かわうそ kawauso
1
1.1k
AIとハーネスで育てるトランスコンパイラ / 20260722 Yasushi Katayama
Avatar for SHIFT EVOLVE shift_evolve
PRO
3
770
文字起こし基盤の信頼性
Avatar for abnoumaru abnoumaru
0
120

Featured

See All Featured
The agentic SEO stack - context over prompts
Avatar for schlessera schlessera
0
850
Let's Do A Bunch of Simple Stuff to Make Websites Faster
Avatar for Chris Coyier chriscoyier
508
140k
A brief & incomplete history of 
UX Design for the World Wide Web: 1989–2019
Avatar for Jason CranfordTeague jct
2
420
VelocityConf: Rendering Performance Case Studies
Avatar for Addy Osmani addyosmani
333
25k
The Curious Case for Waylosing
Avatar for Cassini Nazir cassininazir
1
440
The Language of Interfaces
Avatar for Des Traynor destraynor
162
27k
A better future with KSS
Avatar for Kyle Neath kneath
240
18k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
Avatar for Rebecca Miller-Webster rmw
35
3.7k
Learning to Love Humans: Emotional Interface Design
Avatar for Aarron Walter aarron
275
41k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
Avatar for Kevin Liebholz kevinliebholz
37
6.5k
Paper Plane (Part 1)
Avatar for Katie Cordina Lindsey katiecoart
PRO
1
9.8k
The Power of CSS Pseudo Elements
Avatar for Geoffrey Crofte geoffreycrofte
82
6.5k

Transcript

  1. 3FBMUJNF%BUB1MBUGPSN GSPN-BLFIPVTFUP4USFBNIPVTF -:$PSQPSBUJPO 9JBP;IJZBO

  2. 🎯 0QFOSFTFBSDI PO3FBMUJNF%BUB1MBUGPSN &YQMPSFUIFMBUFTUUFDIOPMPHJFTBOEBSDIJUFDUVSFTMJLF4USFBNIPVTF 🔒 /PU SFQSFTFOUBUJWFPGJOIPVTFQSPKFDUT BU-:$PSQPSBUJPO 4DPQF PGUIF4FTTJPO

    8IBUXFXJMMDPWFSUPEBZ

  3. ঻ ࢤ඙ 9JBP;IJZBO γϠ΢ ζ΢ΠΤϯ 🏠 தࠃॏܚ $IPOHRJOH $IJOB ","l%.BHJD$JUZz

    🎓 ߳ߓதจେֶ 5IF$IJOFTF6OJWFSTJUZPG)POH,POH .BUI*OGPSNBUJPO&OHJOFFSJOH 👨💻 4PGUXBSF&OHJOFFS!-:$PSQPSBUJPO %BUB&OHJOFFSJOH%BUB1JQFMJOF&OHJOFFSJOH*OHFTUJPO1SPDFTTJOH ✨ *NQSPWJOHCJHEBUB TZTUFNTXJUI3VTU 0QFO%BUB%SJWFODPNNVOJUZ 4USFBNIPVTF "*OBUJWF 3VTU BOENPSF "CPVU.F !9JBP;IJZBO

  4. 💻 4PGUXBSFJTFBUJOHUIFXPSME &WFSZCVTJOFTTCFDBNFBTPGUXBSFDPNQBOZ 🤖 "*JTFBUJOHTPGUXBSF 🚀 3FBMUJNFJTFBUJOHFWFSZUIJOHFMTF -JWFEBTICPBSET 3FBMUJNFBMFSUT 0OUIFGMZQFSTPOBMJ[BUJPO

    *OTUBOUGFFECBDLGSPN"*BHFOUT 🐢 .PTU%BUB1MBUGPSNTà /PUGVMMZTVQQPSUJOHSFBMUJNFTDFOBSJPT 🐇 3FBMUJNF%BUB1MBUGPSNà 4USFBNIPVTF 8IZ3FBMUJNF %BUB1MBUGPSN "MBSHFTIJGUIBQQFOJOHBSPVOEVT 🌏 ˠ💻 ˠ🤖 ˠ🚀

  5. %BUB8BSFIPVTFBOE%BUB-BLF 5IFFBSMZEBZTPG%BUB1MBUGPSNT 4USVDUVSFE%BUB 4FNJTUSVDUVSFE%BUB 6OTUSVDUVSFE%BUB &5- &5- %BUB8BSFIPVTF #*3FQPSUT %BUB-BLF

    )%'44 2VFSZ&OHJOF 4QBSL .- %BUB8BSFIPVTF %BUB-BLF %BUB5ZQF 4USVDUVSFE ✅ 4USVDUVSFE TFNJTUSVDUVSFE VOTUSVDUVSFE 4DBMBCJMJUZ %JGGJDVMUBOEFYQFOTJWF ✅ &BTZBUBMPXDPTU 5SBOTBDUJPO ✅ 4VQQPSUFE /PUTVQQPSUFE 2VFSZ1FSGPSNBODF ✅ )JHI -PX 🤔 $BOXFDPNCJOF UIFBEWBOUBHFT PGCPUITZTUFNTJOUPPOF

  6. -BLFIPVTF %BUB-BLF %BUB8BSFIPVTF 4USVDUVSFE%BUB 4FNJTUSVDUVSFE%BUB 6OTUSVDUVSFE%BUB &5- -BLFIPVTF5BCMF'PSNBU *DFCFSH #*3FQPSUT

    %BUB-BLF )%'44 2VFSZ&OHJOF 4QBSL .- -BLFIPVTF ,FZ1PJOU *OEFYEBUBGJMFTXJUITUBUTUPTQFFEVQRVFSJFT 5BCMF'PSNBUT "QBDIF*DFCFSH %FMUB-BLF "QBDIF)VEJ 1SPT ✅ 5SBOTBDUJPO IJHIRVFSZQFSGPSNBODF $POT 🚫 )JHIMBUFODZ NJOVUFT MPXUISPVHIQVUPGTUSFBNJOHXSJUF 🤔 )PXUPTVQQPSUMPXMBUFODZTUSFBNJOHQSPDFTTJOH

  7. -BNCEB "SDIJUFDUVSF #BUDI1JQFMJOF 4USFBNJOH1JQFMJOF %BUB4PVSDFT #BUDI1JQFMJOF 4QBSL -BLFIPVTF4UPSBHF *DFCFSH 2VFSZ&OHJOF

    %BUB6TFST 4USFBNJOH1JQFMJOF 'MJOL 4USFBNJOH4UPSBHF ,BGLB -BNCEB"SDIJUFDUVSF ,FZ1PJOU %VBMMBZFSEFTJHO CBUDI TUSFBNJOH 6TBHF .FSHFSFTVMUTPGCPUIMBZFSTBURVFSZTJEF 1SPT ✅ -PXMBUFODZTUSFBNJOHQSPDFTTJOH TVCTFDPOE $POT 🚫 $PNQMFYJUZ IJHIDPTU EFMBZJOIJTUPSJDBMEBUB NJOVUFT 🤔 *TJUGFBTJCMFUPVOJGZ UIFTFUXPEBUBQJQFMJOFT

  8. ,BQQB "SDIJUFDUVSF 6OJGZ#BUDIBOE4USFBNJOH1JQFMJOFT ˠ ,BGLB4PVSDFT 4USFBNJOH1JQFMJOF 'MJOL 4USFBNJOH4UPSBHF ,BGLB 2VFSZ&OHJOF

    %BUB6TFST ,BQQB"SDIJUFDUVSF ,FZ1PJOU "MMEBUBBTTUSFBNT IJTUPSJDBMEBUBCZSFQMBZJOH 1SPT ✅ 4JNQMJDJUZ MPXMBUFODZ TVCTFDPOE $POT 🚫 &YQFOTJWFSFQMBZJOH JOFGGJDJFOURVFSJFT 🤔 $BOXFJNQSPWF,BQQB "SDIJUFDUVSFXJUI-BLFIPVTF 4UPSBHF

  9. 6OJGJFE/FBS3FBMUJNF1JQFMJOF ,BGLBˠ1BJNPO %BUB4PVSDFT 6OJGJFE1JQFMJOF 'MJOL 2VFSZ&OHJOF %BUB6TFST 🤔 )PXEPFT1BJNPO TVQQPSUCPUI4USFBNJOH

    BOE-BLFIPVTF GFBUVSFT -BLFIPVTF4UPSBHF *DFCFSH NJOVUFT 4USFBNJOH4UPSBHF ,BGLB TVCTFDPOE 4USFBNJOHGJSTU-BLFIPVTF4UPSBHF 1BJNPO TVCNJOVUF

  10. "-JUUMF.PSFPO1BJNPO 4USFBNJOHGJSTU-BLFIPVTF5BCMF'PSNBU 🤔 $BOXFGVSUIFSJNQSPWF6OJGJFE1JQFMJOFUPBDIJFWFTVCTFDPOEMBUFODZ IUUQTQBJNPOBQBDIFPSHEPDTNBTUFSDPODFQUTCBTJDDPODFQUT *OEFYEBUBGJMFTXJUITUBUT TJNJMBSUP*DFCFSH 8SJUFUPNVMUJQMFCVDLFUT JOQBSBMMFM 3FBEDIBOHFMPHPG1,UBCMFT

    4USFBNJOHSFBE"QQFOEUBCMFT

  11. 6OJGJFE3FBMUJNF1JQFMJOF 1BJNPO 'MVTT %BUB4PVSDFT 6OJGJFE1JQFMJOF -BLFIPVTF4UPSBHF 1BJNPO TVCNJOVUF 2VFSZ&OHJOF %BUB6TFST

    4USFBNJOH4UPSBHF 'MVTT TVCTFDPOE ,BGLB 'MVTT %BUB'PSNBU #JOBSZ SPXCBTFE ✅ "QBDIF"SSPX DPMVNOCBTFE 4DIFNB &YUFSOBMSFHJTUSZ ✅ *OUFSOBMTDIFNB 1SPKFDUJPO1VTIEPXO /PUTVQQPSUFE ✅ 4VQQPSUFE 2VFSZ*OUFSGBDF $POTVNFS3&45 ✅ "SSPX'MJHIU IJHIQFSGPSNBODF 📝 -FU`TTVNNBSJ[F XIBUXFIBWFEJTDVTTFETPGBS

  12. 4USFBNIPVTF 6OJGJFE3FBMUJNF1JQFMJOF %BUB8BSFIPVTF %BUB-BLF -BNCEB -BLFIPVTF ,BQQB 1BJNPO 'MVTT

  13. ✨ 8FIBWFTFFOMBUFTU4USFBNIPVTF "SDIJUFDUVSFXJUI1BJNPOBOE'MVTT 🤔 "SFUIFSFBOZPUIFSQPUFOUJBMJNQSPWFNFOUTBT3FBMUJNF%BUB1MBUGPSN )PXUPPSDIFTUSBUJPOPGEBUBQJQFMJOFT )PXUPJNQSPWFJU 1PUFOUJBM*NQSPWFNFOUT

  14. %ZOBNJD %BUB'MPX 4UBUJD%BUB1JQFMJOFTˠ-JWFMZ$PNQPTBCMF%BUB'MPXT %BUB4PVSDFT *OHFTU 0%4 $MFBO %8% "HHSFHBUF %84

    $VTUPNJ[F "%4 %BUB'MPX :".- 3FVTBCMF%BUB"DUJPOT 42- 'MPX"DUJPO3FHJTUSZ 'MPX.BUFSJBMJ[FS 'MPX5SJHHFS

  15. "*OBUJWF $POUSPM1MBOF "VUPNBUFEˠ"VUPOPNPVT %BUB"DUJPO %BUB'MPX 'MPX"DUJPO3FHJTUSZ 'MPX5SJHHFS 'MPX1MBOOFS "DUJPO$PNQPTFS "HFOUJD"*

    6TFS1SPNQU 0SDIFTUSBUPS 'MPX.BUFSJBMJ[FS

  16. "*OBUJWF4USFBNIPVTF /FYUHFOFSBUJPO3FBMUJNF%BUB1MBUGPSN "*OBUJWF$POUSPM1MBOF %ZOBNJD%BUB'MPX 6OJGJFE3FBMUJNF1JQFMJOF

  17. ✨ 4USFBNIPVTF "SDIJUFDUVSFJTTUJMMRVJUFOFX 🧭 -FU`TTFFIPXJUDBOCSJOHSFBMWBMVF UPPVSCVTJOFTT 🚀 &YQMPSF CVJME BOETIBSF

    4USFBNIPVTFJNQMFNFOUBUJPOTUPHFUIFS 5IF3PBE"IFBE

  18.  -BNCEB"SDIJUFDUVSF IUUQOBUIBONBS[DPNCMPHIPXUPCFBUUIFDBQUIFPSFNIUNM  ,BQQB"SDIJUFDUVSF IUUQTXXXPSFJMMZDPNSBEBSRVFTUJPOJOHUIFMBNCEBBSDIJUFDUVSF  -BLFIPVTF IUUQTXXXEBUBCSJDLTDPNCMPHXIBUJTBEBUBMBLFIPVTFIUNM 

    4USFBNIPVTF IUUQTXXXWFSWFSJDBDPNCMPHTUSFBNIPVTFVOWFJMFE  "*/BUJWF IUUQTXXXTQMVOLDPNFO@VTCMPHMFBSOBJOBUJWFIUNM 3FMBUFE-JOLT

  19. '*/