Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
We tried to sell a cake for 1 Billion Euro... t...
Search
Posedio
PRO
April 23, 2024
Programming
0
37
We tried to sell a cake for 1 Billion Euro... then build a data mesh
Posedio
PRO
April 23, 2024
Tweet
Share
More Decks by Posedio
See All by Posedio
Lost Jobs, Zombie Tasks and AirFlow Nightmares: A debugging Deep Dive
posedio
PRO
0
17
Designing Zero Trust Systems
posedio
PRO
0
21
Platform user's remorse
posedio
PRO
0
120
Go KonMari on your SQL
posedio
PRO
0
19
Rolling out digital receipts on GCP infrastructure
posedio
PRO
0
15
API First revisited - where did we take a left turn?
posedio
PRO
0
61
Solving Multi-Tenant Challenges: Apache Airflow and Cloud Composer in Action
posedio
PRO
0
51
Contract testing with Java
posedio
PRO
0
43
Flink in two nutshells
posedio
PRO
0
53
Other Decks in Programming
See All in Programming
PostgreSQLのRow Level SecurityをPHPのORMで扱う Eloquent vs Doctrine #phpcon #track2
77web
2
330
Enterprise Web App. Development (2): Version Control Tool Training Ver. 5.1
knakagawa
1
120
Railsアプリケーションと パフォーマンスチューニング ー 秒間5万リクエストの モバイルオーダーシステムを支える事例 ー Rubyセミナー 大阪
falcon8823
4
940
Kotlin エンジニアへ送る:Swift 案件に参加させられる日に備えて~似てるけど色々違う Swift の仕様 / from Kotlin to Swift
lovee
1
260
関数型まつり2025登壇資料「関数プログラミングと再帰」
taisontsukada
2
850
AIエージェントはこう育てる - GitHub Copilot Agentとチームの共進化サイクル
koboriakira
0
380
Webの外へ飛び出せ NativePHPが切り拓くPHPの未来
takuyakatsusa
2
360
アンドパッドの Go 勉強会「 gopher 会」とその内容の紹介
andpad
0
260
Haskell でアルゴリズムを抽象化する / 関数型言語で競技プログラミング
naoya
17
4.9k
Benchmark
sysong
0
270
すべてのコンテキストを、 ユーザー価値に変える
applism118
2
790
Team topologies and the microservice architecture: a synergistic relationship
cer
PRO
0
1k
Featured
See All Featured
GitHub's CSS Performance
jonrohan
1031
460k
StorybookのUI Testing Handbookを読んだ
zakiyama
30
5.8k
Mobile First: as difficult as doing things right
swwweet
223
9.7k
Making Projects Easy
brettharned
116
6.3k
Testing 201, or: Great Expectations
jmmastey
42
7.5k
How to Think Like a Performance Engineer
csswizardry
24
1.7k
The Cult of Friendly URLs
andyhume
79
6.5k
BBQ
matthewcrist
89
9.7k
Scaling GitHub
holman
459
140k
Fashionably flexible responsive web design (full day workshop)
malarkey
407
66k
Build your cross-platform service in a week with App Engine
jlugia
231
18k
Improving Core Web Vitals using Speculation Rules API
sergeychernyshev
17
940
Transcript
None
WHY DATA MESH? 1. The story of the billion-euro cake
2. Data everywhere and not a drop to be used 3. How would a data mesh help? 4.The REWE Data Platform
THE STORY OF THE BILLION- EURO CAKE 1
4 • Obvious data error f • Requires collaboration between
different departments ff • Sensitive data (prices) f • Difficult to propagate the fix through all the systems WHY A CAKE
DATA EVERYWHERE AND NOT A DROP TO BE USED 2
6 MEANING • Data is scattered across teams • Meaining
is unclear or different outside the context of the team
7 QUALITY • Quality gates do no exists, data is
not checked f • Data graveyards f • By-product of the operational processes
8 SECURITY • Some data is sensitive f • Usage
of some data must be tracked and reported f • The people that produce the data are not always aware of all the rules
9 AVAILABILITY • Data is difficult to find f •
It takes weeks to get access to data f • It takes weeks to give access to data
HOW WOULD A DATA MESH HELP? 3
11 DOMAIN OWNERSHIP • Article masterdata domain is responsible for
all article data f • The team makes the data available to all
12 DATA PRODUCTS • The team is responsible for the
data quality f • Internal customer satisfaction is tracked f • Tests catch errors
13 FEDERATED GOVERNANCE • A governence team decides on rules
and access control f • Rules are enforced by the system
14 SELF-SERVICE DATA PLATFORM • Data is easy to find
f • Data is easy to publish and consume f • The platform enforces the rules
THE REWE DATA PLATFORM 4
16
17 THE REWE DATA PLATFORM • Not all smooth sailing
f • Idea to working platform f • Technical and organisational challenges f • See you in the workshop
THANK YOU!!! and see you IN THE WORKSHOP!