Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
We tried to sell a cake for 1 Billion Euro... t...
Search
Posedio
PRO
April 23, 2024
Programming
0
20
We tried to sell a cake for 1 Billion Euro... then build a data mesh
Posedio
PRO
April 23, 2024
Tweet
Share
More Decks by Posedio
See All by Posedio
API First revisited - where did we take a left turn?
posedio
PRO
0
29
Solving Multi-Tenant Challenges: Apache Airflow and Cloud Composer in Action
posedio
PRO
0
18
Contract testing with Java
posedio
PRO
0
18
Flink in two nutshells
posedio
PRO
0
17
Taming the Codebase: Strategies for Refactoring Legacy Code
posedio
PRO
0
13
Access & Usage Policies and Enforcement: Challenges and Solutions
posedio
PRO
0
13
The Future of Data Sharing
posedio
PRO
0
54
Is your spring boot application in Kubernetes secure?
posedio
PRO
0
63
Zero trust architecture with Keycloak
posedio
PRO
0
190
Other Decks in Programming
See All in Programming
Итераторы в Go 1.23: зачем они нужны, как использовать, и насколько они быстрые?
lamodatech
0
970
これが俺の”自分戦略” プロセスを楽しんでいこう! - Developers CAREER Boost 2024
niftycorp
PRO
0
200
Recoilを剥がしている話
kirik
5
7.2k
GitHubで育つ コラボレーション文化 : ニフティでのインナーソース挑戦事例 - 2024-12-16 GitHub Universe 2024 Recap in ZOZO
niftycorp
PRO
0
120
アクターシステムに頼らずEvent Sourcingする方法について
j5ik2o
4
360
良いユニットテストを書こう
mototakatsu
8
3.1k
nekko cloudにおけるProxmox VE利用事例
irumaru
3
460
useSyncExternalStoreを使いまくる
ssssota
6
1.4k
Zoneless Testing
rainerhahnekamp
0
120
情報漏洩させないための設計
kubotak
4
840
ドメインイベント増えすぎ問題
h0r15h0
2
430
ある日突然あなたが管理しているサーバーにDDoSが来たらどうなるでしょう?知ってるようで何も知らなかったDDoS攻撃と対策 #phpcon.2024
akase244
2
410
Featured
See All Featured
No one is an island. Learnings from fostering a developers community.
thoeni
19
3k
Why Our Code Smells
bkeepers
PRO
335
57k
The MySQL Ecosystem @ GitHub 2015
samlambert
250
12k
Six Lessons from altMBA
skipperchong
27
3.5k
Optimizing for Happiness
mojombo
376
70k
How To Stay Up To Date on Web Technology
chriscoyier
789
250k
Gamification - CAS2011
davidbonilla
80
5.1k
Product Roadmaps are Hard
iamctodd
PRO
50
11k
jQuery: Nuts, Bolts and Bling
dougneiner
61
7.6k
A designer walks into a library…
pauljervisheath
205
24k
Art, The Web, and Tiny UX
lynnandtonic
298
20k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
PRO
10
810
Transcript
None
WHY DATA MESH? 1. The story of the billion-euro cake
2. Data everywhere and not a drop to be used 3. How would a data mesh help? 4.The REWE Data Platform
THE STORY OF THE BILLION- EURO CAKE 1
4 • Obvious data error f • Requires collaboration between
different departments ff • Sensitive data (prices) f • Difficult to propagate the fix through all the systems WHY A CAKE
DATA EVERYWHERE AND NOT A DROP TO BE USED 2
6 MEANING • Data is scattered across teams • Meaining
is unclear or different outside the context of the team
7 QUALITY • Quality gates do no exists, data is
not checked f • Data graveyards f • By-product of the operational processes
8 SECURITY • Some data is sensitive f • Usage
of some data must be tracked and reported f • The people that produce the data are not always aware of all the rules
9 AVAILABILITY • Data is difficult to find f •
It takes weeks to get access to data f • It takes weeks to give access to data
HOW WOULD A DATA MESH HELP? 3
11 DOMAIN OWNERSHIP • Article masterdata domain is responsible for
all article data f • The team makes the data available to all
12 DATA PRODUCTS • The team is responsible for the
data quality f • Internal customer satisfaction is tracked f • Tests catch errors
13 FEDERATED GOVERNANCE • A governence team decides on rules
and access control f • Rules are enforced by the system
14 SELF-SERVICE DATA PLATFORM • Data is easy to find
f • Data is easy to publish and consume f • The platform enforces the rules
THE REWE DATA PLATFORM 4
16
17 THE REWE DATA PLATFORM • Not all smooth sailing
f • Idea to working platform f • Technical and organisational challenges f • See you in the workshop
THANK YOU!!! and see you IN THE WORKSHOP!