Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Hands-on Data Orchestration: Building a CDC Pipeline on top of Kafka and Kubernetes

Aldo Ziflaj
January 26, 2024
Programming
2
38

Hands-on Data Orchestration: Building a CDC Pipeline on top of Kafka and Kubernetes

Aldo Ziflaj

January 26, 2024
Tweet

More Decks by Aldo Ziflaj

See All by Aldo Ziflaj
No-Bullshit Guide into Building Software
aziflaj
0
160
Ruby is dead. Long live Ruby
aziflaj
0
180
How to become a better developer
aziflaj
0
210
Building CLI apps with Ruby
aziflaj
0
49
Git SCM
aziflaj
0
280
Reflections on my Project52
aziflaj
0
490
Cryptanalysis - basic ciphers and a bit more
aziflaj
0
90
Some hours of python
aziflaj
0
56

Other Decks in Programming

See All in Programming
Domain-Driven Transformation
hschwentner
2
1.5k
はてなにおける CSS Modules、及び CSS Modules に足りないもの / CSS Modules in Hatena, and CSS Modules missing parts
mizdra
7
960
Build Apps for iOS, Android & Desktop in 100% Kotlin With Compose Multiplatform (mDevCamp 2024)
zsmb
0
420
Fragment Composition of GraphQL
quramy
13
1.4k
スキーマ駆動開発による品質とスピードの両立 - 私達は何故、スキーマを書くのか
kentaroutakeda
0
170
GitHub Copilotのススメ
marcy731
1
220
Going beyond Apache Parquet's default settings
xhochy
0
120
Behind VS Code Extensions for JavaScript / TypeScript Linnting and Formatting
unvalley
5
1.1k
Snowflakeで眠ったデータを起こそう！
estie
0
130
冗長なエラーログを削減し、スタックトレースを手に入れる / Reducing Verbose Error Logs and Obtaining Stack Traces
upamune
0
970
Amazon SQSコンシューマー疎結合への旅 - 出張！ #DevelopersIO IT技術ブログの中の人が語る勉強会 #3
quiver
0
300
"config" ってなんだ？ / What is "config"?
okashoi
0
250

Featured

See All Featured
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
64
14k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
21
1.4k
Making the Leap to Tech Lead
cromwellryan
125
8.5k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
117
18k
How to train your dragon (web standard)
notwaldorf
74
5.2k
How GitHub Uses GitHub to Build GitHub
holman
468
290k
Mobile First: as difficult as doing things right
swwweet
217
8.6k
Pencils Down: Stop Designing & Start Developing
hursman
117
11k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
228
16k
The Cult of Friendly URLs
andyhume
74
5.7k
Robots, Beer and Maslow
schacon
PRO
155
7.9k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
21
1.9k

Transcript

  1. Hands-On Data Orchestration Building a CDC Pipeline on top of

    Kafka and Kubernetes

  2. /usr/bin/whoami Aldo Ziflaj @aziflaj

  3. /usr/bin/whoami Aldo Ziflaj @aziflaj

  4. /usr/bin/whoami • Tech Lead @ Dealfront • DX: UX for

    Developers Aldo Ziflaj @aziflaj

  5. /usr/bin/whoami • Tech Lead @ Dealfront • DX: UX for

    Developers • xPubler • Systems Architecture & Backend Aldo Ziflaj @aziflaj

  6. /usr/bin/whoami • Tech Lead @ Dealfront • DX: UX for

    Developers • xPubler • Systems Architecture & Backend • Data Engineering @ UPT • I can’t do, so I teach Aldo Ziflaj @aziflaj

  7. RLFO.SUBSTACK.COM

  8. wat

  9. wat

  10. None
  11. None
  12. None

  13. wat kafka?

  14. wat kafka?

  15. None
  16. None

  17. wat k8s?

  18. None
  19. None

  20. wat cdc?

  21. None
  22. None

  23. demo time

  24. demo time may the demo gods be with us

  25. github.com/aziflaj/crabify

  26. RLFO.SUBSTACK.COM