Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Hands-on Data Orchestration: Building a CDC Pip...

Avatar for Aldo Ziflaj Aldo Ziflaj
January 26, 2024
Programming
3
350

Hands-on Data Orchestration: Building a CDC Pipeline on top of Kafka and Kubernetes

Avatar for Aldo Ziflaj

Aldo Ziflaj

January 26, 2024
Tweet

More Decks by Aldo Ziflaj

See All by Aldo Ziflaj
No-Bullshit Guide into Building Software
Avatar for Aldo Ziflaj aziflaj
0
300
Ruby is dead. Long live Ruby
Avatar for Aldo Ziflaj aziflaj
0
380
How to become a better developer
Avatar for Aldo Ziflaj aziflaj
0
230
Building CLI apps with Ruby
Avatar for Aldo Ziflaj aziflaj
0
66
Git SCM
Avatar for Aldo Ziflaj aziflaj
0
290
Reflections on my Project52
Avatar for Aldo Ziflaj aziflaj
0
510
Cryptanalysis - basic ciphers and a bit more
Avatar for Aldo Ziflaj aziflaj
0
110
Some hours of python
Avatar for Aldo Ziflaj aziflaj
0
64

Other Decks in Programming

See All in Programming
Conquering Massive Traffic Spikes in Ruby Applications with Pitchfork
Avatar for Shia riseshia
0
150
Go Conference 2025: Goで体感するMultipath TCP ― Go 1.24 時代の MPTCP Listener を理解する
Avatar for Takeru Hayasaka takehaya
7
1.6k
Go言語の特性を活かした公式MCP SDKの設計
Avatar for hond hond0413
1
180
Local Peer-to-Peer APIはどのように使われていくのか？
Avatar for Hal hal_spidernight
2
450
そのpreloadは必要？見過ごされたpreloadが技術的負債として爆発した日
Avatar for mugi mugitti9
2
3k
フロントエンド開発に役立つクライアントプログラム共通のノウハウ / Universal client-side programming best practices for frontend development
Avatar for nrs nrslib
7
3.9k
(Extension DC 2025) Actor境界を越える技術
Avatar for Himeshi teamhimeh
1
220
Web技術を最大限活用してRAW画像を現像する / Developing RAW Images on the Web
Avatar for TOMIKAWA Sotaro ssssota
2
1.2k
開発生産性を上げるための生成AI活用術
Avatar for starfish719 starfish719
1
170
実践AIチャットボットUI実装入門
Avatar for syumai syumai
7
2.5k
Introducing ReActionView: A new ActionView-Compatible ERB Engine @ Kaigi on Rails 2025, Tokyo, Japan
Avatar for Marco Roth marcoroth
3
920
私はどうやって技術力を上げたのか
Avatar for Yusuke Wada yusukebe
43
17k

Featured

See All Featured
Building Better People: How to give real-time feedback that sticks.
Avatar for Will Jessup wjessup
368
20k
VelocityConf: Rendering Performance Case Studies
Avatar for Addy Osmani addyosmani
332
24k
The Illustrated Children's Guide to Kubernetes
Avatar for Chris Short chrisshort
48
51k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
Avatar for Stéphanie Walter stephaniewalter
285
14k
Music & Morning Musume
Avatar for Bryan Veloso bryan
46
6.8k
Code Review Best Practice
Avatar for Trisha Gee trishagee
72
19k
GitHub's CSS Performance
Avatar for Jon Rohan jonrohan
1032
460k
Fantastic passwords and where to find them - at NoRuKo
Avatar for Phil Nash philnash
52
3.4k
Become a Pro
Avatar for Speaker Deck speakerdeck
PRO
29
5.5k
Into the Great Unknown - MozCon
Avatar for Noah Learner thekraken
40
2.1k
Large-scale JavaScript Application Architecture
Avatar for Addy Osmani addyosmani
514
110k
Code Reviewing Like a Champion
Avatar for maltzj maltzj
525
40k

Transcript

  1. Hands-On Data Orchestration Building a CDC Pipeline on top of

    Kafka and Kubernetes

  2. /usr/bin/whoami Aldo Ziflaj @aziflaj

  3. /usr/bin/whoami Aldo Ziflaj @aziflaj

  4. /usr/bin/whoami • Tech Lead @ Dealfront • DX: UX for

    Developers Aldo Ziflaj @aziflaj

  5. /usr/bin/whoami • Tech Lead @ Dealfront • DX: UX for

    Developers • xPubler • Systems Architecture & Backend Aldo Ziflaj @aziflaj

  6. /usr/bin/whoami • Tech Lead @ Dealfront • DX: UX for

    Developers • xPubler • Systems Architecture & Backend • Data Engineering @ UPT • I can’t do, so I teach Aldo Ziflaj @aziflaj

  7. RLFO.SUBSTACK.COM

  8. wat

  9. wat

  10. None
  11. None
  12. None

  13. wat kafka?

  14. wat kafka?

  15. None
  16. None

  17. wat k8s?

  18. None
  19. None

  20. wat cdc?

  21. None
  22. None

  23. demo time

  24. demo time may the demo gods be with us

  25. github.com/aziflaj/crabify

  26. RLFO.SUBSTACK.COM