Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Hands-on Data Orchestration: Building a CDC Pip...

Avatar for Aldo Ziflaj Aldo Ziflaj
January 26, 2024
Programming
3
330

Hands-on Data Orchestration: Building a CDC Pipeline on top of Kafka and Kubernetes

Avatar for Aldo Ziflaj

Aldo Ziflaj

January 26, 2024
Tweet

More Decks by Aldo Ziflaj

See All by Aldo Ziflaj
No-Bullshit Guide into Building Software
Avatar for Aldo Ziflaj aziflaj
0
280
Ruby is dead. Long live Ruby
Avatar for Aldo Ziflaj aziflaj
0
360
How to become a better developer
Avatar for Aldo Ziflaj aziflaj
0
220
Building CLI apps with Ruby
Avatar for Aldo Ziflaj aziflaj
0
63
Git SCM
Avatar for Aldo Ziflaj aziflaj
0
290
Reflections on my Project52
Avatar for Aldo Ziflaj aziflaj
0
500
Cryptanalysis - basic ciphers and a bit more
Avatar for Aldo Ziflaj aziflaj
0
110
Some hours of python
Avatar for Aldo Ziflaj aziflaj
0
64

Other Decks in Programming

See All in Programming
Kotlin エンジニアへ送る：Swift 案件に参加させられる日に備えて～似てるけど色々違う Swift の仕様 / from Kotlin to Swift
Avatar for Elvis Shi lovee
1
240
技術懸念に立ち向かい 法改正を穏便に乗り切った話
Avatar for popCashew pop_cashew
0
1.5k
Prism.parseで 300本以上あるエンドポイントに 接続できる権限の一覧表を作ってみた
Avatar for hatsu hatsu38
1
110
Rails産でないDBを Railsに引っ越すHACK - Omotesando.rb #110
Avatar for lni_T lnit
1
170
Team topologies and the microservice architecture: a synergistic relationship
Avatar for Chris Richardson cer
PRO
0
910
コードの90%をAIが書く世界で何が待っているのか / What awaits us in a world where 90% of the code is written by AI
Avatar for r-kagaya rkaga
41
27k
Bytecode Manipulation 으로 생산성 높이기
Avatar for Daekyu bigstark
2
360
都市をデータで見るってこういうこと　PLATEAU属性情報入門
Avatar for nokonoko1203 nokonoko1203
1
540
C++20 射影変換
Avatar for Akira Takahashi faithandbrave
0
500
GoのGenericsによるslice操作との付き合い方
Avatar for syumai syumai
2
670
機械学習って何？ 5分で解説頑張ってみる
Avatar for Kazuki Ishikawa kuroneko2828
0
220
データの民主化を支える、透明性のあるデータ利活用への挑戦 2025-06-25 Database Engineering Meetup#7
Avatar for Kentaro Yoshida y_ken
0
260

Featured

See All Featured
JavaScript: Past, Present, and Future - NDC Porto 2020
Avatar for David Neal reverentgeek
48
5.4k
Building an army of robots
Avatar for Kyle Neath kneath
306
45k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
Avatar for Marc Duiker marcduiker
30
2.1k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
Avatar for Rebecca Miller-Webster rmw
34
3k
GraphQLとの向き合い方2022年版
Avatar for Yosuke Kurami quramy
46
14k
Done Done
Avatar for chrislema chrislema
184
16k
Docker and Python
Avatar for Tania Allard trallard
44
3.4k
How to Think Like a Performance Engineer
Avatar for Harry Roberts csswizardry
24
1.7k
Intergalactic Javascript Robots from Outer Space
Avatar for Vicent Martí tanoku
271
27k
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
63
7.8k
Designing for Performance
Avatar for Lara Hogan lara
609
69k
Typedesign – Prime Four
Avatar for Hannes Fritz hannesfritz
42
2.7k

Transcript

  1. Hands-On Data Orchestration Building a CDC Pipeline on top of

    Kafka and Kubernetes

  2. /usr/bin/whoami Aldo Ziflaj @aziflaj

  3. /usr/bin/whoami Aldo Ziflaj @aziflaj

  4. /usr/bin/whoami • Tech Lead @ Dealfront • DX: UX for

    Developers Aldo Ziflaj @aziflaj

  5. /usr/bin/whoami • Tech Lead @ Dealfront • DX: UX for

    Developers • xPubler • Systems Architecture & Backend Aldo Ziflaj @aziflaj

  6. /usr/bin/whoami • Tech Lead @ Dealfront • DX: UX for

    Developers • xPubler • Systems Architecture & Backend • Data Engineering @ UPT • I can’t do, so I teach Aldo Ziflaj @aziflaj

  7. RLFO.SUBSTACK.COM

  8. wat

  9. wat

  10. None
  11. None
  12. None

  13. wat kafka?

  14. wat kafka?

  15. None
  16. None

  17. wat k8s?

  18. None
  19. None

  20. wat cdc?

  21. None
  22. None

  23. demo time

  24. demo time may the demo gods be with us

  25. github.com/aziflaj/crabify

  26. RLFO.SUBSTACK.COM