Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Hands-on Data Orchestration: Building a CDC Pip...

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Aldo Ziflaj Aldo Ziflaj
January 26, 2024
Programming
470
3

Hands-on Data Orchestration: Building a CDC Pipeline on top of Kafka and Kubernetes

Avatar for Aldo Ziflaj

Aldo Ziflaj

January 26, 2024

More Decks by Aldo Ziflaj

See All by Aldo Ziflaj
No-Bullshit Guide into Building Software
Avatar for Aldo Ziflaj aziflaj
0
360
Ruby is dead. Long live Ruby
Avatar for Aldo Ziflaj aziflaj
0
470
How to become a better developer
Avatar for Aldo Ziflaj aziflaj
0
240
Building CLI apps with Ruby
Avatar for Aldo Ziflaj aziflaj
0
86
Git SCM
Avatar for Aldo Ziflaj aziflaj
0
310
Reflections on my Project52
Avatar for Aldo Ziflaj aziflaj
0
550
Cryptanalysis - basic ciphers and a bit more
Avatar for Aldo Ziflaj aziflaj
0
140
Some hours of python
Avatar for Aldo Ziflaj aziflaj
0
90

Other Decks in Programming

See All in Programming
Enforcing Your Architecture with Unit Tests in the AI Era (Swift Connection X)
Avatar for Stelios Frantzeskakis steliosf
PRO
1
150
AI時代のシニアエンジニアとは
Avatar for Yosuke Furukawa yosuke_furukawa
PRO
15
11k
Crash Auto Pipelines
Avatar for Veronikapj veronikapj
1
390
ActionController meets Protocol Buffers
Avatar for Sorah Fukumori sorah
1
790
あなたの await、OS まで届いてる？ strace で覗く JavaScript の非同期
Avatar for hasuto sasaki hasutosasaki
1
2.2k
私なりのハーネスエンジニアリング ～独自の言語処理系の開発を通して～
Avatar for 瀬尾佳隆 seosoft
0
180
Vapor Mode でアクセシビリティは 壊れないか検証した話
Avatar for fuqda fuqda
1
330
自作Discord音声botをLambda MicroVMsに移行した話 / Migrating My Discord Voice Bot to Lambda MicroVMs
Avatar for アキキー | Akihisa Ikeda akihisaikeda
1
300
AmebaブログはKMPから卒業します
Avatar for 伊藤光次郎 kmars0605
0
330
作って学ぶSpring BootのAuto Configuration / JJUG Night Seminar 2026-10-19
Avatar for Ryo Shindo rshindo
0
220
Web3Dライブラリを作ってVue Custom Rendererの仕組みを理解しよう / lets learn vue custom renderer by making 3d library
Avatar for にー兄さん drumath2237
1
130
우리의 Nitro Modules는 당신의 Turbo Modules보다 아름답다
Avatar for HyunWoo Lee l2hyunwoo
0
260

Featured

See All Featured
Mind Mapping
Avatar for Hélio Medeiros helmedeiros
1
430
Neural Spatial Audio Processing for Sound Field Analysis and Control
Avatar for NII S. Koyama's Lab skoyamalab
0
610
Tips & Tricks on How to Get Your First Job In Tech
Avatar for Honza Javorek honzajavorek
1
830
Winning Ecommerce Organic Search in an AI Era - #searchnstuff2025
Avatar for Aleyda Solis aleyda
2
2.2k
What Being in a Rock Band Can Teach Us About Real World SEO
Avatar for Ade Holder 427marketing
0
1.1k
BBQ
Avatar for Matthew Crist matthewcrist
90
10k
Dealing with People You Can't Stand - Big Design 2015
Avatar for Cassini Nazir cassininazir
367
27k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
Avatar for panda_program panda_program
123
22k
Product Roadmaps are Hard
Avatar for C. Todd Lombardo iamctodd
55
13k
Speed Design
Avatar for Sergey Chernyshev sergeychernyshev
33
2.2k
The Art of Delivering Value - GDevCon NA Keynote
Avatar for David Neal reverentgeek
16
2.2k
The untapped power of vector embeddings
Avatar for Frank van Dijk frankvandijk
2
2k

Transcript

  1. Hands-On Data Orchestration Building a CDC Pipeline on top of

    Kafka and Kubernetes

  2. /usr/bin/whoami Aldo Ziflaj @aziflaj

  3. /usr/bin/whoami Aldo Ziflaj @aziflaj

  4. /usr/bin/whoami • Tech Lead @ Dealfront • DX: UX for

    Developers Aldo Ziflaj @aziflaj

  5. /usr/bin/whoami • Tech Lead @ Dealfront • DX: UX for

    Developers • xPubler • Systems Architecture & Backend Aldo Ziflaj @aziflaj

  6. /usr/bin/whoami • Tech Lead @ Dealfront • DX: UX for

    Developers • xPubler • Systems Architecture & Backend • Data Engineering @ UPT • I can’t do, so I teach Aldo Ziflaj @aziflaj

  7. RLFO.SUBSTACK.COM

  8. wat

  9. wat

  10. None
  11. None
  12. None

  13. wat kafka?

  14. wat kafka?

  15. None
  16. None

  17. wat k8s?

  18. None
  19. None

  20. wat cdc?

  21. None
  22. None

  23. demo time

  24. demo time may the demo gods be with us

  25. github.com/aziflaj/crabify

  26. RLFO.SUBSTACK.COM