Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Hands-on Data Orchestration: Building a CDC Pip...

Avatar for Aldo Ziflaj Aldo Ziflaj
January 26, 2024
Programming
3
390

Hands-on Data Orchestration: Building a CDC Pipeline on top of Kafka and Kubernetes

Avatar for Aldo Ziflaj

Aldo Ziflaj

January 26, 2024
Tweet

More Decks by Aldo Ziflaj

See All by Aldo Ziflaj
No-Bullshit Guide into Building Software
Avatar for Aldo Ziflaj aziflaj
0
310
Ruby is dead. Long live Ruby
Avatar for Aldo Ziflaj aziflaj
0
400
How to become a better developer
Avatar for Aldo Ziflaj aziflaj
0
230
Building CLI apps with Ruby
Avatar for Aldo Ziflaj aziflaj
0
66
Git SCM
Avatar for Aldo Ziflaj aziflaj
0
290
Reflections on my Project52
Avatar for Aldo Ziflaj aziflaj
0
510
Cryptanalysis - basic ciphers and a bit more
Avatar for Aldo Ziflaj aziflaj
0
120
Some hours of python
Avatar for Aldo Ziflaj aziflaj
0
67

Other Decks in Programming

See All in Programming
AtCoder Conference 2025「LLM時代のAHC」
Avatar for Yuki Imajuku imjk
2
620
Developing static sites with Ruby
Avatar for Masafumi Okura okuramasafumi
0
340
[AI Engineering Summit Tokyo 2025] LLMは計画業務のゲームチェンジャーか？ 最適化業務における活⽤の可能性と限界
Avatar for terry-u16 terryu16
1
190
Pythonではじめるオープンデータ分析〜書籍の紹介と書籍で紹介しきれなかった事例の紹介〜
Avatar for Ryo YOSHI welliving
3
700
Rubyで鍛える仕組み化プロヂュース力
Avatar for muryoimpl muryoimpl
0
260
フルサイクルエンジニアリングをAI Agentで全自動化したい 〜構想と現在地〜
Avatar for Kaito Minatoya kamina_zzz
0
340
tparseでgo testの出力を見やすくする
Avatar for utagawa kiki utgwkk
2
330
QAフローを最適化し、品質水準を満たしながらリリースまでの期間を最短化する #RSGT2026
Avatar for shibayu36 shibayu36
0
140
C-Shared Buildで突破するAI Agent バックテストの壁
Avatar for po3rin po3rin
0
430
Denoのセキュリティに関する仕組みの紹介 (toranoana.deno #23)
Avatar for uki00a uki00a
0
200
はじめてのカスタムエージェント【GitHub Copilot Agent Mode編】
Avatar for Satoshi Kaneyasu satoshi256kbyte
0
140
クラウドに依存しないS3を使った開発術
Avatar for しめさば simesaba80
0
200

Featured

See All Featured
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
Avatar for soudai sone soudai
PRO
196
70k
DBのスキルで生き残る技術 - AI時代におけるテーブル設計の勘所
Avatar for soudai sone soudai
PRO
61
47k
Improving Core Web Vitals using Speculation Rules API
Avatar for Sergey Chernyshev sergeychernyshev
21
1.3k
Fashionably flexible responsive web design (full day workshop)
Avatar for Andy Clarke malarkey
408
66k
Google's AI Overviews - The New Search
Avatar for Barry Adams badams
0
880
The Language of Interfaces
Avatar for Des Traynor destraynor
162
26k
How to Think Like a Performance Engineer
Avatar for Harry Roberts csswizardry
28
2.4k
Art, The Web, and Tiny UX
Avatar for Lynn Fisher lynnandtonic
304
21k
What does AI have to do with Human Rights?
Avatar for Per Axbom axbom
PRO
0
1.9k
JAMstack: Web Apps at Ludicrous Speed - All Things Open 2022
Avatar for David Neal reverentgeek
1
300
Chasing Engaging Ingredients in Design
Avatar for Sebastian Deterding codingconduct
0
92
What Being in a Rock Band Can Teach Us About Real World SEO
Avatar for Ade Holder 427marketing
0
160

Transcript

  1. Hands-On Data Orchestration Building a CDC Pipeline on top of

    Kafka and Kubernetes

  2. /usr/bin/whoami Aldo Ziflaj @aziflaj

  3. /usr/bin/whoami Aldo Ziflaj @aziflaj

  4. /usr/bin/whoami • Tech Lead @ Dealfront • DX: UX for

    Developers Aldo Ziflaj @aziflaj

  5. /usr/bin/whoami • Tech Lead @ Dealfront • DX: UX for

    Developers • xPubler • Systems Architecture & Backend Aldo Ziflaj @aziflaj

  6. /usr/bin/whoami • Tech Lead @ Dealfront • DX: UX for

    Developers • xPubler • Systems Architecture & Backend • Data Engineering @ UPT • I can’t do, so I teach Aldo Ziflaj @aziflaj

  7. RLFO.SUBSTACK.COM

  8. wat

  9. wat

  10. None
  11. None
  12. None

  13. wat kafka?

  14. wat kafka?

  15. None
  16. None

  17. wat k8s?

  18. None
  19. None

  20. wat cdc?

  21. None
  22. None

  23. demo time

  24. demo time may the demo gods be with us

  25. github.com/aziflaj/crabify

  26. RLFO.SUBSTACK.COM