Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Hands-on Data Orchestration: Building a CDC Pip...

Avatar for Aldo Ziflaj Aldo Ziflaj
January 26, 2024
Programming
440
3

Hands-on Data Orchestration: Building a CDC Pipeline on top of Kafka and Kubernetes

Avatar for Aldo Ziflaj

Aldo Ziflaj

January 26, 2024

More Decks by Aldo Ziflaj

See All by Aldo Ziflaj
No-Bullshit Guide into Building Software
Avatar for Aldo Ziflaj aziflaj
0
350
Ruby is dead. Long live Ruby
Avatar for Aldo Ziflaj aziflaj
0
450
How to become a better developer
Avatar for Aldo Ziflaj aziflaj
0
240
Building CLI apps with Ruby
Avatar for Aldo Ziflaj aziflaj
0
82
Git SCM
Avatar for Aldo Ziflaj aziflaj
0
300
Reflections on my Project52
Avatar for Aldo Ziflaj aziflaj
0
540
Cryptanalysis - basic ciphers and a bit more
Avatar for Aldo Ziflaj aziflaj
0
130
Some hours of python
Avatar for Aldo Ziflaj aziflaj
0
86

Other Decks in Programming

See All in Programming
React本体のコードリーディング
Avatar for high-g high_g_engineer
1
150
ドリフトを絶対に許さない（？）CDK運用 / CDK Ops with Zero Tolerance for Drifts (?)
Avatar for アキキー | Akihisa Ikeda akihisaikeda
1
200
AWS CDK を「作」ってみた 〜フルスクラッチで見えた CDK の裏側〜 / aws-cdk-from-scratch
Avatar for k.goto gotok365
3
2.8k
PHP に部分適用が来るぞ！……ところで何それ？おいしいの？ #phpcon / phpcon-2026
Avatar for shogogg shogogg
0
690
Jindong: Introducing Declarative Haptics in Compose Multiplatform
Avatar for HyunWoo Lee l2hyunwoo
0
120
ここ半年くらいでAIに作らせたR用ツール
Avatar for eitsupi eitsupi
0
390
仕様書を書く前にハーネスを作る - Agent Native開発は「探索を速く、判定を固く」
Avatar for Gota gotalab555
4
1.7k
Laravel Boostに学ぶ、AIにPHPを書かせる技術 〜OSSの実装から蒸留するエージェント制御の王道〜
Avatar for 武田 憲太郎 kentaroutakeda
3
710
楽しそうなつよつよエンジニアと目が死んでる僕/A brilliant engineer having a blast, and dead-eyed me.
Avatar for Ryusei Ohkura 3l4l5
2
190
仕様駆動開発の消費期限
Avatar for watany watany
20
8.6k
Flow は今どうなっているか
Avatar for mizdra mizdra
PRO
0
610
生成AIで帳票OCRが「簡単に」作れる時代になった？
Avatar for Shohei Kondo kon_shou
0
1.1k

Featured

See All Featured
What Being in a Rock Band Can Teach Us About Real World SEO
Avatar for Ade Holder 427marketing
0
1.1k
Everyday Curiosity
Avatar for Cassini Nazir cassininazir
0
290
Skip the Path - Find Your Career Trail
Avatar for Mark Kilby mkilby
1
190
AI in Enterprises - Java and Open Source to the Rescue
Avatar for ivargrimstad ivargrimstad
0
1.4k
Why Your Marketing Sucks and What You Can Do About It - Sophie Logan
Avatar for Sophie Logan marketingsoph
0
390
Building Better People: How to give real-time feedback that sticks.
Avatar for Will Jessup wjessup
370
20k
End of SEO as We Know It (SMX Advanced Version)
Avatar for Michael King ipullrank
3
4.4k
Large-scale JavaScript Application Architecture
Avatar for Addy Osmani addyosmani
515
110k
Leading Effective Engineering Teams in the AI Era
Avatar for Addy Osmani addyosmani
9
2.3k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
Avatar for Sam Stephenson sstephenson
162
16k
WENDY [Excerpt]
Avatar for Tessa Abrams tessaabrams
11
39k
Leadership Guide Workshop - DevTernity 2021
Avatar for David Neal reverentgeek
1
340

Transcript

  1. Hands-On Data Orchestration Building a CDC Pipeline on top of

    Kafka and Kubernetes

  2. /usr/bin/whoami Aldo Ziflaj @aziflaj

  3. /usr/bin/whoami Aldo Ziflaj @aziflaj

  4. /usr/bin/whoami • Tech Lead @ Dealfront • DX: UX for

    Developers Aldo Ziflaj @aziflaj

  5. /usr/bin/whoami • Tech Lead @ Dealfront • DX: UX for

    Developers • xPubler • Systems Architecture & Backend Aldo Ziflaj @aziflaj

  6. /usr/bin/whoami • Tech Lead @ Dealfront • DX: UX for

    Developers • xPubler • Systems Architecture & Backend • Data Engineering @ UPT • I can’t do, so I teach Aldo Ziflaj @aziflaj

  7. RLFO.SUBSTACK.COM

  8. wat

  9. wat

  10. None
  11. None
  12. None

  13. wat kafka?

  14. wat kafka?

  15. None
  16. None

  17. wat k8s?

  18. None
  19. None

  20. wat cdc?

  21. None
  22. None

  23. demo time

  24. demo time may the demo gods be with us

  25. github.com/aziflaj/crabify

  26. RLFO.SUBSTACK.COM