Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Hands-on Data Orchestration: Building a CDC Pip...

Avatar for Aldo Ziflaj Aldo Ziflaj
January 26, 2024
Programming
440
3

Hands-on Data Orchestration: Building a CDC Pipeline on top of Kafka and Kubernetes

Avatar for Aldo Ziflaj

Aldo Ziflaj

January 26, 2024

More Decks by Aldo Ziflaj

See All by Aldo Ziflaj
No-Bullshit Guide into Building Software
Avatar for Aldo Ziflaj aziflaj
0
340
Ruby is dead. Long live Ruby
Avatar for Aldo Ziflaj aziflaj
0
440
How to become a better developer
Avatar for Aldo Ziflaj aziflaj
0
240
Building CLI apps with Ruby
Avatar for Aldo Ziflaj aziflaj
0
81
Git SCM
Avatar for Aldo Ziflaj aziflaj
0
300
Reflections on my Project52
Avatar for Aldo Ziflaj aziflaj
0
530
Cryptanalysis - basic ciphers and a bit more
Avatar for Aldo Ziflaj aziflaj
0
130
Some hours of python
Avatar for Aldo Ziflaj aziflaj
0
84

Other Decks in Programming

See All in Programming
ルールを書いて終わらせないハーネスエンジニアリング
Avatar for Yuji Yamaguchi yug1224
4
1.8k
FDEが実現するAI駆動経営の現在地
Avatar for ryuta sakamoto gonta
2
230
『コードを書く以外の』エンジニアリング〜課金基盤移行プロジェクト推進のためのTips4選
Avatar for yuriko yuriko1211
0
550
JAWS-UG横浜 #102 AWSサ終供養LT会 成仏できない AWS サービスたち 〜本日、三体供養します〜
Avatar for maroon1st maroon1st
0
250
今さら聞けない .NET CLI
Avatar for tkym htkym
0
140
自作OSでスライド発表する
Avatar for uyuki uyuki234
1
4k
ビデオ通話が繋がる0.2秒で何が起きているのか
Avatar for Miyamoto Naoyuki supurazako
2
150
ここ半年くらいでAIに作らせたR用ツール
Avatar for eitsupi eitsupi
0
320
Claude Opus 4.6以後の受託開発エンジニアの変化(Claude Code開発ノウハウ大公開スペシャルbyクラスメソッド)
Avatar for t-iida iidatakuma
1
890
AWS CDK を「作」ってみた 〜フルスクラッチで見えた CDK の裏側〜 / aws-cdk-from-scratch
Avatar for k.goto gotok365
3
2.6k
AI時代のPHPer生存戦略 ～「言語、もうなんでもよくない？」に本気で向き合う～
Avatar for viviON vivion
0
190
壊れたパーサから始める関数型設計と構成的なパーサ #fp_matsuri
Avatar for ライガー raiga0310
2
410

Featured

See All Featured
AI in Enterprises - Java and Open Source to the Rescue
Avatar for ivargrimstad ivargrimstad
0
1.4k
The Illustrated Children's Guide to Kubernetes
Avatar for Chris Short chrisshort
51
53k
AI Search: Implications for SEO and How to Move Forward - #ShenzhenSEOConference
Avatar for Aleyda Solis aleyda
1
1.3k
GraphQLとの向き合い方2022年版
Avatar for Yosuke Kurami quramy
50
15k
Why Your Marketing Sucks and What You Can Do About It - Sophie Logan
Avatar for Sophie Logan marketingsoph
0
320
sira's awesome portfolio website redesign presentation
Avatar for ElsiraPls elsirapls
0
310
SEO Brein meetup: CTRL+C is not how to scale international SEO
Avatar for Linda Hogenes lindahogenes
1
2.8k
The Illustrated Guide to Node.js - THAT Conference 2024
Avatar for David Neal reverentgeek
1
420
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
Avatar for Tammy Everts tammyeverts
55
3.4k
Automating Front-end Workflow
Avatar for Addy Osmani addyosmani
1370
210k
Bioeconomy Workshop: Dr. Julius Ecuru, Opportunities for a Bioeconomy in West Africa
Avatar for AKADEMIYA2063 akademiya2063
PRO
1
190
svc-hook: hooking system calls on ARM64 by binary rewriting
Avatar for Akira Moroo retrage
2
390

Transcript

  1. Hands-On Data Orchestration Building a CDC Pipeline on top of

    Kafka and Kubernetes

  2. /usr/bin/whoami Aldo Ziflaj @aziflaj

  3. /usr/bin/whoami Aldo Ziflaj @aziflaj

  4. /usr/bin/whoami • Tech Lead @ Dealfront • DX: UX for

    Developers Aldo Ziflaj @aziflaj

  5. /usr/bin/whoami • Tech Lead @ Dealfront • DX: UX for

    Developers • xPubler • Systems Architecture & Backend Aldo Ziflaj @aziflaj

  6. /usr/bin/whoami • Tech Lead @ Dealfront • DX: UX for

    Developers • xPubler • Systems Architecture & Backend • Data Engineering @ UPT • I can’t do, so I teach Aldo Ziflaj @aziflaj

  7. RLFO.SUBSTACK.COM

  8. wat

  9. wat

  10. None
  11. None
  12. None

  13. wat kafka?

  14. wat kafka?

  15. None
  16. None

  17. wat k8s?

  18. None
  19. None

  20. wat cdc?

  21. None
  22. None

  23. demo time

  24. demo time may the demo gods be with us

  25. github.com/aziflaj/crabify

  26. RLFO.SUBSTACK.COM