Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Kafka-Section2
Search
Pelin Sarıhan
July 01, 2020
Technology
5
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Kafka-Section2
💻
GitHub
🌐
pelinsarihan.com
💼
LinkedIn
Pelin Sarıhan
July 01, 2020
Transcript
17 slides
Bölüm 2 Pelin Sarıhan Senior Software Engineer /pelinsarihan Kafka 101
/pelinsarihan /pelinsarihan
Bölüm 2 Apache Kafka Konular • Apache Kafka Nedir? •
Kafka Nerelerde Kullanılır? • Kafka’ nın Avantajları Nelerdir? • Kafka Bileşenleri Nelerdir? • Kafka Nasıl Çalışır? • Topic Bazlı Dağıtık Sistem Nedir?
•Franz Kafka Kimdir?
Apache Kafka Nedir?
Kafka Nerelerde Kullanılır?
• Hızlı • Ölçeklenebilir • Güvenilir • Sağlam • Open-Source
Kafka’ nın Avantajları Nelerdir?
Kafka’ nın Bileşenleri Nedir? • Fire & Forget • Synchronous
Send • Asynchronous Send
Kafka Nasıl Çalışır? Kafka Broker Port:9092 Logs Topic 0: Application
Log 1: System Log producer 2: Error Log consumer Application Log push et 0: Application Log System Log push et 1: System Log Error Log push et 2: Error Log Pozisyon bilgisi dön
Kafka Nasıl Çalışır? Kafka Broker Port:9092 Logs Topic Partition 1
producer CPU Error Application Error DB Error Memory Error Socket Error Disk Error Partition 2 0: CPU Error 0: Application Error 1: Memory Error 1: DB Error 2: Disk Error 2: Socket Error
Kafka Nasıl Çalışır? Kafka Broker Port:9092 Logs Topic Partition 1
Partition 2 0: CPU Error 0: Application Error 1: Memory Error 1: DB Error 2: Disk Error 2: Socket Error consumer 0: Application Error 1: DB Error 2: Socket Error
Kafka Nasıl Çalışır? • Queue, 1 mesaj 1 kere publish
edilir, 1 consumer tarafından consume edilir. • Pub/Sub, 1 mesaj publish edildiğinde, 1 den fazla consumer tarafından consume edilir.
consumers Kafka Broker Topic producer Mobil Encoder 1K, 2K Encoder
4K, 8K Encoder clients
Kafka Broker Port:9092 Logs Topic Partition 1 0: CPU Error
Partition 2 Consumer Group 0: Application Error 1: Memory Error 1: DB Error 2: Disk Error 2: Socket Error Consumer-1 (Partition 1&2) 0: Application Error 1: DB Error 0: CPU Error 1: Memory Error 2: Socket Error 2: Disk Error
Kafka Broker Port:9092 Logs Topic Partition 1 0: CPU Error
Partition 2 Consumer Group 0: Application Error 1: Memory Error 1: DB Error 2: Disk Error 2: Socket Error Consumer-1 (Partition 1) Consumer-2 (Partition 2) Consumer-1 (Partition 1) Consumer-2 (Partition 2) 0: CPU Error 0: Application Error 1: Memory Error 1: DB Error 2: Disk Error 2: Socket Error
Consumer Group Kafka Broker Port:9092 Encoder Topic Mobil Encoder (Partition
1) Partition 1 0: Raw Video Consumer Group 1: Raw Video producer 2: Raw Video 3: Raw Video 1K, 2K Video Encoder (Partition 1) Consumer Group 4K, 8K Video Encoder (Partition 1)
Topic Bazlı Dağıtık Sistem Nedir? Kafka Broker Port:9092 Kafka Broker
Port:9093 Logs Topic Logs Topic Partition 1 Partition 2 Partition 1 0: CPU Error 0: Application Error 0: Application Error 0: CPU Error 1: Memory Error 1: DB Error 1: DB Error 1: Memory Error 2: Disk Error 2: Socket Error 2: Socket Error 2: Disk Error • Leader • Follower • Replica Partition 2
Q&A /pelinsarihan /pelinsarihan /pelinsarihan
More Decks by Pelin Sarıhan
See All by Pelin Sarıhan
Building Resilience & Stable Microservices
pelinsarihan
0
24
Kafka-Section1
pelinsarihan
0
3
Other Decks in Technology
See All in Technology
統制されたID・権限をどう利用するか : DPoP/FAPIによるAPIセキュリティ強化
oidfj
2
300
閉域網でのAPI公開の選択肢全部比較!
takano0131
5
700
IVRy における AI 時代のデータプロダクトと事業開発
ivry_presentationmaterials
0
100
ノードが消える前提で設計する!Karpenterで金融システムを止めないためのノウハウ大全
daitak
1
250
技術書典で本を売る流れ
yoshimura_datam
0
130
フロントエンドのテストカバレッジは 100%強制がいい
bengo4com
5
1.6k
ワークフローからハーネスへ — Web フレームワークの作者たちが AI エージェントに向かう理由
azukiazusa1
2
850
専門家に使ってもらうAIプロダクトをつくる - 病院の医事課向けDPCコーディング支援システムの設計と評価
hagino3000
4
1k
社内アプリ基盤「Quartz」による、 非エンジニアとAIに本番デプロイを 任せても壊れないプラットフォームの設計
staka121
PRO
1
230
[DBRE Summit 26] DBRE はデータベース運用をどう変えたのか
_awache
0
130
現地速報! Microsoft Ignite アップデートレポート
kasada
1
460
OpenTelemetryで変わった 新時代のCloudWatchメトリクス監視
tsukuboshi
0
500
Featured
See All Featured
The Invisible Side of Design
smashingmag
301
52k
Discover your Explorer Soul
emna__ayadi
2
1.3k
Noah Learner - AI + Me: how we built a GSC Bulk Export data pipeline
techseoconnect
PRO
0
500
Why You Should Never Use an ORM
jnunemaker
PRO
61
10k
Scaling GitHub
holman
464
140k
Breaking role norms: Why Content Design is so much more than writing copy - Taylor Woolridge
uxyall
2
540
Music & Morning Musume
bryan
48
7.5k
Large-scale JavaScript Application Architecture
addyosmani
516
110k
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
33
5.9k
New Earth Scene 8
popppiees
5
2.9k
Visual Storytelling: How to be a Superhuman Communicator
reverentgeek
2
750
AI: The stuff that nobody shows you
jnunemaker
PRO
12
1.3k