×
Copy
Open
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Slide 1
Slide 1 text
@ Apache Kafka A Streaming Data Platform
Slide 2
Slide 2 text
@ @gamussa @confluentinc Solutions Architect Developer Advocate @gamussa in internetz Hey you, yes, you, go follow me in twitter © Who am I?
Slide 3
Slide 3 text
@ @gamussa @confluentinc A company is build on DATA FLOWS but All we have is DATA STORES
Slide 4
Slide 4 text
@ @gamussa @confluentinc
Slide 5
Slide 5 text
@ @gamussa @confluentinc
Slide 6
Slide 6 text
@ @gamussa @confluentinc
Slide 7
Slide 7 text
@ @gamussa @confluentinc
Slide 8
Slide 8 text
@ @gamussa @confluentinc
Slide 9
Slide 9 text
@ @gamussa @confluentinc Streaming Platform 1. Pub/Sub 2. Store 3. Process
Slide 10
Slide 10 text
@ @gamussa @confluentinc Streaming Platform 1. Pub/Sub 2. Store 3. Process
Slide 11
Slide 11 text
@ @gamussa @confluentinc Core abstraction DB - table Hadoop - file Messaging -?
Slide 12
Slide 12 text
@ @gamussa @confluentinc LOGS
Slide 13
Slide 13 text
@ @gamussa @confluentinc Producing to Kafka Time
Slide 14
Slide 14 text
@ @gamussa @confluentinc Producing to Kafka Time C C C
Slide 15
Slide 15 text
@ @gamussa @confluentinc Producing to Kafka - With Key Time A B C D hash(key) % numPartitions = N
Slide 16
Slide 16 text
@ @gamussa @confluentinc Producing to Kafka - No Key Time Messages will be produced in a round robin fashion
Slide 17
Slide 17 text
@ @gamussa @confluentinc Consuming From Kafka - Single Consumer C
Slide 18
Slide 18 text
@ @gamussa @confluentinc Consuming From Kafka - Grouped Consumers C C C1 C C C2
Slide 19
Slide 19 text
@ @gamussa @confluentinc Consuming From Kafka - Grouped Consumers C C C C
Slide 20
Slide 20 text
@ @gamussa @confluentinc Consuming From Kafka - Grouped Consumers 0 1 2 3
Slide 21
Slide 21 text
@ @gamussa @confluentinc Consuming From Kafka - Grouped Consumers 0 1 2 3
Slide 22
Slide 22 text
@ @gamussa @confluentinc Consuming From Kafka - Grouped Consumers 0, 3 1 2 3
Slide 23
Slide 23 text
@ @gamussa @confluentinc Producers Consumers
Slide 24
Slide 24 text
@ @gamussa @confluentinc
Slide 25
Slide 25 text
@ @gamussa @confluentinc
Slide 26
Slide 26 text
@ @gamussa @confluentinc
Slide 27
Slide 27 text
@ @gamussa @confluentinc Kafka Connect does hard work so you don’t 1. Scale out
Slide 28
Slide 28 text
@ @gamussa @confluentinc
Slide 29
Slide 29 text
@ @gamussa @confluentinc
Slide 30
Slide 30 text
@ @gamussa @confluentinc
Slide 31
Slide 31 text
@ @gamussa @confluentinc
Slide 32
Slide 32 text
@ @gamussa @confluentinc Streaming Platform 1. Pub/Sub 2. Store 3. Process
Slide 33
Slide 33 text
@ @gamussa @confluentinc Why Store?
Slide 34
Slide 34 text
@ @gamussa @confluentinc Scalability of a filesystem Throughput 100s mb/s TBs per server Commodity Hardware O(1) writes
Slide 35
Slide 35 text
@ @gamussa @confluentinc Guarantees of a database Persistence Strict ordering
Slide 36
Slide 36 text
@ @gamussa @confluentinc Replication Fault Tolerance Partitioning Scale Distributed by Design
Slide 37
Slide 37 text
@ @gamussa @confluentinc
Slide 38
Slide 38 text
@ @gamussa @confluentinc Partition Leadership and Replication Broker 1 Topic1 partition1 Broker 2 Broker 3 Broker 4 Topic1 partition1 Topic1 partition1 Leader Follower Topic1 partition2 Topic1 partition2 Topic1 partition2 Topic1 partition3 Topic1 partition4 Topic1 partition3 Topic1 partition3 Topic1 partition4 Topic1 partition4
Slide 39
Slide 39 text
@ @gamussa @confluentinc Partition Leadership and Replication - node failure Broker 1 Topic1 partition1 Broker 2 Broker 3 Broker 4 Topic1 partition1 Topic1 partition1 Leader Follower Topic1 partition2 Topic1 partition2 Topic1 partition2 Topic1 partition3 Topic1 partition4 Topic1 partition3 Topic1 partition3 Topic1 partition4 Topic1 partition4
Slide 40
Slide 40 text
@ @gamussa @confluentinc Streaming Platform 1. Pub/Sub 2. Store 3. Process
Slide 41
Slide 41 text
@ @gamussa @confluentinc What is Stream Processing? A machine for combining streams of events
Slide 42
Slide 42 text
@ @gamussa @confluentinc
Slide 43
Slide 43 text
@ @gamussa @confluentinc
Slide 44
Slide 44 text
@ @gamussa @confluentinc https://www.confluent.io/download/
Slide 45
Slide 45 text
@ @gamussa @confluentinc We are hiring! https://www.confluent.io/careers/
Slide 46
Slide 46 text
@ @gamussa @confluentinc One more thing…
Slide 47
Slide 47 text
@ @gamussa @confluentinc
Slide 48
Slide 48 text
@ @gamussa @confluentinc
Slide 49
Slide 49 text
@ @gamussa @confluentinc A Major New Paradigm
Slide 50
Slide 50 text
@ @gamussa @confluentinc Thanks! questions? @gamussa
[email protected]
We are hiring! https://www.confluent.io/careers/