Tweet
Tweet

Slide 1

Slide 1 text

I don’t Want to Miss a Thing Track Database Changes with Apache Kafka Francesco Tisiot - Developer Advocate @ftisiot

Slide 2

Slide 2 text

@ftisiot

Slide 3

Slide 3 text

@ftisiot

Slide 4

Slide 4 text

@ftisiot

Slide 5

Slide 5 text

@ftisiot

Slide 6

Slide 6 text

@ftisiot What is Apache Kafka?

Slide 7

Slide 7 text

@ftisiot Topic A Topic B 0 1 2 3 4 0 1 2 3 Producer Consumer Producer Consumer Consumer

Slide 8

Slide 8 text

@ftisiot Events in a Database?

Slide 9

Slide 9 text

@ftisiot Table Log vs The Fridge Dilemma

Slide 10

Slide 10 text

@ftisiot Table Log 5 3 6 +7 +3 +6 -5 -2 +5

Slide 11

Slide 11 text

@ftisiot Integrating Apache Kafka

Slide 12

Slide 12 text

@ftisiot Kafka Connect Source Kafka Connect Sink

Slide 13

Slide 13 text

@ftisiot Changes in Kafka?

Slide 14

Slide 14 text

@ftisiot Query Based Approach

Slide 15

Slide 15 text

@ftisiot

Slide 16

Slide 16 text

@ftisiot Log Based Approach

Slide 17

Slide 17 text

@ftisiot

Slide 18

Slide 18 text

@ftisiot Debezium

Slide 19

Slide 19 text

@ftisiot

Slide 20

Slide 20 text

@ftisiot Query Bulk Query Timestamp Log INSERT UPDATE DELETE NOTES

Slide 21

Slide 21 text

@ftisiot Resources https://aiven.io https://debezium.io/ https://aiven.io/blog/using-kafka-connect-jdbc-source- a-postgresql-example https://kafka.apache.org/