Slide 1

Slide 1 text

MySQL to NoSQL & Search Engine Gea-Suan Lin

Slide 2

Slide 2 text

我是誰?

Slide 3

Slide 3 text

Gea-Suan Lin (DK)

Slide 4

Slide 4 text

PIXNET (Sr. Engineer) KKBOX (Lead Engineer) 104 (CTO) 無業遊民

Slide 5

Slide 5 text

今天來講個台灣不常提到, 但很有用的技術...

Slide 6

Slide 6 text

Change data capture (CDC)

Slide 7

Slide 7 text

In databases, change data capture (CDC) is a set of software design patterns used to determine (and track) the data that has changed so that action can be taken using the changed data. (from Wikipedia)

Slide 8

Slide 8 text

MySQL Replication 就是一種 CDC

Slide 9

Slide 9 text

今天要推銷的技術...

Slide 10

Slide 10 text

Python 的 mysql-replication: pip install mysql-replication

Slide 11

Slide 11 text

Pure Python Implementation of MySQL replication protocol build on top of PyMYSQL

Slide 12

Slide 12 text

https://github.com/noplay/python-mysql-r eplication

Slide 13

Slide 13 text

Live Demo!

Slide 14

Slide 14 text

所以我們可以拿來做什麼事情?

Slide 15

Slide 15 text

MySQL to Redis?

Slide 16

Slide 16 text

MySQL to Cassandra?

Slide 17

Slide 17 text

MySQL to Search Engine?

Slide 18

Slide 18 text

MySQL to PostgreSQL?

Slide 19

Slide 19 text

MySQL to Cache Invalidation?

Slide 20

Slide 20 text

或者是 「Projects using this library」 提到的專案

Slide 21

Slide 21 text

更重要的是...

Slide 22

Slide 22 text

組織決定技術架構

Slide 23

Slide 23 text

同個老闆直接摸 DB 不同老闆透過 API

Slide 24

Slide 24 text

是個不給摸 DB 時的選擇

Slide 25

Slide 25 text

像是...

Slide 26

Slide 26 text

Account & Other System

Slide 27

Slide 27 text

Operation & Data Science

Slide 28

Slide 28 text

Thanks!