MySQL to NoSQL & Search Engine

Speaker: Gea-Suan Lin (@gslin)
Topic: MySQL to NoSQL & Search Engine
Conference: MOPCON 2017 (in Kaohsiung, Taiwan)

Transcript

1. MySQL to
   NoSQL & Search Engine
   Gea-Suan Lin
   

   View Slide

2. 我是誰？
   

   View Slide

3. Gea-Suan Lin (DK)
   

   View Slide

4. PIXNET (Sr. Engineer)
   KKBOX (Lead Engineer)
   104 (CTO)
   無業遊民
   

   View Slide

5. 今天來講個台灣不常提到，
   但很有用的技術...
   

   View Slide

6. Change data capture (CDC)
   

   View Slide

7. In databases, change data capture
   (CDC) is a set of software design
   patterns used to determine (and track)
   the data that has changed so that action
   can be taken using the changed data.
   (from Wikipedia)
   

   View Slide

8. MySQL Replication 就是一種 CDC
   

   View Slide

9. 今天要推銷的技術...
   

   View Slide

10. Python 的 mysql-replication：
    pip install mysql-replication
    

    View Slide

11. Pure Python Implementation of MySQL
    replication protocol build on top of
    PyMYSQL
    

    View Slide

12. https://github.com/noplay/python-mysql-r
    eplication
    

    View Slide

13. Live Demo！
    

    View Slide

14. 所以我們可以拿來做什麼事情？
    

    View Slide

15. MySQL to Redis？
    

    View Slide

16. MySQL to Cassandra？
    

    View Slide

17. MySQL to Search Engine？
    

    View Slide

18. MySQL to PostgreSQL？
    

    View Slide

19. MySQL to Cache Invalidation？
    

    View Slide

20. 或者是
    「Projects using this library」
    提到的專案
    

    View Slide

21. 更重要的是...
    

    View Slide

22. 組織決定技術架構
    

    View Slide

23. 同個老闆直接摸 DB
    不同老闆透過 API
    

    View Slide

24. 是個不給摸 DB 時的選擇
    

    View Slide

25. 像是...
    

    View Slide

26. Account & Other System
    

    View Slide

27. Operation & Data Science
    

    View Slide

28. Thanks！
    

    View Slide