Upgrade to Pro — share decks privately, control downloads, hide ads and more …

MySQL to NoSQL & Search Engine

Gea-Suan Lin
October 28, 2017

MySQL to NoSQL & Search Engine

Speaker: Gea-Suan Lin (@gslin)
Topic: MySQL to NoSQL & Search Engine
Conference: MOPCON 2017 (in Kaohsiung, Taiwan)

Gea-Suan Lin

October 28, 2017
Tweet

More Decks by Gea-Suan Lin

Other Decks in Technology

Transcript

  1. MySQL to
    NoSQL & Search Engine
    Gea-Suan Lin

    View Slide

  2. 我是誰?

    View Slide

  3. Gea-Suan Lin (DK)

    View Slide

  4. PIXNET (Sr. Engineer)
    KKBOX (Lead Engineer)
    104 (CTO)
    無業遊民

    View Slide

  5. 今天來講個台灣不常提到,
    但很有用的技術...

    View Slide

  6. Change data capture (CDC)

    View Slide

  7. In databases, change data capture
    (CDC) is a set of software design
    patterns used to determine (and track)
    the data that has changed so that action
    can be taken using the changed data.
    (from Wikipedia)

    View Slide

  8. MySQL Replication 就是一種 CDC

    View Slide

  9. 今天要推銷的技術...

    View Slide

  10. Python 的 mysql-replication:
    pip install mysql-replication

    View Slide

  11. Pure Python Implementation of MySQL
    replication protocol build on top of
    PyMYSQL

    View Slide

  12. https://github.com/noplay/python-mysql-r
    eplication

    View Slide

  13. Live Demo!

    View Slide

  14. 所以我們可以拿來做什麼事情?

    View Slide

  15. MySQL to Redis?

    View Slide

  16. MySQL to Cassandra?

    View Slide

  17. MySQL to Search Engine?

    View Slide

  18. MySQL to PostgreSQL?

    View Slide

  19. MySQL to Cache Invalidation?

    View Slide

  20. 或者是
    「Projects using this library」
    提到的專案

    View Slide

  21. 更重要的是...

    View Slide

  22. 組織決定技術架構

    View Slide

  23. 同個老闆直接摸 DB
    不同老闆透過 API

    View Slide

  24. 是個不給摸 DB 時的選擇

    View Slide

  25. 像是...

    View Slide

  26. Account & Other System

    View Slide

  27. Operation & Data Science

    View Slide

  28. Thanks!

    View Slide