Readyset - A new era for MySQL caching

Readyset is a database scalability platform that uses transparent, event-driven caches to boost the performance and uptime of your database while driving down costs. It's wire compatible with Postgres and MySQL so it works out of the box with all of your favorite database tools and ORMs.

Transcript

1. Readyset A New Era For MySQL Caching MySQL Belgium Days 02/01/2024
2. Marcelo Altmann 2 • Senior Software Engineer @ Readyset • Senior Software Engineer @ Percona ◦ Maintainer of Percona XtraBackup for MySQL • Long time Community contributor • MySQL Code Contributor
3. Agenda
4. Agenda 4 • Intro • How Readyset Works • Readyset Architecture
5. Intro
6. Intro - Cache landscape in MySQL 6 • What is Cache
7. Intro - Cache landscape in MySQL 7 • What is Cache • Maintenance / Invalidation There are only two hard things in computer science: cache invalidation and naming things. – Phil Karlton
8. Intro - Cache landscape in MySQL 8 • What is Cache • Maintenance / Invalidation • MySQL Query Cache
9. Intro - Cache landscape in MySQL 9 • What is Cache • Maintenance / Invalidation • MySQL Query Cache • InnoDB Buffer Pool
10. Intro - Cache landscape in MySQL 10 • What is Cache • Maintenance / Invalidation • MySQL Query Cache • InnoDB Buffer Pool • ProxySQL
11. Intro - Cache landscape in MySQL 11 • What is Cache • Maintenance / Invalidation • MySQL Query Cache • InnoDB Buffer Pool • ProxySQL • External tools (eg.: Redis, memcache)
12. Readyset
13. Readyset 13 • Based on MIT PHD Thesis - Partial State in Dataflow-Based Materialized Views (Noria) by Jon Gjengset • https://github.com/readysettech/readyset • Core / Cloud • No application code changes • Automatic cache maintenance • Horizontal Scale • Wire compatible with MySQL & PostgreSQL
14. How Readyset Works
15. How Readyset Works 15 • Snapshotting & CDC (Change Data Capture) / Replication
16. How Readyset Works 16 • Snapshotting & CDC (Change Data Capture) / Replication • Dataflow Graph SELECT id, author, title, vcount FROM stories JOIN (SELECT story_id, COUNT(*) AS vcount FROM votes GROUP BY story_id) AS VoteCount ON VoteCount.story_id = stories.id WHERE stories.id = ?;
17. How Readyset Works - DataFlow Graph 17
18. How Readyset Works 18 • Snapshotting & CDC (Change Data Capture) / Replication • Dataflow Graph • Partial Materialization
19. How Readyset Works - Partial Materialization 19
20. How Readyset Works 20 • Snapshotting & CDC (Change Data Capture) / Replication • Dataflow Graph • Partial Materialization • Cache Miss
21. How Readyset Works - Partial Materialization 21
22. How Readyset Works - Partial Materialization 22
23. How Readyset Works - Partial Materialization 23
24. How Readyset Works - Partial Materialization 24
25. How Readyset Works - Partial Materialization 25
26. How Readyset Works - Partial Materialization 26
27. How Readyset Works - Partial Materialization 27
28. How Readyset Works - Partial Materialization 28
29. How Readyset Works - Partial Materialization 29
30. How Readyset Works - Partial Materialization 30
31. How Readyset Works - Partial Materialization 31
32. How Readyset Works 32 • Snapshotting & CDC (Change Data Capture) / Replication • Dataflow Graph • Partial Materialization • Cache Miss • Cache Maintenance
33. How Readyset Works - Cache Maintenance 33
34. How Readyset Works - Cache Maintenance 34
35. How Readyset Works - Cache Maintenance 35
36. How Readyset Works - Cache Maintenance 36
37. How Readyset Works 37 • Snapshotting & CDC (Change Data Capture) / Replication • Dataflow Graph • Partial Materialization • Cache Miss • Cache Maintenance • Stale Reads
38. How Readyset Works - Cache Maintenance - Stale Reads 38
39. How Readyset Works - Cache Maintenance - Stale Reads 39
40. Readyset Architecture
41. Readyset Architecture 41
42. Readyset Architecture 42
43. Summary
44. Summary 44 • Wire compatible with MySQL & PostgreSQL • No application code caches / plug & play • Automatically Cache Maintenance
45. Summary 45 • Give it a try ◦ https://github.com/readysettech/readyset/releases/ ◦ If you like, star-us, blog / tweet about your experience. • Slack Community - > https://bit.ly/readyset-slack • X / Twitter @readysetio -> https://bit.ly/readyset-x • Linkedin @readysettech -> https://bit.ly/readyset-linkedin
46. Summary 46 Happy Hour Hosted by Readyset Saturday 3rd Feb - 6PM @Delirium Café RSVP - https://bit.ly/readysetrsvp
47. Thank You!