MySQL HeatWave - Supercharge your cloud native workloads with a unified OLTP, Analytics & ML database

MySQL HeatWave KubeCon + CloudNativeCon Europe 2024 Supercharge your cloud
native workloads with a unified OLTP , Analytics & ML database Olivier Dasini Cloud Solutions Architect @ Oracle MySQL [email protected] Blogs : www.dasini.net/blog/en : www.dasini.net/blog/fr Linkedin : www.linkedin.com/in/olivier-dasini Slides : https://speakerdeck.com/freshdaz

Copyright © 2024, Oracle and/or its affiliates. All rights reserved.
2 Me, Myself & I 2 Olivier DASINI  MySQL Geek  Addicted to MySQL for 15+ years  Playing with databases for 20+ years  MySQL Writer, Blogger and Speaker  Also former : DBA, Consultant, Architect, Trainer, ...  Cloud Solutions Architect at Oracle MySQL  Stay up to date!  Blog: www.dasini.net/blog/en  Linkedin: www.linkedin.com/in/olivier-dasini/  Slides: https://speakerdeck.com/freshdaz

3 Agenda 1. MySQL for Cloud Native 2. MySQL HeatWave – Analytics / Lakehouse / Machine Learning 3. Generative AI and vector store 3

4 MySQL for Cloud Native Why it is a Natural Choice? 4

5 MySQL is the Natural Choice for Cloud Native • MySQL can perform multiple roles: – Traditional RDBMS (SQL) – JSON Document Store (NoSQL) • MySQL is lightweight, inexpensive and easy to operate – Deploying multiple instances is not a problem • MySQL produces container-ready images – For both Community Edition and Enterprise Edition – MySQL has a Kubernetes Operator making the deployment of HA MySQL containers simplistic • MySQL has connectors for all mainstream programming and scripting languages • MySQL can be consumed as a service in Oracle Cloud Infrastructure • MySQL HeatWave Database Service – the only service to be 100% MySQL – Concentrate on your schema – we do all the rest (support, updates, backup, appropriate config, etc) – Removes complexity of handling state in orchestration environments such as Kubernetes

6 MySQL Official Docker Images  MySQL Server Community Edition – https://hub.docker.com/r/mysql/mysql-server/  MySQL NDB Cluster (Experimental) – https://hub.docker.com/r/mysql/mysql-cluster/  MySQL Router (transparent routing between your application and MySQL) – https://hub.docker.com/r/mysql/mysql-router/  MySQL Server Enterprise Edition – https://container-registry.oracle.com – https://support.oracle.com/ Created, maintained and supported by the MySQL team at Oracle

7 MySQL Operator for Kubernetes • The MySQL Operator for Kubernetes is designed to help operate MySQL InnoDB Cluster in Kubernetes environment: – Greatly simplify operations – Improve high-availability – Offer a more "native" Kubernetes experience to the user – https://hub.docker.com/r/mysql/mysql-operator Manage MySQL InnoDB Cluster inside a Kubernetes Cluster Kubernetes • Automated deployment and management of: – MySQL Server – MySQL Router • Self-healing • Backup & Restore • Scaleup/Scaledown of Router & Server • Rolling upgrades with minimal downtime • Community Edition, Open Source License (UPL) • Enterprise Edition • Fully supported by Oracle • Configuration Management • Deploy from InnoDB CLONE • Private container registries Available on GitHub: https://github.com/mysql/mysql-operator

8 MySQL Operator for Kubernetes - Features •Automated deployment and management of • MySQL Server • MySQL Router •Self-healing •Backup & Restore to/from • AWS S3 • OCI Object Storage •Scaleup/Scaledown of Routers & Servers •Rolling upgrades with minimal downtime •Configuration Management •Deploy from InnoDB CLONE •Private container registries •CNCF cert-manager support •Community Edition, Open Source License (UPL) •Enterprise Edition • Data Masking • Encryption Functions • Keyring Functions •Fully supported by Oracle Level III Maturity Operator Next step: Level IV

9 MySQL HeatWave One Database for OLTP, OLAP , ML & Lakehouse

10 The MySQL universe - The view from the moon… MySQL Commercial/Enterprise MySQL Community + MySQL Enterprise Backup MySQL Enterprise Monitor MySQL Enterprise Authentication MySQL Enterprise Audit MySQL Enterprise TDE MySQL Enterprise Masking MySQL Enterprise Firewall MySQL Technical Support … MySQL Cluster CGE MySQL Cluster NDB + MySQL Enterprise + MySQL Cluster Manager MySQL Community MySQL Server MySQL Client, Workbench MySQL Shell MySQL GR plugin & InnoDB Cluster & Router MySQL Operator for Kubernetes MySQL Connector (C API, Java, Node.js, others) MySQL Support for MS VS Code (Preview) … MySQL Cluster NDB MySQL NDB Storage Engine MySQL NDB Operator for Kubernetes MySQL HeatWave (Cloud Services) MySQL HeatWave Databases Services (for OLTP) MySQL HeatWave (for Analytics) MySQL HeatWave AutoML (for Machine Learning) MySQL HeatWave on AWS MySQL HeatWave on Azure MySQL HeatWave Lakehouse Community, Enterprise, Cloud Services (HeatWave) https://www.mysql.com/products

11 MySQL HeatWave Cloud Service 100% developed, managed, and supported by the MySQL team Automation MySQL HeatWave Database High Availability Read Replicas Backup Query Acceleration AutoPilot AutoML Security Patch & Upgrade Provision & Configure OS OS Security Patch & Upgrade OS Installation Server Hardware Provisioning & Maintenance Storage Storage Provisioning & Maintenance Data Center Rack & Space Power, HVAC, Networking

12 … the MySQL Cloud services made by the MySQL Team The MySQL HeatWave “Family” “MySQL HeatWave” MySQL HeatWave for OLTP (OLTP) General Purpose Optimized for OLTP MySQL HeatWave Lakehouse (Lakehouse) OLTP + Analytics (OLAP) + Machine Learning MySQL HeatWave Analytics (Warehouse) OLTP + Analytics (OLAP) + Machine Learning InnoDB Lakehouse InnoDB RAPID InnoDB RAPID

13 Analytics In-Memory Query Accelerator

14 MySQL HeatWave - MySQL in-Memory Query Accelerator Architecture

15 *Benchmark queries are derived from the TPC-H benchmark, but results are not comparable to published TPC-H benchmark results since they do not comply with the TPC-H specification 400Gb, 64 cores MySQL HeatWave dramatically speeds up analytic queries

16 MySQL HeatWave Optimized for Data Warehouse , Machine Learning, and OLTP

17 Already lowest cost in industry for data warehouse TPC-H 10TB price performance comparison 13x better than Redshift 28x better than Snowflake 28x better than BigQuery 62x better than Databricks 3 year reserved, paid upfront Standard Edition 1 year reserved 1 year reserved Benchmark queries are derived from the TPC-H benchmarks, but results are not comparable to published TPC-H benchmark results since these do not comply with the TPC-H specifications. https://www.oracle.com/mysql/heatwave/performance/#heatwave-on-oci

18 Lakehouse Fast analytics across databases and object storage

19 MySQL HeatWave Lakehouse Process data in object store and transactional database  Process and query 100’s of TB of data in the object store — in a variety of file formats  Query data across MySQL, the object store, or both—using standard MySQL commands  Querying the database is as fast as querying the object store Scales from 16 GB to 512 TB

20 Provides flexibility to develop applications on object store without any performance, cost impact Same price-performance when data inside MySQL or in object store HeatWave HeatWave Lakehouse Snowflake Redshift Google Big Query Databricks 0 10 20 30 40 50 60 70 80 90 100 1.5 1.5 41.9 20.2 41.4 92.5 10TB TPC-H Price-Performance Price-Performance (cents) • 10 HeatWave Nodes, X-Large cluster for Snowflake; 10 nodes of ra3.4xlarge for Redshift; 800 slots for Google BigQuery; Large cluster for Databricks • Standard edition price for Snowflake; 3 yr upfront price for Redshift; 1 year reserved price for Google BigQuery and Databricks https://www.oracle.com/mysql/heatwave/performance/#heatwave-lakehouse

21 Machine Learning Fully automated in-database machine learning

22 In-database machine learning with MySQL HeatWave AutoML Accelerate ML initiatives, increase security, and reduce costs

23 Classification Classify warranty claims Identify similar users Recommend movies Recommender System Loan default prediction Predict flight delay Rain fall prediction Regression Predict Advt spend ROI Demand forecasting Anomaly Detection Detect anomalous credit card spend Identify game hacker Fully automated in-database machine learning • In-database • Secure • Fully automated training • 25x faster than Redshift ML • Explainable • No additional cost Time-series forecasting Training, inference, explanation with HeatWave AutoML

24 Generative AI and vector store Interact with MySQL HeatWave in natural language

25 Generative AI with MySQL HeatWave vector store  Users can query and retrieve information in natural language  Efficient searching of documents in HeatWave Lakehouse Users can interact with MySQL HeatWave in natural language https://blogs.oracle.com/mysql/post/introducing-vector-store-and-generative-ai-in-mysql-heatwave Private preview

26 Vector store provides context to LLM for more relevant results Users can interact with MySQL HeatWave in natural language https://blogs.oracle.com/mysql/post/introducing-vector-store-and-generative-ai-in-mysql-heatwave Private preview

27 Vector store provides context to LLM for more relevant results Users can interact with MySQL HeatWave in natural language https://blogs.oracle.com/mysql/post/introducing-vector-store-and-generative-ai-in-mysql-heatwave Private preview

28 MySQL HeatWave Social ECommerce FinTech SaaS InnoDB HeatWave OLTP OLAP ML Tools Machine Learning Autopilot Lakehouse Database Exports MySQL HeatWave Analytics tools Database One Database for Transactional, Data Warehouse, Lakehouse & Machine Learning

Get $300 in credits and try free for 30 days
Get started with MySQL HeatWave oracle.com/mysql/free Learn more about MySQL HeatWave oracle.com/mysql Request a guided workshop Ask your account manager 30 Copyright © 2024, Oracle and/or its affiliates

Merci! Q&R Olivier Dasini Cloud Solutions Architect @ Oracle MySQL
[email protected] Blogs : www.dasini.net/blog/en : www.dasini.net/blog/fr Linkedin : www.linkedin.com/in/olivier-dasini Twitter : @freshdaz

35 MySQL Autopilot: machine learning-powered automation Workload aware automation for analytics, OLTP and Lakehouse Workload aware automation for analytics, OLTP and Lakehouse

36 • MySQL Autopilot indexing (limited availability) – Helps customers eliminate the time-consuming tasks of creating optimal indexes for their OLTP workloads and maintaining those over time as workloads evolve. MySQL Autopilot automatically determines the indexes customers should create or drop from their tables to optimize their OLTP throughput, using machine learning to make a prediction based on individual application workloads. In addition, Autopilot indexing predicts the expected improvement with the recommended indexes without creating those indexes and without incurring compute or storage overhead on the users’ tenancy • Auto compression – Helps customers determine the optimal compression algorithm for each column, which improves load and query performance with faster data compression and decompression. By reducing memory usage, customers can cut costs by up to 25 percent • Adaptive query execution – Helps customers optimize the execution plan of a query after the query has started to execute, improving the performance of ad hoc queries by up to 25 percent. It uses information obtained from the partial execution of the query to adjust data structures and system resources and then independently optimizes query execution for each HeatWave node based on actual data distribution at run time • Auto load and unload – Autopilot automatically loads the columns being used in an application workload to HeatWave and automatically unload tables that were never or rarely queried. This helps free up memory and reduce costs for customers, without having to manually perform this task NEW MySQL Autopilot: machine learning-powered automation Help improve performance and scalability without requiring database tuning expertise Help improve performance and scalability without requiring database tuning expertise

MySQL HeatWave - Supercharge your cloud native workloads with a unified OLTP, Analytics & ML database

MySQL HeatWave - Supercharge your cloud native workloads with a unified OLTP, Analytics & ML database

More Decks by Olivier DASINI

Other Decks in Technology

Featured

Transcript