What’s New in MySQL HeatWave - 100% Developed, Managed and Supported by the Oracle MySQL Team

Oracle now sees MySQL as a core part of its strategy, supported by significant investments in new MySQL Heatwave cloud offerings on OCI, AWS and Azure.

In this presentation you will find the latest MySQL HeatWave news:
- MySQL HeatWave Machine Learning
- MySQL HeatWave on AWS & Azure
- MySQL HeatWave DataLake

Transcript

1. What’s New in MySQL HeatWave 100% Developed, Managed and Supported by the Oracle MySQL Team Olivier Dasini MySQL Cloud Principal Solutions Architect EMEA olivier.dasini@oracle.com Blogs : www.dasini.net/blog/en : www.dasini.net/blog/fr Linkedin: www.linkedin.com/in/olivier-dasini Twitter : @freshdaz
2. Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 2 Me, Myself & I  MySQL Geek  Addicted to MySQL for 15+ years  Playing with databases for 20+ years  MySQL Writer, Blogger and Speaker  Also: DBA, Consultant, Architect, Trainer, ...  MySQL Cloud Principal Solutions Architect EMEA at Oracle  Stay up to date!  Blog: www.dasini.net/blog/en  Linkedin: www.linkedin.com/in/olivier-dasini/  Twitter: @freshdaz Olivier DASINI
3. MySQL HeatWave Database Service Copyright © 2022, Oracle and/or its affiliates The MySQL Cloud Service 100% developed, managed, & supported by the MySQL team
4. MySQL HeatWave Database Service is a fully managed cloud service MySQL On Premise MySQL Database Service Database Scaling Backup Security Patch & Upgrade Provision & Configure OS OS Security Patch & Upgrade OS Installation Server Hardware Purchase & Maintenance Storage Storage Purchase & Maintenance Data Center Rack & Space Power, HVAC, Networking Automated Manual 6 Automate many of the manual tasks Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
5. MySQL HeatWave Database Service – Highlights 1/2 Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 7 A fully managed cloud service • Easy provisioning – Best default configuration for Performance, Security & Compliance – Fast Data Import • Managed manual & automatic backups with Point In Time Recovery • Always up-to-date • Automation via Terraform, CLI, SDK, API • Flexibility to grow as you go – Dynamic configuration changes – Online scale storage size – Online enable and disable High Availability – Online add and remove Read Replicas & Replication Channels • Metrics & Alarms – Enable you to measure useful quantitative data of the MySQL DB system
6. MySQL HeatWave Database Service – Highlights 2/2 Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 8 A fully managed cloud service • Data Security – MySQL Database Service utilizes encryption to keep your data private • Encryption at rest • Encryption in transit (TLS) – Enforces use of private networks and security lists – Data masking functions – Identity federation – Password policy validation • Replication – Inbound Replication: from a source to a DB system – Outbound Replication: asynchronous replication of your DB system database • Audit Service – MySQL Database integrates with the Oracle Cloud Infrastructure Audit Service • Standalone – Single-instance MySQL DB System • High Availablility – Guarantees if one instance fails, another takes over, with zero data loss and minimal downtime • HeatWave – A distributed, scalable, shared-nothing, in-memory, hybrid columnar, query processing engine designed for extreme performance
7. MySQL HeatWave an In-Memory Query Accelerator Copyright © 2022, Oracle and/or its affiliates The only MySQL service with a massively-scalable integrated analytics engine Available today on OCI / AWS / Azure https://www.oracle.com/mysql/heatwave/
8. During the last 20 years MySQL has democratized the usage of transactional databases. Now with MySQL HeatWave we are in the process of democratizing Analytics and Machine Learning. With MySQL HeatWave, valorizing your data has never been so easy! MySQL HeatWave - MySQL in-Memory Query Accelerator The only MySQL service with a massively-scalable, native query accelerator Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 10
9. • A fully managed MySQL database service, powered by the integrated HeatWave a massively parallel, high-performance, in-memory query processing engine optimized to manage half a petabyte-scale data size across a cluster of nodes • It’s the only cloud database service that combines transactions, analytics, and machine learning services into one MySQL Database, delivering real-time, secure analytics without the complexity, latency, and cost of ETL duplication What is MySQL HeatWave? The only MySQL service with a massively-scalable, native query accelerator https://dev.mysql.com/doc/heatwave/en/heatwave-architecture.html Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 11
10. One database is better than two Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 12 Analytics tools and applications Transactional applications OLTP engine HeatWave analytics cluster 1>2 with MySQL HeatWave Easily run high performance analytics against your MySQL database, no ETL required Query Accelerator InnoDB One service for OTLP & OLAP No ETL duplication Unmatched performance, at a fraction of the cost Real-time analytics Improved security Applications work without changes
11. *Benchmark queries are derived from the TPC-H benchmark, but results are not comparable to published TPC-H benchmark results since they do not comply with the TPC-H specification 400G, 64 cores MySQL HeatWave dramatically speeds up analytic queries Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 13
12. MySQL HeatWave performance and price comparison Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 14 30TB TPCH, MySQL HeatWave is faster, cheaper & easier to use than all the competitive database services See documented performance comparisons that show how HeatWave is 6.5X faster than Amazon Redshift at half the cost, 1400X faster than Amazon Aurora at half the cost, and 5400X faster than Amazon RDS for MySQL at two-thirds the cost www.oracle.com/mysql/heatwave/performance
13. TPCH, MySQL HeatWave is faster, cheaper & easier to use than all the competitive database services OLAP Performance 3x faster than Synapse 6.5x faster than Redshift 7x faster than Snowflake 10x faster than Big Query 1100x faster than Aurora 5400x faster than RDS OLAP Price Performance 15x better than Synapse 13x better than Redshift 35x better than Snowflake 37x better than Big Query 2200x better than Aurora 7000x better than RDS MySQL Mix workload: OLAP + OLTP 20x-500x faster than Aurora 50x-1200x better price/perf than Aurora MySQL HeatWave Performance and Price Summary Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 15 15 www.oracle.com/fr/mysql/heatwave
14. MySQL HeatWave ML Copyright © 2022, Oracle and/or its affiliates Build, train, deploy, & explain machine learning models within MySQL HeatWave, at no additional cost Available today on OCI / AWS / Azure https://www.oracle.com/mysql/heatwave/
15. In-database machine learning with MySQL HeatWave Accelerate ML initiatives, increase security, and reduce costs Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 17
16. HeatWave ML automates the ML lifecycle and all models can be explained Dataset Data preprocessing Algorithm selection Adaptive sampling Feature selection Hyper-parameter tuning Tuned model Model explainer Prediction explainer Regulatory compliance Fairness Repeatability Causality Trust HeatWave ML leverages Oracle AutoML technology to automate the process of training a machine learning model https://dev.mysql.com/doc/heatwave/en/heatwave-machine-learning.html Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 18
17. 19 Copyright © 2022, Oracle and/or its affiliates. All rights reserved. • You only need to use a limited set of SQL routines: ✔ ML_TRAIN: Trains a machine learning model for a given training dataset ✔ ML_PREDICT_ROW: Makes predictions for one or more rows of data ✔ ML_PREDICT_TABLE: Makes predictions for a table of data ✔ ML_EXPLAIN_ROW: Explains predictions for one or more rows of data ✔ ML_EXPLAIN_TABLE: Explains predictions for a table of data ✔ ML_SCORE: Computes the quality of a model ✔ ML_MODEL_LOAD: Loads a machine learning model for predictions and explanations ✔ ML_MODEL_UNLOAD: Unloads a machine learning model • In addition, with MySQL HeatWave ML, there is no need to move or reformat your data • Data and machine learning models never leave the MySQL Database Service, which saves you time and effort while keeping your data and models secure MySQL HeatWave ML uses a set of SQL routines Machine Learning with MySQL HeatWave is so simple
18.  Produces more accurate results  Trains models 25X faster on average  1% of the cost  Scales as more modes are added HeatWave ML vs Redshift ML: Benchmarks See Benchmark details: https://www.oracle.com/mysql/heatwave/performance/ Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 20
19. MySQL HeatWave ML – Run Machine Learning on existing cluster 21 Copyright © 2022, Oracle and/or its affiliates. All rights reserved. Build, train, deploy, & explain machine learning models within MySQL HeatWave, at no additional cost Single MySQL database for all applications All existing applications work without any changes Train, inference & explain within the database No need to learn new language or ML packages
20. Ready for the distributed cloud Copyright © 2022, Oracle and/or its affiliates Available in public clouds and in your data center
21. Available in different public clouds Optimized to deliver the best price performance in each cloud NEW NEW NEW Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 23
22. • MySQL HeatWave runs natively on AWS, optimized for AWS infrastructure • Data doesn’t leave AWS – saves egress cost, and avoids compliance approvals • Lowest latency access to MySQL HeatWave • Tight integration with the AWS ecosystem – S3, CloudWatch, PrivateLink • Easier migration from other databases (e.g., Amazon Aurora, Redshift, Snowflake) MySQL HeatWave on AWS NEW Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 24
23. MySQL HeatWave offers up to 10x better throughput than Aurora for OLTP Auto thread pooling TPC-C_100W (10G, Data fits in Buffer Pool) 1 4 16 64 128 256 512 1024 2048 4096 0 1000 2000 3000 4000 5000 6000 7000 Concurrency Throughput (Transactions/s) MySQL HeatWave Amazon Aurora *Benchmark queries are derived from the TPC-C benchmarks, but results are not comparable to published TPC-C benchmark results since these do not comply with the TPC-C specifications. Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 25
24. Price performance comparison Only compute costs are considered here Pricing for Redshift is based on 1-year reserved instance, paid upfront. Snowflake price is based on standard edition Price for Google BigQuery is based on monthly flat rate commitment. Azure Synapse is based on 1-year reserved pricing *Benchmark queries are derived from the TPC-H benchmarks, but results are not comparable to published TPC-H benchmark results since these do not comply with the TPC-H specifications. 7x better than Redshift, 10x better than Snowflake, 12x better than Big Query, 4x better than Synapse Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 26
25. MySQL HeatWave on Azure Connecting to MySQL HeatWave on OCI from Azure VNET • Familiar Azure-native user experience • Automated identity, networking, and monitoring integration • Private interconnect and networking with < 2 ms latency • Use Microsoft Azure services with MySQL HeatWave • Collaborative support https://www.oracle.com/cloud/azure/oracle-database-for-azure NEW Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 27
26. Oracle Dedicated Region Cloud@Customer Available in your data center Self-contained cloud region MySQL HeatWave and all Oracle public cloud services in your data center Public cloud economics and security Meet data residency and latency requirements Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 28
27. MySQL HeatWave Lakehouse (Beta) Copyright © 2022, Oracle and/or its affiliates NEW
28. • 1.7 MB of data generated/person/sec in 2020. We’ll double that amount by 2025 (TechJury) • 180 ZB of data expected in 2025 (IDC) • Over 80% of the data we generate is in files (CIO) • Often stored in data lakes on object storage • 99.5% of collected data remains unused (grow.com) Significant growth of data stored outside databases Object Store Devices Sensors Social Voice Events Managing the data deluge is challenging Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 30
29. MySQL HeatWave Lakehouse (Beta) • Query data across MySQL, the object store, or both—using standard MySQL commands • Up to 400 TB of data—the HeatWave cluster scales to 512 nodes • Querying the database is as fast as querying the object store NEW Process and query 100’s of TB of data in the object store—in a variety of file formats Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 31
30. Query performance of MySQL HeatWave Lakehouse Annual provisioned cost for HeatWave $1,589,036; for Redshift $2,261,760; for Snowflake $2,242,560 Pricing for Redshift is based on 1-year reserved instance, paid upfront. Snowflake is based on standard edition *Benchmark queries are derived from the TPC-H benchmarks, but results are not comparable to published TPC-H benchmark results since these do not comply with the TPC-H specifications. 17x faster than Snowflake, 6x faster than Redshift Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 32
31. Load performance of MySQL HeatWave Lakehouse Annual provisioned cost for HeatWave $1,589,036; for Redshift $2,261,760; for Snowflake $2,242,560 Pricing for Redshift is based on 1-year reserved instance, paid upfront. Snowflake is based on standard edition *Benchmark queries are derived from the TPC-H benchmarks, but results are not comparable to published TPC-H benchmark results since these do not comply with the TPC-H specifications. 8x faster than Redshift, 2.7x faster than Snowflake Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 33
32. MySQL Autopilot for MySQL HeatWave Lakehouse Auto Provisioning • Adaptively sample raw files and collect statistics • Estimate memory footprint of the data to be loaded Auto Schema Inference • Sample raw files to infer column data types • Generate DDLs to create tables Adaptive Sampling • Adaptively samples a fraction of files to collect stats • Use collected stats for various Autopilot features Auto Load • Predict load time • Load script generation Adaptive Data Flow • System adapts to the performance of object store • Improves system performance and reliability Auto Query Plan Improvement • Continuously collect statistics while running queries • Enhance future execution plans NEW NEW NEW NEW Machine learning-powered automation Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 34
33. Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 35 Test Drive MySQL HeatWave Database Service for Free Today Get $300 in credits and try MySQL HeatWave Database Service free for 30 days. https://www.oracle.com/cloud/free/
34. Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 36 Follow us on Social Media
35. Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 37 Merci! Q&R Olivier Dasini MySQL Cloud Principal Solutions Architect EMEA olivier.dasini@oracle.com Blogs : www.dasini.net/blog/en : www.dasini.net/blog/fr Linkedin: www.linkedin.com/in/olivier-dasini Twitter : @freshdaz
36. MySQL HeatWave DS Copyright © 2022, Oracle and/or its affiliates Resources
37. Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 39  Introducing the MySQL Database Service https://blogs.oracle.com/mysql/introducing-the-mysql-database-service  Migrate from on premise MySQL to MySQL Database Service https://blogs.oracle.com/mysql/migrate-from-on-premise-mysql-to-mysql-database-service  Setup Disaster Recovery for OCI MySQL Database Service https://lefred.be/content/setup-disaster-recovery-for-oci-mysql-database-service/  Cost Estimator https://www.oracle.com/cloud/cost-estimator.html  OCI Free Trial https://www.oracle.com/cloud/free/  Documentations https://docs.cloud.oracle.com/en-us/iaas/mysql-database/index.html https://www.oracle.com/mysql/  Iris Data Set with MySQL HeatWave Machine Learning & Zeppelin https://dasini.net/blog/2022/07/18/iris-data-set-with-mysql-heatwave-machine-learning-zeppelin/  Configure Apache Zeppelin for MySQL HeatWave https://dasini.net/blog/2022/07/05/interactively-explore-visualize-your-mysql-heatwave-data-with-apache-zeppelin/ MySQL HeatWave Database Service Resources
38. Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 40  Discovering MySQL Database Service – Episode 1 – Introduction http://dasini.net/blog/2021/08/03/discovering-mysql-database-service-episode-1-introduction/  Discovering MySQL Database Service – Episode 2 – Create a compartment http://dasini.net/blog/2021/08/10/discovering-mysql-database-service-episode-2-create-a-compartment/  Discovering MySQL Database Service – Episode 3 – Create a Virtual Cloud Network http://dasini.net/blog/2021/08/17/discovering-mysql-database-service-episode-3-create-a-virtual-cloud-network/  Discovering MySQL Database Service – Episode 4 – Dump your MySQL data into an Object Storage bucket http://dasini.net/blog/2021/08/24/discovering-mysql-database-service-episode-4-dump-your-mysql-data-into-an-object-storage-bucket/  Discovering MySQL Database Service – Episode 5 – Create a MySQL DB system from a MySQL Shell dump http://dasini.net/blog/2021/08/31/discovering-mysql-database-service-episode-5-create-a-mysql-db-system-from-a-mysql-shell-dump/  Discovering MySQL Database Service – Episode 6 – Update the Private Subnet Security List http://dasini.net/blog/2021/09/07/discovering-mysql-database-service-episode-6-update-the-private-subnet-security-list/  Discovering MySQL Database Service – Episode 7 – Use a Bastion SSH port forwarding session http://dasini.net/blog/2021/09/14/discovering-mysql-database-service-episode-7-use-a-bastion-ssh-port-forwarding-session/  Discovering MySQL Database Service – Episode 8 – Connect to MySQL Database Service Using MySQL Shell http://dasini.net/blog/2021/09/21/discovering-mysql-database-service-episode-8-connect-to-mysql-database-service-using-mysql-shell/  Discovering MySQL Database Service – Episode 9 – Connect to MySQL Database Service Using MySQL Workbench http://dasini.net/blog/2021/09/28/discovering-mysql-database-service-episode-9-connect-to-mysql-database-service-using-mysql-workbench/  Discovering MySQL Database Service – Episode 10 – Connect to MySQL Database Service Using OCI Cloud Shell http://dasini.net/blog/2021/10/05/discovering-mysql-database-service-episode-10-connect-to-mysql-database-service-using-oci-cloud-shell/ Discovering MySQL HeatWave Database Service Tutorials where I show you, step by step, how to use MDS and some other OCI services www.dasini.net/blog/en
39. Copyright © 2022, Oracle and/or its affiliates. All rights reserved. 41 MySQL HeatWave — New Machine Learning Capabilities (2022) • What is MySQL HeatWave? – https://www.youtube.com/watch?v=cTUCzsYAi94 • MySQL HeatWave Database Service – https://www.oracle.com/mysql/ • In-Database Machine Learning with MySQL HeatWave – https://blogs.oracle.com/mysql/post/in-database-machine-learning-with-mysql-heatwave • MySQL HeatWave ML – https://www.oracle.com/a/ocom/docs/mysql/mysql-heatwave-ml-technical-brief.pdf • Estuda.com increases query responses by 300X with MySQL HeatWave – https://www.youtube.com/watch?v=9cedEkFEKLs • VRGlass increases database performance 5X with MySQL HeatWave – https://www.youtube.com/watch?v=D4z-Ewk9bh8 • Genius Sonority speeds game analytics by 90X with MySQL HeatWave – https://www.youtube.com/watch?v=zwmVYq0MsPs One MySQL Database for OLTP, OLAP, and machine learning (ML) https://www.oracle.com/fr/events/live/mysql-heatwave-ml/on-demand/
41. Copyright © 2022, Oracle and/or its affiliates Oracle Live Labs Self-paced learning MySQL HeatWave Live Labs
42. • Modernize transactional applications using Amazon Aurora, RDS for MySQL, Azure Database for MySQL, Google’s Cloud SQL for MySQL with supporting analytical workloads from Amazon Redshift, Snowflake, Azure Synapse, and Google BigQuery • Modernize mixed workload applications using Amazon Aurora, RDS for MySQL, Azure Database for MySQL, GCP Cloud SQL for MySQL (initially without separate analytics database) • Modernize mixed workload applications using MySQL either on-premises or in the cloud • Rely on MySQL HeatWave for in-database machine learning to avoid using a separate machine learning service with data coming from MySQL, MySQL-based services, or analytics databases Modernizing applications with MySQL HeatWave Copyright © 2022, Oracle and/or its affiliates Key use cases
43. • The best MySQL releases ever, as widely acknowledged by the MySQL Community • Commitment to open source, with continued code contributions (as opposed to AWS, who forked MySQL to create the closed source Aurora) • A constant stream of innovation, with new products and services—including MySQL HeatWave—helping users and customers tackle the new challenges that they are facing • Unparalleled MySQL Database expertise from Oracle, the leading database company Oracle is committed to MySQL’s success Copyright © 2022, Oracle and/or its affiliates
44. • Go to cloud.mysql.com • Sign in with OCI account (or signup for an OCI account) Easy to get started using MySQL HeatWave on AWS 1/2 Copyright © 2022, Oracle and/or its affiliates
45. Easy to get started using MySQL HeatWave on AWS 2/2 Copyright © 2022, Oracle and/or its affiliates • Interact with the service with just the hostname & user credentials – Admins use the console to manage