What’s New in MySQL HeatWave - 100% Developed, Managed and Supported by the Oracle MySQL Team

What’s New in MySQL HeatWave
100% Developed, Managed and Supported by the Oracle MySQL Team
Olivier Dasini
MySQL Cloud Principal Solutions Architect EMEA
[email protected]
Blogs : www.dasini.net/blog/en
: www.dasini.net/blog/fr
Linkedin: www.linkedin.com/in/olivier-dasini
Twitter : @freshdaz

View Slide

Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
2
Me, Myself & I

MySQL Geek
 Addicted to MySQL for 15+ years
 Playing with databases for 20+ years

MySQL Writer, Blogger and Speaker
 Also: DBA, Consultant, Architect, Trainer, ...

MySQL Cloud Principal Solutions Architect EMEA at Oracle

Stay up to date!
 Blog: www.dasini.net/blog/en
 Linkedin: www.linkedin.com/in/olivier-dasini/
 Twitter: @freshdaz
Olivier DASINI

View Slide

MySQL HeatWave Database Service
Copyright © 2022, Oracle and/or its affiliates
The MySQL Cloud Service 100% developed, managed, & supported
by the MySQL team

View Slide

MySQL HeatWave Database Service is a fully managed cloud service
MySQL On Premise MySQL Database Service
Database
Scaling
Backup
Security Patch & Upgrade
Provision & Configure
OS
OS Security Patch & Upgrade
OS Installation
Server Hardware Purchase & Maintenance
Storage Storage Purchase & Maintenance
Data Center
Rack & Space
Power, HVAC, Networking
Automated
Manual
6
Automate many of the manual tasks

View Slide

MySQL HeatWave Database Service – Highlights 1/2
7
A fully managed cloud service
●
Easy provisioning
– Best default configuration for Performance, Security & Compliance
– Fast Data Import
●
Managed manual & automatic backups with Point In Time Recovery
●
Always up-to-date
●
Automation via Terraform, CLI, SDK, API
●
Flexibility to grow as you go
– Dynamic configuration changes
– Online scale storage size
– Online enable and disable High Availability
– Online add and remove Read Replicas & Replication Channels
●
Metrics & Alarms
– Enable you to measure useful quantitative data of the MySQL DB system

View Slide

MySQL HeatWave Database Service – Highlights 2/2
8
A fully managed cloud service
●
Data Security
– MySQL Database Service utilizes encryption to keep your data private
●
Encryption at rest
●
Encryption in transit (TLS)
– Enforces use of private networks and security lists
– Data masking functions
– Identity federation
– Password policy validation
●
Replication
– Inbound Replication: from a source to a DB system
– Outbound Replication: asynchronous replication of your DB system database
●
Audit Service
– MySQL Database integrates with the Oracle Cloud Infrastructure Audit Service
●
Standalone
– Single-instance MySQL DB System
●
High Availablility
– Guarantees if one instance fails, another takes over, with zero data loss and minimal downtime
●
HeatWave
– A distributed, scalable, shared-nothing, in-memory, hybrid columnar, query processing engine designed for extreme
performance

View Slide

MySQL HeatWave
an In-Memory Query Accelerator
The only MySQL service with a massively-scalable integrated analytics engine
Available today on
OCI / AWS / Azure
https://www.oracle.com/mysql/heatwave/

View Slide

During the last 20 years MySQL has democratized the usage of transactional
databases.
Now with MySQL HeatWave we are in the process of democratizing Analytics
and Machine Learning.
With MySQL HeatWave, valorizing your data has never been so easy!
MySQL HeatWave - MySQL in-Memory Query Accelerator
The only MySQL service with a massively-scalable, native query accelerator
10

View Slide

●
A fully managed MySQL database service, powered by the integrated
HeatWave a massively parallel, high-performance, in-memory query
processing engine optimized to manage half a petabyte-scale data size across
a cluster of nodes
●
It’s the only cloud database service that combines transactions, analytics, and
machine learning services into one MySQL Database, delivering real-time,
secure analytics without the complexity, latency, and cost of ETL duplication
What is MySQL HeatWave?
The only MySQL service with a massively-scalable, native query accelerator
https://dev.mysql.com/doc/heatwave/en/heatwave-architecture.html
11

View Slide

One database is better than two
12
Analytics tools and
applications
Transactional
applications
OLTP
engine
HeatWave
analytics
cluster
1>2 with MySQL HeatWave
Easily run high performance analytics against your MySQL database, no ETL required
Query
Accelerator
InnoDB
One service for OTLP & OLAP
No ETL duplication
Unmatched performance, at a
fraction of the cost
Real-time analytics
Improved security
Applications work without
changes

View Slide

*Benchmark queries are derived from the TPC-H benchmark, but results are not comparable to published TPC-H benchmark results since they do not comply with the TPC-H specification
400G, 64 cores
MySQL HeatWave dramatically speeds up analytic queries
13

View Slide

MySQL HeatWave performance and price comparison
14
30TB TPCH, MySQL HeatWave is faster, cheaper & easier to use than all the competitive database services
See documented performance comparisons that show how HeatWave is 6.5X faster than Amazon Redshift at half the cost, 1400X faster than Amazon Aurora at half the cost, and 5400X faster than Amazon RDS for MySQL at two-thirds the cost
www.oracle.com/mysql/heatwave/performance

View Slide

TPCH, MySQL HeatWave is faster, cheaper & easier to use than all the competitive database services
OLAP Performance
3x faster than Synapse
6.5x faster than Redshift
7x faster than Snowflake
10x faster than Big Query
1100x faster than Aurora
5400x faster than RDS
OLAP Price Performance
15x better than Synapse
13x better than Redshift
35x better than Snowflake
37x better than Big Query
2200x better than Aurora
7000x better than RDS MySQL
Mix workload: OLAP + OLTP
20x-500x faster than Aurora
50x-1200x better price/perf than
Aurora
MySQL HeatWave Performance and Price Summary
15
15
www.oracle.com/fr/mysql/heatwave

View Slide

MySQL HeatWave ML
Build, train, deploy, & explain machine learning models within
MySQL HeatWave, at no additional cost
Available today on
OCI / AWS / Azure
https://www.oracle.com/mysql/heatwave/

View Slide

In-database machine learning with MySQL HeatWave
Accelerate ML initiatives, increase security, and reduce costs
17

View Slide

HeatWave ML automates the ML lifecycle and all models can be explained
Dataset
Data preprocessing
Algorithm selection
Adaptive sampling
Feature selection
Hyper-parameter tuning
Tuned model
Model explainer
Prediction explainer
Regulatory compliance
Fairness
Repeatability
Causality
Trust
HeatWave ML leverages Oracle AutoML technology to automate the process of training a machine learning model
https://dev.mysql.com/doc/heatwave/en/heatwave-machine-learning.html
18

View Slide

19 Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
●
You only need to use a limited set of SQL routines:
✔
ML_TRAIN: Trains a machine learning model for a given training dataset
✔
ML_PREDICT_ROW: Makes predictions for one or more rows of data
✔
ML_PREDICT_TABLE: Makes predictions for a table of data
✔
ML_EXPLAIN_ROW: Explains predictions for one or more rows of data
✔
ML_EXPLAIN_TABLE: Explains predictions for a table of data
✔
ML_SCORE: Computes the quality of a model
✔
ML_MODEL_LOAD: Loads a machine learning model for predictions and explanations
✔
ML_MODEL_UNLOAD: Unloads a machine learning model
●
In addition, with MySQL HeatWave ML, there is no need to move or reformat your data
●
Data and machine learning models never leave the MySQL Database Service, which saves you time and
effort while keeping your data and models secure
MySQL HeatWave ML uses a set of SQL routines
Machine Learning with MySQL HeatWave is so simple

View Slide

 Produces more accurate results
 Trains models 25X faster on average
 1% of the cost
 Scales as more modes are added
HeatWave ML vs Redshift ML: Benchmarks
See Benchmark details:
https://www.oracle.com/mysql/heatwave/performance/
20

View Slide

MySQL HeatWave ML – Run Machine Learning on existing cluster
21 Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
Build, train, deploy, & explain machine learning models within MySQL HeatWave, at no additional cost
Single MySQL database for all
applications
All existing applications work
without any changes
Train, inference & explain
within the database
No need to learn new
language or ML packages

View Slide

Ready for the distributed cloud
Available in public clouds and in your data center

View Slide

Available in different public clouds
Optimized to deliver the best price performance in each cloud
NEW
NEW
NEW
23

View Slide

• MySQL HeatWave runs natively on AWS, optimized for AWS infrastructure
• Data doesn’t leave AWS – saves egress cost, and avoids compliance approvals
• Lowest latency access to MySQL HeatWave
• Tight integration with the AWS ecosystem – S3, CloudWatch, PrivateLink
• Easier migration from other databases (e.g., Amazon Aurora, Redshift,
Snowflake)
MySQL HeatWave on AWS
NEW
24

View Slide

MySQL HeatWave offers up to 10x better throughput than
Aurora for OLTP
Auto thread pooling
TPC-C_100W (10G, Data fits in Buffer Pool)
1 4 16 64 128 256 512 1024 2048 4096
0
1000
2000
3000
4000
5000
6000
7000
Concurrency
Throughput (Transactions/s)
MySQL
HeatWave
Amazon Aurora
*Benchmark queries are derived from the TPC-C benchmarks, but results are not comparable to published TPC-C benchmark results since these do not comply with the TPC-C
specifications.
25

View Slide

Price performance comparison
Only compute costs are considered here
Pricing for Redshift is based on 1-year reserved instance, paid upfront. Snowflake price is based on standard edition
Price for Google BigQuery is based on monthly flat rate commitment. Azure Synapse is based on 1-year reserved pricing
*Benchmark queries are derived from the TPC-H benchmarks, but results are not comparable to published TPC-H benchmark results since these do not comply with the TPC-H specifications.
7x better than Redshift, 10x better than Snowflake, 12x better than Big Query, 4x better than Synapse
26

View Slide

MySQL HeatWave on Azure
Connecting to MySQL HeatWave on OCI from Azure VNET
• Familiar Azure-native user
experience
• Automated identity,
networking, and monitoring
integration
• Private interconnect and
networking with < 2 ms
latency
• Use Microsoft Azure services
with MySQL HeatWave
• Collaborative support
https://www.oracle.com/cloud/azure/oracle-database-for-azure
NEW
27

View Slide

Oracle Dedicated Region Cloud@Customer
Available in your data center
Self-contained cloud region
MySQL HeatWave and all Oracle
public cloud services in your data
center
Public cloud economics and
security
Meet data residency and latency
requirements
28

View Slide

MySQL HeatWave Lakehouse (Beta)
NEW

View Slide

• 1.7 MB of data generated/person/sec in 2020. We’ll double that amount by 2025
(TechJury)
• 180 ZB of data expected in 2025 (IDC)
• Over 80% of the data we generate is in files (CIO)
• Often stored in data lakes on object storage
• 99.5% of collected data remains unused (grow.com)
Significant growth of data stored outside databases
Object Store
Devices
Sensors
Social Voice
Events
Managing the data deluge is challenging
30

View Slide

MySQL HeatWave Lakehouse (Beta)
• Query data across MySQL, the
object store, or both—using
standard MySQL commands
• Up to 400 TB of data—the HeatWave
cluster scales to 512 nodes
• Querying the database is as fast as
querying the object store
NEW
Process and query 100’s of TB of data in the object store—in a variety of file formats
31

View Slide

Query performance of MySQL HeatWave Lakehouse
Annual provisioned cost for HeatWave $1,589,036; for Redshift $2,261,760; for Snowflake $2,242,560
Pricing for Redshift is based on 1-year reserved instance, paid upfront. Snowflake is based on standard edition
17x faster than Snowflake, 6x faster than Redshift
32

View Slide

Load performance of MySQL HeatWave Lakehouse
Annual provisioned cost for HeatWave $1,589,036; for Redshift $2,261,760; for Snowflake $2,242,560
Pricing for Redshift is based on 1-year reserved instance, paid upfront. Snowflake is based on standard edition
8x faster than Redshift, 2.7x faster than Snowflake
33

View Slide

MySQL Autopilot for MySQL HeatWave Lakehouse
Auto Provisioning
• Adaptively sample raw
files and collect statistics
• Estimate memory
footprint of the data to be
loaded
Auto Schema
Inference
• Sample raw files to infer
column data types
• Generate DDLs to create
tables
Adaptive Sampling
• Adaptively samples a
fraction of files to collect
stats
• Use collected stats for
various Autopilot features
Auto Load
• Predict load time
• Load script generation
Adaptive Data Flow
• System adapts to the
performance of object
store
• Improves system
performance and reliability
Auto Query Plan
Improvement
• Continuously collect statistics
while running queries
• Enhance future execution
plans
NEW NEW
NEW
NEW
Machine learning-powered automation
34

View Slide

35
Test Drive
MySQL HeatWave
Database Service for
Free Today
Get $300 in credits
and try MySQL HeatWave Database Service
free for 30 days.
https://www.oracle.com/cloud/free/

View Slide

36
Follow us on Social Media

View Slide

37
Merci!
Q&R
Olivier Dasini
MySQL Cloud Principal Solutions Architect EMEA
[email protected]
Blogs : www.dasini.net/blog/en
: www.dasini.net/blog/fr
Linkedin: www.linkedin.com/in/olivier-dasini
Twitter : @freshdaz

View Slide

MySQL HeatWave DS
Resources

View Slide

39
 Introducing the MySQL Database Service
https://blogs.oracle.com/mysql/introducing-the-mysql-database-service
 Migrate from on premise MySQL to MySQL Database Service
https://blogs.oracle.com/mysql/migrate-from-on-premise-mysql-to-mysql-database-service
 Setup Disaster Recovery for OCI MySQL Database Service
https://lefred.be/content/setup-disaster-recovery-for-oci-mysql-database-service/
 Cost Estimator
https://www.oracle.com/cloud/cost-estimator.html
 OCI Free Trial
https://www.oracle.com/cloud/free/
 Documentations
https://docs.cloud.oracle.com/en-us/iaas/mysql-database/index.html
https://www.oracle.com/mysql/
 Iris Data Set with MySQL HeatWave Machine Learning & Zeppelin
https://dasini.net/blog/2022/07/18/iris-data-set-with-mysql-heatwave-machine-learning-zeppelin/
 Configure Apache Zeppelin for MySQL HeatWave
https://dasini.net/blog/2022/07/05/interactively-explore-visualize-your-mysql-heatwave-data-with-apache-zeppelin/
MySQL HeatWave Database Service Resources

View Slide

40
 Discovering MySQL Database Service – Episode 1 – Introduction
http://dasini.net/blog/2021/08/03/discovering-mysql-database-service-episode-1-introduction/
 Discovering MySQL Database Service – Episode 2 – Create a compartment
http://dasini.net/blog/2021/08/10/discovering-mysql-database-service-episode-2-create-a-compartment/
 Discovering MySQL Database Service – Episode 3 – Create a Virtual Cloud Network
http://dasini.net/blog/2021/08/17/discovering-mysql-database-service-episode-3-create-a-virtual-cloud-network/
 Discovering MySQL Database Service – Episode 4 – Dump your MySQL data into an Object Storage bucket
http://dasini.net/blog/2021/08/24/discovering-mysql-database-service-episode-4-dump-your-mysql-data-into-an-object-storage-bucket/
 Discovering MySQL Database Service – Episode 5 – Create a MySQL DB system from a MySQL Shell dump
http://dasini.net/blog/2021/08/31/discovering-mysql-database-service-episode-5-create-a-mysql-db-system-from-a-mysql-shell-dump/
 Discovering MySQL Database Service – Episode 6 – Update the Private Subnet Security List
http://dasini.net/blog/2021/09/07/discovering-mysql-database-service-episode-6-update-the-private-subnet-security-list/
 Discovering MySQL Database Service – Episode 7 – Use a Bastion SSH port forwarding session
http://dasini.net/blog/2021/09/14/discovering-mysql-database-service-episode-7-use-a-bastion-ssh-port-forwarding-session/
 Discovering MySQL Database Service – Episode 8 – Connect to MySQL Database Service Using MySQL Shell
http://dasini.net/blog/2021/09/21/discovering-mysql-database-service-episode-8-connect-to-mysql-database-service-using-mysql-shell/
 Discovering MySQL Database Service – Episode 9 – Connect to MySQL Database Service Using MySQL Workbench
http://dasini.net/blog/2021/09/28/discovering-mysql-database-service-episode-9-connect-to-mysql-database-service-using-mysql-workbench/
 Discovering MySQL Database Service – Episode 10 – Connect to MySQL Database Service Using OCI Cloud Shell
http://dasini.net/blog/2021/10/05/discovering-mysql-database-service-episode-10-connect-to-mysql-database-service-using-oci-cloud-shell/
Discovering MySQL HeatWave Database Service
Tutorials where I show you, step by step, how to use MDS and some other OCI services
www.dasini.net/blog/en

View Slide

41
MySQL HeatWave — New Machine Learning Capabilities (2022)
●
What is MySQL HeatWave?
– https://www.youtube.com/watch?v=cTUCzsYAi94
●
MySQL HeatWave Database Service
– https://www.oracle.com/mysql/
●
In-Database Machine Learning with MySQL HeatWave
– https://blogs.oracle.com/mysql/post/in-database-machine-learning-with-mysql-heatwave
●
MySQL HeatWave ML
– https://www.oracle.com/a/ocom/docs/mysql/mysql-heatwave-ml-technical-brief.pdf
●
Estuda.com increases query responses by 300X with MySQL HeatWave
– https://www.youtube.com/watch?v=9cedEkFEKLs
●
VRGlass increases database performance 5X with MySQL HeatWave
– https://www.youtube.com/watch?v=D4z-Ewk9bh8
●
Genius Sonority speeds game analytics by 90X with MySQL HeatWave
– https://www.youtube.com/watch?v=zwmVYq0MsPs
One MySQL Database for OLTP, OLAP, and machine learning (ML)
https://www.oracle.com/fr/events/live/mysql-heatwave-ml/on-demand/

View Slide

View Slide

Oracle Live Labs
Self-paced learning
MySQL HeatWave Live Labs

View Slide

• Modernize transactional applications using Amazon Aurora, RDS for MySQL, Azure
Database for MySQL, Google’s Cloud SQL for MySQL with supporting analytical
workloads from Amazon Redshift, Snowflake, Azure Synapse, and Google BigQuery
• Modernize mixed workload applications using Amazon Aurora, RDS for MySQL, Azure
Database for MySQL, GCP Cloud SQL for MySQL (initially without separate analytics
database)
• Modernize mixed workload applications using MySQL either on-premises or in the
cloud
• Rely on MySQL HeatWave for in-database machine learning to avoid using a
separate machine learning service with data coming from MySQL, MySQL-based
services, or analytics databases
Modernizing applications with MySQL HeatWave
Key use cases

View Slide

• The best MySQL releases ever, as widely acknowledged by the MySQL Community
• Commitment to open source, with continued code contributions (as opposed to AWS,
who forked MySQL to create the closed source Aurora)
• A constant stream of innovation, with new products and services—including MySQL
HeatWave—helping users and customers tackle the new challenges that they are facing
• Unparalleled MySQL Database expertise from Oracle, the leading database company
Oracle is committed to MySQL’s success

View Slide

• Go to cloud.mysql.com
• Sign in with OCI account (or signup for an OCI account)
Easy to get started using MySQL HeatWave on AWS 1/2

View Slide

Easy to get started using MySQL HeatWave on AWS 2/2
• Interact with the service with just the
hostname & user credentials
– Admins use the console to manage

View Slide

What’s New in MySQL HeatWave - 100% Developed, Managed and Supported by the Oracle MySQL Team

What’s New in MySQL HeatWave - 100% Developed, Managed and Supported by the Oracle MySQL Team

Olivier DASINI

More Decks by Olivier DASINI

Other Decks in Technology

Featured

Transcript