Upgrade to Pro — share decks privately, control downloads, hide ads and more …

What’s New in MySQL HeatWave - 100% Developed, Managed and Supported by the Oracle MySQL Team

What’s New in MySQL HeatWave - 100% Developed, Managed and Supported by the Oracle MySQL Team

Oracle now sees MySQL as a core part of its strategy, supported by significant investments in new MySQL Heatwave cloud offerings on OCI, AWS and Azure.

In this presentation you will find the latest MySQL HeatWave news:
- MySQL HeatWave Machine Learning
- MySQL HeatWave on AWS & Azure
- MySQL HeatWave DataLake

Olivier DASINI

November 21, 2022
Tweet

More Decks by Olivier DASINI

Other Decks in Technology

Transcript

  1. What’s New in MySQL HeatWave
    100% Developed, Managed and Supported by the Oracle MySQL Team
    Olivier Dasini
    MySQL Cloud Principal Solutions Architect EMEA
    [email protected]
    Blogs : www.dasini.net/blog/en
    : www.dasini.net/blog/fr
    Linkedin: www.linkedin.com/in/olivier-dasini
    Twitter : @freshdaz

    View full-size slide

  2. Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    2
    Me, Myself & I

    MySQL Geek
     Addicted to MySQL for 15+ years
     Playing with databases for 20+ years

    MySQL Writer, Blogger and Speaker
     Also: DBA, Consultant, Architect, Trainer, ...

    MySQL Cloud Principal Solutions Architect EMEA at Oracle

    Stay up to date!
     Blog: www.dasini.net/blog/en
     Linkedin: www.linkedin.com/in/olivier-dasini/
     Twitter: @freshdaz
    Olivier DASINI

    View full-size slide

  3. MySQL HeatWave Database Service
    Copyright © 2022, Oracle and/or its affiliates
    The MySQL Cloud Service 100% developed, managed, & supported
    by the MySQL team

    View full-size slide

  4. MySQL HeatWave Database Service is a fully managed cloud service
    MySQL On Premise MySQL Database Service
    Database
    Scaling
    Backup
    Security Patch & Upgrade
    Provision & Configure
    OS
    OS Security Patch & Upgrade
    OS Installation
    Server Hardware Purchase & Maintenance
    Storage Storage Purchase & Maintenance
    Data Center
    Rack & Space
    Power, HVAC, Networking
    Automated
    Manual
    6
    Automate many of the manual tasks
    Copyright © 2022, Oracle and/or its affiliates. All rights reserved.

    View full-size slide

  5. MySQL HeatWave Database Service – Highlights 1/2
    Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    7
    A fully managed cloud service

    Easy provisioning
    – Best default configuration for Performance, Security & Compliance
    – Fast Data Import

    Managed manual & automatic backups with Point In Time Recovery

    Always up-to-date

    Automation via Terraform, CLI, SDK, API

    Flexibility to grow as you go
    – Dynamic configuration changes
    – Online scale storage size
    – Online enable and disable High Availability
    – Online add and remove Read Replicas & Replication Channels

    Metrics & Alarms
    – Enable you to measure useful quantitative data of the MySQL DB system

    View full-size slide

  6. MySQL HeatWave Database Service – Highlights 2/2
    Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    8
    A fully managed cloud service

    Data Security
    – MySQL Database Service utilizes encryption to keep your data private

    Encryption at rest

    Encryption in transit (TLS)
    – Enforces use of private networks and security lists
    – Data masking functions
    – Identity federation
    – Password policy validation

    Replication
    – Inbound Replication: from a source to a DB system
    – Outbound Replication: asynchronous replication of your DB system database

    Audit Service
    – MySQL Database integrates with the Oracle Cloud Infrastructure Audit Service

    Standalone
    – Single-instance MySQL DB System

    High Availablility
    – Guarantees if one instance fails, another takes over, with zero data loss and minimal downtime

    HeatWave
    – A distributed, scalable, shared-nothing, in-memory, hybrid columnar, query processing engine designed for extreme
    performance

    View full-size slide

  7. MySQL HeatWave
    an In-Memory Query Accelerator
    Copyright © 2022, Oracle and/or its affiliates
    The only MySQL service with a massively-scalable integrated analytics engine
    Available today on
    OCI / AWS / Azure
    https://www.oracle.com/mysql/heatwave/

    View full-size slide

  8. During the last 20 years MySQL has democratized the usage of transactional
    databases.
    Now with MySQL HeatWave we are in the process of democratizing Analytics
    and Machine Learning.
    With MySQL HeatWave, valorizing your data has never been so easy!
    MySQL HeatWave - MySQL in-Memory Query Accelerator
    The only MySQL service with a massively-scalable, native query accelerator
    Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    10

    View full-size slide


  9. A fully managed MySQL database service, powered by the integrated
    HeatWave a massively parallel, high-performance, in-memory query
    processing engine optimized to manage half a petabyte-scale data size across
    a cluster of nodes

    It’s the only cloud database service that combines transactions, analytics, and
    machine learning services into one MySQL Database, delivering real-time,
    secure analytics without the complexity, latency, and cost of ETL duplication
    What is MySQL HeatWave?
    The only MySQL service with a massively-scalable, native query accelerator
    https://dev.mysql.com/doc/heatwave/en/heatwave-architecture.html
    Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    11

    View full-size slide

  10. One database is better than two
    Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    12
    Analytics tools and
    applications
    Transactional
    applications
    OLTP
    engine
    HeatWave
    analytics
    cluster
    1>2 with MySQL HeatWave
    Easily run high performance analytics against your MySQL database, no ETL required
    Query
    Accelerator
    InnoDB
    One service for OTLP & OLAP
    No ETL duplication
    Unmatched performance, at a
    fraction of the cost
    Real-time analytics
    Improved security
    Applications work without
    changes

    View full-size slide

  11. *Benchmark queries are derived from the TPC-H benchmark, but results are not comparable to published TPC-H benchmark results since they do not comply with the TPC-H specification
    400G, 64 cores
    MySQL HeatWave dramatically speeds up analytic queries
    Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    13

    View full-size slide

  12. MySQL HeatWave performance and price comparison
    Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    14
    30TB TPCH, MySQL HeatWave is faster, cheaper & easier to use than all the competitive database services
    See documented performance comparisons that show how HeatWave is 6.5X faster than Amazon Redshift at half the cost, 1400X faster than Amazon Aurora at half the cost, and 5400X faster than Amazon RDS for MySQL at two-thirds the cost
    www.oracle.com/mysql/heatwave/performance

    View full-size slide

  13. TPCH, MySQL HeatWave is faster, cheaper & easier to use than all the competitive database services
    OLAP Performance
    3x faster than Synapse
    6.5x faster than Redshift
    7x faster than Snowflake
    10x faster than Big Query
    1100x faster than Aurora
    5400x faster than RDS
    OLAP Price Performance
    15x better than Synapse
    13x better than Redshift
    35x better than Snowflake
    37x better than Big Query
    2200x better than Aurora
    7000x better than RDS MySQL
    Mix workload: OLAP + OLTP
    20x-500x faster than Aurora
    50x-1200x better price/perf than
    Aurora
    MySQL HeatWave Performance and Price Summary
    Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    15
    15
    www.oracle.com/fr/mysql/heatwave

    View full-size slide

  14. MySQL HeatWave ML
    Copyright © 2022, Oracle and/or its affiliates
    Build, train, deploy, & explain machine learning models within
    MySQL HeatWave, at no additional cost
    Available today on
    OCI / AWS / Azure
    https://www.oracle.com/mysql/heatwave/

    View full-size slide

  15. In-database machine learning with MySQL HeatWave
    Accelerate ML initiatives, increase security, and reduce costs
    Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    17

    View full-size slide

  16. HeatWave ML automates the ML lifecycle and all models can be explained
    Dataset
    Data preprocessing
    Algorithm selection
    Adaptive sampling
    Feature selection
    Hyper-parameter tuning
    Tuned model
    Model explainer
    Prediction explainer
    Regulatory compliance
    Fairness
    Repeatability
    Causality
    Trust
    HeatWave ML leverages Oracle AutoML technology to automate the process of training a machine learning model
    https://dev.mysql.com/doc/heatwave/en/heatwave-machine-learning.html
    Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    18

    View full-size slide

  17. 19 Copyright © 2022, Oracle and/or its affiliates. All rights reserved.

    You only need to use a limited set of SQL routines:

    ML_TRAIN: Trains a machine learning model for a given training dataset

    ML_PREDICT_ROW: Makes predictions for one or more rows of data

    ML_PREDICT_TABLE: Makes predictions for a table of data

    ML_EXPLAIN_ROW: Explains predictions for one or more rows of data

    ML_EXPLAIN_TABLE: Explains predictions for a table of data

    ML_SCORE: Computes the quality of a model

    ML_MODEL_LOAD: Loads a machine learning model for predictions and explanations

    ML_MODEL_UNLOAD: Unloads a machine learning model

    In addition, with MySQL HeatWave ML, there is no need to move or reformat your data

    Data and machine learning models never leave the MySQL Database Service, which saves you time and
    effort while keeping your data and models secure
    MySQL HeatWave ML uses a set of SQL routines
    Machine Learning with MySQL HeatWave is so simple

    View full-size slide

  18.  Produces more accurate results
     Trains models 25X faster on average
     1% of the cost
     Scales as more modes are added
    HeatWave ML vs Redshift ML: Benchmarks
    See Benchmark details:
    https://www.oracle.com/mysql/heatwave/performance/
    Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    20

    View full-size slide

  19. MySQL HeatWave ML – Run Machine Learning on existing cluster
    21 Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    Build, train, deploy, & explain machine learning models within MySQL HeatWave, at no additional cost
    Single MySQL database for all
    applications
    All existing applications work
    without any changes
    Train, inference & explain
    within the database
    No need to learn new
    language or ML packages

    View full-size slide

  20. Ready for the distributed cloud
    Copyright © 2022, Oracle and/or its affiliates
    Available in public clouds and in your data center

    View full-size slide

  21. Available in different public clouds
    Optimized to deliver the best price performance in each cloud
    NEW
    NEW
    NEW
    Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    23

    View full-size slide

  22. • MySQL HeatWave runs natively on AWS, optimized for AWS infrastructure
    • Data doesn’t leave AWS – saves egress cost, and avoids compliance approvals
    • Lowest latency access to MySQL HeatWave
    • Tight integration with the AWS ecosystem – S3, CloudWatch, PrivateLink
    • Easier migration from other databases (e.g., Amazon Aurora, Redshift,
    Snowflake)
    MySQL HeatWave on AWS
    NEW
    Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    24

    View full-size slide

  23. MySQL HeatWave offers up to 10x better throughput than
    Aurora for OLTP
    Auto thread pooling
    TPC-C_100W (10G, Data fits in Buffer Pool)
    1 4 16 64 128 256 512 1024 2048 4096
    0
    1000
    2000
    3000
    4000
    5000
    6000
    7000
    Concurrency
    Throughput (Transactions/s)
    MySQL
    HeatWave
    Amazon Aurora
    *Benchmark queries are derived from the TPC-C benchmarks, but results are not comparable to published TPC-C benchmark results since these do not comply with the TPC-C
    specifications.
    Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    25

    View full-size slide

  24. Price performance comparison
    Only compute costs are considered here
    Pricing for Redshift is based on 1-year reserved instance, paid upfront. Snowflake price is based on standard edition
    Price for Google BigQuery is based on monthly flat rate commitment. Azure Synapse is based on 1-year reserved pricing
    *Benchmark queries are derived from the TPC-H benchmarks, but results are not comparable to published TPC-H benchmark results since these do not comply with the TPC-H specifications.
    7x better than Redshift, 10x better than Snowflake, 12x better than Big Query, 4x better than Synapse
    Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    26

    View full-size slide

  25. MySQL HeatWave on Azure
    Connecting to MySQL HeatWave on OCI from Azure VNET
    • Familiar Azure-native user
    experience
    • Automated identity,
    networking, and monitoring
    integration
    • Private interconnect and
    networking with < 2 ms
    latency
    • Use Microsoft Azure services
    with MySQL HeatWave
    • Collaborative support
    https://www.oracle.com/cloud/azure/oracle-database-for-azure
    NEW
    Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    27

    View full-size slide

  26. Oracle Dedicated Region Cloud@Customer
    Available in your data center
    Self-contained cloud region
    MySQL HeatWave and all Oracle
    public cloud services in your data
    center
    Public cloud economics and
    security
    Meet data residency and latency
    requirements
    Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    28

    View full-size slide

  27. MySQL HeatWave Lakehouse (Beta)
    Copyright © 2022, Oracle and/or its affiliates
    NEW

    View full-size slide

  28. • 1.7 MB of data generated/person/sec in 2020. We’ll double that amount by 2025
    (TechJury)
    • 180 ZB of data expected in 2025 (IDC)
    • Over 80% of the data we generate is in files (CIO)
    • Often stored in data lakes on object storage
    • 99.5% of collected data remains unused (grow.com)
    Significant growth of data stored outside databases
    Object Store
    Devices
    Sensors
    Social Voice
    Events
    Managing the data deluge is challenging
    Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    30

    View full-size slide

  29. MySQL HeatWave Lakehouse (Beta)
    • Query data across MySQL, the
    object store, or both—using
    standard MySQL commands
    • Up to 400 TB of data—the HeatWave
    cluster scales to 512 nodes
    • Querying the database is as fast as
    querying the object store
    NEW
    Process and query 100’s of TB of data in the object store—in a variety of file formats
    Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    31

    View full-size slide

  30. Query performance of MySQL HeatWave Lakehouse
    Annual provisioned cost for HeatWave $1,589,036; for Redshift $2,261,760; for Snowflake $2,242,560
    Pricing for Redshift is based on 1-year reserved instance, paid upfront. Snowflake is based on standard edition
    *Benchmark queries are derived from the TPC-H benchmarks, but results are not comparable to published TPC-H benchmark results since these do not comply with the TPC-H specifications.
    17x faster than Snowflake, 6x faster than Redshift
    Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    32

    View full-size slide

  31. Load performance of MySQL HeatWave Lakehouse
    Annual provisioned cost for HeatWave $1,589,036; for Redshift $2,261,760; for Snowflake $2,242,560
    Pricing for Redshift is based on 1-year reserved instance, paid upfront. Snowflake is based on standard edition
    *Benchmark queries are derived from the TPC-H benchmarks, but results are not comparable to published TPC-H benchmark results since these do not comply with the TPC-H specifications.
    8x faster than Redshift, 2.7x faster than Snowflake
    Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    33

    View full-size slide

  32. MySQL Autopilot for MySQL HeatWave Lakehouse
    Auto Provisioning
    • Adaptively sample raw
    files and collect statistics
    • Estimate memory
    footprint of the data to be
    loaded
    Auto Schema
    Inference
    • Sample raw files to infer
    column data types
    • Generate DDLs to create
    tables
    Adaptive Sampling
    • Adaptively samples a
    fraction of files to collect
    stats
    • Use collected stats for
    various Autopilot features
    Auto Load
    • Predict load time
    • Load script generation
    Adaptive Data Flow
    • System adapts to the
    performance of object
    store
    • Improves system
    performance and reliability
    Auto Query Plan
    Improvement
    • Continuously collect statistics
    while running queries
    • Enhance future execution
    plans
    NEW NEW
    NEW
    NEW
    Machine learning-powered automation
    Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    34

    View full-size slide

  33. Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    35
    Test Drive
    MySQL HeatWave
    Database Service for
    Free Today
    Get $300 in credits
    and try MySQL HeatWave Database Service
    free for 30 days.
    https://www.oracle.com/cloud/free/

    View full-size slide

  34. Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    36
    Follow us on Social Media

    View full-size slide

  35. Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    37
    Merci!
    Q&R
    Olivier Dasini
    MySQL Cloud Principal Solutions Architect EMEA
    [email protected]
    Blogs : www.dasini.net/blog/en
    : www.dasini.net/blog/fr
    Linkedin: www.linkedin.com/in/olivier-dasini
    Twitter : @freshdaz

    View full-size slide

  36. MySQL HeatWave DS
    Copyright © 2022, Oracle and/or its affiliates
    Resources

    View full-size slide

  37. Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    39
     Introducing the MySQL Database Service
    https://blogs.oracle.com/mysql/introducing-the-mysql-database-service
     Migrate from on premise MySQL to MySQL Database Service
    https://blogs.oracle.com/mysql/migrate-from-on-premise-mysql-to-mysql-database-service
     Setup Disaster Recovery for OCI MySQL Database Service
    https://lefred.be/content/setup-disaster-recovery-for-oci-mysql-database-service/
     Cost Estimator
    https://www.oracle.com/cloud/cost-estimator.html
     OCI Free Trial
    https://www.oracle.com/cloud/free/
     Documentations
    https://docs.cloud.oracle.com/en-us/iaas/mysql-database/index.html
    https://www.oracle.com/mysql/
     Iris Data Set with MySQL HeatWave Machine Learning & Zeppelin
    https://dasini.net/blog/2022/07/18/iris-data-set-with-mysql-heatwave-machine-learning-zeppelin/
     Configure Apache Zeppelin for MySQL HeatWave
    https://dasini.net/blog/2022/07/05/interactively-explore-visualize-your-mysql-heatwave-data-with-apache-zeppelin/
    MySQL HeatWave Database Service Resources

    View full-size slide

  38. Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    40
     Discovering MySQL Database Service – Episode 1 – Introduction
    http://dasini.net/blog/2021/08/03/discovering-mysql-database-service-episode-1-introduction/
     Discovering MySQL Database Service – Episode 2 – Create a compartment
    http://dasini.net/blog/2021/08/10/discovering-mysql-database-service-episode-2-create-a-compartment/
     Discovering MySQL Database Service – Episode 3 – Create a Virtual Cloud Network
    http://dasini.net/blog/2021/08/17/discovering-mysql-database-service-episode-3-create-a-virtual-cloud-network/
     Discovering MySQL Database Service – Episode 4 – Dump your MySQL data into an Object Storage bucket
    http://dasini.net/blog/2021/08/24/discovering-mysql-database-service-episode-4-dump-your-mysql-data-into-an-object-storage-bucket/
     Discovering MySQL Database Service – Episode 5 – Create a MySQL DB system from a MySQL Shell dump
    http://dasini.net/blog/2021/08/31/discovering-mysql-database-service-episode-5-create-a-mysql-db-system-from-a-mysql-shell-dump/
     Discovering MySQL Database Service – Episode 6 – Update the Private Subnet Security List
    http://dasini.net/blog/2021/09/07/discovering-mysql-database-service-episode-6-update-the-private-subnet-security-list/
     Discovering MySQL Database Service – Episode 7 – Use a Bastion SSH port forwarding session
    http://dasini.net/blog/2021/09/14/discovering-mysql-database-service-episode-7-use-a-bastion-ssh-port-forwarding-session/
     Discovering MySQL Database Service – Episode 8 – Connect to MySQL Database Service Using MySQL Shell
    http://dasini.net/blog/2021/09/21/discovering-mysql-database-service-episode-8-connect-to-mysql-database-service-using-mysql-shell/
     Discovering MySQL Database Service – Episode 9 – Connect to MySQL Database Service Using MySQL Workbench
    http://dasini.net/blog/2021/09/28/discovering-mysql-database-service-episode-9-connect-to-mysql-database-service-using-mysql-workbench/
     Discovering MySQL Database Service – Episode 10 – Connect to MySQL Database Service Using OCI Cloud Shell
    http://dasini.net/blog/2021/10/05/discovering-mysql-database-service-episode-10-connect-to-mysql-database-service-using-oci-cloud-shell/
    Discovering MySQL HeatWave Database Service
    Tutorials where I show you, step by step, how to use MDS and some other OCI services
    www.dasini.net/blog/en

    View full-size slide

  39. Copyright © 2022, Oracle and/or its affiliates. All rights reserved.
    41
    MySQL HeatWave — New Machine Learning Capabilities (2022)

    What is MySQL HeatWave?
    – https://www.youtube.com/watch?v=cTUCzsYAi94

    MySQL HeatWave Database Service
    – https://www.oracle.com/mysql/

    In-Database Machine Learning with MySQL HeatWave
    – https://blogs.oracle.com/mysql/post/in-database-machine-learning-with-mysql-heatwave

    MySQL HeatWave ML
    – https://www.oracle.com/a/ocom/docs/mysql/mysql-heatwave-ml-technical-brief.pdf

    Estuda.com increases query responses by 300X with MySQL HeatWave
    – https://www.youtube.com/watch?v=9cedEkFEKLs

    VRGlass increases database performance 5X with MySQL HeatWave
    – https://www.youtube.com/watch?v=D4z-Ewk9bh8

    Genius Sonority speeds game analytics by 90X with MySQL HeatWave
    – https://www.youtube.com/watch?v=zwmVYq0MsPs
    One MySQL Database for OLTP, OLAP, and machine learning (ML)
    https://www.oracle.com/fr/events/live/mysql-heatwave-ml/on-demand/

    View full-size slide

  40. Copyright © 2022, Oracle and/or its affiliates
    Oracle Live Labs
    Self-paced learning
    MySQL HeatWave Live Labs

    View full-size slide

  41. • Modernize transactional applications using Amazon Aurora, RDS for MySQL, Azure
    Database for MySQL, Google’s Cloud SQL for MySQL with supporting analytical
    workloads from Amazon Redshift, Snowflake, Azure Synapse, and Google BigQuery
    • Modernize mixed workload applications using Amazon Aurora, RDS for MySQL, Azure
    Database for MySQL, GCP Cloud SQL for MySQL (initially without separate analytics
    database)
    • Modernize mixed workload applications using MySQL either on-premises or in the
    cloud
    • Rely on MySQL HeatWave for in-database machine learning to avoid using a
    separate machine learning service with data coming from MySQL, MySQL-based
    services, or analytics databases
    Modernizing applications with MySQL HeatWave
    Copyright © 2022, Oracle and/or its affiliates
    Key use cases

    View full-size slide

  42. • The best MySQL releases ever, as widely acknowledged by the MySQL Community
    • Commitment to open source, with continued code contributions (as opposed to AWS,
    who forked MySQL to create the closed source Aurora)
    • A constant stream of innovation, with new products and services—including MySQL
    HeatWave—helping users and customers tackle the new challenges that they are facing
    • Unparalleled MySQL Database expertise from Oracle, the leading database company
    Oracle is committed to MySQL’s success
    Copyright © 2022, Oracle and/or its affiliates

    View full-size slide

  43. • Go to cloud.mysql.com
    • Sign in with OCI account (or signup for an OCI account)
    Easy to get started using MySQL HeatWave on AWS 1/2
    Copyright © 2022, Oracle and/or its affiliates

    View full-size slide

  44. Easy to get started using MySQL HeatWave on AWS 2/2
    Copyright © 2022, Oracle and/or its affiliates
    • Interact with the service with just the
    hostname & user credentials
    – Admins use the console to manage

    View full-size slide