HeatWave Overview - Get faster insights from all your data

HeatWave is a fully-managed Oracle Cloud Infrastructure service. It offered different solutions for different workloads:
1. HeatWave MySQL: built on MySQL, for your transactional needs.
2. HeatWave Analytics: get real-time analytics on your data.
3. HeatWave Lakehouse: query data in various formats in object storage
4. HeatWave AutoML: automate the pipeline to build, train, and explain ML models
5. HeatWave GenAI: integrated & automated GenAI with in-database LLMs

https://dasini.net/blog/en/

Transcript

1. HeatWave Overview Get faster insights from all your data Olivier Dasini Cloud Solutions Architect @ Oracle olivier.dasini@oracle.com Blogs : www.dasini.net/blog/en : www.dasini.net/blog/fr Linkedin : www.linkedin.com/in/olivier-dasini Slides : https://speakerdeck.com/freshdaz September 2024
2. Safe harbor statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, timing, and pricing of any features or functionality described for Oracle’s products may change and remains at the sole discretion of Oracle Corporation. 2 Copyright © 2024, Oracle and/or its affiliates. All rights reserved.
3. 3 Me, Myself & I 3 Olivier DASINI Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 3  Data Geek  Addicted to MySQL for 15+ years  Playing with databases for 20+ years  Writer, Blogger and Speaker  Also former : DBA, Consultant, Architect, Trainer, ...  Cloud Solutions Architect at Oracle  Stay up to date!  Blog: www.dasini.net/blog/en  Linkedin: www.linkedin.com/in/olivier-dasini/  Slides: https://speakerdeck.com/freshdaz
4. Copyright © 2023, Oracle and/or its affiliates. All rights reserved. Agenda 1. MySQL Overview 2. HeatWave MySQL 3. HeatWave the In-Memory Query Accelerator 4. HeatWave Lakehouse 5. HeatWave AutoML 6. HeatWave GenAI & Vector Store 4
5. Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 5 MySQL Overview The world’s most popular open source database
6. Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 6 MySQL is the #1 Open Source Database https://db-engines.com/en/ranking
7. Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 7 The MySQL universe - The view from the moon… MySQL Commercial/Enterprise MySQL Community + MySQL Enterprise Backup MySQL Enterprise Monitor MySQL Enterprise Authentication MySQL Enterprise Audit MySQL Enterprise TDE MySQL Enterprise Masking MySQL Enterprise Firewall MySQL Technical Support … MySQL Cluster CGE MySQL Cluster NDB + MySQL Enterprise + MySQL Cluster Manager MySQL Community MySQL Server MySQL Client, Workbench MySQL Shell MySQL GR plugin & InnoDB Cluster & Router MySQL Operator for Kubernetes MySQL Connector (C API, Java, Node.js, others) MySQL Support for MS VS Code (Preview) … MySQL Cluster NDB MySQL NDB Storage Engine MySQL NDB Operator for Kubernetes HeatWave (Cloud Services) HeatWave MySQL HeatWave Analytics HeatWave Lakehouse HeatWave AutoML HeatWave GenAI Community, Enterprise, HeatWave (Cloud Services) https://www.mysql.com/products
8. Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 8 HeatWave
9. Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 9 HeatWave MySQL Accelerate MySQL query performance by orders of magnitude And get real-time analytics on your transactional data
10. Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 10 HeatWave Cloud Service 100% developed, managed, and supported by the MySQL team Automation HeatWave Database High Availability Read Replicas Backup Query Acceleration AutoPilot AutoML Security Patch & Upgrade Provision & Configure OS OS Security Patch & Upgrade OS Installation Server Hardware Provisioning & Maintenance Storage Storage Provisioning & Maintenance Data Center Rack & Space Power, HVAC, Networking
11. Copyright © 2024, Oracle and/or its affiliates HeatWave MySQL – Highlights 1/2 Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 11 A fully managed cloud service • Easy provisioning – Best default configuration for Performance, Security & Compliance – Fast Data Import • Managed manual & automatic backups with Point In Time Recovery • Always up-to-date • Automation via Terraform, CLI, SDK, API • Flexibility to grow as you go – Dynamic configuration changes – Online automated scale storage size – Online enable and disable High Availability – Online add and remove Read Replicas & Replication Channels • Metrics & Alarms – Enable you to measure useful quantitative data of the MySQL DB system
12. Copyright © 2024, Oracle and/or its affiliates HeatWave MySQL – Highlights 2/2 Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 12 A fully managed cloud service • Data Security – Encryption at rest / Encryption in transit (TLS) – Enforces use of private networks and security lists – Data masking functions – Identity federation – Password policy validation • Channel (Replication) – Inbound / Outbound Replication: asynchronous replication from or to MDS • Managed Read Replicas – Increase capacity for read-intensive workloads • Audit Service – MySQL Database integrates with the Oracle Cloud Infrastructure Audit Service – MySQL Enterprise Audit plugin - define filters that specify which events and activities should be collected • Standalone – Single-instance MySQL DB System • High Availablility – Guarantees if one instance fails, another takes over, with zero data loss and minimal downtime • HeatWave – A distributed, scalable, shared-nothing, in-memory, hybrid columnar, query processing engine designed for extreme performance
13. Oracle Cloud Infrastructure MySQL Inbound Replication Primary instance Existing on-premises or cloud app Leverage HeatWave features in the cloud HeatWave Cluster OLTP + Analytics or ML/AI Queries OLTP Query MySQL Database 13 Effortless Hybrid Deployment with HeatWave and MySQL On-Premises / Cloud
14. HeatWave MySQL: Standard E3 AMD 16GB/Core, all regions have the same price. Amazon RDS: Intel R5 16GB/Core, AWS US East. Azure: Memory Optimized Intel 20GB/Core, MS Azure US-East. Google: High Memory N1 Standard Intel 13GB/Core, GCP Northern Virginia. Configuration: 100 OCPUs, 1 TB Storage. MySQL Database Service Amazon RDS Microsoft Azure Google Cloud SQL $0 $50,000 $100,000 $150,000 $200,000 $250,000 $65,833 $215,652 $212,974 $170,244 Annual cost for a 100 OCPUs, 1TB Storage configuration HeatWave MySQL costs less Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 14
15. Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 15 HeatWave In-Memory Query Accelerator https://www.oracle.com/mysql/heatwave/
16. Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 16 HeatWave - In-Memory Query Accelerator Architecture https://dev.mysql.com/doc/heatwave/en/mys-hw-architecture.html
17. *Benchmark queries are derived from the TPC-H benchmark, but results are not comparable to published TPC-H benchmark results since they do not comply with the TPC-H specification 400G, 64 cores HeatWave MySQL dramatically speeds up analytic queries Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 17
18. See documented performance comparisons that show how HeatWave is 6.5X faster than Amazon Redshift at half the cost, 1400X faster than Amazon Aurora at half the cost, and 5400X faster than Amazon RDS for MySQL at two-thirds the cost 30TB TPCH, HeatWave is faster, cheaper & easier to use than all the competitive database services HeatWave performance and price comparison Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 18 www.oracle.com/mysql/heatwave/performance
19. Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 19 HeatWave Lakehouse Process and query hundreds of terabytes of data in the object store https://www.oracle.com/heatwave/lakehouse/
20. Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 20 HeatWave can process data from multiple data sources e.g. Oracle Golden Gate, ... AWS Aurora AWS Redshift Data can be in a file or other databases → No requirement to have data in MySQL https://www.mysql.com/products/mysqlheatwave/lakehouse
21. Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 21 Provides flexibility to develop applications on object store without any performance, cost impact Same price-performance when data inside HeatWave or in object store HeatWave HeatWave Lakehouse Snowflake Redshift Google Big Query Databricks 0 10 20 30 40 50 60 70 80 90 100 1.5 1.5 41.9 20.2 41.4 92.5 10TB TPC-H Price-Performance Price-Performance (cents) • 10 HeatWave Nodes, X-Large cluster for Snowflake; 10 nodes of ra3.4xlarge for Redshift; 800 slots for Google BigQuery; Large cluster for Databricks • Standard edition price for Snowflake; 3 yr upfront price for Redshift; 1 year reserved price for Google BigQuery and Databricks https://www.oracle.com/mysql/heatwave/performance/#heatwave-lakehouse
22. Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 22 HeatWave AutoML Build, train, deploy, & explain machine learning models within HeatWave, at no additional cost https://www.oracle.com/heatwave/features/#automl
23. Copyright © 2024, Oracle and/or its affiliates In-database machine learning with HeatWave AutoML Accelerate ML initiatives, increase security, and reduce costs 23
24. HeatWave AutoML automates the ML lifecycle & all models can be explained Dataset Data preprocessing Algorithm selection Adaptive sampling Feature selection Hyper-parameter tuning Tuned model Model explainer Prediction explainer Regulatory compliance Fairness Repeatability Causality Trust HeatWave AutoML leverages Oracle AutoML technology to automate the process of training a ML model https://dev.mysql.com/doc/heatwave/en/heatwave-machine-learning.html Copyright © 2024, Oracle and/or its affiliates 24
25. Classification Classify warranty claims Identify similar users Recommend movies Recommender System Loan default prediction Predict flight delay Rain fall prediction Regression Predict Advt spend ROI Demand forecasting Anomaly Detection Detect anomalous credit card spend Identify game hacker Fully automated in-database machine learning Training, inference, explanation with HeatWave AutoML • In-database • Secure • Fully automated • 25x faster than Redshift ML • Explainable • No additional cost Time-series forecasting 25 Copyright © 2024, Oracle and/or its affiliates
26. HeatWave AutoML uses a set of SQL routines 26 Copyright © 2024, Oracle and/or its affiliates. All rights reserved. Machine Learning with HeatWave is so simple • You only need to use a limited set of SQL routines: ✔ ML_TRAIN: Trains a machine learning model for a given training dataset ✔ ML_PREDICT_ROW: Makes predictions for one or more rows of data ✔ ML_PREDICT_TABLE: Makes predictions for a table of data ✔ ML_EXPLAIN_ROW: Explains predictions for one or more rows of data ✔ ML_EXPLAIN_TABLE: Explains predictions for a table of data ✔ ML_SCORE: Computes the quality of a model ✔ ML_MODEL_LOAD: Loads a machine learning model for predictions and explanations ✔ ML_MODEL_UNLOAD: Unloads a machine learning model • In addition, with HeatWave AutoML, there is no need to move or reformat your data • Data and machine learning models never leave the HeatWave Service, which saves you time and effort while keeping your data and models secure
27. Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 27 HeatWave GenAI & Vector Store Generative AI Integrated and Automated, at no additional cost https://www.oracle.com/heatwave/features/#automl
28. Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 28 HeatWave GenAI  Provides integrated and automated generative AI with in-database large language models (LLMs)  An automated, in-database vector store & scale-out vector processing  The ability to have contextual conversations in natural language Letting you take advantage of generative AI without AI expertise, data movement, or additional cost https://www.oracle.com/heatwave/genai/
29. Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 29 Vector store provides context to LLM for more relevant results Users can interact with HeatWave GenAI in natural language https://blogs.oracle.com/mysql/post/introducing-vector-store-and-generative-ai-in-mysql-heatwave
30. Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 30 Vector store provides context to LLM for more relevant results Users can interact with HeatWave GenAI in natural language https://blogs.oracle.com/mysql/post/introducing-vector-store-and-generative-ai-in-mysql-heatwave
31. HeatWave GenAI offers several advantages: • Simplicity – Easy to use, no AI expertise required, and streamlined integration into existing systems • Flexibility – Can run on various platforms and offers multiple ways to interact with the model (natural language, SQL) • Performance – Delivers fast and consistent performance due to in-database processing and parallel architecture • Security – Protects data privacy by keeping information within the database • Cost-effectiveness – No additional costs for the GenAI service and optimized resource utilization 31 Copyright © 2024, Oracle and/or its affiliates HeatWave GenAI Benefits Summary Simplify the development of genAI apps while providing performance, security, & cost benefits
32. Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 32 Conclusion Get faster insights from all your data with HeatWave https://www.oracle.com/heatwave/features/#automl
33. Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 33 Best price performance ratio for OLTP, data warehouse, machine learning and AI workloads HeatWave
34. Get faster insights from all your data with unmatched performance HeatWave Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 34 • HeatWave GenAI – Take advantage of generative AI without AI expertise or data movement. HeatWave GenAI provides integrated and automated generative AI with in-database large language models (LLMs); an automated, in-database vector store; and the ability to have contextual conversations in natural language • HeatWave MySQL – Accelerate MySQL query performance by orders of magnitude and get real-time analytics on your transactional data—without the complexity, latency, risks, and cost of ETL duplication. Rely on the only cloud service built on MySQL Enterprise Edition • HeatWave Lakehouse – Query data in various formats in object storage and optionally combine it with transactional data in MySQL databases. HeatWave Lakehouse delivers unmatched performance and price-performance • HeatWave AutoML – Automate the pipeline to build, train, and explain ML models using data in object storage and MySQL Database—without moving the data to a separate ML cloud service and at no additional cost https://www.mysql.com/products/heatwave/
35. Get $300 in credits and try free for 30 days Get started with MySQL HeatWave oracle.com/mysql/free Learn more about MySQL HeatWave oracle.com/mysql Request a guided workshop Ask your account manager 35 Copyright © 2024, Oracle and/or its affiliates
36. • Try Always Free cloud services and get a 30-day trial • 30-day Free Trial – US$300 in free credits – Access to a wide range of Oracle Cloud services for 30 days, including MySQL Database Service, etc… • Always Free – Limited list of services you can use for an unlimited time – HeatWave included! – https://www.oracle.com/cloud/free/#always-free 36 Copyright © 2024, Oracle and/or its affiliates. All rights reserved. Oracle Cloud Free Tier https://www.oracle.com/cloud/free/
37. Follow us on Social Media “Data is the Oxygen of Business” 37 Copyright © 2024, Oracle and/or its affiliates
38. Merci! Q&R Olivier Dasini Cloud Solutions Architect @ Oracle olivier.dasini@oracle.com Blogs : www.dasini.net/blog/en : www.dasini.net/blog/fr Linkedin : www.linkedin.com/in/olivier-dasini Slides : https://speakerdeck.com/freshdaz
40. Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 40 HeatWave MySQL Optimized for OLTP, Data Warehouse, Machine Learning, and AI
41. Copyright © 2024, Oracle and/or its affiliates. All rights reserved. 41 HeatWave Lakehouse Process data in object store and transactional database  Process and query 100’s of TB of data in the object store — in a variety of file formats  Query data across MySQL, the object store, or both—using standard MySQL commands  Querying the database is as fast as querying the object store Scales from 16 GB to 512 TB