Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Best Practices for Migrating your workloads to Azure PostgreSQL and MySQL | Data Platform Summit 2020 | Arun Kumar Thiagarajan & Sunil Agarwal

Best Practices for Migrating your workloads to Azure PostgreSQL and MySQL | Data Platform Summit 2020 | Arun Kumar Thiagarajan & Sunil Agarwal

For open source relational database workloads, customers are increasingly adopting Azure Database for MySQL and Azure Database for PostgreSQL to take advantage of a fully managed database service technical teams innovate faster. In this session, we will cover the best practices to migrate existing MySQL/PostgreSQL/Oracle workloads to Azure PaaS. We will also dive deeper into various migration tools available for offline (one-time migrations and online (ongoing replication) migrations with a live demo of a MySQL to Azure DB for MySQL online migration.

143117954187136b825331f24da0e201?s=128

Azure Postgres

December 03, 2020
Tweet

Transcript

  1. Best Practices for Migrating your workloads to Azure PostgreSQL and

    MySQL Arun Kumar Thiagarajan Principal Program Manager Microsoft Sunil Agarwal Principal PM Manager Microsoft
  2. Agenda • Why Migrate to Azure Cloud • Migrate to

    Azure Database for MySQL • Migrate to Azure Database for PostgreSQL • Migrate Oracle to Azure Database for PostgreSQL
  3. WHY MIGRATE TO

  4. Rich feature set Proven resilience & stability Open source Azure

    is the best place to run your Open-Source Relational Databases
  5. Azure is the best place to run your Open-Source Relational

    Databases Rich feature set Proven resilience & stability Open source Fully managed Highly scalable Security & Compliance Intelligent performance
  6. Rich feature set Proven resilience & stability Open source Fully

    managed Highly scalable Security & Compliance Intelligent performance Azure is the best place to run your Open-Source Relational Databases
  7. Azure is the best place to run your Open-Source Relational

    Databases Available on Microsoft Azure Rich feature set Proven resilience & stability Open source Fully managed Highly scalable Security & Compliance Intelligent performance
  8. MIGRATING TO A ZURE CLOUD Data Center/hardware Upgrades Backup/HADR Security

    Monitoring/Troubleshooting Managing at scale Application Scaling Data Center/hardware Upgrades Backup/HADR Security Monitoring/Troubleshooting Managing at scale Application Scaling Data Center/hardware Upgrades Backup/HADR Security Monitoring/Troubleshooting Managing at scale Application Scaling Data Center/hardware Upgrades Backup/HADR Security Monitoring/Troubleshooting Managing at scale Application Scaling
  9. Migration Types: Homogeneous and Heterogeneous Homogeneous Migration – PostgreSQL (On-premises/IaaS)

    à Azure PostgreSQL (PaaS) – PostgreSQL (AWS/GCP) à Azure PostgreSQL (PaaS) – MySQL (On-premises/IaaS) à Azure MySQL (PaaS) – MySQL (AWS/GCP) à Azure MySQL (PaaS) Heterogeneous Migration – Oracle to Azure PostgreSQL (PaaS)
  10. Why Migrate from Oracle to Azure PostgreSQL?

  11. SHOW IT TO ME!

  12. Pre-migration Discover Assess Migrating to OSS databases on Azure Migrate

    Schema
  13. Migration Pre-migration Discover Assess Migrate Schema Migrating to OSS databases

    on Azure Dump & restore – offline
  14. Migration Pre-migration Discover Assess Migrate Schema Migrating to OSS databases

    on Azure Dump & restore – offline Native logical replication – online OR
  15. Migration Pre-migration Discover Assess Migrate Schema Migrating to OSS databases

    on Azure Dump & restore – offline Native logical replication – online Azure Database Migration Service – online OR OR
  16. Migration Pre-migration Discover Assess Migrate Schema Migrating to OSS databases

    on Azure Dump & restore – offline Native logical replication – online Azure Database Migration Service – online OR OR Post-migration Remediate applications Optimize Run functional & performance tests
  17. Azure Database Migration Service On-premises Migration Azure Database Migration Service

    Microsoft Azure
  18. MIGRATING TO AZURE DATABASE FOR MYSQL

  19. MySQL to MySQL migration options Discover and assess Connect to

    Azure with your favorite tool Migrate schema and data Azure Database Migration Service DMS Continuous Sync
  20. MySQL to MySQL migration options Discover and assess Connect to

    Azure with your favorite tool Migrate schema and data Azure Database Migration Service DMS Continuous Sync X Remediate apps Optimize Test
  21. MySQL to MySQL migration options Discover and assess Connect to

    Azure with your favorite tool Migrate schema and data Azure Database Migration Service DMS Continuous Sync X Remediate apps Optimize Test Data-in replication
  22. MySQL to MySQL migration options Discover and assess Connect to

    Azure with your favorite tool Migrate schema and data Azure Database Migration Service Dump and restore DMS Continuous Sync X Remediate apps Optimize Test Data-in replication Azure Data Factory can also be used
  23. The MySQL Migration Guide Has Landed! Application & DB experts

    Migration Framework Community and in-house tools Pre-migration Migration Post- migration Planning/assessments DB storage/code object migrations Data migrations (Offline vs. online) Experts to engage? Checklists? Tools? + + ENABLING SUCCESSFUL MIGRATIONS MYSQL MIGRATION GUIDE • Scenario-based learning approach with labs deployable via ARM templates • Assessment/planning approaches • Migration best practices • Testing and validation best practices • Post-migration to-dos for success GitHub Link
  24. DEMO: MIGRATING AN RDS FOR MYSQL DB TO AZURE DATABASE

    FOR MYSQL
  25. MIGRATING TO AZURE DATABASE FOR POSTGRESQL

  26. PostgreSQL to PostgreSQL migration options Discover and assess Connect to

    Azure with your favorite tool Migrate schema and data Azure Database Migration Service DMS Continuous Sync
  27. PostgreSQL to PostgreSQL migration options Discover and assess Connect to

    Azure with your favorite tool Migrate schema and data Azure Database Migration Service DMS Continuous Sync X Remediate apps Optimize Test
  28. PostgreSQL to PostgreSQL migration options Discover and assess Connect to

    Azure with your favorite tool Migrate schema and data Azure Database Migration Service Logical replication* DMS Continuous Sync X Remediate apps Optimize Test *Only for migrations into flexible server
  29. PostgreSQL to PostgreSQL migration options Discover and assess Connect to

    Azure with your favorite tool Migrate schema and data Azure Database Migration Service Logical replication* Dump and restore DMS Continuous Sync X Remediate apps Optimize Test *Only for migrations into flexible server Azure Data Factory can also be used
  30. DEMO: MIGRATING A POSTGRESQL DB TO AZURE DB FOR POSTGRESQL

  31. MIGRATING FROM ORACLE TO AZURE DATABASE FOR POSTGRESQL

  32. Oracle to PostgreSQL - Migration Journey Map EVALUATE DISCOVER ASSESS

    & PLAN CONVERT VALIDATE & TEST CONVERSION MIGRATE VALIDATE DATA & TEST FULL STACK CUTOVER & OPERATE
  33. Oracle to PostgreSQL migration process 1. Pre-migration 2. Data Migration

    3. Optimize, cutover and operate Pre-migration + Migration + Post-Migration made easy https://datamigration.microsoft.com/ Discover Convert Assess • Discover • Evaluate • Assess • Plan • Convert • Test conversion Azure DMS Initial bulk load Change replication Remediate applications Iteratively make any necessary changes to your applications Run functional & performance tests Iteratively run functional and performance tests Optimize Based on the tests you performed, address any performance issues, and then retest to confirm the performance improvements App • Set up migration infrastructure • Set up migration • Replicate ongoing changes • Cutover and test
  34. Oracle to PostgreSQL Migration Guide • Oracle conversion best practices

    in one place • Topic-by-topic overview of how each feature in Oracle maps to PostgreSQL. • 300+ pages of details showing – § General compatibility level of an Oracle feature in PostgreSQL § Ora2pg automation capability § Summary of differences with code snippets explaining the feature § Comparison of how the feature will work in PostgreSQL 11 vs. 12 vs. 13 EXAMPLES: NOTE: Users spend ~50% of the time in the entire migration project on converting Oracle DB objects and embedded SQL in apps to PostgreSQL!
  35. aka.ms/postgresql AskAzureDBforMySQL@service.microsoft.com AskAzureDBforPostgreSQL@service.microsoft.com aka.ms/postgres-cloud9 aka.ms/mysql aka.ms/postgres-flexible-blog aka.ms/mysql-flexible-blog aka.ms/mysql-tenthline

  36. Three Ways to Win Prizes Post your selfie with hash

    tag #DPS2020 Give Session & Conference Feedback Visit our Sponsors & Exhibitors Thank You Follow us on Twitter @TheDataGeeks @DataAISummit
  37. Data Platform Virtual Summit 2020 is a community initiative by

    DataPlatformGeeks RESOURCES
  38. Go Deeper Into Postgres & Hyperscale (Citus) • https://www.citusdata.com/ •

    http://docs.citusdata.com/en/v9.5/ Why Scale Out Postgres? https://youtu.be/g3H4nGsJsl0 DEMO - High performance HTAP with Postgres & Hyperscale (Citus) https://youtu.be/W_3e07nGFxY DEMO – Building HTAP Applications with Python & Postgres on Azurehttps://youtu.be/YDT8_riLLs0
  39. Special Thanks To for supporting DataPlatformGeeks & SQLServerGeeks Community Initiatives

  40. DELETE BEFORE PUBLISHING

  41. Why Migrate from Oracle to Azure PostgreSQL? Key Drivers PostgreSQL

    enterprise grade database – OLTP (On-Line Transaction Processing), Geospatial, Analytical, Federated hub – LAPP Stack (Linux, Apache, PostgreSQL, PHP, Python and Perl) – Rich capabilities: Multi-Version Concurrency Control (MVCC), asynchronous replication, nested transactions, online backups, a refined query planner/optimizer – I18N enabled. Supports international character sets, multi-byte character encodings, Unicode, and it is locale-aware for sorting – And more High compatibility between PL/SQL and PL/PGSQL (typically 80%+). Lowers the risk – Migrate Oracle PL/SQL stored procedures, queries, datatypes, packages, sequences etc. to PostgreSQL with little or no code changes – Although incompatibilities exist, experts say migrating from Oracle to PostgreSQL is no costlier than upgrading from one major version of Oracle to the next major version of Oracle TCO (1/5th cost) Open-Source Platform. Freedom to migrate to any public cloud Rich Azure Ecosystem
  42. A P P L I C AT I O N

    M O D E R N I Z AT I O N J O U R N E Y - S A A S • sdfr