Making Azure the best destination to run Postgres | European Virtual Open Source Summit 2020 | Umur Cubukcu

Making Azure the best destination to run Postgres | European Virtual Open Source Summit 2020 | Umur Cubukcu

Developers love Postgres, and so does our open source database team at Microsoft. And we’ve been investing more and more in Postgres—by acquiring Citus Data to enable apps that need horizontal scale, by hiring and investing in Postgres open source committers, and of course by launching the Azure Database for PostgreSQL database service back in the day. In this talk—Umur Cubukcu, head of the Azure Postgres product team and former CEO of Citus Data—will explain why he believes Azure is the best destination to run Postgres.

This talk will show you how Hyperscale (Citus)—now built into Azure Database for PostgreSQL—is changing what is possible with Postgres. Based on the Citus open source extension to Postgres, Hyperscale (Citus) transforms Postgres into a distributed database, empowering developers and applications to do things that were simply not possible before. Umur also plans to share insights into real-world Azure scenarios that run on Postgres, including multi-tenant SaaS, real-time analytics, time series, and geospatial use cases.

143117954187136b825331f24da0e201?s=128

Azure Postgres

June 16, 2020
Tweet

Transcript

  1. Making Azure the best destination to run Postgres Umur Cubukcu

    Principal Group PM Manager, Azure & former CEO of Citus Data @umurc / @AzureDBPostgres / @citusdata
  2. None
  3. 9 years ago we founded a company to change what’s

    possible with Postgres
  4. PostgreSQL transformed into a horizontally scalable database

  5. Packaged as extension, not a fork PostgreSQL transformed into a

    horizontally scalable database Open source & Fully managed
  6. Packaged as extension, not a fork PostgreSQL transformed into a

    horizontally scalable database Open source & fully-managed
  7. “Distributed PostgreSQL is a game changer. We can support more

    than 6M queries every day, on 2 PB of data. With Citus, response times for 75% of queries are less than 0.2 seconds.”
  8. Microsoft Azure Welcomes PostgreSQL Committers aka.ms/blog-postgres-committers

  9. None
  10. Azure Why PostgreSQL? Postgres-as-a-Service on Azure Postgres at any scale:

    Hyperscale (Citus) What makes Azure unique for PostgreSQL? Use cases & resources
  11. DB-Engines Ranking PostgreSQL (+ OSS Relational) more & more popular

    Source: DB-Engines.com.
  12. of companies invest in public cloud technologies3 of new in-house

    applications being built on open source DBMS2 https://insights.stackoverflow.com/survey/2019 Postgres one of most loved & wanted databases in Stack Overflow Developer Survey 20191 >70% growing in popularity 80%
  13. Open source Large developer community Rich feature set Solves a

    multitude of use cases Proven resilience & stability Thousands of mission critical workloads Why PostgreSQL? • Enterprise-ready • Zero data loss • Rich indexing, text search, arrays • Extensible & tooling
  14. Why We Postgres • Open Source • Constraints • Extensions

    • PostGIS • Citus • B-tree, GIN, BRIN, & GiST • Available as a database service • Decades of robustness • Millions of happy users • Foreign data wrappers • Window functions • CTEs • ACID • Full text search • JSONB • Rich datatypes • pg_stat_statements • Rollups
  15. Azure Why PostgreSQL? Postgres-as-a-Service on Azure Postgres at any scale:

    Hyperscale (Citus) What makes Azure unique for PostgreSQL? Use cases & resources
  16. PostgreSQL built for cloud: Simpler & better on Azure Global

    reach Security Scale up & out High Availability Compliance Intelligent performance Easy ecosystem integration Extension support
  17. You have choices. We are fans of fully-managed database service

    (PaaS) On-prem PostgreSQL Managed by you Managed by Postgres experts at Microsoft Datacenter management Hardware O/S provision / patching Database provision / Patch / Scaling Virtualization Security / Compliance Performance optimization High availability / DR / Backups Data Applications
  18. You have choices. We are fans of fully-managed database service

    (PaaS) On-prem PostgreSQL IaaS Azure VMs with PostgreSQL Managed by you Managed by Postgres experts at Microsoft Datacenter management Hardware Virtualization O/S patching Database provision / Patch / Scaling Security / Compliance Performance optimization High availability / DR / Backups Data Applications Datacenter management Hardware O/S provision / patching Database provision / Patch / Scaling Virtualization Security / Compliance Performance optimization High availability / DR / Backups Data Applications
  19. You have choices. We are fans of fully-managed database service

    (PaaS) On-prem PostgreSQL IaaS Azure VMs with PostgreSQL PaaS Azure Database for PostgreSQL Managed by you Managed by Postgres experts at Microsoft Security / Compliance Intelligent performance Datacenter management Hardware Virtualization O/S Database provision / Patch / Scaling High availability / DR / Backups Data Applications Datacenter management Hardware Virtualization O/S patching Database provision / Patch / Scaling Security / Compliance Performance optimization High availability / DR / Backups Data Applications Datacenter management Hardware O/S provision / patching Database provision / Patch / Scaling Virtualization Security / Compliance Performance optimization High availability / DR / Backups Data Applications
  20. Azure Why PostgreSQL? Postgres-as-a-Service on Azure Postgres at any scale:

    Hyperscale (Citus) What makes Azure unique for PostgreSQL? Use cases & resources
  21. Changing what's possible with Hyperscale (Citus) Grow to 100s of

    database nodes, without re-architecting your application Block growth on 1 (monolithic) database 18 Total Nodes
  22. None
  23. aka.ms/citus

  24. Elastic scale Always current Unified management Azure data services anywhere:

    On-premises, multi-cloud Cloud benefits for both disconnected and connected scenarios Disconnected support aka.ms/AzureArc (PREVIEW) Azure SQL Database PREVIEW Azure Database for PostgreSQL Hyperscale PREVIEW
  25. Azure Why PostgreSQL? Postgres-as-a-Service on Azure Postgres at any scale:

    Hyperscale (Citus) What makes Azure unique for PostgreSQL? Use cases & resources
  26. Rich feature set Proven resilience & stability Open source Making

    Azure the best destination for PostgreSQL Collaborate & contribute
  27. Making Azure the best destination for PostgreSQL Rich feature set

    Proven resilience & stability Open source Highly scalable Fully managed Run anywhere Security & Compliance Hyperscale (Citus) Azure Arc
  28. Rich feature set Proven resilience & stability Open source Making

    Azure the best destination for PostgreSQL Highly scalable Fully managed Run anywhere Security & Compliance
  29. Rich feature set Proven resilience & stability Open source Making

    Azure the best destination for PostgreSQL Highly scalable Fully managed Run anywhere Security & Compliance Available on Microsoft Azure
  30. Rich feature set Proven resilience & stability Open source Making

    Azure the best destination for PostgreSQL Highly scalable Fully managed Run anywhere Security & Compliance Available on Microsoft Azure
  31. aka.ms/ads-postgres-extension

  32. Azure Why PostgreSQL? Postgres-as-a-Service on Azure Postgres at any scale:

    Hyperscale (Citus) What makes Azure unique for PostgreSQL? Use cases & resources
  33. Single Server Use Cases for PostgreSQL on Azure Digital transformations

    & data estate modernization AKS, Python/Django, Ruby/Rails, Java/Hibernate New Cloud-Native
  34. Lift & shift to cloud Single Server Use Cases for

    PostgreSQL on Azure Digital transformations & data estate modernization AKS, Python/Django, Ruby/Rails, Java/Hibernate PaaS v. IaaS: Focusing on your application & not your database. New Cloud-Native
  35. Lift & shift to cloud Oracle to PostgreSQL Single Server

    Use Cases for PostgreSQL on Azure Digital transformations & data estate modernization AKS, Python/Django, Ruby/Rails, Java/Hibernate PaaS v. IaaS: Focusing on your application & not your database. Modernize data estate, build new analytics, lower costs New Cloud-Native
  36. Lift & shift to cloud Oracle to PostgreSQL Single Server

    Use Cases for PostgreSQL on Azure Digital transformations & data estate modernization AKS, Python/Django, Ruby/Rails, Java/Hibernate PaaS v. IaaS: Focusing on your application & not your database. Modernize data estate, build new analytics, lower costs New Cloud-Native Digital transformations + Modern relational applications built with OSS
  37. Hyperscale (Citus) use cases for Postgres on Azure Digital transformations

    & data estate modernization Real-time, operational analytics JSON, Geospatial, Timeseries, HTAP workloads
  38. Hyperscale (Citus) use cases for Postgres on Azure Digital transformations

    & data estate modernization Multi-tenant & SaaS Real-time, operational analytics JSON, Geospatial, Timeseries, HTAP workloads Enterprises, B2B, Sharding, ISVs building SaaS apps
  39. Hyperscale (Citus) use cases for Postgres on Azure Digital transformations

    & data estate modernization Multi-tenant & SaaS Real-time, operational analytics JSON, Geospatial, Timeseries, HTAP workloads Transactional / OLTP Enterprises, B2B, Sharding, ISVs building SaaS apps Strong consistency, Relational (foreign keys, joins), limitless data
  40. Scaling from as low as 10s of GBs up to

    Petabytes
  41. Architecting petabyte-scale analytics by scaling out Postgres on Azure with

    the Citus extension aka.ms/blog-petabyte-scale-analytics
  42. Citus helps ASB onboard customers 20x faster “After migrating to

    Citus, we can onboard Vonto customers 20X faster, in 2 minutes vs. the 40+ minutes it used to take. And with the launch of Hyperscale (Citus) on Azure Database for PostgreSQL, we are excited to see what we can build next on Azure.”
  43. Superpowers in Azure Database for PostgreSQL Hyperscale (Citus) to scale

    out horizontally
  44. Know that Microsoft loves open source (& Postgres) Hyperscale (Citus)

    to scale out horizontally Open source commitment
  45. If thinking of using Postgres, 3 reasons to think of

    Azure Hyperscale (Citus) to scale out horizontally Complemented with Azure ecosystem Open source commitment
  46. Our Azure Postgres service page—and our blog! Azure Database for

    PostgreSQL https://aka.ms/azure-postgres Azure Postgres Blog https://aka.ms/azure-postgres-blog
  47. Migrations https://aka.ms/postgres-migration-tutorial Wealth of documentation resources, too Azure Postgres Quickstart

    Docs https://aka.ms/azure-postgres-quickstart Azure Database for PostgreSQL https://aka.ms/azure-postgres Azure Postgres Blog https://aka.ms/azure-postgres-blog
  48. Migrations https://aka.ms/postgres-migration-tutorial AskAzureDBforPostgreSQL@service.microsoft.com Citus open source packages on GitHub—also, Email

    https://aka.ms/citus Azure Postgres Quickstart Docs https://aka.ms/azure-postgres-quickstart Azure Database for PostgreSQL https://aka.ms/azure-postgres Azure Postgres Blog https://aka.ms/azure-postgres-blog
  49. Citus Newsletter aka.ms/citus-newsletter

  50. © Copyright Microsoft Corporation. All rights reserved. danke schön dank

    u merci teşekkürler thank you grazie gracias tack @umurc @AzureDBPostgres @citusdata Umur Cubukcu
  51. BACKUP

  52. “Distributed PostgreSQL is a game changer. We can support more

    than 6M queries every day, on 2 PB of data. With Citus, response times for 75% of queries are less than 0.2 seconds.”
  53. Hyperscale (Citus) use cases for Postgres on Azure JSON, Geospatial,

    Timeseries, HTAP workloads Enterprises, B2B, Sharding, ISVs building SaaS apps Strong consistency, Relational (foreign keys, joins), limitless data Real-time, operational analytics Multi-tenant & SaaS Transactional / OLTP
  54. Digital transformations with data at the heart +

  55. Single Server Use Cases for PostgreSQL on Azure AKS, Python/Django,

    Ruby/Rails, Java/Hibernate PaaS v. IaaS: Focusing on your application & not your database Modernize data estate, build new analytics, lower costs New Cloud-Native Apps Lift/shift to cloud Oracle to Postgres
  56. Digital transformations with data at the heart

  57. Digital transformations with data at the heart

  58. Scaling from as low as 10s of GBs up to

    PBs
  59. Making Azure the best destination for PostgreSQL Rich feature set

    Proven resilience & stability Open source Highly scalable Fully managed Run anywhere Intelligent Perf & Security Hyperscale (Citus) Azure Arc
  60. Rich feature set Proven resilience & stability Open source Making

    Azure the best destination for PostgreSQL Highly scalable Fully managed Run anywhere Intelligent Perf & Security
  61. Rich feature set Proven resilience & stability Open source Making

    Azure the best destination for PostgreSQL Highly scalable Fully managed Run anywhere Intelligent Perf & Security Available on Microsoft Azure
  62. Rich feature set Proven resilience & stability Open source Fully

    managed Highly scalable Security & Compliance Intelligent performance Making Azure the best destination for PostgreSQL
  63. Making Azure the best destination for PostgreSQL Available on Microsoft

    Azure Rich feature set Proven resilience & stability Open source Fully managed Highly scalable Security & Compliance Intelligent performance Hyperscale (Citus)
  64. Unmatched security Elastic scale Always current Cloud billing Unified management

    Azure SQL Database PREVIEW Azure Database for PostgreSQL Hyperscale PREVIEW Azure data services anywhere Bring Azure data services to on-premises, multi-cloud, and edge with Azure Arc aka.ms/AzureArc
  65. Changing what's possible with Hyperscale (Citus) Grow to 100s of

    database nodes, without re-architecting your application Block growth on 1 (monolithic) database 18 Total Nodes
  66. Source: DB-Engines.com. DB-Engines Ranking PostgreSQL is more popular than ever

  67. of companies invest in public cloud technologies1 PostgreSQL named 2018

    and 2017 “Database of the year” by DB-Engines.com2 https://db-engines.com/en/blog_post/76 https://insights.stackoverflow.com/survey/2019 Postgres one of most loved & wanted databases in Stack Overflow Developer Survey 20193 80% growing in popularity
  68. Microsoft acquired Citus Data in early 2019 Umur I added

    this new slide. Screenshot of the MSFT blog about the acquisition. You tripped in the dry run here. So I thought it would make more sense to give you an explicit slide to mention the acquisition (after talking about how you founded a company 9 years ago)
  69. Slide palette info PowerPoint Theme Accent colors Accent 1 Accent

    2 Accent 3 Accent 4 Accent 5 Accent 6
  70. Ensure slide content is accessible Take the following steps to

    create accessible content that everyone can consume effectively. Contrast Use high contrast colors for maximum readability The recommended contrast ratio is at least 4.5:1 Text Text Color Contrast Analyzer Download this tool to determine the legibility of text and the contrast of visual elements Download Shape and color Use different shapes with a legend to indicate statuses to accommodate for color blindness Example: Alt text Alt text helps people with screen readers understand the content of slides You should create alternative text for shapes, pictures, charts, tables, SmartArt graphics, or other objects Here’s how: Right click on item Select Edit Alt Text Enter a Description If an object is meant to add visual styling and doesn’t contain meaning (e.g. stylistic borders), do not add alt text and instead check Mark as decorative Slide layouts Using a built-in slide layout that matches your content ensures a hierarchical reading order of text blocks Example: If a new slide will have a title, rather than starting with a blank layout and adding a text block for the title, choose one of the built-in layouts with a title placeholder Reading order Screen readers describe content on the screen in the order it was created To ensure your content is read back in the order you prefer, arrange your objects in the Selection Pane appropriately. Objects on the bottom of the selection pane are read first Here’s how: Click the Home tab In the Drawing group, select the Arrange drop-down menu Click Selection Pane… Additional tips Be sure to run the Accessibility Checker! Go to File click the Check for Issues drop down menu click Check Accessibility Videos need to be accessible: If your presentation includes a video, ensure it is captioned and audio described (if appropriate) Visit the Office Accessibility Center to learn more about accessibility in PowerPoint
  71. Brand and accent colors accessibility Type and background combinations must

    meet a minimum 4.5:1 contrast ratio to help ensure people of all abilities can access and understand our communications. Pick colors carefully and avoid relying on color alone to convey information. Always provide text or other graphical cues to guide customers to our message. Examples demonstrate correct color use for on-screen applications. Get the Color Contrast Analyzer Get more information on accessibility Get the Microsoft color guidelines PDF Dark Orange Rich Black R255 G147 B73 Hex #FF9349 Dark Yellow Rich Black R254 G240 B0 Hex #FEF000 Dark Green Rich Black R155 G240 B11 Hex #9BF00B Dark Teal Rich Black R48 G229 B208 Hex #30E5D0 Dark Blue Rich Black R80 G230 B255 Hex #50E6FF Dark Purple Rich Black R213 G157 B255 Hex #D59DFF White Rich Black R216 G59 B1 Hex #D83B01 Rich Black R255 G185 B0 Hex #FFB900 White R16 G124 B16 Hex #107C10 White Rich Black R0 G133 B117 Hex #008575 White Rich Black R0 G120 B212 Hex #0078D4 White Rich Black R134 G97 B197 Hex #8661C5 Light Orange White R107 G41 B41 Hex #6B2929 Light Yellow White R106 G75 B22 Hex #6A4B16 Light Green White R5 G75 B22 Hex #054B16 Light Teal White R39 G75 B71 Hex #274B47 Light Blue White R36 G58 B94 Hex #243A5E Light Purple White R59 G46 B88 Hex #3B2E58 White R255 G255 B255 Hex #FFFFFF Orange Dark Orange Dark Yellow Green Dark Green Teal Dark Teal Blue Dark Blue Purple Dark Purple Rich Black R0 G0 B0 Hex #000000 White Light Orange Orange White Light Yellow Yellow White Light Green White Light Teal Teal White Light Blue Blue White Light Purple Purple Extra Light Gray R242 G242 B242 Hex #F2F2F2 Light Gray R230 G230 B230 Hex #E6E6E6 Gray R210 G210 B210 Hex #D2D2D2 Mid Gray R115 G115 B115 Hex #737373 Dark Gray R80 G80 B80 Hex #505050 Extra Dark Gray R47 G47 B47 Hex #2F2F2F
  72. Fully-managed database service on Azure means you can focus on

    your application On-prem PostgreSQL IaaS Azure VMs with PostgreSQL PaaS Azure Database for PostgreSQL Datacenter management Hardware O/S provision /patching Database provision/ Patch/Scaling Virtualization Data Applications High availability /DR/Backups Datacenter management Hardware Virtualization O/S Database provision/ Patch/Scaling Data Applications High availability /DR/Backups Data Applications Datacenter management Hardware Virtualization O/S Database provision/ Patch/Scaling High availability/ DR/Backups Intelligent performance/security Managed by our Postgres experts at Microsoft Managed by you Only on Azure—machine learning capability
  73. “After migrating to Citus, we can onboard Vonto customers 20X

    faster, in 2 minutes vs. the 40+ minutes it used to take. And with the launch of Hyperscale (Citus) on Azure Database for PostgreSQL, we are excited to see what we can build next on Azure.” Citus helps ASB onboard customers 20x faster
  74. “ At ASB, our Vonto service had a vast amount

    of signups in a short period, causing our single-node Postgres database to creak at the seams—no matter how much we vertically scaled our single node infrastructure. After migrating to Citus, we can onboard Vonto customers 20X faster, in 2 minutes vs. the 40+ minutes it used to take. And with the launch of Hyperscale (Citus) on Azure Database for PostgreSQL, we are excited to see what we can build next on Azure.” Citus was a game changer for us. Vonto / ASB
  75. Why Azure is the best destination to run Postgres Umur

    Cubukcu Principal Group PM Manager, Azure & former CEO of Citus Data