Look Mom No Hands! Moving from a managed relational database to a serverless one_Renato Losio _Codemotion Berlin 2019

A relational database is often a bottleneck, hard to scale, harder to manage: from AWS to Google Cloud, the major cloud providers offer different options to run a MySQL or a MySQL compatible database on the cloud. You can spin up virtual machines and configure your own cluster or rely on managed services, but the new trend is serverless databases that offer both traditional interfaces and HTTP API access. Can they be the future? Is Amazon Aurora Serverless really serverless?

About:
Renato Losio Principal Cloud Architect - Funambol

Renato Losio is a software and cloud architect, a digital nomad and a slow runner. He has many years of experience as a software engineer, tech lead and cloud services specialist in Italy, UK, Portugal and Germany. He currently lives in Berlin and works remotely as principal cloud architect for Funambol inc. Location-based services and relational databases are his main working interests. A certified AWS professional, he holds a MSc degree in Physics and a MSc in Computing Science.

Transcript

1. Look Mom No Hands! Moving from a managed relational database to a serverless one Renato Losio, Funambol 12-13 November, 2019
2. devops HA serverless kubernetes autoscaling docker AI infrastructure as code orchestration
5. Relational databases Connection limits Networking issues Provisioning issues Scaling issues Infrastructure as code issues
8. Amazon Aurora PlanetScale Percona server Google Cloud SQL Azure Database for MySQL RDS for MariaDB Vitess
11. MySQL & AWS
12. MySQL on VM Rely on EC2 + EBS Full control: root access Flexibility Easy vertical scaling Set your own replication Backup & failover Very latest MySQL, Percona server-full databases
13. RDS MySQL Managed service 10 years old Vertical scaling Sync replication Backup & point in time recovery Other RDS engines available Performance Insights (new) Autoscaling storage Managed and scalable MySQL
14. Amazon Aurora MySQL/PostgreSQL compatible Vertical scaling Proprietary technology 5 years old Automatic, six-way replication Backtrack: turn back time Multi-Master built for the cloud, fully managed
15. automation
17. How to scale vertically an instance size for the peak load?
20. fake autoscaling SDK bash (CLI) minor version IOPS CPU Lambda latency
21. Why not available out of the box?
22. outage
23. 23 Database frozen
24. RDS memory PIOPS vCPU memory optimized networking 50+ instance types burstable standard
25. Serverless HA and fault tolerance No server maintenance Charge for usage Continuous scaling what is it?
26. Simply functions?
28. wait but... DynamoDB? FaunaDB? Google Firebase?
29. Aurora Serverless Endpoint without instance size Easy scaling Pay-per-use Auth IAM roles MySQL 5.6 compatible (and Postgres) MySQL since 2018, Postgres 2019 MySQL TCP connection auto-scaling configuration
30. A DB cluster that automatically starts up, shuts down, and scales up or down capacity based on your application's needs.
32. super exciting? development/test weekly reporting unpredictable load intermittent
35. Might not be able to find a scaling point if you have long-running queries or transactions in progress, or temporary tables or table locks in use.
36. Serverless Aurora or Autoscaling Aurora? Aurora Serverless Data API (beta)
37. var params = { resourceArn: 'STRING_VALUE', /* required */ secretArn: 'STRING_VALUE', /* required */ sql: 'STRING_VALUE', /* required */ (...) database: 'STRING_VALUE', parameters: [ { name: 'STRING_VALUE', value: { blobValue: new Buffer('...') || 'STRING_VALUE' /* Strings will be Base-64 encoded on your behalf */, booleanValue: true || false, doubleValue: 'NUMBER_VALUE', isNull: true || false, longValue: 'NUMBER_VALUE', stringValue: 'STRING_VALUE' } }, /* more items */ ], }; rdsdataservice.executeStatement(params, function(err, data) { if (err) console.log(err, err.stack); // an error occurred else console.log(data); // successful response });
38. limitations? new & iterating No MySQL 5.7+ managing pools no auditing delay / sleep VPC only configuration
39. vertical
41. Amazon Northern Light a managed Kubernetes MySQL Cluster
43. cloudiamo.com