Share
Embed
COM402-Building SaaS Platform with AWS Serverless - An Experience Report
AWS Cloud Day Dublin, 2024
Lalit
October 10, 2024
Transcript
43 slides
-
D U B L I N | 1 0 .
1 0 . 2 0 2 4 Cloud Day Dublin -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Building SaaS Enablement Platform with AWS Serverless – An Experience Report Lalit Kale C O M 4 0 2 Platform Architect Globalization Partners -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. AWS SaaS Factory Program Your place for all things SaaS on AWS The AWS SaaS Factory Program helps AWS Partners at any stage of the software-as-a-service (SaaS) journey. https://aws.amazon.com/partners/programs/saas-factory -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. $whoami ⚫ Lalit Kale ⚫ Platform Architect ⚫ First AWS Usage: 2006 ⚫ Dell → Verizon → Amdocs → Globalization Partners ⚫ 5 X AWS Community Builder ⚫ AWS SaaS Community Builder -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Agenda • Business Overview • Platform Architecture • Platform Cloud Infrastructure • Platform Continuous Deployment • Takeaways -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Business Overview Telecom and Media Enterprise ~10B > 60 Products SaaS as a side offer GreenField SaaSify All Products Java, K8s, No previous SaaS Experience, Jr. Eng > Sr. Eng 4 Teams Israel, Ireland, India, USA, Canada -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. source: https://www.amdocs.com/sites/default/files/2023-02/amdocs-service-offering-review-2022.pdf -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Business Overview – User Journey Register Select from Product Catalog Custom parameters e.g. geo-region, Deployment size Bill payment Receive Deployment Email Visit Platform ISV Console Define Users Roles Define Users Roles Access Products via Console -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Outcome - Growth focus for transformation Procurement to Product Use– 12 Months → 48 Hours Increased Conversations – Customers can try and then buy → Free Trials Operational Efficiency – Streamline Sales Channel 5G Market Readiness New Customer Segment – Tier 2,3 + MNVO Telco Providers New Markets– Ability to reach New Geos and New Logos 0 Deals →4 Deals/Qtr ($500k) -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Platform Architecture -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Product A Product A Product A Tenant A Product A Tenant 1-A Tenant 2-A Tenant 3-A customer1 customer2 customer3 Product C Product B Tenant A Product A Tenant 1-A Tenant 2-B Tenant 3-C customer1 customer2 customer3 Tenant 4-A+C customer4 Platform’s Unconventional Challenge Typical SaaS Player Product Portfolio SaaS Player -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Product Onboarding Identity Monitoring, Metrics and analytics Billing and metering Management and monitoring DevOps and provisioning Routing Shared Characteristics of SaaS Product Disaster Recovery Product Delivery and Upgrades Product Configurations Product Integrations -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Tenant 1 Silo Microservice WebApp Microservice Tenant 2 Microservice WebApp Microservice Bridge Tenant 1 Microservice WebApp Tenant 2 Microservice Pool Microservice WebApp Microservice Microservice Microservice Tenant isolation Patterns -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. AWS SaaS Factory Guidance -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Platform Architecture – Conceptual View Admin Console CLI API User Mgt (Platform + Product + Customer) Product Catalog ISV mgt Tenant Mgt Provisioning engine Provisioning engine Account Mgt (Infra+ Networking) Identity (Platform + Product + Customer) Monitoring & Observability Backups Compliance FinOps Tenant ISV Management Product Deployment and Upgrades SaaS Onboarding Product User Platform User Billing Tenant Agent -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Initial Key Decisions • ISV – aka business unit • Product – Product/Solution • Customer – End-Customer – Telco Provider • Platform Geo-Region – US, EU, APAC • Environment – Dev,Test, Prod Tenancy Dimensions • AWS Account • VPC • Subnets • Logical Tenancy in DB Tenant Isolation Levels • AWS EC2 based • Serverless • EKS Based • AWS Single Region • Multi-tenant Product Product Architectures Supported • Multi-Region • Cross Cloud Product Not Supported -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. • AWS DynamoDB and S3: Cross Region Replication • Disaster Recovery • Less Operations and Toil • Focus on Customer Value and Delivering Capabilities • Team Composition and Expertise Why Serverless? -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Platform Service Anatomy AWS Cloud AWS Cloud AWS Cloud • Programming Languages: • Typescript + Node • Python • IaC: Terraform → OpenTofu • DataStores: Amazon DynamoDB • AWS – For All Heavy Lifting • AuthN/AuthZ: Cognito → Auth0 • Github ES → Github Cloud -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Platform Architecture – Conceptual View Admin Console CLI API User Mgt (Platform + Customer) Product Catalog ISV mgt Tenant Mgt Provisioning engine Provisioning engine Account Mgt (Infra+ Networking) Identity (Platform + Customer) Monitoring & Observability Backups Compliance FinOps Tenant ISV Management Product Deployment and Upgrades SaaS Onboarding Product User Platform User Billing Tenant Agent -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Platform Cloud Infrastructure Landscape -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Platform Landing Zone Management Account Network OU Dev Network Account Prod Network Account Security OU Log Achieve Account Audit Account Dev OU Control Plane Dev Account Test OU Test Account Prod OU Tenant UAT Tenant LIVE -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Platform Infrastructure Key Decisions • Region Selection – NO US-East-1 Failures • Hub and Spoke Architecture • Networking – Single Ingress-Single Egress • Availability via Redundancy • Account Pool – 50 Accounts • Security is job zero –Design Validation with Infosec and AWS SAs -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Infosec • Overworked and Understaffed • Age-old security practices • Not significantly aware of Cloud Security Practices • Roadblocks Instead of Guardrails • IT Security and Compliance Intermingle • Security Theater -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Architecture Product Mgt Collaboration - Shared Responsibility Models Platform Team Responsibility For Security ’OF’ the Platform AWS Responsibility For Security ’OF’ the Cloud software Compute Storage Database Networking Hardware/Global Infrastructure Platform AWS Infrastructure Platform Data Platform Security Platform Availability Networking Backbone Platform Control Plane API and Services Product Team Responsibility For Security ’OF’ the PRODUCT Product AWS Account Resources End-Customer Data Platform App Security Product Access Management Platform Team Responsibility For Security ’OF’ the Platform Platform AWS Infrastructure Platform Data Platform Security Platform Availability Networking Backbone Platform Control Plane API and Services -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Platform Continuous Deployment Story -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Once upon a time… • New Organization • People Churn + Contractors • No Customer • Lack of Better Engineering Practices • Telco – Traditional Development Culture • SaFe - Not So Agile • Lack of Technical Product Management Expertise -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Production Deployments A C C E L E R AT E : T H E S C I E N C E O F L E A N S O F T W A R E A N D D E V O P S : B U I L D I N G A N D S C A L I N G H I G H P E R F O R M I N G T E C H N O L O G Y O R G A N I Z AT I O N S Change Advisory boards are useless. Industry doesn’t matter Integration times and branch lifetimes lasting hours are better than days -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. After 5 Months of branch Merge 2 9 china.org.cn -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Inverse Conway Maneuver • Two Pizza Teams focused on Business Capability • You Build it, You Run it! • Microservices -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. If it hurts do it more! -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Deployment Improvement F R O M M O R E T H A N 6 M O N T H S → E V E R Y W E E K Teams taking Ownership Collaboration Improvement Inner sourcing Utilization of Modules Push to production Every week 5 Days -> 30 minutes -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Platform Disaster Recovery -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Disaster Recovery Strategies -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. AWS Backup Service -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Backup Challenges AWS Cognito Product Data Customer Data CICD – Github Enterprise Server Github Cloud Solution Platform Shared Responsibility Model -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. DR Firedrill / Mockdrill Pre-requisite – Monitoring and Observability of System Conduct DR exercise as if there is real disaster happened Wheel of Misfortune – (Failure Hypothesis) Backups are good but Restore!! Restore!! Restore!! -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. DR Firedrill / Mockdrill Complexities Involved - • CICD Pipelines Flaws • Auth0 Restoring Users and Permissions • Sequence of Activities • Team’s Measuring RTO and RPO (No cheating! No Beating!!) • Share the Trends as wins with Management • Runbooks • Transitioning runbooks to L1 Support -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Outcome - Growth focus for transformation Procurement to Product Use– 12 Months → 48 Hours Increased Conversations – Customers can try and then buy → Free Trials Operational Efficiency – Streamline Sales Channel 5G Market Readiness New Markets– Ability to reach New Geos and New Logos 0 Deals →4 Deals/Qtr ($500k) -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Takeaways SaaS is a business strategy Serverless makes Control Plane easier SaaS is a team sport Think Value Streams and Capabilities Instead of Features Platforms can’t solve culture Start Imperfect and follow Continuous Improvements Build Tenant Oriented Observability and Operations -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. The road to success is not a straight line -
Thank you! © 2024, Amazon Web Services, Inc. or its
affiliates. All rights reserved. Lalit Kale [email protected] @atechiethought in/lalitkale/ -
! Please complete the session survey © 2024, Amazon Web
Services, Inc. or its affiliates. All rights reserved. -
© 2024, Amazon Web Services, Inc. or its affiliates. All
rights reserved. Lalit Kale https://www.linkedin.com/in/lalitkale/