Microservice architecture in practice on AWS: DDD with Java Spring, React and many more

Everyone talks and writes about Microservices, but few show off their actual implementation. We want to change this by opening up our architecture and giving you a peek into how we run. This means we will take you on a ride that dives into the whole development cycle starting at the split of our system into microservices (bounded contexts), how they look from the inside up to the point of how we deploy and manage our infrastructure and system on AWS (ECS) with Infrastructure as Code. All of this is a real system with real challenges and real pain points that we haven't solved yet, but want to show to you.

Transcript

1. Microservice architecture in practice on AWS: DDD with Java Spring, React and many more
2. Steve Behrendt netlight Consulting Tobias Küttner ee-mobility
4. Electric Car Charging ‣ Find stations ‣ Manage charging sessions ‣ Billing ‣ Accounting ‣ Control physical charging station
5. Bounded Context = Microservice = Deployment Unit
6. Chargepoint Customer Energy Management Chargepoint Operator Operations for every charging station Analysis, predication and purchase of energy Customer, driver and contract management Operations of physical and directly connected chargepoints
7. Physical station Physical station Physical station Physical station Physical station Physical station Apps OAuth 3rd Party Backends Aggregators
8. Good fences make good neighbours
9. Defend your language against the enemies Physical station Model + Language Flow Call Flow
10. Defend your language against the enemies Physical station Model + Language Flow Call Flow ACL
11. Defend your language against the enemies Physical station Model + Language Flow Call Flow Adapter
12. ACL as separate deployment unit Defend your language against the enemies Physical station Model + Language Flow Call Flow Adapter
13. Adapter Web Backend-For- Frontend Mobile Backend-For- Frontend Adapter Adater Adapter Adapter Adapter Adapter Adapter Adapter Adapter Architecture
14. Web Backend- For-Frontend Mobile Backend- For-Frontend API React API
15. Adapter Web Backend-For- Frontend Mobile Backend-For- Frontend Adapter Adater Adapter Adapter Adapter Adapter Adapter Adapter Adapter Service level design
17. PostgreSQL Spring Boot Gradle
18. Build Test Package Infra- structure Deploy CI/CD with Bitbucket Pipelines Docker image AWS General Resources AWS ECS Service AWS Application Resources
19. Build Test Package Docker Image Gradle Sonarcloud Unit Tests Infra- structure Deploy
20. AWS Infrastructure Resources Container Service Database Queueing Logging Load Balancing Secrets Build Test Package Infra- structure Deploy
21. AWS CloudFormation (Infrastructure as Code) Template Stack Harder: Application resources as part of the whole platform infrastructure Build Test Package Infra- structure Deploy Easy: ECR Repository for each application to store and access docker image
22. Build Test Package Infra- structure Deploy Build Test Package Infra- structure Deploy Sharing infrastructure code CI/CD Pipeline executed in Docker Container with custom Image aws-cli (python package) cfn-create-or-update (npm package) shared shell scripts shared AWS Cloudformation scripts
23. Build Test Package Infra- structure Deploy Master Stack Networking Hosting Database Queueing Secrets- manager Bastion Host Challenges: Passwords of stacks should not be in code! Creating vs. updating of a stack Excursus to ePower Infrastructure Manually created resources
24. Build Test Package Infra- structure Deploy VPC AWS Cloud Public subnet Private subnet Region eu-central-1 Availability Zone 1 Availability Zone 2 NAT Gateway Auto Scaling Group Instance Instance Amazon Aurora Amazon MQ Bastion Host Elastic Load Balancing Elastic Load Balancing Public subnet Private subnet NAT Gateway Instance Instance Amazon Aurora Amazon MQ Elastic Load Balancing Elastic Load Balancing Secretsmanager Route 53 Elastic Container Service AWS Lambda Amazon IAM Internet gateway Excursus to ePower Infrastructure
25. Build Test Package Infra- structure Deploy ECS with EC2 Instances
26. Build Test Package Infra- structure Deploy Load Balancing with ECS and ELB
27. How does the application get the urls for http inter-service-communication? AWS Secrets Manager Build Test Package Infra- structure Deploy AWS Identity and Access Management (IAM) Role for every Service Permissions List Secrets, Get Secret Value Task Role
28. Build Test Package Infra- structure Deploy Deployment Docker container image of application is built. ECR Repository for container image is built. Application infrastructure resources are built within existing infrastructure. Force new deployment of ECS Service. Push container image.
29. 200% of running instances are allowed while deployment. Build Test Package Infra- structure Deploy Trigger new deployment for service with aws-cli. Place tasks with new image and remove existing ones. Tasks get placed over different availability zones. Press the red button
30. Fetch secrets and configurations from AWS Secrets Manager Different sources for environment variables: - application.yml - System environment variables - PropertySource Fetch secrets and set as environment variables: - URLs - Springboot Admin - Database Credentials - Active MQ Credentials - Configurations AWS Secrets Manager Build Test Package Infra- structure Deploy
31. Build Test Package Infra- structure Deploy Monitoring and Logging Cloudwatch Spring Boot Admin Grafana Prometheus
32. Thank YOU Tobias Küttner ee-mobility Steve Behrendt netlight Consulting
33. Backup
34. AWS Account Setup IAM Users: assume roles in member accounts PLAYGROUND Account DEV Account INT Account LIVE Account Root Account Organization Organization Unit