Connecting 10000 cars to the AWS Cloud

Talk at AWS community Day Kochi

Transcript

1. Connecting 10000 cars to the AWS Cloud Ashwin @ Zoomcar | Oct-12, 2019
2. $whoami • Old school Sys / Network Admin • <3 Shell / UNIX • <3 Cloud and scaling tech companies • IoT is my new tinker toy • Own Mail and DNS servers
4. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9 India’s first and largest app-based self- drive car rental company.
5. Cars E-Scooters
6. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9 100% AWS
7. Some more data • 40 Cities • 3mn users on the platform • > 4000 rides every day • 5lac km travelled daily • 10000 cars
8. Some more data contd… • All cars are connected to platform • > 500mn IoT events ingested daily • > 1TB data lake for analysis and reporting
9. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9 This is just cars! We have scooters too ;-)
10. How did we do this?
11. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9 WE BURNT OURSELVES, OUR FAMILIES, OUR FRIENDS, OUR LAPTOPS and then some!
12. THAT CHEAP Datacenter!
13. • ~ 70 % uptime • No NOC • Noisy neighbor problems • Hands tied on architectural, design, infra decisions • DevOps === Red eyed devils on the floor • Maintain / own Systems • Maintain / own Infra
14. Bring on the experts!
15. • Mandate to scale – Zap subscribe • 1 month to create migration plan • 2 days to create instances • 3 days to migrate data • 4 hours of downtime • 5 Star Performance
16. Post the upgrade • Cloudfront – Website (1.2 secs to first paint) • Autoscaling API cluster (2sec to 150ms avg resp time) • EKS (~30% cost advantage) • Multi AZ RDS (No DBAs in office) • Read Replica Slaves (Daisy chained on demand for teams) • AWS Glue / Athena / Redshift (More data sources, more information) • 40X average scale / 200X peak load (Yaaaaay!!!) • Elasticache (Memcache / Redis at their performant best) • Kafka for IoT pipelines (Beast mode on steroids for distributed data processing)
17. Data is the new FUEL!
18. Business Intelligence • User behavior capturing • Quicker identification of UX drop off points • Demand Forecasting • Predictive Maintenance
19. Data Analytics • Every data point we can think of captured • Cars produce 500mn data points per day • Customer Churn • Fraud detection • Driver Score
20. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9 And that’s how we connect 10000 cars to the AWS Cloud…
21. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9 Hold on! There’s more!
22. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9 How would YOU do it?
23. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9 How would you connect 1mn devices?
24. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9 Few Key Learnings
25. Bad arch decisions bite you hard
26. Be prepared to change at the earliest
27. Managed Services exist for a reason
28. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9 AWS IoT
29. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9 Key Components
30. Ingestion / Persistence / Analysis
31. Key Components • Applications • Device Management • Message management • Storage • Data Processing • Notifications • Analytics
32. Key Components • Applications – AWS IoT SDK / Edge with Greengrass • Device Management – AWS IoT Hub / Device Shadows • Message management – AWS IoT Message Queue / AWS IoT Rules Engine • Storage – RDS / DynamoDB • Data Processing - Lambda • Notifications – SQS • Analytics – EMR / Kinesis / Redshift
33. Why AWS IoT???
34. • Rock solid / proven ecosystem • Infinite Scale • Insanely small Time to Market • Programmability • Insights • Smooth learning curve • Existing support systems and community
36. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9 Thank You me@imashwin.co +91 9003010231