FOSSAsia 2018: A DevOps State of Mind with Microservices, Containers, and Kubernetes

Transcript

1. A DevOps State of Mind with Microservices, Containers
 and Kubernetes Chris Van Tuin Chief Technologist, NA West / Silicon Valley cvantuin@redhat.com
2. “Only the Paranoid Survive” - Andy Grove, 1996
3. Retail Finance Media Transportation ? ? SOFTWARE DISRUPTS BUSINESS
4. THE DISRUPTERS
5. INNOVATION & EXECUTION Shift to Executing at Scale in Dynamic Execution Innovation Innovation Execution
6. + ≠ TAXI TRANSPORTATION DISRUPTER https://goo.gl/MP7QQH Ack: Andrew Ng APP IT’S NOT JUST A… +
7. Culture of experimentation A B 20% vs. 25% Empowered organization Time Change Rapid Innovation THE DISRUPTORS = AI /
 ML Data-driven intelligence Data, Data, Data
8. DISRUPT OR BE DISRUPTED
9. Innovation Months THE AVERAGE ENTERPRISE DOES 
 DEPLOYMENTS EVERY 6 TO 9 MONTHS.
10. DEV QA OPS Walled off people, walled off processes, walled off technologies “THROW IT OVER THE WALL”
11. HOW DOES I.T. TRANSFORM FROM A COST CENTER INTO AN INNOVATION CENTER? Months Innovation
12. THE DEVOPS FACTORY
13. DEV QA OPS Linux + Containers IaaS Orchestration CI/CD Source Control Management Collaboration Build and Artifact Management Testing Frameworks Culture Process Automation Technology + + Collaborative Transparent Open Agile Continuous Iterative Automate Open Source Hybrid Dynamic THE SOFTWARE FACTORY
14. THE DEVOPS FACTORY BARE METAL VIRTUAL PRIVATE CLOUD PUBLIC CLOUD
15. THE VALUE OF DEVOPS Faster Time to Market Security More time To Innovate Faster Resolution Of Problems More Stable Operating Environment Improved Communication & Collaboration Less Complex Less Risk
16. CASE STUDY
17. CUSTOMER CHALLENGES “It could take 6 weeks to get a single word changed on the web site.” “It took 2 years after a competitive start-up launch to get a competing product to market.” “When developers work in Node.js, they can change the code they’re working on, direct it to run, and see whether it works-in the blink of an eye.” “The environment, while stable, didn’t use the sexiest technologies, which made recruiting difficult.”
18. DEVELOPMENT TO PRODUCTION 
 IN <30 MINUTES Source CI Cloud Repo Repo 
 Cloud
19. CULTURE
20. DEV QA OPS Collaborative and empowered teams, 
 consistent processes, consistent technologies MOVE FAST, BREAK THINGS Line of Business Security , DBA, Network, etc.
21. ORGANIZATION COMMUNICATION AND DECISION MAKING Decision
 Making Decision Making Siloed Open
22. Collaboration Shared problems are solved faster + OPEN SOURCE CULTURE Transparency 
 (both access and 
 the ability to act) Working together creates necessary standardization + IT’S NOT JUST CODE; IT’S CULTURE
23. PROCESS
24. AUTOMATION: CI/CD PIPELINE Continuous Integration Continuous Build Continuous Deployment Feedback Loop
27. CONTINUOUS FEEDBACK LOOP
28. TECHNOLOGY
29. KEY TECHNOLOGY TRENDS
30. docker.io Registry Private Registry Red Hat Certified FROM fedora:latest CMD echo “Hello” Build file Physical, Virtual, Cloud Image Container Build Run Ship CONTAINERS: BUILD, SHIP, RUN
31. Containers at Scale
32. Scheduling Monitoring Persistence Discovery Lifecycle & health Scaling Aggregation Security CONTAINERS AT SCALE BARE METAL VIRTUAL PRIVATE CLOUD PUBLIC CLOUD
33. DEV QA OPS Open organization + 
 cross-functional teams Software factory automation CI/CD pipelines with feedback Culture Process Technology + + THE DEVOPS FACTORY
34. Enabling Microservices
35. code config data Kubernetes configmaps secrets Container image Traditional 
 data services, Kubernetes 
 persistent volumes TREAT CONTAINERS AS IMMUTABLE
36. Web Database replicas=1, 
 role=db replicas=2, 
 role=web ORCHESTRATION Deployment, Declarative Nodes Controller Manager & Data Store (etcd)
37. role=web role=web ORCHESTRATION Schedule + Provision Pods (Compute/Storage/Network) Image Registry Pods Nodes Web replicas=2, 
 role=web ReplicaSet
38. role=web role=db role=web Pods Nodes Image Registry ORCHESTRATION Schedule + Provision Pods (Compute/Storage/Network) Web replicas=2, 
 role=web ReplicaSet Database replicas=1, 
 role=db StatefulSet
39. Web Database role=web role=db role=web replicas=1, 
 role=db replicas=2, 
 role=web DISCOVERY Service (Load Balancer) Pods Nodes Services Controller Manager & Data Store (etcd)
40. HEALTH CHECK Monitoring & Logging Pods Nodes Services Web Database role=web role=db role=web replicas=1, 
 role=db replicas=2, 
 role=web
41. HEALTH CHECK Pods Nodes Services Web Database role=web role=db role=web replicas=1, 
 role=db replicas=2, 
 role=web role=web Controller Manager & Data Store (etcd)
42. Web Database replicas=1, 
 role=db replicas=2, 
 role=web HEALTH CHECK Pods Nodes Services role=web role=db role=web Controller Manager & Data Store (etcd)
43. Web Database replicas=1, 
 role=db replicas=2, 
 role=web AUTO-SCALE Monitoring & Logging 80% CPU Pods Nodes Services role=web role=db role=web
44. Web Database replicas=1, 
 role=db replicas=3 
 role=web AUTO-SCALE 80% CPU Pods Nodes Services role=web role=db role=web role=web Controller Manager & Data Store (etcd)
45. Pods Nodes Services Web Database replicas=1, 
 role=db replicas=3 
 role=web AUTO-SCALE 50% CPU role=web role=db role=web role=web Controller Manager & Data Store (etcd)
46. RAPID INNOVATION & EXPERIMENTATION
47. ”only about 1/3 of ideas improve the metrics 
 they were designed to improve.”
 Ronny Kohavi, Microsoft (Amazon) MICROSERVICES RAPID INNNOVATION & EXPERIMENTATION
48. CONTINUOUS FEEDBACK LOOP
49. A/B TESTING USING CANARY DEPLOYMENTS
50. Version 1.2 Version 1 100% Tests / CI Version 1.2 Route 25% Conversion Rate ?! Conversion Rate CANARY DEPLOYMENTS
51. 50% 50% Version 1.2 Version 1 Route Version 1.2 25% Conversion Rate 30% Conversion Rate CANARY DEPLOYMENTS
52. 25% Conversion Rate 100% Version 1 Version 1.2 Route Version 1.2 30% Conversion Rate CANARY DEPLOYMENTS
53. Version 1.2 Version 1 100% Route Rollback 25% Conversion Rate 20% Conversion Rate CANARY DEPLOYMENTS
54. 24x Faster Recovery From Failure 3x Lower Change Failure Rate 2555x Shorter Lead Times https://puppet.com/resources/whitepaper/2016-state-of-devops-report 200x More Deployments THE IMPACT…
55. THANK YOU linkedin: Chris Van Tuin email: cvantuin@redhat.com twitter: @chrisvantuin
56. I.T. ENABLING 
 BUSINESS DIFFERENTIATION Taxi Ridesharing $2.50/mile, $0.50/idle Fare Static
 Pricing Dynamic 
 Pricing vs. Ack: William Benton Fare 
 based on 
 real-time and historical data: supply/demand distance, time
 route, traffic etc.