[deSymfony] Trovit Deployment pipeline

Trovit Deployment pipeline using ansible and jenkins pipeline

Transcript

1. Presentation styleguide May 2016
2. Presentation styleguide May 2016
3. TROVIT & DEPLOYMENT OVERVIEW TROVIT DEPLOYMENT SYSTEM (PAST, PRESENT AND FUTURE) ADVICE
4. TROVIT & DEPLOYMENT OVERVIEW TROVIT DEPLOYMENT SYSTEM (PAST, PRESENT AND FUTURE) ADVICE
5. A CLASSIFIED SEARCH ENGINE FOR PROPERTY, JOBS, CARS AND PRODUCTS
8. PLATFORM NUMBERS 5 SERVERS 40 SERVERS 20 SERVERS 4 SERVERS 50 SERVERS 400 SERVERS
9. Deployment
10. Build
11. Synchronization
12. Release
13. TROVIT & DEPLOYMENT OVERVIEW TROVIT DEPLOYMENT SYSTEM (PAST, PRESENT AND FUTURE) ADVICE
14. Trovit deployment system (Past, present and future)
15. Old deployment system
16. BUILD CREATION Build host Internal External Services Commands SATIS
17. OLD TROVIT DEPLOYMENT - BUILD 1 PROJECT PROJECT FRAMEWORK symlink ✔ BUILD SIZE ✘ BUILD DEPENDENCY ✘ QA INSECURITY
18. OLD TROVIT DEPLOYMENT - BUILD X PROJECTS PROJECT 1 FRAMEWORK symlink PROJECT 2 symlink PROJECT 3 symlink
19. ✔ BUILD SIZE ✘ DEPENDENCY ✘ QA INSECURITY ✘ COMPLEXITY ✘ COMMUNICATION ✘ C&P BASH SCRIPTS ✘ CHANGELESS OLD TROVIT DEPLOYMENT - BUILD X PROJECTS
20. DEPLOYMENT WITHOUT SYMBOLIC LINK Deployment host tag ../project/ ../project/
21. DEPLOYMENT WITHOUT SYMBOLIC LINK ✔ UPLOAD ONLY MODIFIED FILES (rsync) ✘ SLOW ROLLBACK ✘ ERRORS 500! ✘ SERVERS WITH DIFFERENT VERSIONS
22. DEPLOYMENT WITH SYMBOLIC LINK Deployment host tag ../project/ ../project/releases/tag ../project/current Symbolic link Full copy
23. DEPLOYMENT WITH SYMBOLIC LINK ✔ FAST VERSION INSTALLATION ✔ SERVERS WITH THE SAME VERSION ✔ IMMEDIATE ROLLBACK ✔ AVOID ANY ERRORS DURING THE DEPLOY ✘ SLOW UPLOAD
24. RELEASE • Change symbolik link (with symbolic link ) • Php bin/console cache:clear --env=prod --no-debug • Clean opcache • Apache graceful
25. Sum up
26. DEPLOYMENT SYSTEM OVERVIEW • Copy-Paste. • Poor design (rigidity, fragility, immobility, viscosity). • Command line execution. • Slow deploys (20 minutes!!!). • Multi builds for different environments. • Some projects with releases and others without. • Production errors!
27. Current deployment system
28. Vision
29. 10 BACKEND TEAMS +15 PHP PROJECTS
31. +
32. +
33. ABOUT ANSIBLE App deployment, configuration management and orchestration. • Minimal in nature • Consistent • Secure • Highly reliable • Low learning curve INFRASTRUCTURE AS CODE • Cost reduction • Faster execution • Remove errors and security violations
34. HOW ANSIBLE WORKS?
35. ANSIBLE STRUCTURE
36. INVENTORY
37. PROJECT
38. ROLES
39. https://docs.ansible.com/ansibl e/deploy_helper_module.html DEPLOY HELPER
40. FOLDER STRUCTURE
41. EXAMPLE
42. JENKINS OVERVIEW
43. JENKINS PROGRAM
45. CONTINUOUS DELIVERY DEPLOYMENT PIPELINE CODE REVIEW QA OR DEVELOPER BUILD PREPRODUCTION PRODUCTION
46. BUILD Execute ansible playbook Execute all the roles Tag: X.X.X Get tags
47. BUILD
48. PRODUCTION Get tags Tag: X.X.X DEPLOYMENT ENVIRONMENT
49. DEPLOYMENT ENVIRONMENT
50. UI DEPLOYMENT PIPELINE
51. UI DEPLOYMENT PIPELINE
52. PIPELINE DSL (GROOVY)
53. JENKINS TROVIT BUILDS
54. JENKINS TROVIT DEPLOYMENT
55. Rollback
56. Future
57. AGILE WORKFLOW CONTINUOUS INTEGRATION CONTINUOUS DELIVERY CONTINUOUS DEPLOYMENT
58. PIPELINE SCALABILITY
59. QA WORKFLOW QA SYSTEM TO BE TESTED AUTOMATED TESTING PRACTICES TESTING PLATFORM TEST ADMINISTRA TOR TESTING TOOLS TEST LIBRARY
60. SERVICE CONTAINER
61. CONTAINER DEPLOYMENT LOAD BALANCER WEB SERVER APP SERVER DATABASES
62. WIKI • ANSIBLE: https://www.ansible.com/ • ANSIBLE DEPLOY HELPER: https://docs.ansible.com/ansible/deploy_helper_module.html • JENKINS: https://jenkins.io/solutions/pipeline • BLUE GREEN DEPLOYMENT: http://martinfowler.com/bliki/BlueGreenDeployment.html • KUBERNETES: http://kubernetes.io/ • DOCKER: https://www.docker.com/ • NETFLIX: http://techblog.netflix.com/2015/11/global-continuous-delivery-with.html • ETSY: https://www.infoq.com/news/2014/03/etsy-deploy-50-times-a-day • CONTINUOUS INTEGRATION VS CONTINUOUS DELIVERY VS CONTINUOUS DEPLOYMENT: http://stackoverflow.com/questions/28608015/continuous-integration-vs-continuous-delivery-vs-continuou s-deployment • PMP: https://en.wikipedia.org/wiki/Project_Management_Body_of_Knowledge • TROVIT: https://www.youtube.com/channel/UCz8S73iKoCom2RN8B8l-Heg • TROVIT CAREERS: http://careers.trovit.com/
63. TROVIT & DEPLOYMENT OVERVIEW TROVIT DEPLOYMENT SYSTEM (PAST, PRESENT AND FUTURE) ADVICE
64. Advice
65. GLOBAL VISION SCOPE COST TIME
66. GLOBAL VISION RISK QUALITY STAKEHOLDERS INTEGRATION COMMUNICATION
68. Albert Playà (@albertplaya) Software Development Manager
69. QUESTIONS?