Upgrade to Pro — share decks privately, control downloads, hide ads and more …

From 1 to 100k CI/CD Pipeline Jobs in 3 years

From 1 to 100k CI/CD Pipeline Jobs in 3 years

Starting in April 2017 with exactly 1 CI job running inside the on-premise Gitlab-CE installation we raised to more than 50000 pipeline jobs per month at the end of 2019. Why and how did we come to this point? This talk will give you an insight into people and technology and how they both managed it to change the way they work together today and how they are able to deliver services with quality now. Furthermore, I will show you how easy it was to onboard a new young colleague to the team because we already used the GitOps approach. Jump onto a ride through two impressive years and let yourself be inspired about how we did it.

981461e0f9a0fb00cd5d5b762ce99c27?s=128

Mario Kleinsasser

December 07, 2020
Tweet

Transcript

  1. CI/CD jobs per month in 3 years 100k From 1

    to
  2. Mario Kleinsasser Team Leader / Solution Engineer @STRABAG BRVZ @m4r10k

    linkedin.com/in/mario-kleinsasser A B O U T M E medium.com/@m4r10k Source: Icons by Freepik (flaticon.com)
  3. Launch calendar

  4. T-3 years (2014) GitLab since 2014 GitLab for developers “Git”

    only OpenVZ environment Semi automatic deployments Source: https://images.nasa.gov/details-6754387
  5. C O M I C

  6. C O M I C

  7. T-1 year (2016) Start using Docker Manual builds Containers are

    nice… but… hard to tackle if you do it manually Source: https://images.nasa.gov/details-MAF_19671005_S1C_ViewtoWest
  8. T-0 Ignition (2017) TOGETHER, Dev and Ops! NO CI WITHOUT

    CD 2017-04-28 08:04:48 (GMT) Source: https://images.nasa.gov/details-6864722
  9. T+1 second First pipeline run - canceled Next runs -

    canceled Run #9 - Successfully failed! Run #14 - First success! New failure culture needed! Source: https://www.nasa.gov/images/content/618280main_LAS_apolloaborttest.jpg
  10. P I P E L I N E S

  11. T+3 months More pipelines More jobs More projects More of

    everything Source: Apollo 2, Apollo 3, Apollo 5, Apollo 6, Apollo 7 launch taken from Wikipedia NASA public domain
  12. S T A T S Jobs Pipelines

  13. T+4 months Houston we’ve a problem! Change our work culture

    Going meta Care about the Doers Source: https://images.nasa.gov/details-s70-34986
  14. T R A N S I T I O N

  15. T>4 months Recreate everything More backends More Docker Swarm (true!)

    More GitLab projects More Load Balancers Templating (GitLab includes) Source: https://www.flickr.com/photos/spacex/40126460511/
  16. T>2 years GitOps! For us the only way Hundreds of

    projects Different knowledge Different software stacks Source: https://images.nasa.gov/details-9253429
  17. Checklists Everyone knows them Plugin for the brain Easy to

    maintain Can be changed centrally Source for automation https://images.nasa.gov/details-s134e010904
  18. Know your work Kanban board Talk with each other Listen

    to and learn from other people
  19. Source: https://images.nasa.gov/details-s93-30238 Onboarding young heroes Catacomb of tools Transparency Communication

  20. Communication Lot of different ways to communicate Red communication Green

    communication Yellow communication Blue communication Maybe rethink your communication ways!
  21. N O W 2 0 2 0

  22. Now! (2020) Thank you team!

  23. Attempt To Automate Wherever It’s Appropriate! Thank You! @m4r10k