Upgrade to Pro — share decks privately, control downloads, hide ads and more …

From 1 to 100k CI/CD Pipeline Jobs in 3 years

From 1 to 100k CI/CD Pipeline Jobs in 3 years

Starting in April 2017 with exactly 1 CI job running inside the on-premise Gitlab-CE installation we raised to more than 50000 pipeline jobs per month at the end of 2019. Why and how did we come to this point? This talk will give you an insight into people and technology and how they both managed it to change the way they work together today and how they are able to deliver services with quality now. Furthermore, I will show you how easy it was to onboard a new young colleague to the team because we already used the GitOps approach. Jump onto a ride through two impressive years and let yourself be inspired about how we did it.

Mario Kleinsasser

December 07, 2020
Tweet

More Decks by Mario Kleinsasser

Other Decks in Technology

Transcript

  1. Mario Kleinsasser Team Leader / Solution Engineer @STRABAG BRVZ @m4r10k

    linkedin.com/in/mario-kleinsasser A B O U T M E medium.com/@m4r10k Source: Icons by Freepik (flaticon.com)
  2. T-3 years (2014) GitLab since 2014 GitLab for developers “Git”

    only OpenVZ environment Semi automatic deployments Source: https://images.nasa.gov/details-6754387
  3. T-1 year (2016) Start using Docker Manual builds Containers are

    nice… but… hard to tackle if you do it manually Source: https://images.nasa.gov/details-MAF_19671005_S1C_ViewtoWest
  4. T-0 Ignition (2017) TOGETHER, Dev and Ops! NO CI WITHOUT

    CD 2017-04-28 08:04:48 (GMT) Source: https://images.nasa.gov/details-6864722
  5. T+1 second First pipeline run - canceled Next runs -

    canceled Run #9 - Successfully failed! Run #14 - First success! New failure culture needed! Source: https://www.nasa.gov/images/content/618280main_LAS_apolloaborttest.jpg
  6. T+3 months More pipelines More jobs More projects More of

    everything Source: Apollo 2, Apollo 3, Apollo 5, Apollo 6, Apollo 7 launch taken from Wikipedia NASA public domain
  7. T+4 months Houston we’ve a problem! Change our work culture

    Going meta Care about the Doers Source: https://images.nasa.gov/details-s70-34986
  8. T>4 months Recreate everything More backends More Docker Swarm (true!)

    More GitLab projects More Load Balancers Templating (GitLab includes) Source: https://www.flickr.com/photos/spacex/40126460511/
  9. T>2 years GitOps! For us the only way Hundreds of

    projects Different knowledge Different software stacks Source: https://images.nasa.gov/details-9253429
  10. Checklists Everyone knows them Plugin for the brain Easy to

    maintain Can be changed centrally Source for automation https://images.nasa.gov/details-s134e010904
  11. Communication Lot of different ways to communicate Red communication Green

    communication Yellow communication Blue communication Maybe rethink your communication ways!