From twice a year to twice a month - the story of No More Majors

Slide 1

Slide 1 text

www.co-learning.be Thierry de Pauw Continuous Delivery coach in/tdpauw/ @tdpauw From twice a year to twice a month: the story of No More Majors Tom Jans Agile coach @ SFPD in/tomjans/

Slide 2

Slide 2 text

www.co-learning.be SFPD: Service Fédérale des Pensions - Federale PensioenDienst Belgian Federal Pension Service Calculate and pay most Belgian legal pensions 2500 employees www.mypension.be

Slide 3

Slide 3 text

www.co-learning.be SFPD: Service Fédérale des Pensions - Federale PensioenDienst Belgian Federal Pension Service Calculate and pay most Belgian legal pensions 2500 employees www.mypension.be 11.000.000 customers 40.000.000.000 € per year

Slide 4

Slide 4 text

www.co-learning.be IT @ SFPD 250 people 4 sub-departments

Slide 5

Slide 5 text

www.co-learning.be IT @ SFPD 250 people 4 sub-departments Theseos 15 development teams (150 people) Central in-house application since 2005

Slide 6

Slide 6 text

www.co-learning.be 2016 + Fusion =

Slide 7

Slide 7 text

www.co-learning.be 2016 + Fusion =

Slide 8

Slide 8 text

www.co-learning.be 2016 + = Confusion

Slide 9

Slide 9 text

www.co-learning.be “Luck is what happens when preparation meets opportunity.” -- Seneca

Slide 10

Slide 10 text

www.co-learning.be 2016 Nov 2017 We don’t like major releases

Slide 11

Slide 11 text

www.co-learning.be 2016 Nov 2017 Feb 2018 Training

Slide 12

Slide 12 text

www.co-learning.be 2016 Nov 2017 Feb 2018 + Training

Slide 13

Slide 13 text

www.co-learning.be 2016 Nov 2017 Feb 2018 Jul 2018 Lessons Learned Major Release Theseos 18.06

Slide 14

Slide 14 text

www.co-learning.be 2016 Nov 2017 Feb 2018 Jul 2018 Lessons Learned Major Release Theseos 18.06

Slide 15

Slide 15 text

www.co-learning.be 2016 Nov 2017 Feb 2018 Jul 2018 Sep 2018 No More Majors

Slide 16

Slide 16 text

www.co-learning.be Sept 5th 2018: Can you help us achieve Continuous Delivery with fortnightly release cycles by end of December 2018?

Slide 17

Slide 17 text

www.co-learning.be “In preparing for battle I have always found that plans are useless, but planning is indispensable.” -- Dwight Eisenhower, 1957

Slide 18

Slide 18 text

www.co-learning.be ● Improvement Kata ● Value Stream Mapping ● Measuring Continuous Delivery ● Theory of Constraints

Slide 19

Slide 19 text

www.co-learning.be Implementing Continuous Delivery is not easy nor cheap ! It is very difficult.

Slide 20

Slide 20 text

www.co-learning.be Technological changes Version Control Test Driven Development Trunk Based Development Acceptance Test Driven Development Deployment Pipeline Contract Tests Continuous Integration Exploratory Testing Automated Configuration Smoke Tests Automated Infrastructure Test Data Management Evolutionary Architecture Monitoring & Alerting Database Migrations Incremental Releases acknowledgment: Steve Smith

Slide 21

Slide 21 text

www.co-learning.be Organisational changes Small Batch Sizes Everyone does On-Call Empowered Product Teams Continuous Change Review Cross-Functional Teams Traceability of Changes Shared Incentives Upskilling and Empowering Employees Blameless Post-Mortems Conway's Law Alignment You build it, You run it Continuous Improvement acknowledgment: Steve Smith

Slide 22

Slide 22 text

www.co-learning.be The Improvement Kata

Slide 23

Slide 23 text

www.co-learning.be The Agency's Improvement Kata

Slide 24

Slide 24 text

www.co-learning.be Major release ~ 6 months lead time

Slide 25

Slide 25 text

www.co-learning.be Patch releases - every fortnight

Slide 26

Slide 26 text

www.co-learning.be Theory of Constraints Every system has a bottleneck. Spending time optimising anything other than the bottleneck is an illusion.

Slide 27

Slide 27 text

www.co-learning.be Where is the bottleneck? activity lead time activity failure rate VCS Branches

Slide 28

Slide 28 text

www.co-learning.be First experiment: the pipeline and its metrics

Slide 29

Slide 29 text

www.co-learning.be The Agency's Improvement Kata

Slide 30

Slide 30 text

www.co-learning.be The Agency's Improvement Kata

Slide 31

Slide 31 text

www.co-learning.be The Agency's Improvement Kata Establish a pipeline ✔ Daily evaluation of failing tests Dedicated environment for automated acceptance tests Recreate database before running acceptance tests Stub 3rd party services Auto collect lead time and failure rate metrics from the pipeline

Slide 32

Slide 32 text

www.co-learning.be “... but plans are worthless when the fighting is once begun, and all depends on the inspiration of the moment.” -- a war correspondent for the British newspaper “The Daily News”, 1877

Slide 33

Slide 33 text

www.co-learning.be Fear of Complexity

Slide 34

Slide 34 text

www.co-learning.be Complex branching strategy

Slide 35

Slide 35 text

www.co-learning.be Proposed branching strategy roadmap

Slide 36

Slide 36 text

www.co-learning.be Fear of Missing Key Steps

Slide 37

Slide 37 text

www.co-learning.be Meanwhile … 18/10: LT of 8h, 21/3529 failing tests 29/10: LT of 4h, 545/5390 failing tests 05/11: pipeline did not run for 5 days - CI upgrade 23/11: first green pipeline, all tests passing Afterwards the pipeline was red for 2 weeks

Slide 38

Slide 38 text

www.co-learning.be “If anyone can refute me - show me I’m making a mistake or looking at things from the wrong perspective - I’ll gladly change. It’s the truth I’m after, and the truth never harmed anyone. ” -- Marcus Aurelius

Slide 39

Slide 39 text

www.co-learning.be 2016 Nov 2017 Feb 2018 Jul 2018 Sep 2018 Time to go public Nov 2018

Slide 40

Slide 40 text

www.co-learning.be 2016 Nov 2017 Feb 2018 Jul 2018 Sep 2018 Negotiations Nov 2018

Slide 41

Slide 41 text

www.co-learning.be 2016 Nov 2017 Feb 2018 Jul 2018 Sep 2018 The last major release ever? Nov 2018 Dec 2018

Slide 42

Slide 42 text

www.co-learning.be 2016 Nov 2017 Feb 2018 Jul 2018 Sep 2018 First new release Nov 2018 Jan 2019 Dec 2018

Slide 43

Slide 43 text

www.co-learning.be 2016 Nov 2017 Feb 2018 Jul 2018 Sep 2018 First new release Nov 2018 Jan 2019 Dec 2018

Slide 44

Slide 44 text

www.co-learning.be “They did not know it was impossible, so they did it.” -- Mark Twain

Slide 45

Slide 45 text

www.co-learning.be But, but, but … are fortnightly releases considered to be Continuous Delivery?

Slide 46

Slide 46 text

www.co-learning.be It is possible to achieve Continuous Delivery without first reaching Continuous Integration.

Slide 47

Slide 47 text

www.co-learning.be 2016 Nov 2017 Feb 2018 Jul 2018 Sep 2018 Effects on the organisation Nov 2018 Jan 2019 Sep 2019 Dec 2018

Slide 48

Slide 48 text

www.co-learning.be 2016 Nov 2017 Feb 2018 Jul 2018 Sep 2018 Effects on the organisation Nov 2018 Jan 2019 Sep 2019 Dec 2018

Slide 49

Slide 49 text

www.co-learning.be 2016 Nov 2017 Feb 2018 Jul 2018 Sep 2018 Effects on the organisation Nov 2018 Jan 2019 Sep 2019 Dec 2018 LeSS bubble

Slide 50

Slide 50 text

www.co-learning.be 2016 Nov 2017 Feb 2018 Jul 2018 Sep 2018 So many conversations about quality & testing Nov 2018 Jan 2019 Sep 2019 Dec 2018

Slide 51

Slide 51 text

www.co-learning.be 2016 Nov 2017 Feb 2018 Jul 2018 Sep 2018 Problems become very visible Nov 2018 Jan 2019 Sep 2019 Dec 2018

Slide 52

Slide 52 text

www.co-learning.be Why did it work? Open and pro-active communication

Slide 53

Slide 53 text

www.co-learning.be Why did it work? Open and pro-active communication Great people

Slide 54

Slide 54 text

www.co-learning.be Why did it work? Open and pro-active communication Great people Spend time building the core team

Slide 55

Slide 55 text

www.co-learning.be Why did it work? Open and pro-active communication Great people Spend time building the core team Short deadline

Slide 56

Slide 56 text

www.co-learning.be Why did it work? Open and pro-active communication Great people Spend time building the core team Short deadline External coach

Slide 57

Slide 57 text

www.co-learning.be “I tell you in solemn truth that no prophet is welcomed among his own people” — Jesus