From 1 release a month to 6 per day

Slides from my talk at the Cape Town Scrum Users Group (SUGSA) on Nomanini's lessons from Scrum, Kanban & Continuous Delivery.

Transcript

1. From 1 release a month to 6 per day
   Lessons from Scrum, Kanban & Continuous Delivery
   Dale Humby
   CTO, Nomanini
   

   View Slide

2. View Slide

3. micro-transactions in emerging markets
   

   View Slide

4. View Slide

5. View Slide

6. View Slide

7. View Slide

8. Why Continuous Delivery?
   • Product discovery
   • Start-up = Limited cash runway
   • Small team
   • Fintech hotly contested market
   • Established competition, years ahead
   

   View Slide

9. View Slide

10. “Move fast and break things”
    

    View Slide

11. “Move fast and break things”
    

    View Slide

12. “Move fast and break things”
    

    View Slide

13. “Move fast and break things”
    Week 1: 80%
    

    View Slide

14. “Move fast and break things”
    Week 1: 80% Week 1: nothing
    

    View Slide

15. “Move fast and break things”
    Week 1: 80%
    Week 2: 80%
    Week 1: nothing
    Week 2: 95%
    

    View Slide

16. “Move fast and break things”
    Week 1: 80%
    Week 2: 80%
    Week 3: 80%
    Week 1:
    Week 2: 95%
    Week 3:
    

    View Slide

17. “Move fast and break things”
    Week 1: 80%
    Week 2: 80%
    Week 3: 80%
    Week 4: 80%
    Week 1:
    Week 2: 95%
    Week 3:
    Week 4: 95%
    

    View Slide

18. “Move fast and break things”
    Week 1: 80%
    Week 2: 80%
    Week 3: 80%
    Week 4: 80%
    Week 1:
    Week 2: 95%
    Week 3:
    Week 4: 95%
    99.84% 99.75%
    

    View Slide

19. 2011: Scrum + XP
    

    View Slide

20. 2011: Scrum board: Feb - Jul
    Story
    Story
    Story
    Planned In progress Done
    

    View Slide

21. 2011: Scrum board: Aug
    Release
    Story
    Story
    Planned In progress Done
    Story
    

    View Slide

22. 2011: Scrum board: Aug
    Release
    Story
    Story
    Tech debt
    Planned In progress Done
    Story
    

    View Slide

23. 2011: Scrum board: Sep
    Release
    Story
    Story
    Tech debt
    Planned In progress Done
    Fix bugs
    

    View Slide

24. 2011: Scrum board: Sep
    Release
    Story
    Story
    Tech debt
    Planned In progress Done
    Fix bugs ?
    

    View Slide

25. 2011: Scrum board: Sep - Nov
    Release
    Story
    Support
    Tech debt
    Planned In progress Done
    Fix bugs ?
    ?
    

    View Slide

26. 2011: Scrum metrics
    37
    49
    15
    0
    25
    24
    28
    29
    16
    29
    23
    13
    12
    25
    18 18
    16
    19
    0
    38
    9 9
    5
    20
    0
    5
    10
    15
    20
    25
    30
    35
    40
    45
    50
    01-Mar
    08-Mar
    15-Mar
    22-Mar
    29-Mar
    05-Apr
    12-Apr
    19-Apr
    26-Apr
    03-May
    10-May
    17-May
    24-May
    31-May
    07-Jun
    14-Jun
    21-Jun
    28-Jun
    05-Jul
    12-Jul
    19-Jul
    26-Jul
    02-Aug
    09-Aug
    16-Aug
    23-Aug
    30-Aug
    06-Sep
    13-Sep
    20-Sep
    27-Sep
    04-Oct
    11-Oct
    18-Oct
    25-Oct
    01-Nov
    08-Nov
    15-Nov
    22-Nov
    29-Nov
    06-Dec
    13-Dec
    20-Dec
    27-Dec
    03-Jan
    10-Jan
    Team points per week
    Ave
    +1σ
    -1σ
    

    View Slide

27. Waterfall: Planned
    Plan
    Development
    Test
    Release
    

    View Slide

28. Waterfall: Reality
    Plan
    Development
    Test
    Release
    

    View Slide

29. Scrum: 1 month Sprints
    Release
    Story
    Demo
    SP2
    Retro
    Story
    Story
    Story
    Story
    Story
    SP1
    

    View Slide

30. Scrum: 2 week – 1 week Sprints
    Release
    Story
    Demo
    SP2
    Retro
    Story
    Story
    SP1
    

    View Slide

31. Scrum: 1 Story Sprints
    Story
    Demo
    SP1
    Release
    SP2
    

    View Slide

32. Kanban
    Dev Demo
    Analysis Release
    Dev Plan
    

    View Slide

33. Kanban
    Dev Demo
    Analysis α
    Dev Plan Stbl A/B
    β
    

    View Slide

34. Kanban: Phase gates
    Dev Demo
    Analysis α
    Dev Plan Stbl A/B
    β
    

    View Slide

35. Kanban
    Dev Demo
    Analysis α
    Dev Plan Stbl A/B
    β
    Dev Demo
    Analysis α
    Dev Plan Stbl A/B
    β
    

    View Slide

36. Work in progress (WIP) limits
    

    View Slide

37. Classes of Work
    Dev Demo
    Analysis α
    Dev Plan Stbl A/B
    β
    Fast-track
    Fixed delivery date
    Standard
    Background
    

    View Slide

38. Classes of Work: SLA’s
    Dev Demo
    Analysis α
    Dev Plan Stbl A/B
    β
    Fast-track
    Fixed delivery date
    Standard
    Background
    2 days
    by date
    5 days
    5 days
    

    View Slide

39. View Slide

40. Story card
    

    View Slide

41. Metrics: Cumulative lead time
    5 day SLA
    

    View Slide

42. Feedback loops
    Build tools
    Reduces
    bottleneck
    Release
    sooner
    Builds
    excitement
    Increases
    motivation
    

    View Slide

43. Feedback loops
    Dev Demo
    Analysis α
    Dev Plan Stbl A/B
    β
    

    View Slide

44. Reducing lead time
    4
    16 16
    21 21
    25
    0
    5 5
    7
    8
    14
    0
    1
    2
    2 2
    3
    0
    5
    10
    15
    20
    25
    30
    35
    Days to
    Start
    Days to
    Dev Done
    Days to
    Demo
    Days to
    UAT start
    Days to
    Beta
    Days to
    Stable
    Work Days
    Cumulative Leadtime
    (Jan 2012 - Apr 2012)
    Max (100%)
    SLA (80%)
    Median (50%)
    17-Apr-12
    5 day SLA
    

    View Slide

45. Estimation
    

    View Slide

46. Estimation
    11%
    21%
    41%
    60%
    63%
    70%
    70%
    79%
    83%
    87%
    95% 95% 95% 95%
    97% 97% 97% 97%
    98% 98% 98%
    100%
    0%
    10%
    20%
    30%
    40%
    50%
    60%
    70%
    80%
    90%
    100%
    0
    5
    10
    15
    20
    25
    30
    35
    40
    45
    50
    55
    60
    65
    70
    75
    80
    85
    90
    95
    100
    0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 >=20
    Cumulative distribution
    Occurences
    Number of days from Planning to Beta
    Leadtime Distribution (Standard stories)
    1 Sep '14 - 28 Feb '15
    Released in SLA
    Released outside
    SLA
    

    View Slide

47. Release planning
    Roadmap planning
    Standard stories per month, previous 6 months
    2014-09-01 From
    2015-02-28 To
    Max per month 16
    25th % 13
    50th % 11
    80th % 7
    Min per month 6
    Standard stories per 2 months, previous 7 months
    Max per month 26
    25th % 25
    50th % 22
    80th % 15
    Min per month 14
    

    View Slide

48. Building tools
    2011
    • Scrum, 0 – 50 devices
    • Automated tests run on desktop
    • Devices in office to upgrade
    2012
    • Kanban, 50 – 150 devices
    • CI, Jenkins
    • Bootloader, Manual DOTA
    • Automated provisioning (by hand, 45 min)
    • Runtime hardware/firmware config
    • Feature flags on master
    2013
    • 150 - 200 devices, 3 international clients
    • Parallel tests
    • Promote, dependency analysis
    • Semi-automated DOTA
    2014
    • 200-1000 devices, 7 international clients
    • Alpha, beta, stable groups
    • Automated rollout, remote provisioning
    • Valgrind, cpputest, x86
    • Factory testing
    • Monitoring
    2015
    • 1k - 10k devices
    • ROI monitoring
    • Professional services
    • 3rd party integrations, API’s,
    • ROI/Validation metrics
    

    View Slide

49. Automated tests on hardware
    

    View Slide

50. Feature flags
    

    View Slide

51. Promote
    

    View Slide

52. Is it working in prod? Monitoring
    

    View Slide

53. 2015 and beyond…
    

    View Slide

54. View Slide

55. Thank You
    dale@nomanini.com
    google.com/+DaleHumby
    @dalehumby
    

    View Slide

56. Reducing tech debt: 1story=2tasks
    Dev Demo
    Analysis α
    Dev Plan Stbl A/B
    β
    Fast-track
    Fixed delivery date
    Standard
    Background
    2 days
    by date
    5 days
    5 days
    Story
    T
    T
    

    View Slide

57. Scrum board c2011 (1 week sprint)
    

    View Slide