Upgrade to Pro — share decks privately, control downloads, hide ads and more …

From 1 release a month to 6 per day

From 1 release a month to 6 per day

Slides from my talk at the Cape Town Scrum Users Group (SUGSA) on Nomanini's lessons from Scrum, Kanban & Continuous Delivery.

Dale Humby

April 02, 2015
Tweet

More Decks by Dale Humby

Other Decks in Technology

Transcript

  1. From 1 release a month to 6 per day
    Lessons from Scrum, Kanban & Continuous Delivery
    Dale Humby
    CTO, Nomanini

    View Slide

  2. View Slide

  3. micro-transactions in emerging markets

    View Slide

  4. View Slide

  5. View Slide

  6. View Slide

  7. View Slide

  8. Why Continuous Delivery?
    • Product discovery
    • Start-up = Limited cash runway
    • Small team
    • Fintech hotly contested market
    • Established competition, years ahead

    View Slide

  9. View Slide

  10. “Move fast and break things”

    View Slide

  11. “Move fast and break things”

    View Slide

  12. “Move fast and break things”

    View Slide

  13. “Move fast and break things”
    Week 1: 80%

    View Slide

  14. “Move fast and break things”
    Week 1: 80% Week 1: nothing

    View Slide

  15. “Move fast and break things”
    Week 1: 80%
    Week 2: 80%
    Week 1: nothing
    Week 2: 95%

    View Slide

  16. “Move fast and break things”
    Week 1: 80%
    Week 2: 80%
    Week 3: 80%
    Week 1:
    Week 2: 95%
    Week 3:

    View Slide

  17. “Move fast and break things”
    Week 1: 80%
    Week 2: 80%
    Week 3: 80%
    Week 4: 80%
    Week 1:
    Week 2: 95%
    Week 3:
    Week 4: 95%

    View Slide

  18. “Move fast and break things”
    Week 1: 80%
    Week 2: 80%
    Week 3: 80%
    Week 4: 80%
    Week 1:
    Week 2: 95%
    Week 3:
    Week 4: 95%
    99.84% 99.75%

    View Slide

  19. 2011: Scrum + XP

    View Slide

  20. 2011: Scrum board: Feb - Jul
    Story
    Story
    Story
    Planned In progress Done

    View Slide

  21. 2011: Scrum board: Aug
    Release
    Story
    Story
    Planned In progress Done
    Story

    View Slide

  22. 2011: Scrum board: Aug
    Release
    Story
    Story
    Tech debt
    Planned In progress Done
    Story

    View Slide

  23. 2011: Scrum board: Sep
    Release
    Story
    Story
    Tech debt
    Planned In progress Done
    Fix bugs

    View Slide

  24. 2011: Scrum board: Sep
    Release
    Story
    Story
    Tech debt
    Planned In progress Done
    Fix bugs ?

    View Slide

  25. 2011: Scrum board: Sep - Nov
    Release
    Story
    Support
    Tech debt
    Planned In progress Done
    Fix bugs ?
    ?

    View Slide

  26. 2011: Scrum metrics
    37
    49
    15
    0
    25
    24
    28
    29
    16
    29
    23
    13
    12
    25
    18 18
    16
    19
    0
    38
    9 9
    5
    20
    0
    5
    10
    15
    20
    25
    30
    35
    40
    45
    50
    01-Mar
    08-Mar
    15-Mar
    22-Mar
    29-Mar
    05-Apr
    12-Apr
    19-Apr
    26-Apr
    03-May
    10-May
    17-May
    24-May
    31-May
    07-Jun
    14-Jun
    21-Jun
    28-Jun
    05-Jul
    12-Jul
    19-Jul
    26-Jul
    02-Aug
    09-Aug
    16-Aug
    23-Aug
    30-Aug
    06-Sep
    13-Sep
    20-Sep
    27-Sep
    04-Oct
    11-Oct
    18-Oct
    25-Oct
    01-Nov
    08-Nov
    15-Nov
    22-Nov
    29-Nov
    06-Dec
    13-Dec
    20-Dec
    27-Dec
    03-Jan
    10-Jan
    Team points per week
    Ave
    +1σ
    -1σ

    View Slide

  27. Waterfall: Planned
    Plan
    Development
    Test
    Release

    View Slide

  28. Waterfall: Reality
    Plan
    Development
    Test
    Release

    View Slide

  29. Scrum: 1 month Sprints
    Release
    Story
    Demo
    SP2
    Retro
    Story
    Story
    Story
    Story
    Story
    SP1

    View Slide

  30. Scrum: 2 week – 1 week Sprints
    Release
    Story
    Demo
    SP2
    Retro
    Story
    Story
    SP1

    View Slide

  31. Scrum: 1 Story Sprints
    Story
    Demo
    SP1
    Release
    SP2

    View Slide

  32. Kanban
    Dev Demo
    Analysis Release
    Dev Plan

    View Slide

  33. Kanban
    Dev Demo
    Analysis α
    Dev Plan Stbl A/B
    β

    View Slide

  34. Kanban: Phase gates
    Dev Demo
    Analysis α
    Dev Plan Stbl A/B
    β

    View Slide

  35. Kanban
    Dev Demo
    Analysis α
    Dev Plan Stbl A/B
    β
    Dev Demo
    Analysis α
    Dev Plan Stbl A/B
    β

    View Slide

  36. Work in progress (WIP) limits

    View Slide

  37. Classes of Work
    Dev Demo
    Analysis α
    Dev Plan Stbl A/B
    β
    Fast-track
    Fixed delivery date
    Standard
    Background

    View Slide

  38. Classes of Work: SLA’s
    Dev Demo
    Analysis α
    Dev Plan Stbl A/B
    β
    Fast-track
    Fixed delivery date
    Standard
    Background
    2 days
    by date
    5 days
    5 days

    View Slide

  39. View Slide

  40. Story card

    View Slide

  41. Metrics: Cumulative lead time
    5 day SLA

    View Slide

  42. Feedback loops
    Build tools
    Reduces
    bottleneck
    Release
    sooner
    Builds
    excitement
    Increases
    motivation

    View Slide

  43. Feedback loops
    Dev Demo
    Analysis α
    Dev Plan Stbl A/B
    β

    View Slide

  44. Reducing lead time
    4
    16 16
    21 21
    25
    0
    5 5
    7
    8
    14
    0
    1
    2
    2 2
    3
    0
    5
    10
    15
    20
    25
    30
    35
    Days to
    Start
    Days to
    Dev Done
    Days to
    Demo
    Days to
    UAT start
    Days to
    Beta
    Days to
    Stable
    Work Days
    Cumulative Leadtime
    (Jan 2012 - Apr 2012)
    Max (100%)
    SLA (80%)
    Median (50%)
    17-Apr-12
    5 day SLA

    View Slide

  45. Estimation

    View Slide

  46. Estimation
    11%
    21%
    41%
    60%
    63%
    70%
    70%
    79%
    83%
    87%
    95% 95% 95% 95%
    97% 97% 97% 97%
    98% 98% 98%
    100%
    0%
    10%
    20%
    30%
    40%
    50%
    60%
    70%
    80%
    90%
    100%
    0
    5
    10
    15
    20
    25
    30
    35
    40
    45
    50
    55
    60
    65
    70
    75
    80
    85
    90
    95
    100
    0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 >=20
    Cumulative distribution
    Occurences
    Number of days from Planning to Beta
    Leadtime Distribution (Standard stories)
    1 Sep '14 - 28 Feb '15
    Released in SLA
    Released outside
    SLA

    View Slide

  47. Release planning
    Roadmap planning
    Standard stories per month, previous 6 months
    2014-09-01 From
    2015-02-28 To
    Max per month 16
    25th % 13
    50th % 11
    80th % 7
    Min per month 6
    Standard stories per 2 months, previous 7 months
    Max per month 26
    25th % 25
    50th % 22
    80th % 15
    Min per month 14

    View Slide

  48. Building tools
    2011
    • Scrum, 0 – 50 devices
    • Automated tests run on desktop
    • Devices in office to upgrade
    2012
    • Kanban, 50 – 150 devices
    • CI, Jenkins
    • Bootloader, Manual DOTA
    • Automated provisioning (by hand, 45 min)
    • Runtime hardware/firmware config
    • Feature flags on master
    2013
    • 150 - 200 devices, 3 international clients
    • Parallel tests
    • Promote, dependency analysis
    • Semi-automated DOTA
    2014
    • 200-1000 devices, 7 international clients
    • Alpha, beta, stable groups
    • Automated rollout, remote provisioning
    • Valgrind, cpputest, x86
    • Factory testing
    • Monitoring
    2015
    • 1k - 10k devices
    • ROI monitoring
    • Professional services
    • 3rd party integrations, API’s,
    • ROI/Validation metrics

    View Slide

  49. Automated tests on hardware

    View Slide

  50. Feature flags

    View Slide

  51. Promote

    View Slide

  52. Is it working in prod? Monitoring

    View Slide

  53. 2015 and beyond…

    View Slide

  54. View Slide

  55. Thank You
    [email protected]
    google.com/+DaleHumby
    @dalehumby

    View Slide

  56. Reducing tech debt: 1story=2tasks
    Dev Demo
    Analysis α
    Dev Plan Stbl A/B
    β
    Fast-track
    Fixed delivery date
    Standard
    Background
    2 days
    by date
    5 days
    5 days
    Story
    T
    T

    View Slide

  57. Scrum board c2011 (1 week sprint)

    View Slide