Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Coaching Teams to Modern Test Management

Coaching Teams to Modern Test Management

One year of building a product, from quarterly to monthly releases. From 27 days to 19 minutes release lead time. 13 reusable test charters, 1851 programmatic tests executed in pipelines frequent enough to produce 50 000 test results a day. No bug reports written and zero bugs policy for releasing. This describes my current team in a nutshell.

Modern test management relies on frequent, moving up to continuous releases. Working from a known good baseline taking small steps following the change allows for a new way of managing testing. And while numbers of programmatic tests are impressive, the bugs they miss that exploratory testing - also using automation - finds are more impressive. We say that the large numbers of programmatic tests do 10% of the testing the team does. 90% of the work is keeping test systems up to par with the latest scope of system we deliver and attending to results gap programmatic tests inherently include.

In this talk, we learn to manage testing maintaining agency - the capacity of individuals to act independently and make their own free choices. This is not a story about managing testing based on sessions. This is a story of working with product owners to identify gaps and assign responsibilities, working with teams to make the right skills available for different kinds of testing tasks across roles, identifying testing roadblocks with data deep dives and creating space where test design and test execution always come together while navigating corporate documentation requirements. Practices to this are frequent deliveries, following change, whole-team test automation, bug reports as conversations, pair and ensemble testing, and feature checklists. We need to ensure we pay attention to both testing of today and testing of the future.

Maaret Pyhäjärvi

May 03, 2023
Tweet

More Decks by Maaret Pyhäjärvi

Other Decks in Programming

Transcript

  1. @maaretp
    @[email protected]
    by Maaret Pyhäjärvi
    Coaching Teams to
    Modern Test Management

    View Slide

  2. @maaretp
    @[email protected]
    A Tale of a Team (and its neighbor)
    27 days to 19 minutes release lead time
    13 reusable test charters
    1851 programmatic tests with 50 000 results a day
    no written bug reports
    zero bugs policy – fix (test) and forget
    10% of testing is automated
    Contemporary ExploratoryTesting
    Testing is too important
    to be left just for testers.
    And too important to be
    left without testers.
    Developers CAN
    test and want to
    test.

    View Slide

  3. @maaretp
    @[email protected]
    The Better Teams
    SPEC
    FEEDBACK
    REGRESSION
    GRANULARITY
    GUIDANCE
    UNDERSTANDING
    MODELS
    SERENDIPITY
    Testing as artifact
    creation
    EXAMPLES
    EXPERIMENTS
    Testing as performance

    View Slide

  4. @maaretp
    @[email protected]
    The Better Teams
    Unit
    Tests
    Service
    Tests UI
    Tests

    View Slide

  5. @maaretp
    @[email protected]
    The Better Teams
    Unit
    Tests
    Service
    Tests UI
    Tests
    Mocks, Stubs, Spys and Fakes
    Real Integrations

    View Slide

  6. @maaretp
    @[email protected]
    The Better Teams
    Unit
    Tests
    Service
    Tests UI
    Tests
    Mocks, Stubs, Spys and Fakes
    Real Integrations
    Perfor-
    mance
    Usability
    Functio-
    nality
    Security

    View Slide

  7. @maaretp
    @[email protected]
    The Better Teams
    Unit
    Tests
    Service
    Tests UI
    Tests
    Mocks, Stubs, Spys and Fakes
    SPEC
    FEEDBACK
    REGRESSION
    GRANULARITY
    GUIDANCE
    UNDERSTANDING
    MODELS
    SERENDIPITY
    Real Integrations
    Perfor-
    mance
    Usability
    Functio-
    nality
    Security
    Testing as artifact
    creation
    EXAMPLES
    EXPERIMENTS
    Testing as performance
    impact
    intent

    View Slide

  8. @maaretp
    @[email protected]
    Modern Test Management
    relies on Frequent to
    Continuous Releases
    Known Good Baseline

    View Slide

  9. @maaretp
    @[email protected]
    10 % - Keep Programmatic Tests
    Green
    90 % - Explore for results
    (information / bugs) and learning
    (new programmatic tests)
    Failing test is
    an invitation to
    explore!

    View Slide

  10. @maaretp
    @[email protected]
    Agency
    the capacity of individuals to act
    independently and make their own
    free choices

    View Slide

  11. @maaretp
    @[email protected]
    Pro
    Product Owners are
    the new test managers!

    View Slide

  12. @maaretp
    @[email protected]
    working with product owners to identify gaps and assign
    responsibilities
    working with teams to make the right skills available for
    different kinds of testing tasks across roles
    identifying testing roadblocks with data deep dives
    creating space where test design and test execution always
    come together
    …while navigating corporate documentation requirements
    Coaching?

    View Slide

  13. @maaretp
    @[email protected]
    Practices
    Frequent deliveries
    Following change
    Whole-team test automation
    Bug reports as conversations
    Pair and ensemble testing (and programming)
    Feature checklists

    View Slide

  14. @maaretp
    @[email protected]
    Short-term
    Long-term
    AVAILABILITY TIMELINE
    Productive Generative
    RESULTS
    Break illusions in a
    timely fashion
    Capture notes in
    test automation
    Test automation
    people can use
    when we’re gone
    Improve skills
    of everyone
    Improve your skills
    Learn to pair &
    ensemble

    View Slide

  15. @maaretp
    @[email protected]
    2020 2016
    MIATPP
    Most Influential Agile Testing
    Professional Person
    #PayToSpeak #TechVoices
    #EnsembleTesting #EnsembleProgramming #StrongStylePairing
    #ExploratoryTesting #TestAutomation
    #ModernAgile
    #AwesomeTesters
    Maaret Pyhäjärvi
    (from Finland)
    Email: [email protected]
    Twitter: @maaretp
    Web: maaretp.com
    Blog: visible-quality.blogspot.fi
    (please connect with me through
    Twitter or LinkedIn)
    2019 - 2022
    https://exploratorytestingacademy.com
    Ohjelmistotestaus ry
    https://techvoices.org

    View Slide