Upgrade to Pro — share decks privately, control downloads, hide ads and more …

7N Network: Renegotiating Testing

7N Network: Renegotiating Testing

Testing is about breaking illusions for our software systems. It’s work where results - information at our disposal - matters, with no easy way of listing the results. There is no ‘answer key to all the bugs’, the practice of us testing turns the invisible ink visible line by line.

The world of testing is changing. We can factually state that levels of automation and programmatic tests have increased. A raise of hands in a developer conference asking which of them tests has all hands up. Testing is too important to be left just for testers. And testing is too important to be left without testers. Agile mindset and practices have effectively removed test managers, and redistributed that work to product owners and teams.

Let’s look at what the recipe for resultful testing includes - how different roles contribute, how we assess testing as a whole, and we all have our part to play in creating an environment where resultful testing is not only possible, but likely, both in software delivery and acceptance organizations.

Maaret Pyhäjärvi

March 16, 2023
Tweet

More Decks by Maaret Pyhäjärvi

Other Decks in Technology

Transcript

  1. @maaretp
    @[email protected]
    by Maaret Pyhäjärvi
    Renegotiating
    Testing

    View Slide

  2. @maaretp
    @[email protected]
    Testing serves a
    purpose: catch
    information we
    may be missing.

    View Slide

  3. @maaretp
    @[email protected]
    1250 programmatic tests
    run on average 20 times a day
    producing 25 000 test results
    … being 10% of testing done

    View Slide

  4. View Slide

  5. @maaretp
    @[email protected]
    Test Team
    Test Mgr
    Manual
    Tester
    Automation
    Tester Specialist
    Tester
    Security / Performance
    Dev
    Team
    We used to have this…
    Queuing theory
    Failure demand
    Conways Law

    View Slide

  6. @maaretp
    @[email protected]
    Team
    Team
    And we started having this…
    Power dynamics
    Renegotiation of work and
    expectations
    Renegotiation of identity
    Team
    member
    Product
    Owner
    Agile Coach
    Custo
    mer

    View Slide

  7. @maaretp
    @[email protected]
    Stakeholders happy,
    even delighted
    –Quality Information
    Good Team’s Output
    –Quality Information
    Less than Good
    Team’s Output
    –Quality Information
    Results Gap
    Surprise!
    Results Gap
    on a Team that thinks
    Testers == Testing
    Pick up the pizza boxes…
    ”Find (some of) What Others May Have Missed”

    View Slide

  8. @maaretp
    @[email protected]
    ANTIPATTERN in Framing Testing
    Exploratory Testing – the Noun
    Feature /
    Change
    Early Ideas of
    Testing
    Final Ideas of
    Testing
    Documented
    Tests
    Automated
    Tests
    Throwaway
    automated
    tests
    20 22 0 22 22
    100%
    ‘Agile’
    Exploratory 20 2000 1000 20 = 18+2
    1%
    10 %
    2
    50%
    80%
    RESULTS
    PLAN
    STEER

    View Slide

  9. @maaretp
    @[email protected]
    Creativity requires time
    https://www.youtube.com/watch?v=WDngw5R32WE&list=FLrTlIKuIS-LmRk-aAbcxTKg

    View Slide

  10. @maaretp
    @[email protected]
    People Think Differently
    Source: Adapted from Bret Pettichord. 2000. Testers and Developers Think Differently
    Type A Type B
    Need of Mastery
    Focus of Modeling
    Focus of Thinking
    Tedium and
    Conflict
    Get up to speed quickly
    Generalist
    Domain knowledge
    Ignorance is important
    Thorough understanding
    Specialist
    Knowledge of product internals
    Expertise is important
    Model user behavior
    Focus on what can go wrong
    Focus on severity of problem
    Model system design
    Focus on how it can work
    Focus on interest of problem
    Practical
    Empirical: What is observed
    Sceptics
    Theoretical
    How it is designed
    Believers
    Tolerate tedium
    Comfortable with conflict
    Report problems
    Automate tedium
    Avoid conflict
    Understand problems

    View Slide

  11. @maaretp
    @[email protected]
    Results worth Investment
    Usability
    Validation Verification
    Functionality
    Performance
    Security
    Reliability
    Risk (of these types of problems of relevance)
    Documentation
    Observations from #TestingDozen mentoring program
    for Contemporary Exploratory Testing

    View Slide

  12. @maaretp
    @[email protected]
    Availability timeline
    Results
    Productive Generative
    Short term
    Long term
    Find and get fixed
    Executable docs
    Holding space
    Leaving co-owned
    automation behind
    Leaving better
    behind
    Improving *your*
    skills

    View Slide

  13. @maaretp
    @[email protected]
    Discovery
    Delivery
    Production

    View Slide

  14. @maaretp
    @[email protected]
    Testing Challenges, a paired modeling session result
    by Maaret Pyhäjärvi & Irja Straus, 9.12.2022

    View Slide

  15. @maaretp
    @[email protected]
    Everyone
    can test

    View Slide

  16. @maaretp
    @[email protected]
    Visualized with gource.io

    View Slide

  17. @maaretp
    @[email protected]
    Even a broken clock is right twice a day.

    View Slide

  18. @maaretp
    @[email protected]
    (Exploratory)
    Tester
    (Application)
    Programmer
    Test Automator
    / Programmer
    Testing is too important to be left for testers!
    …but also without testers.

    View Slide

  19. @maaretp
    @[email protected]
    Testing =
    empirically inclined
    glue work
    Results in product;
    ways of working;
    capabilities

    View Slide

  20. @maaretp
    @[email protected]
    2020 2016
    MIATPP
    Most Influential Agile Testing
    Professional Person
    #PayToSpeak #TechVoices
    #EnsembleTesting #EnsembleProgramming #StrongStylePairing
    #ExploratoryTesting #TestAutomation
    #ModernAgile
    #AwesomeTesters
    Maaret Pyhäjärvi
    (from Finland)
    Email: [email protected]
    Twitter: @maaretp
    Web: maaretp.com
    Blog: visible-quality.blogspot.fi
    (please connect with me through
    Twitter or LinkedIn)
    2019 - 2022
    https://exploratorytestingacademy.com
    Ohjelmistotestaus ry
    https://techvoices.org

    View Slide