Deliberate Testing in an Agile World Dan North @tastapod

Software delivery used to be linear

Agile brought people together

Agile brought people together

Programmers thought testing was cool!

Programmers thought TDD was cool!

Programmers thought TDD was testing!

Programmers wrote lots of tests! BDD SbE Unit tests Functional tests TDD ATDD Performance tests Load tests Soak tests Integration tests Smoke tests

BDD SbE Unit tests Functional tests TDD ATDD Performance tests Load tests Soak tests Integration tests Smoke tests Testers focused on the things programmers couldn’t automate

Testers focused on the things programmers couldn’t automate Exploratory testing TDD BDD SbE ATDD Functional tests Integration tests Unit tests Load tests Performance tests Usability testing Soak tests Smoke tests

Testing Corners, or YATQ Automated Manual Deterministic Stochastic TDD BDD SbE ATDD Functional tests Unit tests Load tests Smoke tests Performance tests Soak tests Exploratory testing Integration tests Usability testing

Automated Manual Deterministic Stochastic TDD BDD SbE ATDD Functional tests Unit tests Load tests Smoke tests Performance tests Soak tests Exploratory testing Integration tests Usability testing Testing Corners, or YATQ Wat? Wat?

Automated Manual Deterministic Stochastic TDD BDD SbE ATDD Functional tests Unit tests Load tests Smoke tests Performance tests Soak tests Integration tests Usability testing User journey testing A/B testing Fuzzing Property-based testing Data mother Resilience Documentation testing Exploratory testing Testing Corners, or YATQ Wat?

Risk Plane B A C F G D H E Im pact 80% ? Likelihood

Risk Plane B A C F D G H E Im pact 80% ? F D 80% ? 80% ? Likelihood

Risk Plane B A C F D G H E 80% ? Im pact Likelihood

Risk Planes B A C F D G H E Im pact Likelihood Context

Risk Planes B A C F D G H E Im pact Likelihood D Context Functional correctness

Risk Planes B A C F D G H E Im pact Likelihood Operational stability A Context

Risk Planes B A C F D G H E Im pact Likelihood Regulatory compliance C G Context

Risk Planes Im pact Likelihood Each context has its own risk profile Context

Risk Planes Im pact Likelihood Stakeholder Each stakeholder has their own risk appetite

Testing Corners revisited Automated Manual Deterministic Stochastic TDD BDD SbE ATDD Functional tests Unit tests Load tests Smoke tests Performance tests Soak tests Integration tests Usability testing User journey testing A/B testing Fuzzing Property-based testing Data mother Chaos Monkey Documentation testing Exploratory testing

Testing Corners revisited Automated Manual Deterministic Stochastic TDD BDD SbE ATDD Functional tests Unit tests Load tests Smoke tests Performance tests Soak tests Integration tests Usability testing User journey testing A/B testing Fuzzing Property-based testing Data mother Chaos Monkey Documentation testing Exploratory testing Compliance Failover Forensic Diagnostic Release Alerting Penetration SQL Injection DoS Accessibility Safety Fire drills XSS DNS

Deliberate testing in an agile world Identify all the stakeholders Understand their risk appetite Understand their constraints Study the application Understand its components and flows Explore each Risk Plane with its stakeholder Test according to the overall risk profile

…is nuanced and multi-dimensional Deliberate testing in an agile world

Fortunately, so are deliberate testers

Thanks for listening Dan North http:/ /dannorth.net @tastapod