How Much Testing Is
Enough Testing
Samantha Wong
GovTech
STACK 2020 - Dec 2020
Slide 2
Slide 2 text
You’ve Heard Of These Before
➔ Functional Testing
➔ Load Testing
➔ Integration Testing
➔ User Testing
➔ Smoke Testing
➔ Sanity Testing
➔ Blind Testing
➔ Whitebox Testing
➔ Blackbox Testing
➔ Unit Testing
➔ End to End Testing
Slide 3
Slide 3 text
Just because there is a name for it,
doesn’t mean it exists
Slide 4
Slide 4 text
No content
Slide 5
Slide 5 text
So, how?
Slide 6
Slide 6 text
You should choose
which testings to focus
on based on your
acceptable risks High-traffic user flows
like a promotional flow
on an e-commerce
website
Slide 7
Slide 7 text
You should choose
which testings to focus
on based on the
nature of your
application
End-to-end testings
with your third party
agencies
Slide 8
Slide 8 text
No content
Slide 9
Slide 9 text
No content
Slide 10
Slide 10 text
No content
Slide 11
Slide 11 text
People Who Define The Application and Its
Acceptable Risks
Slide 12
Slide 12 text
How to guarantee the quality of tests
Designing (good) tests are hard!
Slide 13
Slide 13 text
Tests check that
expectations are met
Slide 14
Slide 14 text
Tests alert when
expectations are not
met
Slide 15
Slide 15 text
Know What You Are Testing
Slide 16
Slide 16 text
More Doesn’t Mean Better
Slide 17
Slide 17 text
Because...Sometimes They Are The Same
Slide 18
Slide 18 text
Write Tests Before Development
Slide 19
Slide 19 text
The Spheres of Knowing
Stuff I know
I know
Stuff I didn’t
know I know
Stuff I know
I don’t know
Stuff I didn’t
know I didn’t
know
Slide 20
Slide 20 text
Verify Your Tests Do Something
Slide 21
Slide 21 text
[Example on Unit Testing]
https://jeroenmols.com/blog/2017/11/28/coveragproblem/
Slide 22
Slide 22 text
[Example Function Tested]
https://jeroenmols.com/blog/2017/11/28/coveragproblem/
Slide 23
Slide 23 text
[Modified Test]
Slide 24
Slide 24 text
Good tests should break when things fail
Slide 25
Slide 25 text
Don’t trust code coverage tools
One more thing..
They are a source of information,
not a source of quality.