Slide 1
Slide 1 text
Zero to Eight
Building a QA Team from
Scratch
Slide 3
Slide 3 text
At The
Start
Slide 4
Slide 4 text
5 Year old
Company
“Legacy
Startup”
Slide 5
Slide 5 text
Major
Enterprise
Customers
100K+ users
Slide 6
Slide 6 text
Zero
Automated
Tests
Slide 7
Slide 7 text
Zero
Testers
Slide 8
Slide 8 text
Zero
Slide 9
Slide 9 text
Awful
Codebase
metrics
(Cyclomatic Complexity ==
“OMG!”
Slide 10
Slide 10 text
33% Rework
(and 33% rework on the
rework…)
Slide 11
Slide 11 text
Quality
State?
Slide 12
Slide 12 text
Image: http://en.wikipedia.org/wiki/File:Train_wreck_at_Montparnasse_1895.„g
Slide 13
Slide 13 text
Awful
Rollout/
Release
Process
Slide 14
Slide 14 text
10-15
Release
Candidates
Slide 15
Slide 15 text
Company-wide
“bug bashes”
Slide 16
Slide 16 text
ZERO
TESTERS
Slide 17
Slide 17 text
Impacts:
Slide 18
Slide 18 text
Bad:
Support
hated the
Product Team
Slide 19
Slide 19 text
Worst:
Bad
reputation
with
customers
Slide 20
Slide 20 text
No content
Slide 21
Slide 21 text
Stuff Has To
Change
Slide 22
Slide 22 text
Shoot
For The
Moon
Slide 23
Slide 23 text
0) Support
Team That
Actually
LIKES us
Slide 24
Slide 24 text
1) Frequent
Releases
Slide 25
Slide 25 text
2) Culture
That Cares
Slide 26
Slide 26 text
3) Raving
Fans
Slide 27
Slide 27 text
Shoot
For The
Moon
Slide 28
Slide 28 text
Expect to get
to Dayton
Slide 29
Slide 29 text
START
SMALL
Slide 30
Slide 30 text
MAKE THE
CASE FOR
AUTOMATION
SPIKES, FTW!
Slide 31
Slide 31 text
TELL.
DON’T ASK.
Slide 32
Slide 32 text
SHOW VALUE!
Slide 33
Slide 33 text
FOCUS ON
RISK FIRST
Slide 34
Slide 34 text
TEAM
GROWS!
Slide 35
Slide 35 text
Steady
Growth
Slide 36
Slide 36 text
Hire smart,
curious
folks
Slide 37
Slide 37 text
Work hard at
Onboarding
Slide 38
Slide 38 text
Mentor All
The Things
(Pairing, FTW!)
Slide 39
Slide 39 text
STUDY TIME
Slide 40
Slide 40 text
ON.
THE.
CLOCK.
Slide 41
Slide 41 text
SAFE
ENVIRONMENT
Slide 42
Slide 42 text
AFFECT
CHANGE
Slide 43
Slide 43 text
PUSH LEFT
Slide 44
Slide 44 text
EMBED
TESTERS
(THERE IS NO SILO)
Slide 45
Slide 45 text
HARDWARE
MATTERS
Slide 46
Slide 46 text
TIE BACK TO
COSTS AND
RISK & VALUE
Slide 47
Slide 47 text
VM HOSTS
Slide 48
Slide 48 text
LOAD
HARDWARE
Slide 49
Slide 49 text
(PLAY NICE
AND SHARE,
OKAY?)
Slide 50
Slide 50 text
Getting
the work
done
Slide 51
Slide 51 text
AUTOMATION
IS
SOFTWARE
ENGINEERING
Slide 52
Slide 52 text
FEW
TESTERS
ARE
DEVELOPERS
Slide 53
Slide 53 text
Devs can
help with
things like
Slide 54
Slide 54 text
DRY
SRP
Abstraction
Complexity
Slide 55
Slide 55 text
LET’S USE LOTS
OF IF
STATEMENTS
AND 3,000 LINE
CLASSES AND...
Slide 56
Slide 56 text
Automation
is not
everything
Slide 57
Slide 57 text
Grow your ET
or Context or
Rapid or
Whatever
testing skills
Slide 58
Slide 58 text
Constant
Feedback
Slide 59
Slide 59 text
Retrospectives
Slide 60
Slide 60 text
Three
“R”s
Slide 61
Slide 61 text
Reduce
Refactor
Rearchitect
Slide 62
Slide 62 text
Celebrate
Wins,
Publicize
Failures
Slide 63
Slide 63 text
Whole Team
Automation
Slide 64
Slide 64 text
Stakeholders
PMs
UX/UI
Developers
Slide 65
Slide 65 text
At The
End
Slide 66
Slide 66 text
Didn’t Get To
Dayton, Even
Slide 67
Slide 67 text
Rework Rate
FTL
Slide 68
Slide 68 text
Codebase
Metrics
FTL
Slide 69
Slide 69 text
Culture
Change?
Slide 70
Slide 70 text
Image: http://i594.photobucket.com/albums/tt29/yowhound/Cats/kick-dog.„g
Slide 71
Slide 71 text
Got to the
moon!
Slide 72
Slide 72 text
“Done Done”
included
automation
(where appropriate)
Slide 73
Slide 73 text
Quality
Conversations
pushed all
the way left
Slide 74
Slide 74 text
Automation?
Slide 75
Slide 75 text
Several
Hundred
Unit Tests
Slide 76
Slide 76 text
3,000+
Integration
Tests
Slide 77
Slide 77 text
15,000+
WebDriver
tests
Slide 78
Slide 78 text
Non-
Automated
Testing?
Slide 79
Slide 79 text
3,000 Manual
Test cases ->
“Charters”
Slide 80
Slide 80 text
Testing Team
emphasizing
Exploratory(ish)
Slide 81
Slide 81 text
Release Plan
in Place
(And Followed, Even!)
Slide 82
Slide 82 text
Good:
Rollouts
Smooth
(ish)
Slide 83
Slide 83 text
Better:
Support
Liked Us
Slide 84
Slide 84 text
Best:
Raving Fans
Slide 85
Slide 85 text
The
Takeaways
Slide 86
Slide 86 text
Start Small
Slide 87
Slide 87 text
Tell.
Don’t Ask.
Slide 88
Slide 88 text
Shoot For
The Moon
Slide 89
Slide 89 text
(Screw
Dayton)
Slide 90
Slide 90 text
Be Awesome
Slide 91
Slide 91 text
Thank You!
(for staying awake)