EXPLORATORY TESTING: HARDER, EASIER, BETTER, FASTER
wHAT’s
meetic?
3 PRODUCTS
8 BRANDS
15 COUNTRIES
4 PLATFORMS
15 MOVES TO PRODUCTION A DAY
NEW VERSION OF NATIVES APPS EVERY 2 WEEKS
150 PEOPLE IN IT TEAMS / 7 QA
Slide 7
Slide 7 text
EXPLORATORY TESTING: HARDER, EASIER, BETTER, FASTER
BACK IN TIME
Slide 8
Slide 8 text
EXPLORATORY TESTING: HARDER, EASIER, BETTER, FASTER
BACK IN TIME
2013
ONE MAJOR RELEASE A WEEK
ALL TESTS BY THE QA
ONE MAJOR PRODUCT
NO AUTOMATION
QA IS APART
Slide 9
Slide 9 text
EXPLORATORY TESTING: HARDER, EASIER, BETTER, FASTER
NON-REGRESSION?
FULL
NRT
X2
12 HOURS
TESTING
TEST CASES
REFERENTIALS
Slide 10
Slide 10 text
EXPLORATORY TESTING: HARDER, EASIER, BETTER, FASTER
NON-REGRESSION?
FULL
NRT
X2
12 HOURS
TESTING
TEST CASES
REFERENTIALS
TESTING SKILLS
PRODUCT
TECHNICAL
EXPLORATORY TESTING: HARDER, EASIER, BETTER, FASTER
BuT
…
WE forgot something
Slide 14
Slide 14 text
EXPLORATORY TESTING: HARDER, EASIER, BETTER, FASTER
Teams don’T perform nrt
NOT MY JOB SKILLS ARE NEEDED – TIME IS RUNNING OUT
TEST CASES
REFERENTIALS?
AUTOMATION?
COVERAGE
IS TOO LOW
ARE YOU KIDDING?
Slide 15
Slide 15 text
EXPLORATORY TESTING: HARDER, EASIER, BETTER, FASTER
QA PERFORMS
A DAILY NRT
(45 MIN) X 2
IN PROD
FULL NRT ON 1 PLATEFORM
= 8H TESTING
LOW COVERAGE
10 DEFECTS FOUND
IN THE FIRST
SEMESTER OF 2018
CRITICAL CASES
COMMON FLOWS
EDGE CASES
EXPLORATORY TESTING: HARDER, EASIER, BETTER, FASTER
EXPLORATORY TESTING
LET’S DO A QUICK CHECK
NO NEED FOR
DOCUMENTATION
CLICK AND TAP EVERY BUTTONS TEST RANDOMLY
TO BREAK THE APP
Slide 20
Slide 20 text
EXPLORATORY TESTING: HARDER, EASIER, BETTER, FASTER
LEARN
ARE RISKS COVERED?
HOW TO USPKILL?
METHOD?
HOW TO BEGIN?
HOW TO PRIORITIZE?
Slide 21
Slide 21 text
EXPLORATORY TESTING: HARDER, EASIER, BETTER, FASTER
sfdpo
SAN FRANCISCO DEPOT
Slide 22
Slide 22 text
EXPLORATORY TESTING: HARDER, EASIER, BETTER, FASTER
S
F
D
P
O
STRUCTURE
What the feature is? What are its components?
FUNCTION
What the feature does? What are its functions from
both the business and user perspective?
DATA
What the feature processes? What input does it
accept and what is the expected output? Is input
sequence sensitive?
PLATFORM
What the feature depends on? What operating systems
does it run on? third-party components?
OPERATIONS
How the feature will be used? Who will use it?
Where and how will they use it?
EXPLORATORY TESTING: HARDER, EASIER, BETTER, FASTER
6 months later
FROM THE FIRST DAY : DAILY NRT IS 1/3 SHORTER
NRT BY TEAMS
+ 100 %
MORE DEFECTS FOUND
40% OF NRT