Does coverage follow test suite size?
GTAC’15 Inozemtseva Our Research
# Programs 5 250
Selection of programs Ad hoc Systematic sample from Github
Tool used CodeCover, PIT Emma, Cobertura, CodeCover, PIT
Test suites Random subsets of original Organic & Randomly generated
(New results)
Removal of influence of size Ad hoc Statistical
Our study is much larger, systematic (not ad hoc), and follows the real world usage
Our Research (New results)
M~TestsuiteSize 12.84%
M~log(TSize) 51.26%
residuals(M~log(TSize))~S 75.25%
Statement coverage can explain 75% variability in mutation score after
eliminating influence of test suite size.