of the time, manual testing beats automated testing in finding business logic bugs and automated testing beats manual testing in finding infrastructure bugs” Dr. James Whittaker Former Google’s Test Engineering Director However, manual test can be expensive and time-consuming
Crowdsourcing More inherent bias when testing software Does not offer the simple on- demand testing service Testing approach is not systematic Increasing the number of testers to satisfy peak demand can be costly Number of testers are not easily scalable Quality depends on the testers’ experience and commitment at a test cycle More challenging to test software in diverse test environments More paperwork (contract negotiations, tax forms, etc) Very high turnover rate means non-decreasing product-specific learning curve