Problem #5: What Techniques To Use?
Testing experts rarely agree!
- (e.g., black-box vs. white-box or system-level vs. unit)
Marginal evidence correlating testing methods and the types of errors they detect
Other than the subsumes hierarchy, most evidence is anecdotal that relates defects found per technique to costs of that technique
Reason: Taboo for organizations to reveal real error/fault and test-effectiveness data. ("Dirty laundry" syndrome)
- NIST: Error, Fault, Failure Database