Browse Reliability Publications

Testing

Fault Injection

An Approach to Identifying and Understanding Problematic COTS Components (PS / PDF)
G. Kapfhammer, C. Michael, J. Haddox, R. Coyler
Presented at ISACC 2000, The Software Risk Management Conference.

Techniques for Evaluating the Robustness of Windows NT Software (PDF / Word)
M. Schmid, A.K. Ghosh, F. Hill
To appear in the 2000 DARPA Information Survivability Conference & Exposition (DISCEX'00), January 2000, Hilton Head, SC.

An Approach to Testing COTS Software for Robustness to Operating System Exceptions and Errors (PS / PDF)
A.K. Ghosh, M. Schmid
To appear in the 1999 International Symposium on Software Reliability Engineering (ISSRE99), November 1-4, 1999, Boca Raton, FL.

Predicting When to Reboot "Continuously Operating" Embedded Software (HTML)
J. Voas, F. Charron
In proceedings of CONQUEST'99, September 1999, Nuremburg, Germany.

Inoculating Software for Survivability (PS / PDF)
A. Ghosh, J. Voas
Communications of the ACM, July 1999.

Data Generation Techniques for Automated Software Robustness Testing (PDF / Word)
M. Schmid, F. Hill
Sixteenth International Conference on Testing Computer Software (ICTCS'99)

Software Hazard Mining (PS / PDF)
J. Voas
For the IEEE Workshop on Application Specific Software Engineering and Technology (ASSET'99), March, 1999. Richardson, TX.

NetHose: A Tool for Finding Vulnerabilities in Network Stacks (PS / PDF)
A. Ghosh, F. Hill, M. Schmid
Short talk at the 1999 IEEE Security and Privacy Symposium, Oakland, CA, 1999.

Analyzing Software Sensitivity to Human Error (PS / PDF)
J. Voas
Failure and Lessons Learned in Information Technology Management - An International Journal 2(4), December, 1998.

Wrapping Windows NT Binary Executables for Failure Simulation (PS / PDF)
A.K. Ghosh, M. Schmid
Fast abstract to appear in the International Symposium on Software Reliability Engineering (ISSRE'98), November 4-7, 1998, Paderborn, GE.

Testing the Robustness of Windows NT Software (PS / PDF)
A.K. Ghosh, M. Schmid, and V. Shah
Experience report to appear in the International Symposium on Software Reliability Engineering (ISSRE'98), November 4-7, 1998, Paderborn, GE.

An Approach for Analyzing the Robustness of Windows NT Software (PS / PDF)
A. Ghosh, V. Shah, M. Schmid
Proceedings of the 21st National Information Systems Security Conference, October 5-8, 1998, p. 383-391. Crystal City, VA.

Error Propagation Analysis Studies in a Nuclear Research Code (PDF)
J. Voas, F. Charron, L. Beltracchi
In Proceedings of the 1998 IEEE Aerospace Conference, Snowmass, CO, March 1998.

Fault Injection for the Masses (PS / PDF)
J. Voas
IEEE Computer, December 1997.

Reducing Uncertainty About Common-Mode Failures (PS / PDF)
J. Voas, A. Ghosh, F. Charron, L. Kassab
In Proceedings of ISSRE, November 1997.

Simulating Specification Errors and Ambiguities in Systems Employing Diversity (PS / PDF)
J. Voas, L. Kassab
In the Proceedings of 1997 Pacific Northwest Software Quality Conference, October 27-29, 1997.

Predicting How Badly "Good" Software can Behave (PS)
J. Voas, F. Charron, G. McGraw, E. Miller, M. Friedman
IEEE Software, July 1997.

On the Uniformity of Error Propagation in Software (PS)
C. Michael and R. Jones
In Proceedings of COMPASS '97, June 1997.

Reducing Uncertainty About Common-Mode Failures (PS / PDF)
J. Voas, A. Ghosh, F. Charron, L. Kassab
Submitted to the 12th Annual Conference on Computer Assurance, June 16-20, 1997, Gaithersburg, MD.

Fault-injection: A Crystal Ball for Software Quality (PS / PDF)
J. Voas, G. McGraw, L. Kassab, L. Voas
IEEE Computer, June 1997, Volume 30, Number 6, pp. 29-36.

Software Fault-injection: Growing 'Safer' Systems (PS / PDF)
J. Voas
In Proc. of IEEE Aerospace Conference, February, 1997, Snowmass, CO.

Reducing Uncertainty About Survivability (PS / PDF)
J. Voas, G. McGraw, A. Ghosh
Proc. of the 1997 Information Survivability Workshop, February 12-13, 1997, San Diego, CA

Software Testability: Investing in Testing (PS / PDF)
J. Voas, K. Miller
Proceedings of EuroStar'96, Amsterdam, December, 1996.

Tolerant Software Interfaces: Can COTS-based Systems be Trusted Without Them? (PS / PDF)
J. Voas, F. Charron, K. Miller
Proceedings of the 15th Int'l. Conference on Computer Safety, Reliability, and Security (SAFECOMP'96), Vienna, October, 1996.

Substituting Voas's Testability Measure for Musa's Fault Exposure Ratio (PS / PDF)
J. Voas, K. Miller
Proceedings of the Int'l. Communications Conference, June, 1996, Dallas, TX.

Defining an Adaptive Software Security Metric from a Dynamic Software Failure-tolerance Measure (PS / PDF)
J. Voas, G. McGraw, A.K. Ghosh, F. Charron, K. Miller
Proceedings of the 11th Annual Conference on Computer Assurance (COMPASS'96)

Software Testability: The New Verification (PS / PDF)
J. Voas, K. Miller
IEEE Software. May, 1995.

Software Testability Measurement for Assertion Injection and Fault Localization (PS / PDF)
J. Voas
Proceedings of 2nd Int'l. Workshop on Automated and Algorithmic Debugging (AADEBUG'95), St. Malo, France, May, 1995.

Software Testability: An Experiment in Measuring Simulation Reusability (PS)
J. Voas, J. Payne, R. Mills, J. McManus
Proceedings of ACM Sigsoft (SSR'95), Seattle, April 29-30.

Dynamic Testability Analysis for Assessing Fault Tolerance (PS)
J. Voas, K. Miller
High Integrity Systems Journal. 1(2):171-178, 1994, Oxford University Press.

Formal Testability Analysis (PS)
J. Voas
In the Encyclopedia of Software Engineering, John Wiley & Sons, pp.517--518, 1994.

Software Testability and Its Application to Avionic Software (PS)
J. Voas, K. Miller, J. Payne
Proceedings of Computers in Aerospace 9, October, 1993, San Diego, CA. Publisher: AIAA.

Semantic Metrics for Software Testability (PS)
J. Voas, K. Miller
The Journal of Systems and Software, Elsevier Science Publishers Ltd. 20:207-216, March, 1993.

Applying a Dynamic Testability Technique to Debugging Certain Classes of Software Faults (PS / PDF)
J. Voas, K. Miller
Software Quality Journal, Chapman & Hall, March, 1993, p. 61-75.

Improving the Software Development Process Using Testability Research (PS / PDF)
J. Voas, K. Miller
Proceedings of the 3rd Int'l. Symp. on Softw. Reliability Engineering , p. 114--121, October, 1992, RTP, NC, Publisher: IEEE Computer Society.

PIE: A Dynamic Failure-Based Technique (PS / PDF)
J. Voas
IEEE Trans. on Softw. Eng., 18(8):717--727, August, 1992.

PISCES: A Tool for Predicting Software Testability (PS / PDF)
J. Voas, K. Miller, J. Payne
Proceedings of the Symp. on Assessment of Quality Software Development Tools, May, 1992, p. 297-309, New Orleans, LA, IEEE Computer Society, ISBN: 0-8186-2620-8.

Factors that Affect Software Testability (PS / PDF)
J. Voas
Proceedings of the 9th Pacific Northwest Softw. Quality Conf., p. 235--247, October, 1991, Portland, OR. Publisher: Pacific Northwest Software Quality Conference, Inc.

Predicting Where Faults Can Hide From Testing (PS / PDF)
J. Voas, L. Morell, K. Miller
IEEE Software, 8(2):41--47, March 1991.

Test Data Generation

Testing Commercial-off-the-Shelf Software Components (Word)
J. Haddox, G. Kapfhammer, C. Michael, M. Schatz
Proceedings of the 18th International Conference and Exposition on Testing.

Automated Software Test Data Generation for Complex Programs (PS / PDF)
G. McGraw and C. Michael
Proceedings of the 13th IEEE Automated Software Engineering Conference, October 13-16, 1998, Honolulu, Hawaii.

Genetic Algorithms for Dynamic Test Data Generation (PS / PDF)
C. Michael, G. McGraw, M. Schatz, and C. Walton
In Proceedings of IEEE International Automated Software Engineering Conference (ASE97), November 3-5, 1997.

Building Software Recovery Assertions from Fault Injection Analysis (PS / PDF)
J. Voas
In Proceedings of COMPSAC'97, August 1997, Washington DC.

Automatic Generation of Test-Cases for Software Testing (PS / PDF)
G. McGraw, C. Michael
Proceedings of the 18th Annual Conference of the Cognitive Science Society, July 1996.

General

Software Penetration Testing (PDF)
B. Arkin, S. Stender, G. McGraw
IEEE Security & Privacy (Jan/Feb 2005)

Deriving Accurate Operational Profiles for Mass-Marketed Software (PS / PDF)
J. Voas
Submitted to 4th International Conference on Empirical Assessment & Evaluation in Software (EASE 2000).

Can Chaotic Methods Actually Improve Software Quality Predictions? (PS / PDF)
J. Voas
IEEE Software, to appear in 2000.

Wrapping Windows NT Software for Robustness (PS / PDF)
A. Ghosh, M. Schmid, F. Hill
To appear in Proceedings of the 29th International Fault Tolerant Computer Symposium (FTCS-29), June 15-18, 1999, Madison, WI.

Quality Meets the CEO (PDF)
J. Payne
Software Testing & Quality Engineering, May/June 1999 (Vol. 1, Iss. 3)

Using Assertions to Make Untestable Software More Testable (PS / PDF)
J. Voas, L. Kassab
Software Quality Professional.

OTS Software Failures: Can Anything be Done? (PS / PDF)
J. Voas, J. Payne
In Proceedings of the First IEEE Workshop on Application Specific Software Engineering and Technology (ASSET'98), March, 1998, Dallas

Reusing Tests of Reusable Software Components (PS)
C. Michael
In Proceedings of COMPASS '97, June 1997.

Problems of Accuracy in the Prediction of Software Quality from Directed Tests (PS / PDF)
C. Michael, J. Voas
International Conference on Testing Computer Software, June 1997.

Using Evolution Constraints to Assess the Failure-proneness of Evolving Software (PS)
C. Michael
Proceedings of the First Euromicro Working Conference on Software Maintenance and Reengineering (CSMR97), March 17-19, 1997, Berlin, Germany.

A Few Assertions about Information Hiding (PS / PDF)
J. Voas
IEEE Software (Quality Time Column), March 1997.

On the Use of Process Information in Directed Testing (PS)
C. Michael
Software Quality Engineering '97.

Investigating Rare-Event Failure Tolerance: Reductions in Uncertainty (PS / PDF)
J. Voas, F. Charron, K. Miller
Proceedings of IEEE High-Assurance Systems Engineering Workshop (HASE'96), In conjunection with the 15th Symposium on Reliable Distributed Systems, Niagara-on-the-Lake, Canada, October, 1996.

Untangling the Woven Web: Testing Web-based Software (PS / PDF)
G. McGraw, D. Hovemeyer
Proceedings of the 13th International Conference on Testing Computer Software (ICTCS), June 1996.

Building a Java Software Engineering Tool for Testing Applets (PS / PDF)
A.S. Binns, G. McGraw
Proceedings of the IntraNet 96 NY Conference, April 8-10, 1996, New York City.

Detecting Program Modules with Low Testability (PS)
T.M. Khoshgoftaar, R.M. Szabo, J.M. Voas
Proceedings of ICSM'95, Nice, France, October, 1995.

Examining Fault-tolerance Using Unlikely Inputs: Turning the Test Distribution Up-side Down (PS / PDF)
J. Voas, K. Miller
Proceedings of COMPASS'95, Gaithersburg, MD June, 1995.

Procedures for Reducing the Size of Coverage-based Test Sets (PS / PDF)
J. Offutt, J. Pan, J. Voas
Proceedings of 12th Int'l. Conf. on Testing Computer Software. Washington, DC. June, 1995.

Confidently Assessing a Zero Probability of Software Failure (PS)
J. Voas, C. Michael, K. Miller
High Integrity Systems Journal. Oxford University Press. 1(3):269-275, 1995.

Putting Assertions in Their Place (PS)
J. Voas, K. Miller
Proceedings of the Int'l. Symposium on Software Reliability Engineering, November 6-9, 1994, Monterey, CA.

A Comparison of a Dynamic Software Testability Metric to Static Cyclomatic Complexity (PS)
J. Voas, K. Miller, J. Payne
Proceedings of 2nd Int'l. Conf. on Software Quality Management, July, 1994, Edinburgh, Scotland, Publisher: Computational Mechanics Publications.

An Empirical Comparison of a Dynamic Software Testability Metric to Static Cyclomatic Complexity (PS / PDF)
J. Voas, K. Miller, J. Payne
Proceedings of the 18th Annual Software Engineering Workshop, December, 1993, NASA-Goddard Software Engineering Laboratory Series Report 93-003.

Confidently Assessing a Zero Probability of Software Failure (PS)
J. Voas, C. Michael, K. Miller
Proceedings of the 12th Int'l. Conf. on Computer Safety, Reliability, and Security , October, 1993, pp. 197-206, Poznan, Poland. Publisher: Springer-Verlag, ISBN 3-540-19838-5.

Automating Test Case Generation for Coverages Required by FAA Standard DO-178B (PS)
J. Voas, K. Miller, J. Payne
Proceedings of Computers in Aerospace 9, October, 1993, San Diego, CA. Publisher: AIAA.

A Software Analysis Technique for Quantifying Reliability in High-Risk Medical Devices (PS / PDF)
J. Voas, K. Miller, J. Payne
Proceedings of the 6th IEEE Symposium on Computer-Based Medical Systems, June, 1993, Ann Arbor, MI.

Faults on Its Sleeve: Amplifying Software Reliability Testing (PS / PDF)
R. Hamlet, J. Voas
Proceedings of the ACM SIGSOFT Int'l. Symposium on Software Testing and Analysis, June, 1993, Cambridge, MA, Publisher: ACM.

A Framework for Defining Semantic Metrics (PS)
L. Morell, J. Voas
The Journal of Systems and Software, Elsevier Science Publishers Ltd. 20:245-251, March, 1993.

Designing Programs That are Less Likely to Hide Faults (PS / PDF)
J. Voas, K. Miller, J. Payne
The Journal of Systems and Software, Elsevier Science Publishers Ltd. 20:93-100, January, 1993.

Designing Programs that do not Hide Data State Errors During Random Black-Box Testing (PS)
J. Voas, K. Miller, R. Noonan
Proceedings of the 5th Int'l. Conf. on Putting Into Practice Methods and Tools for Information System Design, September, 1992, Nantes, France.

Dynamic Testing Complexity Metric (PS / PDF)
J. Voas
Software Quality Journal, 1(2):101--114, Chapman & Hall, June, 1992.

The Revealing Power of a Test Case (PS / PDF)
J. Voas, K. Miller
Journal of Software Testing, Verification, and Reliability, John Wiley and Sons, 2(1):25-42, May, 1992.

A Dynamic Failure Model for Predicting the Impact that a Program Location has on the Program (PS / PDF)
J. Voas
Lecture Notes in Computer Science Series, Vol. 550: Proc. of the 3rd European Softw. Eng. Conf., p. 308--331, October, 1991, Italy, Publisher: Springer-Verlag, A. Van Lamsweerde and A. Fugetta (Eds.).

Certification

Limited Software Warranties (PS / PDF)
J. Voas
To be presented at ECBS 2000, April 2000.

Third-Party Usage Profiling: A Model for Optimizing the Mass-Marketed Software Industry (PS / PDF)
J. Voas
Submitted to IEEE Software.

"User Participation"-Based Software Certification (PS / PDF / Word)
J. Voas
To appear in IEEE Computer, early 2000.

Dependability Certification of Software Components (PS / PDF)
J. Voas and J. Payne
Journal of Systems and Software, 2000.

A Recipe for Certifying High Assurance Software (PS / PDF)
J. Voas
IEEE Software, July 1999.

User Participation-Based Software Certification (PS / PDF)
J. Voas
In proceedings of Eurovav'99, Oslo, Norway, June 1999.

The Software Quality Certification Triangle (PS / PDF / HTML)
J. Voas
Crosstalk, November, 1998.

An Approach for Certifying Security in Software Components (PS / PDF)
A. Ghosh, G. McGraw
Proceedings of the 21st National Information Systems Security Conference, October 5-8, 1998, Crystal City, VA.

An Approach to Certifying Off-the-Shelf Software Components (PS / PDF)
J. Voas
IEEE Computer, June, 1998.

Defensive Approaches to Testing Systems that Contain COTS and Third-Party Functionality (PS / PDF)
J. Voas
In Proc. of 15th Int'l. Conference and Exposition on Testing Computer Software, June, 1998.

Software Certification Laboratories? (PS / PDF)
J. Voas
Crosstalk, April 1998.

A Defensive Approach to Testing Systems that Contain COTS and Third-Party Functionality (PS / PDF)
J. Voas
In the Proceedings AQUIS '98, Venice, April 1998.

Certifying Y2K 'Fixes' (PS / PDF)
J. Voas
Crosstalk, January 1998.

Safety

Software Hazard Mining (PS / PDF)
J. Voas
For the IEEE Workshop on Application Specific Software Engineering and Technology (ASSET'99), March, 1999. Richardson, TX.

An Automated Code-based Fault-tree Mitigation Technique (PS / PDF)
J.Voas, K. Miller
Proceedings of 14th Int'l. Conf. on Computer Safety, Security, and Reliability. Italy, October, 1995.

Predicting Software's Minimum-time-to-hazard and Mean-time-to-hazard for Rare Input Events (PS / PDF)
J. Voas, K. Miller
Proceedings of the 6th Int'l. Symp. on Softw. Reliability Engineering, 1995, Publisher: IEEE Computer Society.

Dynamic Testability Analysis for Software Safety (PS)
J. Voas, K. Miller, J. Payne
Proceedings of the 2nd IASTED Int'l. Conf. on Reliability, Quality Control and Risk Assessment, October, 1993, Cambridge, MA, Publisher: IASTED-ACTA Press, ISBN: 0-88986-181-1.



About Cigital
> About Cigital
> Our Team
> Investors
> Affiliations
> Careers
> Labs
> Contact Us
Cigital Labs
> Cigital Labs
> Projects
> Publications