Skip to main content
Toward Automating Requirements Satisfaction Assessment
17th IEEE International Requirements Engineering Conference Proceedings: Atlanta, GA
  • E. Ashlee Holbrook, Lexmark
  • Jane Huffman Hayes, University of Kentucky
  • Alex Dekhtyar, California Polytechnic State University - San Luis Obispo
Publication Date

This paper introduces the automation of satisfaction assessment: the process of determining the satisfaction mapping of natural language textual requirements to natural language design elements. Satisfaction assessment is useful because it assists in discovering unsatisfied requirements early in the lifecycle when such issues can be corrected with lower cost and impact than later. We define the basic terms and concepts for this process and explore the feasibility of developing baseline methods for its automation. This paper describes the satisfaction assessment approach algorithmically and then evaluates the effectiveness of two proposed information retrieval (IR) methods in two industrial studies - one based on a large dataset including a complete requirements specification and design specification for a NASA science instrument, and one based on a smaller dataset for an open source project management dataset. We found that both approaches have merit, and that the more sophisticated approach outperformed the simpler approach in terms of overall accuracy of the results.

Publisher statement
Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Citation Information
E. Ashlee Holbrook, Jane Huffman Hayes and Alex Dekhtyar. "Toward Automating Requirements Satisfaction Assessment" 17th IEEE International Requirements Engineering Conference Proceedings: Atlanta, GA (2009) p. 149 - 158
Available at: