An Approach to Evaluate Software Effectiveness

Abstract

The Air Force Operational Test and Evaluation Center (AFOTEC) is tasked with the evaluation of operational effectiveness of new systems for the Air Force. Currently, the software analysis team within AFOTEC has no methodology to directly address the effectiveness of the software portion of these new systems. This research develops a working definition for software effectiveness, then outlines an approach to evaluate software effectiveness-- the Software Effectiveness Traceability Approach (SETA). Effectiveness is defined as the degree to which the software requirements are satisfied and is therefore application-independent. With SETA, requirements satisfaction is measured by the degree of traceability throughout the software development effort. A degree of traceability is determined for specific pairs of software life-cycle phases, such as the traceability from software requirements to high-level design and low-level design to code. The degrees of traceability are combined for an overall software effectiveness value. It is shown that SETA can be implemented in a simplified database, and basic database operations are described to retrieve traceability information and quantify the software\u27s effectiveness. SETA is demonstrated using actual software development data from a small software component of the avionics subsystem of the C-17, the Air Force\u27s newest transport aircraft

    Similar works