Metrics Pilot Project for Military Avionics Sustainment: Experimental Design and Implementation Plan

Abstract

This working paper outlines the design of an experiment, employing a pilot project, for identifying and validating new metrics for managing the US Air Force military avionics sustainment system. The paper also presents a plan for implementing the pilot project. The experimental design allows for the quantitifation of the effects of the new metrics, while controlling for the effects of other factors impacting the observed outcomes. Underlying the pilot project, and the proposed experimental design, are three main hypotheses derived from earlier research: (a) currently used metrics foster local optimization rather than system-wide optimization; (b) they do not allow measures of progress towards the achievement of system-wide goals and objectives, and, hence, do not allow visibility into the impact of depot maintenance on the warfighter; and (c) they are driving the “wrong behavior,” causing suboptimal decisions governing maintenance and repair priorities and practices and, as a result, undermining the efficiency and effectiveness of the sustainment system, despite the fact that the Air Force sustainment system has a dedicated and highly skilled workforce supporting the warfighter