The focus of this paper was to compare the performance of HUMS condition indicators (CI) when detecting a bearing fault in a test stand or on a helicopter. This study compared data from two sources: first, CI data collected from accelerometers installed on two UH-60 Black Hawk helicopters when oil cooler bearing faults occurred, along with data from helicopters with no bearing faults; and second, CI data that was collected from ten cooler bearings, healthy and faulted, that were removed from fielded helicopters and installed in a test stand. A method using Receiver Operating Characteristic (ROC) curves to compare CI performance was demonstrated. Results indicated the bearing energy CI responded differently for the helicopter and the test stand. Future research is required if test stand data is to be used validate condition indicator performance on a helicopter