Self-reported transvaginal ultrasound visualization of normal ovaries in postmenopausal women is not reliable: results of expert review of archived images in UKCTOCS.
OBJECTIVE: In UKCTOCS self-reported visualization rates(srVR) at annual TVS scan was a key quality control(QC) metric. Our objective was to independently assess srVR using expert review and develop software capable of monitoring it. METHODS: Images from 1,000 examinations randomly selected from 68,951 archived annual TVS exams undertaken between 2008-2011 where the ovaries were reported as 'seen and normal' were reviewed by a single expert. Software was developed to identify exact images used to measure ovaries by measuring caliper dimensions and matching them to that recorded by the sonographer. A logistic regression classifier to determine visualization was trained and validated using ovarian dimension and visualization data reported by the expert . RESULTS: The expert confirmed both ovaries were visualized (cVR-Both) in 50.2%(502/1000) of the exams. The software identified the measurement image in 534 exams which were split 2:1:1 providing training, validating and testing data. Classifier accuracy on validation data was 70.9%(CI-95% 70.0,71.8). Analysis of test data (133 exams) resulted in sensitivity of 90.5%(CI-95% 80.9,95.8) and specificity of 47.5%(CI-95% 34.5,60.8) in detecting expert confirmed cVR-Both. CONCLUSIONS: Our results suggest that in a significant proportion of TVS annual screens the sonographers may have mistaken other structures for normal ovaries. It is uncertain whether or not this affected the sensitivity and stage at detection of ovarian cancer in the ultrasound arm of UKCTOCS, but we conclude QC metrics based on self-reported visualization of normal ovaries are unreliable. The classifier shows some potential for addressing this problem, though further research is needed
