The impact of focused training on abnormality detection and provision of accurate preliminary clinical evaluation in newly qualified radiographers

Introduction: Preliminary clinical evaluation (PCE) can be a useful initial assessment of traumatic abnormalities by frontline radiographers; new graduates are expected to have the skills and knowledge required to provide this initial interpretation. This study evaluates the abnormality detection performance and accuracy of PCE commenting in newly qualified radiographers. Method: Four newly qualified radiographers completed a fracture/dislocation detection task consisting of 58 cases, including providing a PCE for each suspicious area. Following this, an 8-week training program was completed to improve competence in recognizing abnormalities and providing an accurate PCE. Equally weighted jackknife alternative free-response receiver operating characteristic (wJAFROC) analysis was performed; a difference between pre- and post-training would be considered significant at a test alpha of less than 0.05. Results: Fracture/dislocation detection was significantly better in the post-training evaluation for fixed observers and random cases (F (1,57) = 4.48, p = 0.0387). The reader averaged wJAFROC FOM and 95% CIs for pre- and post-training were 0.619 (0.516, 0.737) and 0.703 (0.622, 0.852). A paired t-test demonstrated a significant difference in PCE scores in favour of the post-training evaluation p = 0.0006. This small cohort demonstrated difficulty in recognising undisplaced fractures and buckle fractures. Conclusion: An 8-week training program had a positive impact on participants’ ability to localise and accurately describe fractures. Implementation of abnormality detection training should be considered during preceptorship periods. Due to the small sample size, it is inappropriate to suggest these findings are representative of all graduate radiographers

Who Watches the Watchmen? An Appraisal of Benchmarks for Multiple Sequence Alignment

Multiple sequence alignment (MSA) is a fundamental and ubiquitous technique in bioinformatics used to infer related residues among biological sequences. Thus alignment accuracy is crucial to a vast range of analyses, often in ways difficult to assess in those analyses. To compare the performance of different aligners and help detect systematic errors in alignments, a number of benchmarking strategies have been pursued. Here we present an overview of the main strategies--based on simulation, consistency, protein structure, and phylogeny--and discuss their different advantages and associated risks. We outline a set of desirable characteristics for effective benchmarking, and evaluate each strategy in light of them. We conclude that there is currently no universally applicable means of benchmarking MSA, and that developers and users of alignment tools should base their choice of benchmark depending on the context of application--with a keen awareness of the assumptions underlying each benchmarking strategy.Comment: Revie

Altered functional and structural brain network organization in autism.

Structural and functional underconnectivity have been reported for multiple brain regions, functional systems, and white matter tracts in individuals with autism spectrum disorders (ASD). Although recent developments in complex network analysis have established that the brain is a modular network exhibiting small-world properties, network level organization has not been carefully examined in ASD. Here we used resting-state functional MRI (n = 42 ASD, n = 37 typically developing; TD) to show that children and adolescents with ASD display reduced short and long-range connectivity within functional systems (i.e., reduced functional integration) and stronger connectivity between functional systems (i.e., reduced functional segregation), particularly in default and higher-order visual regions. Using graph theoretical methods, we show that pairwise group differences in functional connectivity are reflected in network level reductions in modularity and clustering (local efficiency), but shorter characteristic path lengths (higher global efficiency). Structural networks, generated from diffusion tensor MRI derived fiber tracts (n = 51 ASD, n = 43 TD), displayed lower levels of white matter integrity yet higher numbers of fibers. TD and ASD individuals exhibited similar levels of correlation between raw measures of structural and functional connectivity (n = 35 ASD, n = 35 TD). However, a principal component analysis combining structural and functional network properties revealed that the balance of local and global efficiency between structural and functional networks was reduced in ASD, positively correlated with age, and inversely correlated with ASD symptom severity. Overall, our findings suggest that modeling the brain as a complex network will be highly informative in unraveling the biological basis of ASD and other neuropsychiatric disorders

Visual function assessment in medical imaging research

Background: Medical image perception research relies on visual data to study the diagnostic relationship between observers and medical images. A consistent method to assess visual function for participants in medical imaging research has not been developed and represents a significant gap in existing research. Methods: Three visual assessment factors appropriate to observer studies were identified: visual acuity, contrast sensitivity, and stereopsis. A test was designed for each, and 30 radiography observers (mean age 31.6 years) participated in each test. Results: Mean binocular visual acuity for distance was 20/14 for all observers. The difference between observers who did and did not use corrective lenses was not statistically significant (P ! .12). All subjects had a normal value for near visual acuity and stereoacuity. Contrast sensitivity was better than population norms. Conclusion: All observers had normal visual function and could participate in medical imaging visual analysis studies. Protocols of evaluation and populations norms are provided. Further studies are necessary to understand fully the relationship between visual performance on tests and diagnostic accuracy in practice

A method to determine the impact of reduced visual function on nodule detection performance

Purpose: In this study we aim to validate a method to assess the impact of reduced visual function and observer performance concurrently with a nodule detection task. Materials and methods: Three consultant radiologists completed a nodule detection task under three conditions: without visual defocus (0.00 Dioptres; D), and with two different magnitudes of visual defocus ( 1.00 D and 2.00 D). Defocus was applied with lenses and visual function was assessed prior to each image evaluation. Observers evaluated the same cases on each occasion; this comprised of 50 abnormal cases containing 1e4 simulated nodules (5, 8, 10 and 12 mm spherical diameter, 100 HU) placed within a phantom, and 25 normal cases (images containing no nodules). Data was collected under the free-response paradigm and analysed using Rjafroc. A difference in nodule detection performance would be considered significant at p < 0.05. Results: All observers had acceptable visual function prior to beginning the nodule detection task. Visual acuity was reduced to an unacceptable level for two observers when defocussed to 1.00 D and for one observer when defocussed to 2.00 D. Stereoacuity was unacceptable for one observer when defocussed to 2.00 D. Despite unsatisfactory visual function in the presence of defocus we were unable to find a statistically significant difference in nodule detection performance (F(2,4) 1⁄4 3.55, p 1⁄4 0.130). Conclusion: A method to assess visual function and observer performance is proposed. In this pilot evaluation we were unable to detect any difference in nodule detection performance when using lenses to reduce visual function

Altered expression of glutamate signaling, growth factor, and glia genes in the locus coeruleus of patients with major depression.

Several studies have proposed that brain glutamate signaling abnormalities and glial pathology have a role in the etiology of major depressive disorder (MDD). These conclusions were primarily drawn from post-mortem studies in which forebrain brain regions were examined. The locus coeruleus (LC) is the primary source of extensive noradrenergic innervation of the forebrain and as such exerts a powerful regulatory role over cognitive and affective functions, which are dysregulated in MDD. Furthermore, altered noradrenergic neurotransmission is associated with depressive symptoms and is thought to have a role in the pathophysiology of MDD. In the present study we used laser-capture microdissection (LCM) to selectively harvest LC tissue from post-mortem brains of MDD patients, patients with bipolar disorder (BPD) and from psychiatrically normal subjects. Using microarray technology we examined global patterns of gene expression. Differential mRNA expression of select candidate genes was then interrogated using quantitative real-time PCR (qPCR) and in situ hybridization (ISH). Our findings reveal multiple signaling pathway alterations in the LC of MDD but not BPD subjects. These include glutamate signaling genes, SLC1A2, SLC1A3 and GLUL, growth factor genes FGFR3 and TrkB, and several genes exclusively expressed in astroglia. Our data extend previous findings of altered glutamate, astroglial and growth factor functions in MDD for the first time to the brainstem. These findings indicate that such alterations: (1) are unique to MDD and distinguishable from BPD, and (2) affect multiple brain regions, suggesting a whole-brain dysregulation of such functions

A JAFROC study of nodule detection performance in CT images of a thorax acquired during PET/CT

Purpose Two types of CT images (modalities) are acquired in PET/CT: for attenuation correction (AC) and diagnosis. The purpose of the study was to compare nodule detection and localization performance between these two modalities. Methods CT images, using both modalities, of an anthropomorphic chest phantom containing zero or more simulated spherical nodules of 5, 8, 10 and 12 mm diameters and contrasts −800, −630 and 100 HU were acquired. An observer performance study using nine observers interpreting 45 normal (zero nodules) images and 47 abnormal images (1–3 nodules; average 1.26) was conducted using the free-response receiver operating characteristic (FROC) paradigm. Data were analysed using an R software package implemented jackknife alternative FROC (JAFROC) analysis. Both empirical areas under the equally weighted AFROC curve (wAFROC) and under the highest rating inferred ROC (HR-ROC) curve were used as figures of merit (FOM). To control the probability of Type I error test alpha was set at 0.05. Results Nodule detection as measured by either FOM was significantly better on the diagnostic quality images (2nd modality), irrespective of the method of analysis, [reader averaged inter-modality wAFROC FOM difference = −0.07 (−0.11,−0.04); reader averaged inter-modality HR-ROC FOM difference = −0.05 (−0.09, −0.01)]. Conclusion Nodule detection was statistically worse on images acquired for AC; suggesting that images acquired for AC should not be used to evaluate pulmonary pathology. Keywords PET/CT; Nodule detection; JAFRO

The impact of simulated motion blur on lesion detection performance in full field digital mammography

Objective: Motion blur is a known phenomenon in full-field digital mammography, but the impact on lesion detection is unknown. This is the first study to investigate detection performance with varying magnitudes of simulated motion blur. Method: Seven observers (15±5 years’ reporting experience) evaluated 248 cases (62 containing malignant masses, 62 containing malignant microcalcifications and 124 normal cases) for three conditions: no blurring (0 mm) and two magnitudes of simulated blurring (0.7 mm and 1.5 mm). Abnormal cases were biopsy proven. Mathematical simulation was used to provide a pixel shift in order to simulate motion blur. A free-response observer study was conducted to compare lesion detection performance for the three conditions. The equally weighted jackknife alternative free-response receiver operating characteristic (wJAFROC) was used as the figure of merit. Test alpha was set at 0.05 to control probability of Type I error. Results: wJAFROC analysis found a statistically significant difference in lesion detection performance for both masses (F(2,22) = 6.01, P=0.0084) and microcalcifications (F(2,49) = 23.14, P&lt;0.0001). The figures of merit reduced as the magnitude of simulated blurring increased. Statistical differences were found between some of the pairs investigated for the detection of masses (0.0mm v 0.7mm, and 0.0mm v 1.5mm) and all pairs for microcalcifications (0.0 mm v 0.7 mm, 0.0 mm v 1.5 mm, and 0.7 mm v 1.5 mm). No difference was detected between 0.7 mm and 1.5 mm for masses. Conclusion: Mathematical simulation of motion blur caused a statistically significant reduction in lesion detection performance. These false negative decisions could have implications for clinical practice. Advances in knowledge: This research demonstrates for the first time that motion blur has a negative and statistically significant impact on lesion detection performance digital mammography

Effect of Endovascular Aneurysm Repair on the Volume-Outcome Relationship in Aneurysm Repair

Background— We aim to quantify the relationship between the annual caseload (volume) and outcome from elective endovascular (EVR) or open repair of abdominal aortic aneurysms (AAAs) in England between 2005 and 2007. Methods and Results— Individual patient data were obtained from the Hospital Episode Statistics. Statistical methods included multiple logistic regression models, mortality control charts, and safety plots to determine the nature of any relationship between volume and outcome. The case-mix between hospitals of different sizes was examined using observed and expected values for in-hospital mortality. Outcome measures included in-hospital mortality and hospital length of stay. Between 2005 and 2007, a total of 57 587 patients were admitted to hospitals in England with a diagnosis of AAA, and 11 574 underwent AAA repair. There were 7313 elective AAA repairs, of which 5668 (78%) were open and 1645 (22%) were EVR. In-hospital mortality rates were 5.63% for all elective AAA repairs with rates of 6.18% for open repair and 3.77% for EVR (odds ratio, 0.676; 95% CI, 0.501 to 0.913; P=0.011). High-volume aneurysm services were associated with significantly lower mortality rates overall (0.991; 0.988 to 0.994; P<0.0001), for open repairs (0.994; 0.991 to 0.998; P=0.0008), and EVR (0.989; 0.982 to 0.995; P=0.0007). Large endovascular units had low mortality rates for open repairs. Conclusion— A strong relationship existed between the volume of surgery performed and outcome from both open and endovascular aneurysm repairs. These data support the concept that abdominal aortic surgery should be performed in specialized units that meet a minimum volume threshold

Effect of reconstruction methods and x-ray tube current-time product on nodule detection in an anthropomorphic thorax phantom : a crossed-modality JAFROC observer study

Purpose: To evaluate nodule detection in an anthropomorphic chest phantom in computed tomography (CT) images reconstructed with adaptive iterative dose reduction 3D (AIDR3D) and filtered back projection (FBP) over a range of tube current-time product (mAs). Methods: Two phantoms were used in this study: (i) an anthropomorphic chest phantom was loaded with spherical simulated nodules of 5, 8, 10 and 12mm in diameter and +100, -630 and -800 Hounsfied Units electron density; this would generate CT images for the observer study; (ii) a whole-body dosimetry verification phantom was used to ultimately estimate effective dose and risk according to the model of the BEIR VII committee. Both phantoms were scanned over a mAs range (10, 20, 30, and 40) while all other acquisition parameters remained constant. Images were reconstructed with both AIDR3D and FBP. 34 normal cases (no nodules) and 34 abnormal cases (containing 1-3 nodules, mean 1.35±0.54) cases were chosen for the observer study. Eleven observers evaluated images from all tube current-time product and reconstruction methods under the free-response paradigm. A crossed-modality jackknife alternative free-response operating characteristic (JAFROC) analysis method was developed for data analysis, averaging data over the two factors influencing nodule detection in this study: mAs and image reconstruction (AIDR3D or FBP). A Bonferroni correction was applied and the threshold for declaring significance was set at 0.025 to maintain the overall probability of Type I error at α = 0.05. Contrast-to-noise (CNR) was also measured for all nodules and evaluated by a linear least squares analysis. Results: For random-reader fixed-case crossed-modality JAFROC analysis there was no significant difference in nodule detection between AIDR3D and FBP when data was averaged over mAs (F(1,10) = 0.08, p = 0.789). However, when data was averaged over reconstruction methods, a significant difference was seen between multiple pairs of mAs settings (F(3,30) = 15.96, p&lt;0.001). Measurements of effective dose and effective risk showed the expected linear dependence on mAs. Nodule CNR was statistically higher for simulated nodules on images reconstructed with AIDR3D (p&lt;0.001). Conclusion: No significant difference in nodule detection performance was demonstrated between images reconstructed with FBP and AIDR3D. Tube current-time product was found to influence nodule detection, though further work is required for dose optimisation