19 research outputs found
Variability in Plus Disease Identified Using a Deep Learning-Based Retinopathy of Prematurity Severity Scale
Evaluation of a Deep Learning–Derived Quantitative Retinopathy of Prematurity Severity Scale
Plus Disease in Retinopathy of Prematurity: Diagnostic Trends in 2016 Versus 2007
To identify any temporal trends in the diagnosis of plus disease in retinopathy of prematurity (ROP) by experts.
Reliability analysis.
ROP experts were recruited in 2007 and 2016 to classify 34 wide-field fundus images of ROP as plus, pre-plus, or normal, coded as “3,” “2,” and “1,” respectively, in the database. The main outcome was the average calculated score for each image in each cohort. Secondary outcomes included correlation on the relative ordering of the images in 2016 vs 2007, interexpert agreement, and intraexpert agreement.
The average score for each image was higher for 30 of 34 (88%) images in 2016 compared with 2007, influenced by fewer images classified as normal (P < .01), a similar number of pre-plus (P = .52), and more classified as plus (P < .01). The mean weighted kappa values in 2006 were 0.36 (range 0.21–0.60), compared with 0.22 (range 0–0.40) in 2016. There was good correlation between rankings of disease severity between the 2 cohorts (Spearman rank correlation ρ = 0.94), indicating near-perfect agreement on relative disease severity.
Despite good agreement between cohorts on relative disease severity ranking, the higher average score and classifications for each image demonstrate that experts are diagnosing pre-plus and plus disease at earlier stages of disease severity in 2016, compared with 2007. This has implications for patient care, research, and teaching, and additional studies are needed to better understand this temporal trend in image-based plus disease diagnosis
Identification of candidate genes and pathways in retinopathy of prematurity by whole exome sequencing of preterm infants enriched in phenotypic extremes
AbstractRetinopathy of prematurity (ROP) is a vasoproliferative retinal disease affecting premature infants. In addition to prematurity itself and oxygen treatment, genetic factors have been suggested to predispose to ROP. We aimed to identify potentially pathogenic genes and biological pathways associated with ROP by analyzing variants from whole exome sequencing (WES) data of premature infants. As part of a multicenter ROP cohort study, 100 non-Hispanic Caucasian preterm infants enriched in phenotypic extremes were subjected to WES. Gene-based testing was done on coding nonsynonymous variants. Genes showing enrichment of qualifying variants in severe ROP compared to mild or no ROP from gene-based tests with adjustment for gestational age and birth weight were selected for gene set enrichment analysis (GSEA). Mean BW of included infants with pre-plus, type-1 or type 2 ROP including aggressive posterior ROP (n = 58) and mild or no ROP (n = 42) were 744 g and 995 g, respectively. No single genes reached genome-wide significance that could account for a severe phenotype. GSEA identified two significantly associated pathways (smooth endoplasmic reticulum and vitamin C metabolism) after correction for multiple tests. WES of premature infants revealed potential pathways that may be important in the pathogenesis of ROP and in further genetic studies.</jats:p
Recommended from our members
Evaluation of a Deep Learning–Derived Quantitative Retinopathy of Prematurity Severity Scale
To evaluate the clinical usefulness of a quantitative deep learning-derived vascular severity score for retinopathy of prematurity (ROP) by assessing its correlation with clinical ROP diagnosis and by measuring clinician agreement in applying a novel scale.
Analysis of existing database of posterior pole fundus images and corresponding ophthalmoscopic examinations using 2 methods of assigning a quantitative scale to vascular severity.
Images were from clinical examinations of patients in the Imaging and Informatics in ROP Consortium. Four ophthalmologists and 1 study coordinator evaluated vascular severity on a scale from 1 to 9.
A quantitative vascular severity score (1–9) was applied to each image using a deep learning algorithm. A database of 499 images was developed for assessment of interobserver agreement.
Distribution of deep learning-derived vascular severity scores with the clinical assessment of zone (I, II, or III), stage (0, 1, 2, or 3), and extent (6 clock hours) of stage 3 evaluated using multivariate linear regression and weighted κ values and Pearson correlation coefficients for interobserver agreement on a 1-to-9 vascular severity scale.
For deep learning analysis, a total of 6344 clinical examinations were analyzed. A higher deep learning-derived vascular severity score was associated with more posterior disease, higher disease stage, and higher extent of stage 3 disease (P < 0.001 for all). For a given ROP stage, the vascular severity score was higher in zone I than zones II or III (P < 0.001). Multivariate regression found zone, stage, and extent all were associated independently with the severity score (P < 0.001 for all). For interobserver agreement, the mean ± standard deviation weighted κ value was 0.67 ± 0.06, and the Pearson correlation coefficient ± standard deviation was 0.88 ± 0.04 on the use of a 1-to-9 vascular severity scale.
A vascular severity scale for ROP seems feasible for clinical adoption; corresponds with zone, stage, extent of stage 3, and plus disease; and facilitates the use of objective technology such as deep learning to improve the consistency of ROP diagnosis
Recommended from our members
Variability in Plus Disease Diagnosis using Single and Serial Images
PurposeTo assess changes in retinopathy of prematurity (ROP) diagnosis in single and serial retinal images.DesignCohort study.ParticipantsCases of ROP recruited from the Imaging and Informatics in Retinopathy of Prematurity (i-ROP) consortium evaluated by 7 graders.MethodsSeven ophthalmologists reviewed both single and 3 consecutive serial retinal images from 15 cases with ROP, and severity was assigned as plus, preplus, or none. Imaging data were acquired during routine ROP screening from 2011 to 2015, and a reference standard diagnosis was established for each image. A secondary analysis was performed using the i-ROP deep learning system to assign a vascular severity score (VSS) to each image, ranging from 1 to 9, with 9 being the most severe disease. This score has been previously demonstrated to correlate with the International Classification of ROP. Mean plus disease severity was calculated by averaging 14 labels per image in serial and single images to decrease noise.Main outcome measuresGrading severity of ROP as defined by plus, preplus, or no ROP.ResultsAssessment of serial retinal images changed the grading severity for > 50% of the graders, although there was wide variability. Cohen's kappa ranged from 0.29 to 1.0, which showed a wide range of agreement from slight to perfect by each grader. Changes in the grading of serial retinal images were noted more commonly in cases of preplus disease. The mean severity in cases with a diagnosis of plus disease and no disease did not change between single and serial images. The ROP VSS demonstrated good correlation with the range of expert classifications of plus disease and overall agreement with the mode class (P = 0.001). The VSS correlated with mean plus disease severity by expert diagnosis (correlation coefficient, 0.89). The more aggressive graders tended to be influenced by serial images to increase the severity of their grading. The VSS also demonstrated agreement with disease progression across serial images, which progressed to preplus and plus disease.ConclusionsClinicians demonstrated variability in ROP diagnosis when presented with both single and serial images. The use of deep learning as a quantitative assessment of plus disease has the potential to standardize ROP diagnosis and treatment
