The Accuracy and Reliability of Crowdsource Annotations of Digital Retinal Images

Purpose: Crowdsourcing is based on outsourcing computationally intensive tasks to numerous individuals in the online community who have no formal training. Our aim was to develop a novel online tool designed to facilitate large-scale annotation of digital retinal images, and to assess the accuracy of crowdsource grading using this tool, comparing it to expert classification. Methods: We used 100 retinal fundus photograph images with predetermined disease criteria selected by two experts from a large cohort study. The Amazon Mechanical Turk Web platform was used to drive traffic to our site so anonymous workers could perform a classification and annotation task of the fundus photographs in our dataset after a short training exercise. Three groups were assessed: masters only, nonmasters only and nonmasters with compulsory training. We calculated the sensitivity, specificity, and area under the curve (AUC) of receiver operating characteristic (ROC) plots for all classifications compared to expert grading, and used the Dice coefficient and consensus threshold to assess annotation accuracy. Results: In total, we received 5389 annotations for 84 images (excluding 16 training images) in 2 weeks. A specificity and sensitivity of 71% (95% confidence interval [CI], 69%-74%) and 87% (95% CI, 86%-88%) was achieved for all classifications. The AUC in this study for all classifications combined was 0.93 (95% CI, 0.91-0.96). For image annotation, a maximal Dice coefficient (~0.6) was achieved with a consensus threshold of 0.25. Conclusions: This study supports the hypothesis that annotation of abnormalities in retinal images by ophthalmologically naive individuals is comparable to expert annotation. The highest AUC and agreement with expert annotation was achieved in the nonmasters with compulsory training group. Translational Relevance: The use of crowdsourcing as a technique for retinal image analysis may be comparable to expert graders and has the potential to deliver timely, accurate, and cost-effective image analysis

Associations with photoreceptor thickness measures in the UK Biobank.

Spectral-domain OCT (SD-OCT) provides high resolution images enabling identification of individual retinal layers. We included 32,923 participants aged 40-69 years old from UK Biobank. Questionnaires, physical examination, and eye examination including SD-OCT imaging were performed. SD OCT measured photoreceptor layer thickness includes photoreceptor layer thickness: inner nuclear layer-retinal pigment epithelium (INL-RPE) and the specific sublayers of the photoreceptor: inner nuclear layer-external limiting membrane (INL-ELM); external limiting membrane-inner segment outer segment (ELM-ISOS); and inner segment outer segment-retinal pigment epithelium (ISOS-RPE). In multivariate regression models, the total average INL-RPE was observed to be thinner in older aged, females, Black ethnicity, smokers, participants with higher systolic blood pressure, more negative refractive error, lower IOPcc and lower corneal hysteresis. The overall INL-ELM, ELM-ISOS and ISOS-RPE thickness was significantly associated with sex and race. Total average of INL-ELM thickness was additionally associated with age and refractive error, while ELM-ISOS was additionally associated with age, smoking status, SBP and refractive error; and ISOS-RPE was additionally associated with smoking status, IOPcc and corneal hysteresis. Hence, we found novel associations of ethnicity, smoking, systolic blood pressure, refraction, IOPcc and corneal hysteresis with photoreceptor thickness

Automated retinal image quality assessment on the UK Biobank dataset for epidemiological studies.

Morphological changes in the retinal vascular network are associated with future risk of many systemic and vascular diseases. However, uncertainty over the presence and nature of some of these associations exists. Analysis of data from large population based studies will help to resolve these uncertainties. The QUARTZ (QUantitative Analysis of Retinal vessel Topology and siZe) retinal image analysis system allows automated processing of large numbers of retinal images. However, an image quality assessment module is needed to achieve full automation. In this paper, we propose such an algorithm, which uses the segmented vessel map to determine the suitability of retinal images for use in the creation of vessel morphometric data suitable for epidemiological studies. This includes an effective 3-dimensional feature set and support vector machine classification. A random subset of 800 retinal images from UK Biobank (a large prospective study of 500,000 middle aged adults; where 68,151 underwent retinal imaging) was used to examine the performance of the image quality algorithm. The algorithm achieved a sensitivity of 95.33% and a specificity of 91.13% for the detection of inadequate images. The strong performance of this image quality algorithm will make rapid automated analysis of vascular morphometry feasible on the entire UK Biobank dataset (and other large retinal datasets), with minimal operator involvement, and at low cost

Association between polygenic risk score and risk of myopia

YesImportance: Myopia is a leading cause of untreatable visual impairment and is increasing in prevalence worldwide. Interventions for slowing childhood myopia progression have shown success in randomized clinical trials; hence, there is a need to identify which children would benefit most from treatment intervention. Objectives: To examine whether genetic information alone can identify children at risk of myopia development and whether including a child’s genetic predisposition to educational attainment is associated with improved genetic prediction of the risk of myopia. Design, Setting, and Participants: Meta-analysis of 3 genome-wide association studies (GWAS) including a total of 711 984 individuals. These were a published GWAS for educational attainment and 2 GWAS for refractive error in the UK Biobank, which is a multisite cohort study that recruited participants between January 2006 and October 2010. A polygenic risk score was applied in a population-based validation sample examined between September 1998 and September 2000 (Avon Longitudinal Study of Parents and Children [ALSPAC] mothers). Data analysis was performed from February 2018 to May 2019. Main Outcomes and Measures: The primary outcome was the area under the receiver operating characteristic curve (AUROC) in analyses for predicting myopia, using noncycloplegic autorefraction measurements for myopia severity levels of less than or equal to −0.75 diopter (D) (any), less than or equal to -3.00 D (moderate), or less than or equal to −5.00 D (high). The predictor variable was a polygenic risk score (PRS) derived from genome-wide association study data for refractive error (n = 95 619), age of onset of spectacle wear (n = 287 448), and educational attainment (n = 328 917). Results: A total of 383 067 adults aged 40 to 69 years from the UK Biobank were included in the new GWAS analyses. The PRS was evaluated in 1516 adults aged 24 to 51 years from the ALSPAC mothers cohort. The PRS had an AUROC of 0.67 (95% CI, 0.65-0.70) for myopia, 0.75 (95% CI, 0.70-0.79) for moderate myopia, and 0.73 (95% CI, 0.66-0.80) for high myopia. Inclusion in the PRS of information associated with genetic predisposition to educational attainment marginally improved the AUROC for myopia (AUROC, 0.674 vs 0.668; P = .02), but not those for moderate and high myopia. Individuals with a PRS in the top 10% were at 6.1-fold higher risk (95% CI, 3.4–10.9) of high myopia. Conclusions and Relevance: A personalized medicine approach may be feasible for detecting very young children at risk of myopia. However, accuracy must improve further to merit uptake in clinical practice; currently, cycloplegic autorefraction remains a better indicator of myopia risk (AUROC, 0.87).PhD studentship grant from the College of Optometrists (Drs Guggenheim and Williams; supporting Mr Mojarrad) entitled Genetic prediction of individuals at-risk for myopia development) and National Institute for Health Research (NIHR) Senior Research Fellowship award SRF-2015-08-005 (Dr Williams). The UK Medical Research Council and Wellcome grant 102215/2/13/2 and the University of Bristol provide core support for the Avon Longitudinal Study of Parents and Children (ALSPAC). A comprehensive list of grants funding is available on the ALSPAC website (http://www.bristol.ac.uk/alspac/external/documents/grant-acknowledgements.pdf). This research was conducted using the UK Biobank Resource (application 17351). The UK Biobank was established by the Wellcome Trust, the UK Medical Research Council, the Department for Health (London, England), the Scottish government (Edinburgh, Scotland), and the Northwest Regional Development Agency (Warrington, England). It also received funding from the Welsh Assembly Government (Cardiff, Wales), the British Heart Foundation, and Diabetes UK

Multi-trait genome-wide association study identifies new loci associated with optic disc parameters

A new avenue of mining published genome-wide association studies includes the joint analysis of related traits. The power of this approach depends on the genetic correlation of traits, which reflects the number of pleiotropic loci, i.e. genetic loci influencing multiple traits. Here, we applied new meta-analyses of optic nerve head (ONH) related traits implicated in primary open-angle glaucoma (POAG); intraocular pressure and central corneal thickness using Haplotype reference consortium imputations. We performed a multi-trait analysis of ONH parameters cup area, disc area and vertical cup-disc ratio. We uncover new variants; rs11158547 in PPP1R36-PLEKHG3 and rs1028727 near SERPINE3 at genome-wide significance that replicate in independent Asian cohorts imputed to 1000 Genomes. At this point, validation of these variants in POAG cohorts is hampered by the high degree of heterogeneity. Our results show that multi-trait analysis is a valid approach to identify novel pleiotropic variants for ONH

Genome-wide association meta-analysis of corneal curvature identifies novel loci and shared genetic influences across axial length and refractive error

Abstract: Corneal curvature, a highly heritable trait, is a key clinical endophenotype for myopia - a major cause of visual impairment and blindness in the world. Here we present a trans-ethnic meta-analysis of corneal curvature GWAS in 44,042 individuals of Caucasian and Asian with replication in 88,218 UK Biobank data. We identified 47 loci (of which 26 are novel), with population-specific signals as well as shared signals across ethnicities. Some identified variants showed precise scaling in corneal curvature and eye elongation (i.e. axial length) to maintain eyes in emmetropia (i.e. HDAC11/FBLN2 rs2630445, RBP3 rs11204213); others exhibited association with myopia with little pleiotropic effects on eye elongation. Implicated genes are involved in extracellular matrix organization, developmental process for body and eye, connective tissue cartilage and glycosylation protein activities. Our study provides insights into population-specific novel genes for corneal curvature, and their pleiotropic effect in regulating eye size or conferring susceptibility to myopia

Multi-trait genome-wide association study identifies new loci associated with optic disc parameters.

Funder: All funders per study are acknowledged in the Supplementary FileA new avenue of mining published genome-wide association studies includes the joint analysis of related traits. The power of this approach depends on the genetic correlation of traits, which reflects the number of pleiotropic loci, i.e. genetic loci influencing multiple traits. Here, we applied new meta-analyses of optic nerve head (ONH) related traits implicated in primary open-angle glaucoma (POAG); intraocular pressure and central corneal thickness using Haplotype reference consortium imputations. We performed a multi-trait analysis of ONH parameters cup area, disc area and vertical cup-disc ratio. We uncover new variants; rs11158547 in PPP1R36-PLEKHG3 and rs1028727 near SERPINE3 at genome-wide significance that replicate in independent Asian cohorts imputed to 1000 Genomes. At this point, validation of these variants in POAG cohorts is hampered by the high degree of heterogeneity. Our results show that multi-trait analysis is a valid approach to identify novel pleiotropic variants for ONH

A new polygenic score for refractive error improves detection of children at risk of high myopia but not the prediction of those at risk of myopic macular degeneration

Background High myopia (HM), defined as a spherical equivalent refractive error (SER) ≤ −6.00 diopters (D), is a leading cause of sight impairment, through myopic macular degeneration (MMD). We aimed to derive an improved polygenic score (PGS) for predicting children at risk of HM and to test if a PGS is predictive of MMD after accounting for SER. Methods The PGS was derived from genome-wide association studies in participants of UK Biobank, CREAM Consortium, and Genetic Epidemiology Research on Adult Health and Aging. MMD severity was quantified by a deep learning algorithm. Prediction of HM was quantified as the area under the receiver operating curve (AUROC). Prediction of severe MMD was assessed by logistic regression. Findings In independent samples of European, African, South Asian and East Asian ancestry, the PGS explained 19% (95% confidence interval 17–21%), 2% (1–3%), 8% (7–10%) and 6% (3–9%) of the variation in SER, respectively. The AUROC for HM in these samples was 0.78 (0.75–0.81), 0.58 (0.53–0.64), 0.71 (0.69–0.74) and 0.67 (0.62–0.72), respectively. The PGS was not associated with the risk of MMD after accounting for SER: OR = 1.07 (0.92–1.24). Interpretation Performance of the PGS approached the level required for clinical utility in Europeans but not in other ancestries. A PGS for refractive error was not predictive of MMD risk once SER was accounted fo

Descemet stripping automated endothelial keratoplasty after failed penetrating keratoplasty: survival, rejection risk, and visual outcome.

IMPORTANCE Descemet stripping automated endothelial keratoplasty (DSAEK) for isolated endothelial dysfunction has become the preferred surgical option for many corneal surgeons. However, there are limited large-scale reports on DSAEK survival and clinical variables affecting the risk of rejection and failure after failed penetrating keratoplasty (PK). OBJECTIVE To report the survival, risk factors for graft rejection and failure, and visual outcome of DSAEK after failed PK. DESIGN, SETTING, AND PARTICIPANTS A multicenter retrospective interventional case series included patients recruited from 6 tertiary referral surgical centers: 3 in the United States, 2 in Europe, and 1 in Asia. A total of 246 consecutive eyes (246 patients) that underwent DSAEK after failed PK, with a minimum follow-up period of 1 month, was included. Data comprising demographic details, preoperative and postoperative risk factors, time to rejection, time to failure, and corrected distance visual acuity were collected. MAIN OUTCOMES AND MEASURES Cumulative probability of graft survival, hazard ratio estimates for survival, and corrected distance visual acuity were determined. RESULTS The mean (SD) recipient age was 63.2 (16.6) years and the median follow-up period was 17 months (interquartile range, 6-30 months). One-third of the grafts (n = 82) had follow-up data for more than 2 years; 18.3% had more than 1 failed PK before DSAEK. In total, 19.1% (47 of 246) of DSAEK grafts failed. The cumulative probability of DSAEK survival after a failed PK was 0.89 (95% CI, 0.84-0.92), 0.74 (95% CI, 0.64-0.81), and 0.47 (95% CI, 0.29-0.61) at 1 year, 3 years, and 5 years, respectively. Based on multivariate analysis, significant preoperative risk factors for failure were young recipient age (hazard ratio [HR], 5.18 [95% CI, 1.57-17.18]), previous tube filtration surgery (HR, 5.23 [95% CI, 1.47-7.33]), and rejection episodes before PK failure (HR, 3.28 [95% CI, 1.47-7.33]); single-surgeon centers had a protective effect. Any rejection episode prior to PK failure was a significant predictor of post-DSAEK rejection, which in turn was a significant predictor of DSAEK failure. After a median follow-up of 17 months, 33.3% of the grafts achieved 0.3 or greater logMAR (20/40) corrected distance visual acuity. CONCLUSIONS AND RELEVANCE Descemet stripping automated endothelial keratoplasty after failed PK combines greater wound stability and reduced suture-related complications, with visual outcomes and graft survival rates comparable to those of a second PK