The Accuracy and Reliability of Crowdsource Annotations of Digital Retinal Images

Purpose: Crowdsourcing is based on outsourcing computationally intensive tasks to numerous individuals in the online community who have no formal training. Our aim was to develop a novel online tool designed to facilitate large-scale annotation of digital retinal images, and to assess the accuracy of crowdsource grading using this tool, comparing it to expert classification. Methods: We used 100 retinal fundus photograph images with predetermined disease criteria selected by two experts from a large cohort study. The Amazon Mechanical Turk Web platform was used to drive traffic to our site so anonymous workers could perform a classification and annotation task of the fundus photographs in our dataset after a short training exercise. Three groups were assessed: masters only, nonmasters only and nonmasters with compulsory training. We calculated the sensitivity, specificity, and area under the curve (AUC) of receiver operating characteristic (ROC) plots for all classifications compared to expert grading, and used the Dice coefficient and consensus threshold to assess annotation accuracy. Results: In total, we received 5389 annotations for 84 images (excluding 16 training images) in 2 weeks. A specificity and sensitivity of 71% (95% confidence interval [CI], 69%-74%) and 87% (95% CI, 86%-88%) was achieved for all classifications. The AUC in this study for all classifications combined was 0.93 (95% CI, 0.91-0.96). For image annotation, a maximal Dice coefficient (~0.6) was achieved with a consensus threshold of 0.25. Conclusions: This study supports the hypothesis that annotation of abnormalities in retinal images by ophthalmologically naive individuals is comparable to expert annotation. The highest AUC and agreement with expert annotation was achieved in the nonmasters with compulsory training group. Translational Relevance: The use of crowdsourcing as a technique for retinal image analysis may be comparable to expert graders and has the potential to deliver timely, accurate, and cost-effective image analysis

Associations with photoreceptor thickness measures in the UK Biobank.

Spectral-domain OCT (SD-OCT) provides high resolution images enabling identification of individual retinal layers. We included 32,923 participants aged 40-69 years old from UK Biobank. Questionnaires, physical examination, and eye examination including SD-OCT imaging were performed. SD OCT measured photoreceptor layer thickness includes photoreceptor layer thickness: inner nuclear layer-retinal pigment epithelium (INL-RPE) and the specific sublayers of the photoreceptor: inner nuclear layer-external limiting membrane (INL-ELM); external limiting membrane-inner segment outer segment (ELM-ISOS); and inner segment outer segment-retinal pigment epithelium (ISOS-RPE). In multivariate regression models, the total average INL-RPE was observed to be thinner in older aged, females, Black ethnicity, smokers, participants with higher systolic blood pressure, more negative refractive error, lower IOPcc and lower corneal hysteresis. The overall INL-ELM, ELM-ISOS and ISOS-RPE thickness was significantly associated with sex and race. Total average of INL-ELM thickness was additionally associated with age and refractive error, while ELM-ISOS was additionally associated with age, smoking status, SBP and refractive error; and ISOS-RPE was additionally associated with smoking status, IOPcc and corneal hysteresis. Hence, we found novel associations of ethnicity, smoking, systolic blood pressure, refraction, IOPcc and corneal hysteresis with photoreceptor thickness

Optical Coherence Tomography in the UK Biobank Study – Rapid Automated Analysis of Retinal Thickness for Large Population-Based Studies

Purpose: To describe an approach to the use of optical coherence tomography (OCT) imaging in large, population-based studies, including methods for OCT image acquisition, storage, and the remote, rapid, automated analysis of retinal thickness. Methods: In UK Biobank, OCT images were acquired between 2009 and 2010 using a commercially available “spectral domain” OCT device (3D OCT-1000, Topcon). Images were obtained using a raster scan protocol, 6 mm x 6 mm in area, and consisting of 128 B-scans. OCT image sets were stored on UK Biobank servers in a central repository, adjacent to high performance computers. Rapid, automated analysis of retinal thickness was performed using custom image segmentation software developed by the Topcon Advanced Biomedical Imaging Laboratory (TABIL). This software employs dual-scale gradient information to allow for automated segmentation of nine intraretinal boundaries in a rapid fashion. Results: 67,321 participants (134,642 eyes) in UK Biobank underwent OCT imaging of both eyes as part of the ocular module. 134,611 images were successfully processed with 31 images failing segmentation analysis due to corrupted OCT files or withdrawal of subject consent for UKBB study participation. Average time taken to call up an image from the database and complete segmentation analysis was approximately 120 seconds per data set per login, and analysis of the entire dataset was completed in approximately 28 days. Conclusions: We report an approach to the rapid, automated measurement of retinal thickness from nearly 140,000 OCT image sets from the UK Biobank. In the near future, these measurements will be publically available for utilization by researchers around the world, and thus for correlation with the wealth of other data collected in UK Biobank. The automated analysis approaches we describe may be of utility for future large population-based epidemiological studies, clinical trials, and screening programs that employ OCT imaging

The Relationship Between Ambient Atmospheric Fine Particulate Matter (PM2.5) and Glaucoma in a Large Community Cohort.

Purpose: Glaucoma is more common in urban populations than in others. Ninety percent of the world's population are exposed to air pollution above World Health Organization (WHO) recommended limits. Few studies have examined the association between air pollution and glaucoma. Methods: Questionnaire data, ophthalmic measures, and ambient residential area air quality data for 111,370 UK Biobank participants were analyzed. Particulate matter with an aerodynamic diameter < 2.5 μm (PM2.5) was selected as the air quality exposure of interest. Eye measures included self-reported glaucoma, intraocular pressure (IOP), and average thickness of macular ganglion cell-inner plexiform layer (GCIPL) across nine Early Treatment Diabetic Retinopathy Study (ETDRS) retinal subfields as obtained from spectral-domain optical coherence tomography. We examined the associations of PM2.5 concentration with self-reported glaucoma, IOP, and GCIPL. Results: Participants resident in areas with higher PM2.5 concentration were more likely to report a diagnosis of glaucoma (odds ratio = 1.06, 95% confidence interval [CI] = 1.01-1.12, per interquartile range [IQR] increase P = 0.02). Higher PM2.5 concentration was also associated with thinner GCIPL (β = -0.56 μm, 95% CI = -0.63 to -0.49, per IQR increase, P = 1.2 × 10-53). A dose-response relationship was observed between higher levels of PM2.5 and thinner GCIPL (P < 0.001). There was no clinically relevant relationship between PM2.5 concentration and IOP. Conclusions: Greater exposure to PM2.5 is associated with both self-reported glaucoma and adverse structural characteristics of the disease. The absence of an association between PM2.5 and IOP suggests the relationship may occur through a non-pressure-dependent mechanism, possibly neurotoxic and/or vascular effects

PLoS One

Age-related macular degeneration (AMD) is a common, progressive multifactorial vision-threatening disease and many genetic and environmental risk factors have been identified. The risk of AMD is influenced by lifestyle and diet, which may be reflected by an altered metabolic profile. Therefore, measurements of metabolites could identify biomarkers for AMD, and could aid in identifying high-risk individuals. Hypothesis-free technologies such as metabolomics have a great potential to uncover biomarkers or pathways that contribute to disease pathophysiology. To date, only a limited number of metabolomic studies have been performed in AMD. Here, we aim to contribute to the discovery of novel biomarkers and metabolic pathways for AMD using a targeted metabolomics approach of 188 metabolites. This study focuses on non-advanced AMD, since there is a need for biomarkers for the early stages of disease before severe visual loss has occurred. Targeted metabolomics was performed in 72 patients with early or intermediate AMD and 72 control individuals, and metabolites predictive for AMD were identified by a sparse partial least squares discriminant analysis. In our cohort, we identified four metabolite variables that were most predictive for early and intermediate stages of AMD. Increased glutamine and phosphatidylcholine diacyl C28:1 levels were detected in non-advanced AMD cases compared to controls, while the rate of glutaminolysis and the glutamine to glutamate ratio were reduced in non-advanced AMD. The association of glutamine with non-advanced AMD corroborates a recent report demonstrating an elevated glutamine level in early AMD using a different metabolomics technique. In conclusion, this study indicates that metabolomics is a suitable method for the discovery of biomarker candidates for AMD. In the future, larger metabolomics studies could add to the discovery of novel biomarkers in yet unknown AMD pathways and expand our insights in AMD pathophysiology

Retinal asymmetry in multiple sclerosis.

The diagnosis of multiple sclerosis is based on a combination of clinical and paraclinical tests. The potential contribution of retinal optical coherence tomography (OCT) has been recognized. We tested the feasibility of OCT measures of retinal asymmetry as a diagnostic test for multiple sclerosis at the community level. In this community-based study of 72 120 subjects, we examined the diagnostic potential of the inter-eye difference of inner retinal OCT data for multiple sclerosis using the UK Biobank data collected at 22 sites between 2007 and 2010. OCT reporting and quality control guidelines were followed. The inter-eye percentage difference (IEPD) and inter-eye absolute difference (IEAD) were calculated for the macular retinal nerve fibre layer (RNFL), ganglion cell inner plexiform layer (GCIPL) complex and ganglion cell complex. Area under the receiver operating characteristic curve (AUROC) comparisons were followed by univariate and multivariable comparisons accounting for a large range of diseases and co-morbidities. Cut-off levels were optimized by ROC and the Youden index. The prevalence of multiple sclerosis was 0.0023 [95% confidence interval (CI) 0.00229-0.00231]. Overall the discriminatory power of diagnosing multiple sclerosis with the IEPD AUROC curve (0.71, 95% CI 0.67-0.76) and IEAD (0.71, 95% CI 0.67-0.75) for the macular GCIPL complex were significantly higher if compared to the macular ganglion cell complex IEPD AUROC curve (0.64, 95% CI 0.59-0.69, P = 0.0017); IEAD AUROC curve (0.63, 95% CI 0.58-0.68, P  0.14) with narrow confidence intervals. In conclusion, the OCT macular GCIPL complex IEPD and IEAD may be considered as supportive measurements for multiple sclerosis diagnostic criteria in a young patient without relevant co-morbidity. The metric does not allow separation of multiple sclerosis from neuromyelitis optica. Retinal OCT imaging is accurate, rapid, non-invasive, widely available and may therefore help to reduce need for invasive and more costly procedures. To be viable, higher sensitivity and specificity levels are needed

Association between polygenic risk score and risk of myopia

YesImportance: Myopia is a leading cause of untreatable visual impairment and is increasing in prevalence worldwide. Interventions for slowing childhood myopia progression have shown success in randomized clinical trials; hence, there is a need to identify which children would benefit most from treatment intervention. Objectives: To examine whether genetic information alone can identify children at risk of myopia development and whether including a child’s genetic predisposition to educational attainment is associated with improved genetic prediction of the risk of myopia. Design, Setting, and Participants: Meta-analysis of 3 genome-wide association studies (GWAS) including a total of 711 984 individuals. These were a published GWAS for educational attainment and 2 GWAS for refractive error in the UK Biobank, which is a multisite cohort study that recruited participants between January 2006 and October 2010. A polygenic risk score was applied in a population-based validation sample examined between September 1998 and September 2000 (Avon Longitudinal Study of Parents and Children [ALSPAC] mothers). Data analysis was performed from February 2018 to May 2019. Main Outcomes and Measures: The primary outcome was the area under the receiver operating characteristic curve (AUROC) in analyses for predicting myopia, using noncycloplegic autorefraction measurements for myopia severity levels of less than or equal to −0.75 diopter (D) (any), less than or equal to -3.00 D (moderate), or less than or equal to −5.00 D (high). The predictor variable was a polygenic risk score (PRS) derived from genome-wide association study data for refractive error (n = 95 619), age of onset of spectacle wear (n = 287 448), and educational attainment (n = 328 917). Results: A total of 383 067 adults aged 40 to 69 years from the UK Biobank were included in the new GWAS analyses. The PRS was evaluated in 1516 adults aged 24 to 51 years from the ALSPAC mothers cohort. The PRS had an AUROC of 0.67 (95% CI, 0.65-0.70) for myopia, 0.75 (95% CI, 0.70-0.79) for moderate myopia, and 0.73 (95% CI, 0.66-0.80) for high myopia. Inclusion in the PRS of information associated with genetic predisposition to educational attainment marginally improved the AUROC for myopia (AUROC, 0.674 vs 0.668; P = .02), but not those for moderate and high myopia. Individuals with a PRS in the top 10% were at 6.1-fold higher risk (95% CI, 3.4–10.9) of high myopia. Conclusions and Relevance: A personalized medicine approach may be feasible for detecting very young children at risk of myopia. However, accuracy must improve further to merit uptake in clinical practice; currently, cycloplegic autorefraction remains a better indicator of myopia risk (AUROC, 0.87).PhD studentship grant from the College of Optometrists (Drs Guggenheim and Williams; supporting Mr Mojarrad) entitled Genetic prediction of individuals at-risk for myopia development) and National Institute for Health Research (NIHR) Senior Research Fellowship award SRF-2015-08-005 (Dr Williams). The UK Medical Research Council and Wellcome grant 102215/2/13/2 and the University of Bristol provide core support for the Avon Longitudinal Study of Parents and Children (ALSPAC). A comprehensive list of grants funding is available on the ALSPAC website (http://www.bristol.ac.uk/alspac/external/documents/grant-acknowledgements.pdf). This research was conducted using the UK Biobank Resource (application 17351). The UK Biobank was established by the Wellcome Trust, the UK Medical Research Council, the Department for Health (London, England), the Scottish government (Edinburgh, Scotland), and the Northwest Regional Development Agency (Warrington, England). It also received funding from the Welsh Assembly Government (Cardiff, Wales), the British Heart Foundation, and Diabetes UK

Prevalence of Age-Related Macular Degeneration in Europe: The Past and the Future

Purpose Age-related macular degeneration (AMD) is a frequent, complex disorder in elderly of European ancestry. Risk profiles and treatment options have changed considerably over the years, which may have affected disease prevalence and outcome. We determined the prevalence of early and late AMD in Europe from 1990 to 2013 using the European Eye Epidemiology (E3) consortium, and made projections for the future. Design Meta-analysis of prevalence data. Participants A total of 42 080 individuals 40 years of age and older participating in 14 population-based cohorts from 10 countries in Europe. Methods AMD was diagnosed based on fundus photographs using the Rotterdam Classification. Prevalence of early and late AMD was calculated using random-effects meta-analysis stratified for age, birth cohort, gender, geographic region, and time period of the study. Best-corrected visual acuity (BCVA) was compared between late AMD subtypes; geographic atrophy (GA) and choroidal neovascularization (CNV). Main Outcome Measures Prevalence of early and late AMD, BCVA, and number of AMD cases. Results Prevalence of early AMD increased from 3.5% (95% confidence interval [CI] 2.1%–5.0%) in those aged 55–59 years to 17.6% (95%

Multi-trait genome-wide association study identifies new loci associated with optic disc parameters.

Funder: All funders per study are acknowledged in the Supplementary FileA new avenue of mining published genome-wide association studies includes the joint analysis of related traits. The power of this approach depends on the genetic correlation of traits, which reflects the number of pleiotropic loci, i.e. genetic loci influencing multiple traits. Here, we applied new meta-analyses of optic nerve head (ONH) related traits implicated in primary open-angle glaucoma (POAG); intraocular pressure and central corneal thickness using Haplotype reference consortium imputations. We performed a multi-trait analysis of ONH parameters cup area, disc area and vertical cup-disc ratio. We uncover new variants; rs11158547 in PPP1R36-PLEKHG3 and rs1028727 near SERPINE3 at genome-wide significance that replicate in independent Asian cohorts imputed to 1000 Genomes. At this point, validation of these variants in POAG cohorts is hampered by the high degree of heterogeneity. Our results show that multi-trait analysis is a valid approach to identify novel pleiotropic variants for ONH