Microscopy Image Segmentation via Point and Shape Regularized Data Synthesis

Current deep learning-based approaches for the segmentation of microscopy images heavily rely on large amount of training data with dense annotation, which is highly costly and laborious in practice. Compared to full annotation where the complete contour of objects is depicted, point annotations, specifically object centroids, are much easier to acquire and still provide crucial information about the objects for subsequent segmentation. In this paper, we assume access to point annotations only during training and develop a unified pipeline for microscopy image segmentation using synthetically generated training data. Our framework includes three stages: (1) it takes point annotations and samples a pseudo dense segmentation mask constrained with shape priors; (2) with an image generative model trained in an unpaired manner, it translates the mask to a realistic microscopy image regularized by object level consistency; (3) the pseudo masks along with the synthetic images then constitute a pairwise dataset for training an ad-hoc segmentation model. On the public MoNuSeg dataset, our synthesis pipeline produces more diverse and realistic images than baseline models while maintaining high coherence between input masks and generated images. When using the identical segmentation backbones, the models trained on our synthetic dataset significantly outperform those trained with pseudo-labels or baseline-generated images. Moreover, our framework achieves comparable results to models trained on authentic microscopy images with dense labels, demonstrating its potential as a reliable and highly efficient alternative to labor-intensive manual pixel-wise annotations in microscopy image segmentation. The code is available.Comment: Accepted by The 3rd MICCAI Workshop on Data Augmentation, Labeling, and Imperfection

Reliability of Retinal Layer Annotation with a Novel, High-Resolution Optical Coherence Tomography Device : A Comparative Study

Optical coherence tomography (OCT) enables in vivo diagnostics of individual retinal layers in the living human eye. However, improved imaging resolution could aid diagnosis and monitoring of retinal diseases and identify potential new imaging biomarkers. The investigational high-resolution OCT platform (High-Res OCT; 853 nm central wavelength, 3 μm axial-resolution) has an improved axial resolution by shifting the central wavelength and increasing the light source band- width compared to a conventional OCT device (880 nm central wavelength, 7 μm axial-resolution). To assess the possible benefit of a higher resolution, we compared the retest reliability of retinal layer annotation from conventional and High-Res OCT, evaluated the use of High-Res OCT in pa- tients with age-related macular degeneration (AMD), and assessed differences of both devices on subjective image quality. Thirty eyes of 30 patients with early/intermediate AMD (iAMD; mean age 75 ± 8 years) and 30 eyes of 30 age-similar subjects without macular changes (62 ± 17 years) underwent identical OCT imaging on both devices. Inter- and intra-reader reliability were analyzed for manual retinal layer annotation using EyeLab. Central OCT B-scans were graded for image quality by two graders and a mean-opinion-score (MOS) was formed and evaluated. Inter- and intra-reader reliability were higher for High-Res OCT (greatest benefit for inter-reader reliability: ganglion cell layer; for intra-reader reliability: retinal nerve fiber layer). High-Res OCT was signifi- cantly associated with an improved MOS (MOS 9/8, Z-value = 5.4, p < 0.01) mainly due to improved subjective resolution (9/7, Z-Value 6.2, p < 0.01). The retinal pigment epithelium drusen complex showed a trend towards improved retest reliability in High-Res OCT in iAMD eyes but without statistical significance. Improved axial resolution of the High-Res OCT benefits retest reliability of retinal layer annotation and improves perceived image quality and resolution. Automated image analysis algorithms could also benefit from the increased image resolution

Autofluorescent granules of the human retinal pigment epithelium: phenotypes, intracellular distribution, and age-related topography

PURPOSE. The human retinal pigment epithelium (RPE) accumulates granules significant for autofluorescence imaging. Knowledge of intracellular accumulation and distribution is limited. Using high-resolution microscopy techniques, we determined the total number of granules per cell, intracellular distribution, and changes related to retinal topography and age. METHODS. RPE cells from the fovea, perifovea, and near-periphery of 15 human RPE flat mounts were imaged using structured illumination microscopy (SIM) and confocal fluorescence microscopy in young (=51 years, n = 8) and older (>80 years, n = 7) donors. Using custom FIJI plugins, granules were marked with computer assistance, classified based on morphological and autofluorescence properties, and analyzed with regard to intracellular distribution, total number per cell, and granule density. RESULTS. A total of 193,096 granules in 450 RPE cell bodies were analyzed. Based on autofluorescence properties, size, and composition, the RPE granules exhibited nine different phenotypes (lipofuscin, two; melanolipofuscin, five; melanosomes, two), distinguishable by SIM. Overall, lipofuscin (low at the fovea but increases with eccentricity and age) and melanolipofuscin (equally distributed at all three locations with no age-related changes) were the major granule types. Melanosomes were under-represented due to suboptimal visualization of apical processes in flat mounts. CONCLUSIONS. Low lipofuscin and high melanolipofuscin content within foveal RPE cell bodies and abundant lipofuscin at the perifovea suggest a different genesis, plausibly related to the population of overlying photoreceptors (fovea, cones only; perifovea, highest rod density). This systematic analysis provides further insight into RPE cell and granule physiology and links granule load to cell autofluorescence, providing a subcellular basis for the interpretation of clinical fundus autofluorescence. © 2020 Association for Research in Vision and Ophthalmology Inc.. All rights reserved

Quantitative Analysis of Outer Retinal Tubulation in Age-Related Macular Degeneration From Spectral-Domain Optical Coherence Tomography and Histology

Purpose: To assess outer retinal tubulation (ORT) morphology from spectral-domain optical coherence tomography (SD-OCT) volumes and donor eye histology, analyze ORT reflectivity, and estimate the number of cones surviving in ORT. Methods: In SD-OCT volumes from nine patients with advanced AMD, ORT was analyzed en face and in B-scans. The hyperreflective ORT border in cross-section was delineated and surface area calculated. Reflectivity was compared between ORT types (Closed, Open, Forming, and Branching). A flatmount retina from a donor with neovascular AMD was labeled to visualize the external limiting membrane that delimits ORT and allow measurements of cross-sectional cone area, center-to-center cone spacing, and cone density. The number of cones surviving in ORT was estimated. Results: By en face SD-OCT, ORT varies in complexity and shape. Outer retinal tubulation networks almost always contain Closed cross-sections. Spectral-domain OCT volumes containing almost exclusively Closed ORTs showed no significant direction-dependent differences in hyperreflective ORT border intensity. The surface areas of partial ORT assessed by SD-OCT volumes ranged from 0.16 to 1.76 mm2. From the flatmount retina, the average cross-sectional area of cone inner segments was 49.1 ± 7.9 μm2. The average cone spacing was 7.5 ± 0.6 μm. Outer retinal tubulation cone density was 20,351 cones/mm2. The estimated number of cones in ORT in a macula ranged from 26,399 to 186,833 cones, which is 6% to 44% of the cones present in a healthy macula. Conclusions: These first estimates for cone density and number of cones surviving in ORT suggest that ORT formation considerably distorts the photoreceptor mosaic. Results provide additional insight into the reflectivity characteristics and number of ORT cones observable in living patients by SD-OCT, as cones persist and disease progresses

Characteristics of normal human retinal pigment epithelium cells with extremes of autofluorescence or intracellular granule count

Background: Cells of the retinal pigment epithelium (RPE) accumulate different kinds of granules (lipofuscin, melanolipofuscin, melanosomes) within their cell bodies, with lipofuscin and melanolipofuscin being autofluorescent after blue light excitation. High amounts of lipofuscin granules within the RPE have been associated with the development of RPE cell death and age-related macular degeneration (AMD); however, this has not been confirmed in histology so far. Here, based on our previous dataset of RPE granule characteristics, we report the characteristics of RPE cells from human donor eyes that show either high or low numbers of intracellular granules or high or low autofluorescence (AF) intensities. Methods: RPE flatmounts of fifteen human donors were examined using high-resolution structured illumination microscopy (HR-SIM) and laser scanning microscopy (LSM). Autofluorescent granules were analyzed regarding AF phenotype and absolute number of granules. In addition, total AF intensity per cell and granule density (number of granules per cell area) were determined. For the final analysis, RPE cells with total granule number below 5th or above the 95th percentile, or a total AF intensity ± 1.5 standard deviations above or below the mean were included, and compared to the average RPE cell at the same location. Data are presented as mean ± standard deviation. Results: Within 420 RPE cells examined, 42 cells were further analyzed due to extremes regarding total granule numbers. In addition, 20 RPE cells had AF 1.5 standard deviations below, 28 RPE cells above the mean local AF intensity. Melanolipofuscin granules predominate in RPE cells with low granule content and low AF intensity. RPE cells with high granule content have nearly twice (1.8 times) as many granules as an average RPE cell. Conclusions: In normal eyes, outliers regarding autofluorescent granule load and AF intensity signals are rare among RPE cells, suggesting that granule deposition and subsequent AF follows intrinsic control mechanisms at a cellular level. The AF of a cell is related to the composition of intracellular granule types. Ongoing studies using AMD donor eyes will examine possible disease related changes in granule distribution and further put lipofuscin´s role in aging and AMD further into perspective

Autofluorescence imaging of human RPE cell granules using structured illumination microscopy

ABSTRACT Background/aims To characterise single autofluorescent (AF) granules in human retinal pigment epithelium (RPE) cells using structured illumination microscopy (SIM). Methods Morphological characteristics and autofluorescence behaviour of lipofuscin (LF) and melanolipofuscin (MLF) granules of macular RPE cells (66-year-old donor) were examined with SIM using three different laser light excitation wavelengths (488, 568 and 647 nm). High-resolution images were reconstructed and exported to Matlab R2009a (The Mathworks Inc, Natick, MA, USA) to determine accurate size and emission intensities of LF and MLF granules. Results SIM doubles lateral resolution compared with conventionally used wide-field microscopy and allows visualisation of intracellular structures down to 110 nm lateral resolution. AF patterns were examined in 133 LF and 27 MLF granules. LF granules (9686220 nm) were significantly smaller in diameter than MLF granules (10976110 nm; p&lt;0.001). LF granules showed an inhomogeneous intragranular pattern, and the average intensity negatively correlated with the size of these granules when excited at 647 nm. The autofluorescence of MLF granules was more homogeneous, but shifted towards higher excitation wavelengths in the centre of the granules. Conclusion SIM is a useful tool for examining AF signals within single LF and MLF granules in RPE cells. This allows new insights into RPE autofluorescence patterns

Spectrally resolved autofluorescence imaging in posterior uveitis.

Clinical discrimination of posterior uveitis entities remains a challenge. This exploratory, cross-sectional study investigated the green (GEFC) and red emission fluorescent components (REFC) of retinal and choroidal lesions in posterior uveitis to facilitate discrimination of the different entities. Eyes were imaged by color fundus photography, spectrally resolved fundus autofluorescence (Color-FAF) and optical coherence tomography. Retinal/choroidal lesions' intensities of GEFC (500-560 nm) and REFC (560-700 nm) were determined, and intensity-normalized Color-FAF images were compared for birdshot chorioretinopathy, ocular sarcoidosis, acute posterior multifocal placoid pigment epitheliopathy (APMPPE), and punctate inner choroidopathy (PIC). Multivariable regression analyses were performed to reveal possible confounders. 76 eyes of 45 patients were included with a total of 845 lesions. Mean GEFC/REFC ratios were 0.82 ± 0.10, 0.92 ± 0.11, 0.86 ± 0.10, and 1.09 ± 0.19 for birdshot chorioretinopathy, sarcoidosis, APMPPE, and PIC lesions, respectively, and were significantly different in repeated measures ANOVA (p < 0.0001). Non-pigmented retinal/choroidal lesions, macular neovascularizations, and fundus areas of choroidal thinning featured predominantly GEFC, and pigmented retinal lesions predominantly REFC. Color-FAF imaging revealed involvement of both, short- and long-wavelength emission fluorophores in posterior uveitis. The GEFC/REFC ratio of retinal and choroidal lesions was significantly different between distinct subgroups. Hence, this novel imaging biomarker could aid diagnosis and differentiation of posterior uveitis entities

Retest variability and patient reliability indices of quantitative fundus autofluorescence in age-related macular degeneration: a MACUSTAR study report

This study aimed to determine the retest variability of quantitative fundus autofluorescence (QAF) in patients with and without age-related macular degeneration (AMD) and evaluate the predictive value of patient reliability indices on retest reliability. A total of 132 eyes from 68 patients were examined, including healthy individuals and those with various stages of AMD. Duplicate QAF imaging was conducted at baseline and 2 weeks later across six study sites. Intraclass correlation (ICC) analysis was used to evaluate the consistency of imaging, and mean opinion scores (MOS) of image quality were generated by two researchers. The contribution of MOS and other factors to retest variation was assessed using mixed-effect linear models. Additionally, a Random Forest Regressor was trained to evaluate the extent to which manual image grading of image quality could be replaced by automated assessment (inferred MOS). The results showed that ICC values were high for all QAF images, with slightly lower values in AMD-affected eyes. The average inter-day ICC was found to be 0.77 for QAF segments within the QAF8 ring and 0.74 for peripheral segments. Image quality was predicted with a mean absolute error of 0.27 on a 5-point scale, and of all evaluated reliability indices, MOS/inferred MOS proved most important. The findings suggest that QAF allows for reliable testing of autofluorescence levels at the posterior pole in patients with AMD in a multicenter, multioperator setting. Patient reliability indices could serve as eligibility criteria for clinical trials, helping identify patients with adequate retest reliability

Retinal Vascular Occlusion after COVID-19 Vaccination : More Coincidence than Causal Relationship? Data from a Retrospective Multicentre Study

Background: To investigate whether vaccination against SARS-CoV-2 is associated with the onset of retinal vascular occlusive disease (RVOD). Methods: In this multicentre study, data from patients with central and branch retinal vein occlusion (CRVO and BRVO), central and branch retinal artery occlusion (CRAO and BRAO), and anterior ischaemic optic neuropathy (AION) were retrospectively collected during a 2-month index period (1 June–31 July 2021) according to a defined protocol. The relation to any previous vaccination was documented for the consecutive case series. Numbers of RVOD and COVID-19 vaccination were investigated in a case-by-case analysis. A case– control study using age- and sex-matched controls from the general population (study participants from the Gutenberg Health Study) and an adjusted conditional logistic regression analysis was conducted. Results: Four hundred and twenty-one subjects presenting during the index period (61 days) were enrolled: one hundred and twenty-one patients with CRVO, seventy-five with BRVO, fifty-six with CRAO, sixty-five with BRAO, and one hundred and four with AION. Three hundred and thirty-two (78.9%) patients had been vaccinated before the onset of RVOD. The vaccines given were BNT162b2/BioNTech/Pfizer (n = 221), followed by ChadOx1/AstraZeneca (n = 57), mRNA1273/Moderna (n = 21), and Ad26.COV2.S/Johnson & Johnson (n = 11; unknown n = 22). Our case–control analysis integrating population-based data from the GHS yielded no evidence of an increased risk after COVID-19 vaccination (OR = 0.93; 95% CI: 0.60–1.45, p = 0.75) in connection with a vaccination within a 4-week window. Conclusions: To date, there has been no evidence of any association between SARS-CoV-2 vaccination and a higher RVOD risk