Retest variability and patient reliability indices of quantitative fundus autofluorescence in age-related macular degeneration: a MACUSTAR study report

This study aimed to determine the retest variability of quantitative fundus autofluorescence (QAF) in patients with and without age-related macular degeneration (AMD) and evaluate the predictive value of patient reliability indices on retest reliability. A total of 132 eyes from 68 patients were examined, including healthy individuals and those with various stages of AMD. Duplicate QAF imaging was conducted at baseline and 2 weeks later across six study sites. Intraclass correlation (ICC) analysis was used to evaluate the consistency of imaging, and mean opinion scores (MOS) of image quality were generated by two researchers. The contribution of MOS and other factors to retest variation was assessed using mixed-effect linear models. Additionally, a Random Forest Regressor was trained to evaluate the extent to which manual image grading of image quality could be replaced by automated assessment (inferred MOS). The results showed that ICC values were high for all QAF images, with slightly lower values in AMD-affected eyes. The average inter-day ICC was found to be 0.77 for QAF segments within the QAF8 ring and 0.74 for peripheral segments. Image quality was predicted with a mean absolute error of 0.27 on a 5-point scale, and of all evaluated reliability indices, MOS/inferred MOS proved most important. The findings suggest that QAF allows for reliable testing of autofluorescence levels at the posterior pole in patients with AMD in a multicenter, multioperator setting. Patient reliability indices could serve as eligibility criteria for clinical trials, helping identify patients with adequate retest reliability

Test-Retest Variability and Discriminatory Power of Measurements From Microperimetry and Dark Adaptation Assessment in People With Intermediate Age-Related Macular Degeneration – A MACUSTAR Study Report

Purpose: The purpose of this study was to assess test-retest variability and discriminatory power of measures from macular integrity assessment (S-MAIA) and AdaptDx. // Methods: This is a cross-sectional study of 167 people with intermediate age-related macular degeneration (iAMD), no AMD (controls; n = 54), early AMD (n = 28), and late AMD (n = 41), recruited across 18 European ophthalmology centers. Repeat measures of mesopic and scotopic S-MAIA average (mean) threshold (MMAT decibels [dB] and SMAT [dB]) and rod intercept time (RIT [mins]) at 2 visits 14 (±7) days apart were recorded. Repeat measures were assessed by Bland-Altman analysis, intra-class correlation coefficients (ICCs) and variability ratios. Secondary analysis assessed the area under the receiver operating characteristic curves (AUC) to determine the ability to distinguish people as having no AMD, early AMD, or iAMD. // Results: Data were available for 128, 131, and 103 iAMD participants for the mesopic and scotopic S-MAIA and AdaptDx, respectively. MMAT and SMAT demonstrate similar test-retest variability in iAMD (95% confidence interval [CI] ICC of 0.79–0.89 and 0.78–0.89, respectively). ICCs were worse in RIT (95% CI ICC = 0.55–0.77). All tests had equivalent AUCs (approximately 70%) distinguishing between subjects with iAMD and controls, whereas early AMD was indistinguishable from iAMD on all measures (AUC = <55%). A learning effect was not seen in these assessments under the operating procedures used. // Conclusions: MMAT, SMAT, and RIT have adequate test-retest variability and are all moderately good at separating people with iAMD from controls. // Translational Relevance: Expected levels of test-retest variability and discriminatory power of the AdaptDx and MAIA devices in a clinical study setting must be considered when designing future trials for people with AMD

Relative ellipsoid zone reflectivity and its association with disease severity in age-related macular degeneration: a MACUSTAR study report

Quantification of the relative ellipsoid zone reflectivity (rEZR) might be a structural surrogate parameter for an early disease progression in the context of age-related macular degeneration (AMD). Within the European multicenter, cross-sectional MACUSTAR study, we have devised an automatic approach to determine the mean rEZR [arbitrary units, AU] at two independent visits in SD-OCT volume scans in study participants. Linear mixed-effects models were applied to analyze the association of AMD stage and AMD associated high-risk features including presence of pigmentary abnormalities, reticular pseudodrusen (RPD), volume of the retinal-pigment-epithelial-drusenoid-complex (RPEDC) with the rEZR. Intra-class correlation coefficients (ICC) were determined for rEZR reliability analysis. Within the overall study cohort (301 participants), we could observe decreased rEZR values (coefficient estimate ± standard error) of - 8.05 ± 2.44 AU (p = 0.0011) in the intermediate and of - 22.35 ± 3.28 AU (p < 0.0001) in the late AMD group. RPD presence was significantly associated with the rEZR in iAMD eyes (- 6.49 ± 3.14 AU; p = 0.0403), while there was a good ICC of 0.846 (95% confidence interval: 0.809; 0.876) in the overall study cohort. This study showed an association of rEZR with increasing disease severity and the presence of iAMD high-risk features. Further studies are necessary to evaluate the rEZR's value as a novel biomarker for AMD and disease progression

Disease-specific assessment of Vision Impairment in Low Luminance (VILL) in age-related macular degeneration – a MACUSTAR study report

Background/Aims: To further validate the Vision Impairment in Low Luminance (VILL) questionnaire, which captures visual functioning and vision-related quality of life under low luminance, low contrast conditions relevant to age-related macular degeneration (AMD). Methods: The VILL was translated from German into English (UK), Danish, Dutch, French, Italian and Portuguese. Rasch analysis was used to assess psychometric characteristics of 716 participants (65% female, mean age 72±7 years, 82% intermediate AMD) from the baseline visit of the MACUSTAR study. In a sub-set of participants (n=301), test-retest reliability (intra-class correlation coefficient, ICC; coefficient of repeatability, CoR) and construct validity were assessed. Results: Four items were removed from the VILL-37 due to misfit. The resulting VILL-33 has three subscales with no disordered thresholds and no misfitting items. No differential item functioning and no multidimensionality were observed. Person reliability and person separation index were 0.91 and 3.27 for the reading subscale (VILL-R), 0.87 and 2.58 for the mobility subscale (VILL-M) and 0.78 and 1.90 for the emotional subscale (VILL-E). ICC and CoR were 0.92 and 1.9 for VILL-R, 0.93 and 1.8 for VILL-M and 0.82 and 5.0 for VILL-E. Reported visionrelated quality of life decreased with advanced AMD stage (p<0.0001) and was lower in the intermediate AMD group than in the no AMD group (p≤0.0053). Conclusion: The VILL is a psychometrically sound patient-reported outcome instrument and the results further support its reliability and validity across all AMD stages. We recommend the shortened version of the questionnaire with three subscales (VILL-33) for future use. Trial registration number NCT03349801

Clinical study protocol for a low-interventional study in intermediate age-related macular degeneration developing novel clinical endpoints for interventional clinical trials with a regulatory and patient access intention-MACUSTAR.

BACKGROUND: There is an unmet need for treatment options in intermediate age-related macular degeneration (iAMD). However, for any new interventions to be tested in clinical trials, novel currently unavailable clinical endpoints need to be developed. Thus, the MACUSTAR study aims to develop and evaluate functional, structural, and patient-reported candidate endpoints for use in future iAMD trials. METHODS: The protocol describes a low-interventional clinical multicenter study employing a novel two-part design. The cross-sectional part (total duration, 1 month) and the longitudinal part (total duration, 36 months) include participants with iAMD and control groups with early/late/no AMD. The cross-sectional part's primary objective is a technical evaluation of functional, structural, and patient-reported candidate outcomes. The longitudinal part's primary objective is to assess the prognostic power of changes in functional, structural, and patient-reported outcomes for progression from iAMD to late AMD. All data will be used to support a biomarker qualification procedure by regulatory authorities. DISCUSSION: The MACUSTAR study characterizes and evaluates much needed novel functional, structural, and patient-reported endpoints for future clinical trials in iAMD and will improve our understanding of the natural history and prognostic markers of this condition. TRIAL REGISTRATION: ClinicalTrials.gov NCT03349801 . Registered on 22 November 2017

Comparability of automated drusen volume measurements in age-related macular degeneration: a MACUSTAR study report

Drusen are hallmarks of early and intermediate age-related macular degeneration (AMD) but their quantification remains a challenge. We compared automated drusen volume measurements between different OCT devices. We included 380 eyes from 200 individuals with bilateral intermediate (iAMD, n = 126), early (eAMD, n = 25) or no AMD (n = 49) from the MACUSTAR study. We assessed OCT scans from Cirrus (200 × 200 macular cube, 6 × 6 mm; Zeiss Meditec, CA) and Spectralis (20° × 20°, 25 B-scans; 30° × 25°, 241 B-scans; Heidelberg Engineering, Germany) devices. Sensitivity and specificity for drusen detection and differences between modalities were assessed with intra-class correlation coefficients (ICCs) and mean difference in a 5 mm diameter fovea-centered circle. Specificity was > 90% in the three modalities. In eAMD, we observed highest sensitivity in the denser Spectralis scan (68.1). The two different Spectralis modalities showed a significantly higher agreement in quantifying drusen volume in iAMD (ICC 0.993 [0.991-0.994]) than the dense Spectralis with Cirrus scan (ICC 0.807 [0.757-0.847]). Formulae for drusen volume conversion in iAMD between the two devices are provided. Automated drusen volume measures are not interchangeable between devices and softwares and need to be interpreted with the used imaging devices and software in mind. Accounting for systematic difference between methods increases comparability and conversion formulae are provided. Less dense scans did not affect drusen volume measurements in iAMD but decreased sensitivity for medium drusen in eAMD

Challenges, facilitators and barriers to screening study participants in early disease stages-experience from the MACUSTAR study

BACKGROUND: Recruiting asymptomatic participants with early disease stages into studies is challenging and only little is known about facilitators and barriers to screening and recruitment of study participants. Thus we assessed factors associated with screening rates in the MACUSTAR study, a multi-centre, low-interventional cohort study of early stages of age-related macular degeneration (AMD). METHODS: Screening rates per clinical site and per week were compiled and applicable recruitment factors were assigned to respective time periods. A generalized linear mixed-effects model including the most relevant recruitment factors identified via in-depth interviews with study personnel was fitted to the screening data. Only participants with intermediate AMD were considered. RESULTS: A total of 766 individual screenings within 87 weeks were available for analysis. The mean screening rate was 0.6 ± 0.9 screenings per week among all sites. The participation at investigator teleconferences (relative risk increase 1.466, 95% CI [1.018-2.112]), public holidays (relative risk decrease 0.466, 95% CI [0.367-0.591]) and reaching 80% of the site's recruitment target (relative risk decrease 0.699, 95% CI [0.367-0.591]) were associated with the number of screenings at an individual site level. CONCLUSIONS: Careful planning of screening activities is necessary when recruiting early disease stages in multi-centre observational or low-interventional studies. Conducting teleconferences with local investigators can increase screening rates. When planning recruitment, seasonal and saturation effects at clinical site level need to be taken into account. TRIAL REGISTRATION: ClinicalTrials.gov NCT03349801 . Registered on 22 November 2017

Characteristics and Spatial Distribution of Structural Features in Age-Related Macular Degeneration: A MACUSTAR Study Report

PURPOSE: To report the prevalence and topographic distribution of structural characteristics in study participants with age-related macular degeneration (AMD) and controls in the cross-sectional study part of the MACUSTAR study (ClinicalTrials.gov Identifier: NCT03349801). DESIGN: European, multicenter cohort study. SUBJECTS: Overall, 301 eyes of 301 subjects with early (n = 34), intermediate (n = 168), and late AMD (n = 43), as well as eyes without any AMD features (n = 56). METHODS: In study eyes with intermediate AMD (iAMD), the presence of structural AMD biomarkers, including pigmentary abnormalities (PAs), pigment epithelium detachment (PED), refractile deposits, reticular pseudodrusen (RPD), hyperreflective foci (HRF), incomplete/complete retinal pigment epithelium (RPE), and outer retinal atrophy (i/cRORA), and quiescent choroidal neovascularization (qCNV) was systematically determined in the prospectively acquired multimodal retinal imaging cross-sectional data set of MACUSTAR. Retinal layer thicknesses and the RPE drusen complex (RPEDC) volume were determined for the total study cohort in spectral-domain (SD) OCT imaging using a deep-learning-based algorithm. MAIN OUTCOME MEASURES: Prevalence and topographic distribution of structural iAMD features. RESULTS: A total of 301 study eyes of 301 subjects with a mean (± standard deviation) age of 71.2 ± 7.20 years (63.1% women) were included. Besides large drusen, the most prevalent structural feature in iAMD study eyes were PA (57.1%), followed by HRF (51.8%) and RPD (22.0%). Pigment epithelium detachment lesions were observed in 4.8%, vitelliform lesions in 4.2%, refractile deposits in 3.0%, and qCNV in 2.4%. Direct precursor lesions for manifest retinal atrophy were detected in 10.7% (iRORA) and 4.2% (cRORA) in iAMD eyes. Overall, the highest RPEDC volume with a median of 98.92 × 10-4 mm³ was found in iAMD study eyes. Spatial analysis demonstrated a predominant distribution of RPD in the superior and temporal subfields at a foveal eccentricity of 1.5 to 2 mm, whereas HRF and large drusen had a distinct topographic distribution involving the foveal center. CONCLUSIONS: Detailed knowledge of the prevalence and distribution of structural iAMD biomarkers is vital to identify reliable outcome measure for disease progression. Longitudinal analyses are needed to evaluate their prognostic value for conversion to advanced disease stages. FINANCIAL DISCLOSURE(S): Proprietary or commercial disclosure may be found after the references

Test-Retest Variability and Discriminatory Power of Measurements From Microperimetry and Dark Adaptation Assessment in People With Intermediate Age-Related Macular Degeneration - A MACUSTAR Study Report.

PURPOSE: The purpose of this study was to assess test-retest variability and discriminatory power of measures from macular integrity assessment (S-MAIA) and AdaptDx. METHODS: This is a cross-sectional study of 167 people with intermediate age-related macular degeneration (iAMD), no AMD (controls; n = 54), early AMD (n = 28), and late AMD (n = 41), recruited across 18 European ophthalmology centers. Repeat measures of mesopic and scotopic S-MAIA average (mean) threshold (MMAT decibels [dB] and SMAT [dB]) and rod intercept time (RIT [mins]) at 2 visits 14 (±7) days apart were recorded. Repeat measures were assessed by Bland-Altman analysis, intra-class correlation coefficients (ICCs) and variability ratios. Secondary analysis assessed the area under the receiver operating characteristic curves (AUC) to determine the ability to distinguish people as having no AMD, early AMD, or iAMD. RESULTS: Data were available for 128, 131, and 103 iAMD participants for the mesopic and scotopic S-MAIA and AdaptDx, respectively. MMAT and SMAT demonstrate similar test-retest variability in iAMD (95% confidence interval [CI] ICC of 0.79-0.89 and 0.78-0.89, respectively). ICCs were worse in RIT (95% CI ICC = 0.55-0.77). All tests had equivalent AUCs (approximately 70%) distinguishing between subjects with iAMD and controls, whereas early AMD was indistinguishable from iAMD on all measures (AUC = <55%). A learning effect was not seen in these assessments under the operating procedures used. CONCLUSIONS: MMAT, SMAT, and RIT have adequate test-retest variability and are all moderately good at separating people with iAMD from controls. TRANSLATIONAL RELEVANCE: Expected levels of test-retest variability and discriminatory power of the AdaptDx and MAIA devices in a clinical study setting must be considered when designing future trials for people with AMD

Retest variability and patient reliability indices of quantitative fundus autofluorescence in age-related macular degeneration: a MACUSTAR study report

Abstract This study aimed to determine the retest variability of quantitative fundus autofluorescence (QAF) in patients with and without age-related macular degeneration (AMD) and evaluate the predictive value of patient reliability indices on retest reliability. A total of 132 eyes from 68 patients were examined, including healthy individuals and those with various stages of AMD. Duplicate QAF imaging was conducted at baseline and 2 weeks later across six study sites. Intraclass correlation (ICC) analysis was used to evaluate the consistency of imaging, and mean opinion scores (MOS) of image quality were generated by two researchers. The contribution of MOS and other factors to retest variation was assessed using mixed-effect linear models. Additionally, a Random Forest Regressor was trained to evaluate the extent to which manual image grading of image quality could be replaced by automated assessment (inferred MOS). The results showed that ICC values were high for all QAF images, with slightly lower values in AMD-affected eyes. The average inter-day ICC was found to be 0.77 for QAF segments within the QAF8 ring and 0.74 for peripheral segments. Image quality was predicted with a mean absolute error of 0.27 on a 5-point scale, and of all evaluated reliability indices, MOS/inferred MOS proved most important. The findings suggest that QAF allows for reliable testing of autofluorescence levels at the posterior pole in patients with AMD in a multicenter, multioperator setting. Patient reliability indices could serve as eligibility criteria for clinical trials, helping identify patients with adequate retest reliability