Assessing the construct validity and responsiveness of Preference Based Measures (PBMs) in cataract surgery patients

Purpose The validity and responsiveness of the EQ-5D-3L in visual conditions has been questioned, inspiring development of a vision ‘bolt-on’ domain (EQ-5D-3L + VIS). Developments in preference-based measures (PBM) also includes the EQ-5D-5L and the ICECAP-O capability wellbeing measure. This study aimed to examine the construct validity and responsiveness of the EQ-5D-3L, EQ-5D-5L, EQ-5D-3L + VIS and ICECAP-O in cataract surgery patients for the first time, to inform choice of PBM for economic evaluation in this population. Methods The analyses used data from the UK Predict-CAT cataract surgery cohort study. PBMs and the Cat-PROM5 [a validated measure of cataract quality of life (QOL)] were completed before surgery and 4–8 weeks after. Construct validity was assessed using correlations and known-group differences evaluated using regression. Responsiveness was evaluated using effect sizes and analysis of variance to compare change scores between groups, defined by patient-reported and clinical outcomes. Results The sample comprised 1315 patients at baseline. No PBMs were associated with visual acuity and only the ICECAP-O (Spearman’s rs =  − 0.35), EQ-5D-3L + VIS (rs =  − 0.42) and EQ-5D-5L (Value Set for England rs =  − 0.31) correlated at least moderately with the Cat-PROM5. Effect sizes of change were consistently largest for the EQ-5D-3L + VIS (range 0.34–0.41), followed by the ICECAP-O (range 0.20–0.34). Results indicated no improvement in responsiveness using the EQ-5D-5L (range 0.13–0.16) compared to the EQ-5D-3L (range 0.17–0.20). Conclusions Whilst no PBMs comprehensively demonstrated evidence of construct validity and responsiveness in cataract surgery patients, the ICECAP-O was the most responsive generic PBM to improvements in QOL. Surprisingly the EQ-5D-5L was not more responsive than the EQ-5D-3L in this setting

Developing decision support tools incorporating personalised predictions of likely visual benefit versus harm for cataract surgery:research programme

Background Surgery for established cataract is highly cost-effective and uncontroversial, yet uncertainty remains for individuals about when to proceed and when to delay surgery during the earlier stages of cataract. Objective We aimed to improve decision-making for cataract surgery through the development of evidence-based clinical tools that provide general information and personalised risk/benefit information. Design We used a mixed methodology consisting of four work packages. Work package 1 involved the development and psychometric validation of a brief, patient self-reported measure of visual difficulty from cataract and its relief from surgery, named Cataract Patient-Reported Outcome Measure, five items (Cat-PROM5). Work package 2 involved the review and refinement of risk models for adverse surgical events (posterior capsule rupture and visual acuity loss related to cataract surgery). Work package 3 involved the development of prediction models for the Cat-PROM5-based self-reported outcomes from a cohort study of 1500 patients; assessment of the validity of preference-based health economic indices for cataract surgery and the calibration of these to Cat-PROM5; assessment of patients’ and health-care professionals’ views on risk–benefit presentation formats, the perceived usefulness of Cat-PROM5, the value of personalised risk–benefit information, high-value information items and shared decision-making; development of cataract decision aid frequently asked questions, incorporation of personalised estimates of risks and benefits; and development of a cataract decision quality measure to assess the quality of decision-making. Work package 4 involved a mixed-methods feasibility study for a fully powered randomised controlled trial of the use of the cataract decision aid and a qualitative study of discordant or mismatching perceptions of outcome between patients and health-care professionals. Setting Four English NHS recruitment centres were involved: Bristol (lead centre), Brighton, Gloucestershire and Torbay. Multicentre NHS cataract surgery data were obtained from the National Ophthalmology Database. Participants Work package 1 – participants (n = 822) were from all four centres. Work package 2 – electronic medical record data were taken from the National Ophthalmology Database (final set > 1M operations). Work package 3 – cohort study participants were from Bristol (n = 1200) and Gloucestershire (n = 300); qualitative and development work was undertaken with patients and health-care professionals from all four centres. Work package 4 – Bristol, Brighton and Torbay participated in the recruitment of patients (n = 42) for the feasibility trial and recruitment of health-care professionals for the qualitative elements. Interventions For the feasibility trial, the intervention was the use of the cataract decision aid, incorporating frequently asked questions and personalised estimations of both adverse outcomes and self-reported benefit. Main outcome measures There was a range of quantitative and qualitative outcome measures: questionnaire psychometric performance metrics, risk indicators of adverse surgical events and visual outcome, predictors of self-reported outcome following cataract surgery, patient and health-care practitioner views, health economic calibration measures and randomised controlled trial feasibility measures. Data sources The data sources were patient self-reported questionnaire responses, study clinical data collection forms, recorded interviews with patients and health-care professionals, and anonymised National Ophthalmology Database data. Results Work package 1 – Cat-PROM5 was developed and validated with excellent to good psychometric properties (Rasch reliability 0.9, intraclass correlation repeatability 0.9, unidimensionality with residual eigenvalues ≤ 1.5) and excellent responsiveness to surgical intervention (Cohen delta –1.45). Work package 2 – earlier risk models for posterior capsule rupture and visual acuity loss were broadly affirmed (C-statistic for posterior capsule rupture 0.64; visual acuity loss 0.71). Work package 3 – the Cat-PROM5-based self-reported outcome regression models were derived based on 1181 participants with complete data (R2 ≈ 30% for each). Of the four preference-based health economic indices assessed, two demonstrated reasonable performance. Cat-PROM5 was successfully calibrated to health economic indices; adjusted limited dependent variable mixture models offered good to excellent fit (root-mean-square error 0.10–0.16). The personalised quantitative risk information was generally perceived as beneficial. A cataract decision aid and cataract decision quality measure were successfully developed based on the views of patients and health-care professionals. Work package 4 – data completeness was good for the feasibility study primary and secondary variables both before and after intervention/surgery (data completeness range 100–88%). Considering ability to recruit, the sample size required, instrumentation and availability of necessary health economic data, a fully powered randomised controlled trial (patients, n = 800, effect size 0.2 standard deviations, power 80%; p = 0.05) of the cataract decision aid would be feasible following psychometric refinement of the primary outcome (the cataract decision quality measure). The cataract decision aid was generally well-received by patients and health-care professionals, with cautions raised regarding perceived time and workload barriers. Discordant outcomes mostly related to patient dissatisfaction, with no clinical problem found. Limitations The National Ophthalmology Database data are expected to include some errors (mitigated by large multicentre data aggregations). The feasibility randomised controlled trial primary outcome (the cataract decision quality measure) displayed psychometric imperfections requiring refinement. The clinical occurrence of discordant outcomes is uncommon and the study team experienced difficulty identifying patients in this situation. Future work Future work could include regular review of the risk models for adverse outcomes to ensure currency, and the technical precision of complex-numbers analysis of refractive outcome to invite opportunities to improve post-operative spectacle-free vision. In addition, a fully powered randomised controlled trial of the cataract decision aid would be feasible, following psychometric refinement of the primary outcome (the cataract decision quality measure); this would clarify its potential role in routine service delivery. Conclusions In this research programme, evidence-based clinical tools have been successfully developed to improve pre-operative decision-making in cataract surgery. These include a psychometrically robust, patient-reported outcome measure (Cat-PROM5); prediction models for patient self-reported outcomes using Cat-PROM5; prediction models for clinically adverse surgical events and adverse visual acuity outcomes; and a cataract decision aid with relevant general information and personalised risk/benefit predictions. In addition, the successful mapping of Cat-PROM5 to existing health economic indices was achieved and the performances of indices were assessed in patients undergoing cataract surgery. A future full-powered randomised controlled trial of the cataract decision aid would be feasible (patients, n = 800, effect size 0.2 standard deviations, power 80%; p = 0.05). Trial registration This trial is registered as ISRCTN11309852. Funding This project was funded by the National Institute for Health and Care Research (NIHR) Programme Grants for Applied Research programme and will be published in full in Programme Grants for Applied Research; Vol. 10, No. 9. See the NIHR Journals Library website for further project information

Evaluating an enhanced quality improvement intervention in maternity units: PReCePT trial protocol

The UK’s National Institute for Health and Care Excellence Preterm labour and birth guideline recommends use of magnesium sulfate (MgSO4) in deliveries below 30 weeks’ gestation to prevent cerebral palsy and other neurological problems associated with preterm delivery. Despite national guidance, the uptake of MgSO4 administration in eligible women has been slow. National Health Service England has rolled out the PReCePT (PRevention of Cerebral Palsy in Pre-Term labour) quality improvement (QI) toolkit to increase uptake of MgSO4 in preterm deliveries. The toolkit is designed to increase maternity staff knowledge about MgSO4 and provides training and practical tools to help staff consider use in eligible women. The PReCePT trial compares the effectiveness of two different methods of implementing the QI toolkit (standard versus enhanced support). The standard support arm (control) receives the QI toolkit and regional-level support for a midwife/obstetric ‘champion’. The enhanced support arm (intervention) receives this plus additional clinical backfill funding and unit-level QI microcoaching. It is funded by The Health Foundation. This is a cluster randomised controlled trial designed to include 48 maternity units randomised (2:1 ratio) to standard or enhanced support. Units are eligible for inclusion if they have 10 or more preterm (<30 weeks’ gestation) deliveries annually and MgSO4 uptake of 70% or less. Randomisation is stratified by previous level of MgSO4 uptake. The QI intervention is implemented over 9 months. All units are followed up for a further 9 months. Blinding is not possible due to the nature of the intervention. The primary outcome is the proportion of MgSO4 uptake among eligible women at follow-up, adjusting for uptake before implementation of the toolkit. The effectiveness of the intervention will be assessed using weighted linear regression on data from the National Neonatal Research Database. Semistructured qualitative staff interviews will inform understanding of the process and outcomes. Economic evaluation will describe total costs and cost-effectiveness.Trial registration number SRCTN 40938673

Utnyttjande av UML för utveckling av dataprogram för småsågare

OBJECTIVES: Kawasaki disease (KD) is an increasingly common vasculitis with risk of coronary artery aneurysms (CAAs). The last UK survey was in 1990, whereas current epidemiology, treatment patterns and complication rates are unknown. The aim of this study was to address this knowledge gap. METHODS: A British Paediatric Surveillance Unit survey in the UK and Ireland from 1 January 2013 to 28 February 2015 ascertained demographics, ethnicity, seasonal incidence, treatment and complication rates. RESULTS: 553 cases were notified: 389 had complete KD, 46 had atypical KD and 116 had incomplete KD; 2 were diagnosed at postmortem with an incidence of 4.55/100 000 children under 5 years, with a male to female ratio of 1.5:1 and a median age of 2.7 years (2.5 months–15 years). Presentation was highest in January and in rural areas. Most were white (64%), and Chinese and Japanese Asians were over-represented as were black African or African mixed-race children. 94% received intravenous immunoglobulin (IVIG). The overall CAA rate was 19%, and all-cardiac complications affected 28%. Those with CAA received IVIG later than in those without (median 10 days vs 7 days). Those under 1 year had fewer symptoms, but the highest CAA rate (39%). Overall 8 of 512 cases (1.6%) had giant CAA, and 4 of 86 cases (5%) under 1 year of age developed giant CAA. Mortality from KD was 0.36%. CONCLUSIONS: The UK and Ireland incidence of KD has increased and is more frequently seen in winter and rural areas. Delayed IVIG treatment is associated with CAA, suggesting earlier and adjunctive primary treatment might reduce complications to prevent CAA, particularly in the very young

Primary Care implementation of Germ Defence, a digital behaviour change intervention to improve household infection control during the COVID-19 pandemic: A structured summary of a study protocol for a randomised controlled trial

ObjectivesTo examine the effectiveness of randomising dissemination of the Germ Defence behaviour change website via GP practices across England UK.Trial designA two-arm (1:1 ratio) cluster randomised controlled trial implementing Germ Defence via GP practices compared with usual care.ParticipantsSetting: All Primary care GP practices in England. Participants: All patients aged 16 years and over who were granted access by participating GP practices.Intervention and comparatorIntervention: We will ask staff at GP practices randomised to the intervention arm to share the weblink to Germ Defence with all adult patients registered at their practice during the 4-month trial implementation period and care will otherwise follow current standard management. Germ Defence is an interactive website (http://GermDefence.org/) employing behaviour change techniques and practical advice on how to reduce the spread of infection in the home. The coronavirus version of Germ Defence helps people understand what measures to take and when to take them to avoid infection. This includes hand washing, avoiding sharing rooms and surfaces, dealing with deliveries and ventilating rooms. Using behaviour change techniques, it helps users think through and adopt better home hygiene habits and find ways to solve any barriers, providing personalised goal setting and tailored advice that fits users’ personal circumstances and problem solving to overcome barriers.Comparator: Patients at GP practices randomised to the usual care arm will receive current standard management for the 4-month trial period after which we will ask staff to share the link to Germ Defence with all adult patients registered at their practice.Main outcomesThe primary outcome is the effects of implementing Germ Defence on prevalence of all respiratory tract infection diagnoses during the 4-month trial implementation period.The secondary outcomes are:1) incidence of COVID-19 diagnoses2) incidence of COVID-19 symptom presentation3) incidence of gastrointestinal infections4) number of primary care consultations5) antibiotic usage6) hospital admissions7) uptake of GP practices disseminating Germ Defence to their patients8) usage of the Germ Defence website by individuals who were granted access by their GP practiceRandomisationGP practices will be randomised on a 1:1 basis by the independent Bristol Randomised Trials Collaboration (BRTC). Clinical Commission Groups (CCGs) in England will be divided into blocks according to region, and equal numbers in each block will be randomly allocated to intervention or usual care. The randomisation schedule will be generated in Stata statistical software by a statistician not otherwise involved in the enrolment of general practices into the study.Blinding (masking)The principal investigators, the statistician and study collaborators will remain blinded from the identity of randomised practices until the end of the study.Numbers to be randomised (sample size)To detect planned effect size (based on PRIMIT trial, Little et al, 2015): 11.1 million respondents from 6822 active GP practices. Assuming 25% of these GP practices will engage, we will contact all GP practices in England spread across 135 Clinical Commissioning Groups.Trial statusProtocol version 2.0, dated 13 January 2021. Implementation is ongoing. The implementation period started on 10 November 2020 and will end on 10 March 2021.Trial registrationThis trial was registered in the ISRCTN registry (isrctn.com/ISRCTN14602359) on 12 August 2020.Full protocolThe full protocol is attached as an additional file, accessible from the Trials website (Additional file 1). In the interest in expediting dissemination of this material, the familiar formatting has been eliminated; this Letter serves as a summary of the key elements of the full protocol

Developing decision support tools incorporating personalised predictions of likely visual benefit versus harm for cataract surgery: research programme

Background Surgery for established cataract is highly cost-effective and uncontroversial, yet uncertainty remains for individuals about when to proceed and when to delay surgery during the earlier stages of cataract. Objective We aimed to improve decision-making for cataract surgery through the development of evidence-based clinical tools that provide general information and personalised risk/benefit information. Design We used a mixed methodology consisting of four work packages. Work package 1 involved the development and psychometric validation of a brief, patient self-reported measure of visual difficulty from cataract and its relief from surgery, named Cataract Patient-Reported Outcome Measure, five items (Cat-PROM5). Work package 2 involved the review and refinement of risk models for adverse surgical events (posterior capsule rupture and visual acuity loss related to cataract surgery). Work package 3 involved the development of prediction models for the Cat-PROM5-based self-reported outcomes from a cohort study of 1500 patients; assessment of the validity of preference-based health economic indices for cataract surgery and the calibration of these to Cat-PROM5; assessment of patients’ and health-care professionals’ views on risk–benefit presentation formats, the perceived usefulness of Cat-PROM5, the value of personalised risk–benefit information, high-value information items and shared decision-making; development of cataract decision aid frequently asked questions, incorporation of personalised estimates of risks and benefits; and development of a cataract decision quality measure to assess the quality of decision-making. Work package 4 involved a mixed-methods feasibility study for a fully powered randomised controlled trial of the use of the cataract decision aid and a qualitative study of discordant or mismatching perceptions of outcome between patients and health-care professionals. Setting Four English NHS recruitment centres were involved: Bristol (lead centre), Brighton, Gloucestershire and Torbay. Multicentre NHS cataract surgery data were obtained from the National Ophthalmology Database. Participants Work package 1 – participants (n = 822) were from all four centres. Work package 2 – electronic medical record data were taken from the National Ophthalmology Database (final set > 1M operations). Work package 3 – cohort study participants were from Bristol (n = 1200) and Gloucestershire (n = 300); qualitative and development work was undertaken with patients and health-care professionals from all four centres. Work package 4 – Bristol, Brighton and Torbay participated in the recruitment of patients (n = 42) for the feasibility trial and recruitment of health-care professionals for the qualitative elements. Interventions For the feasibility trial, the intervention was the use of the cataract decision aid, incorporating frequently asked questions and personalised estimations of both adverse outcomes and self-reported benefit. Main outcome measures There was a range of quantitative and qualitative outcome measures: questionnaire psychometric performance metrics, risk indicators of adverse surgical events and visual outcome, predictors of self-reported outcome following cataract surgery, patient and health-care practitioner views, health economic calibration measures and randomised controlled trial feasibility measures. Data sources The data sources were patient self-reported questionnaire responses, study clinical data collection forms, recorded interviews with patients and health-care professionals, and anonymised National Ophthalmology Database data. Results Work package 1 – Cat-PROM5 was developed and validated with excellent to good psychometric properties (Rasch reliability 0.9, intraclass correlation repeatability 0.9, unidimensionality with residual eigenvalues ≤ 1.5) and excellent responsiveness to surgical intervention (Cohen delta –1.45). Work package 2 – earlier risk models for posterior capsule rupture and visual acuity loss were broadly affirmed (C-statistic for posterior capsule rupture 0.64; visual acuity loss 0.71). Work package 3 – the Cat-PROM5-based self-reported outcome regression models were derived based on 1181 participants with complete data (R2 ≈ 30% for each). Of the four preference-based health economic indices assessed, two demonstrated reasonable performance. Cat-PROM5 was successfully calibrated to health economic indices; adjusted limited dependent variable mixture models offered good to excellent fit (root-mean-square error 0.10–0.16). The personalised quantitative risk information was generally perceived as beneficial. A cataract decision aid and cataract decision quality measure were successfully developed based on the views of patients and health-care professionals. Work package 4 – data completeness was good for the feasibility study primary and secondary variables both before and after intervention/surgery (data completeness range 100–88%). Considering ability to recruit, the sample size required, instrumentation and availability of necessary health economic data, a fully powered randomised controlled trial (patients, n = 800, effect size 0.2 standard deviations, power 80%; p = 0.05) of the cataract decision aid would be feasible following psychometric refinement of the primary outcome (the cataract decision quality measure). The cataract decision aid was generally well-received by patients and health-care professionals, with cautions raised regarding perceived time and workload barriers. Discordant outcomes mostly related to patient dissatisfaction, with no clinical problem found. Limitations The National Ophthalmology Database data are expected to include some errors (mitigated by large multicentre data aggregations). The feasibility randomised controlled trial primary outcome (the cataract decision quality measure) displayed psychometric imperfections requiring refinement. The clinical occurrence of discordant outcomes is uncommon and the study team experienced difficulty identifying patients in this situation. Future work Future work could include regular review of the risk models for adverse outcomes to ensure currency, and the technical precision of complex-numbers analysis of refractive outcome to invite opportunities to improve post-operative spectacle-free vision. In addition, a fully powered randomised controlled trial of the cataract decision aid would be feasible, following psychometric refinement of the primary outcome (the cataract decision quality measure); this would clarify its potential role in routine service delivery. Conclusions In this research programme, evidence-based clinical tools have been successfully developed to improve pre-operative decision-making in cataract surgery. These include a psychometrically robust, patient-reported outcome measure (Cat-PROM5); prediction models for patient self-reported outcomes using Cat-PROM5; prediction models for clinically adverse surgical events and adverse visual acuity outcomes; and a cataract decision aid with relevant general information and personalised risk/benefit predictions. In addition, the successful mapping of Cat-PROM5 to existing health economic indices was achieved and the performances of indices were assessed in patients undergoing cataract surgery. A future full-powered randomised controlled trial of the cataract decision aid would be feasible (patients, n = 800, effect size 0.2 standard deviations, power 80%; p = 0.05)