8 research outputs found

    An observational study to assess if automated diabetic retinopathy image assessment software can replace one or more steps of manual imaging grading and to determine their cost-effectiveness.

    Get PDF
    BACKGROUND: Diabetic retinopathy screening in England involves labour-intensive manual grading of retinal images. Automated retinal image analysis systems (ARIASs) may offer an alternative to manual grading. OBJECTIVES: To determine the screening performance and cost-effectiveness of ARIASs to replace level 1 human graders or pre-screen with ARIASs in the NHS diabetic eye screening programme (DESP). To examine technical issues associated with implementation. DESIGN: Observational retrospective measurement comparison study with a real-time evaluation of technical issues and a decision-analytic model to evaluate cost-effectiveness. SETTING: A NHS DESP. PARTICIPANTS: Consecutive diabetic patients who attended a routine annual NHS DESP visit. INTERVENTIONS: Retinal images were manually graded and processed by three ARIASs: iGradingM (version 1.1; originally Medalytix Group Ltd, Manchester, UK, but purchased by Digital Healthcare, Cambridge, UK, at the initiation of the study, purchased in turn by EMIS Health, Leeds, UK, after conclusion of the study), Retmarker (version 0.8.2, Retmarker Ltd, Coimbra, Portugal) and EyeArt (Eyenuk Inc., Woodland Hills, CA, USA). The final manual grade was used as the reference standard. Arbitration on a subset of discrepancies between manual grading and the use of an ARIAS by a reading centre masked to all grading was used to create a reference standard manual grade modified by arbitration. MAIN OUTCOME MEASURES: Screening performance (sensitivity, specificity, false-positive rate and likelihood ratios) and diagnostic accuracy [95% confidence intervals (CIs)] of ARIASs. A secondary analysis explored the influence of camera type and patients' ethnicity, age and sex on screening performance. Economic analysis estimated the cost per appropriate screening outcome identified. RESULTS: A total of 20,258 patients with 102,856 images were entered into the study. The sensitivity point estimates of the ARIASs were as follows: EyeArt 94.7% (95% CI 94.2% to 95.2%) for any retinopathy, 93.8% (95% CI 92.9% to 94.6%) for referable retinopathy and 99.6% (95% CI 97.0% to 99.9%) for proliferative retinopathy; and Retmarker 73.0% (95% CI 72.0% to 74.0%) for any retinopathy, 85.0% (95% CI 83.6% to 86.2%) for referable retinopathy and 97.9% (95% CI 94.9 to 99.1%) for proliferative retinopathy. iGradingM classified all images as either 'disease' or 'ungradable', limiting further iGradingM analysis. The sensitivity and false-positive rates for EyeArt were not affected by ethnicity, sex or camera type but sensitivity declined marginally with increasing patient age. The screening performance of Retmarker appeared to vary with patient's age, ethnicity and camera type. Both EyeArt and Retmarker were cost saving relative to manual grading either as a replacement for level 1 human grading or used prior to level 1 human grading, although the latter was less cost-effective. A threshold analysis testing the highest ARIAS cost per patient before which ARIASs became more expensive per appropriate outcome than human grading, when used to replace level 1 grader, was Retmarker £3.82 and EyeArt £2.71 per patient. LIMITATIONS: The non-randomised study design limited the health economic analysis but the same retinal images were processed by all ARIASs in this measurement comparison study. CONCLUSIONS: Retmarker and EyeArt achieved acceptable sensitivity for referable retinopathy and false-positive rates (compared with human graders as reference standard) and appear to be cost-effective alternatives to a purely manual grading approach. Future work is required to develop technical specifications to optimise deployment and address potential governance issues. FUNDING: The National Institute for Health Research (NIHR) Health Technology Assessment programme, a Fight for Sight Grant (Hirsch grant award) and the Department of Health's NIHR Biomedical Research Centre for Ophthalmology at Moorfields Eye Hospital and the University College London Institute of Ophthalmology

    Effectiveness and acceptability of parental financial incentives and quasi-mandatory schemes for increasing uptake of vaccinations in preschool children: systematic review, qualitative study and discrete choice experiment

    Get PDF
    Uptake of preschool vaccinations is less than optimal. Financial incentives and quasi-mandatory policies (restricting access to child care or educational settings to fully vaccinated children) have been used to increase uptake internationally, but not in the UK

    Testing innovative strategies to reduce the social gradient in the uptake of bowel cancer screening: a programme of four qualitatively enhanced randomised controlled trial

    Get PDF
    Background: Bowel cancer screening reduces cancer-specific mortality. There is a socioeconomic gradient in the uptake of the English NHS Bowel Cancer Screening Programme (BCSP), which may lead to inequalities in cancer outcomes. Objective: To reduce socioeconomic inequalities in uptake of the NHS BCSP’s guaiac faecal occult blood test (gFOBt) without compromising uptake in any socioeconomic group. Design: Workstream 1 explored psychosocial determinants of non-uptake of gFOBt in focus groups and interviews. Workstream 2 developed and tested four theoretically based interventions: (1) ‘gist’ information, (2) a ‘narrative’ leaflet, (3) ‘general practice endorsement’ (GPE) and (4) an ‘enhanced reminder’ (ER). Workstream 3 comprised four national cluster randomised controlled trials (RCTs) of the cost-effectiveness of each intervention. Methods: Interventions were co-designed with user panels, user tested using interviews and focus groups, and piloted with postal questionnaires. RCTs compared ‘usual care’ (existing NHS BCSP invitations) with usual care plus each intervention. The four trials tested: (1) ‘gist’ leaflet (n = 163,525), (2) ‘narrative’ leaflet (n = 150,417), (3) GPE on the invitation letter (n = 265,434) and (4) ER (n = 168,480). Randomisation was based on day of mailing of the screening invitation. The Index of Multiple Deprivation (IMD) score associated with each individual’s home address was used as the marker of socioeconomic circumstances (SECs). Change in the socioeconomic gradient in uptake (interaction between treatment group and IMD quintile) was the primary outcome. Screening uptake was defined as the return of a gFOBt kit within 18 weeks of the invitation that led to a ‘definitive’ test result of either ‘normal’ (i.e. no further investigation required) or ‘abnormal’ (i.e. requiring referral for further testing). Difference in overall uptake was the secondary outcome. Results: The gist and narrative trials showed no effect on the SECs gradient or overall uptake (57.6% and 56.7%, respectively, compared with 57.3% and 58.5%, respectively, for usual care; all p-values > 0.05). GPE showed no effect on the gradient (p = 0.5) but increased overall uptake [58.2% vs. 57.5% in usual care, odds ratio (OR) = 1.07, 95% confidence interval (CI) 1.04 to 1.10; p < 0.0001]. ER showed a significant interaction with SECs (p = 0.005), with a stronger effect in the most deprived IMD quintile (14.1% vs. 13.3% in usual care, OR = 1.11, 95% CI 1.04 to 1.20; p = 0.003) than the least deprived (34.7% vs. 34.9% in usual care OR = 1.00, 95% CI 0.94 to 1.06; p = 0.98), and higher overall uptake (25.8% vs. 25.1% in usual care, OR = 1.07, 95% CI 1.03 to 1.11; p = 0.001). All interventions were inexpensive to provide. Limitations: In line with NHS policy, the gist and narrative leaflets supplemented rather than replaced existing NHS BCSP information. This may have undermined their effect. Conclusions: Enhanced reminder reduced the gradient and modestly increased overall uptake, whereas GPE increased overall uptake but did not reduce the gradient. Therefore, given their effectiveness and very low cost, the findings suggest that implementation of both by the NHS BCSP would be beneficial. The gist and narrative results highlight the challenge of achieving equitable delivery of the screening offer when all communication is written; the format is universal and informed decision-making mandates extensive medical information. Future work: Socioculturally tailored research to promote communication about screening with family and friends should be developed and evaluated. Trial registration: Current Controlled Trials ISRCTN74121020. Funding: This project was funded by the National Institute for Health Research (NIHR) Programme Grants for Applied Research programme and will be published in full in Programme Grants for Applied Research; Vol. 5, No. 8. See the NIHR Journals Library website for further project information

    Provision of Information about newborn screening antenatally:a sequential exploratory mixed methods project

    No full text
    Background: Participation in the UK Newborn Bloodspot Screening Programme (NBSP) requires parental consent but concerns exist about whether or not this happens in practice and the best methods and timing to obtain consent at reasonable cost. Objectives: To collate all possible modes of prescreening communication and consent for newborn (neonatal) screening (NBS); examine midwives’, screening professionals’ and users’ views about the feasibility, efficiency and impact on understanding of each; measure midwives’ and parents’ preferences for information provision; and identify key drivers of cost-effectiveness for alternative modes of information provision. Design: Six study designs were used: (1) realist review – to generate alternative communication and consent models; (2) qualitative interviews with parents and health professionals – to examine the implications of current practice for understanding and views on alternative models; (3) survey and observation of midwives – to establish current costs; (4) stated preference surveys with midwives, parents and potential future parents – to establish preferences for information provision; (5) economic analysis – to identify cost-effectiveness drivers of alternative models; and (6) stakeholder validation focus groups and interviews – to examine the acceptability, views and broader impact of alternative communication and consent models. Setting: Providers and users of NBS in England. Participants: Study 2: 45 parents and 37 health professionals; study 3: 22 midwives and eight observations; study 4: 705 adults aged 18–45 years and 134 midwives; and study 6: 12 health-care professionals and five parents. Results: The realist review identified low parental knowledge and evidence of coercive consent practices. Interview, focus group and stated preference data suggested a preference for full information, with some valuing this more than choice. Health professionals preferred informed choice models but parents and health professionals queried whether or not current consent was fully informed. Barriers to using leaflets effectively were highlighted. All studies indicated that a ‘personalised’ approach to NBS communication, allowing parents to select the mode and level of information suited to their learning needs, could have added value. A personalised approach should rely on midwife communication and should occur in the third trimester. Overall awareness was identified as requiring improvement. Starting NBS communication by alerting parents that they have a choice to make and telling them that samples could be stored are both likely to enhance engagement. The methods of information provision and maternal anxiety causing additional visits to health-care professionals were the drivers of relative cost-effectiveness. Lack of data to populate an economic analysis, confirmed by value of information analysis, indicated a need for further research. Limitations: There are some limitations with regard to the range of participants used in studies 2 and 3 and so caution should be exercised when interpreting some of the results. Conclusions: This project highlighted the importance of focusing on information receipt and identified key communication barriers. Health professionals strongly preferred informed consent, which parents endorsed if they were made aware of sample storage. Uniform models of information provision were perceived as ineffective. A choice of information provision was supported by health professionals and parents, which both enhances cost-effectiveness and improves engagement, understanding and the validity of consent. Remaining uncertainties suggest that more research is needed before new communication modes are introduced into practice. Future research should measure the impact of the suggested practice changes (informing in third trimester, information toolkits, changed role of midwife). Trial registration: Current Controlled Trials ISRCTN70227207. Funding: This project was funded by the NIHR Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 21, No. 55. See the NIHR Journals Library website for further project information
    corecore