Use of expert knowledge in evaluating costs and benefits of alternative service provisions: A case study

Objectives: A treatment pathway model was developed to examine the costs and benefits of the current bowel cancer service in England and to evaluate potential alternatives in service provision. To use the pathway model, various parameters and probability distributions had to be specified. They could not all be determined from empirical evidence and, instead, expert opinion was elicited in the form of statistical quantities that gave the required information. The purpose of this study is to describe the procedures used to quantify expert opinion and note examples of good practice contained in the case study. Methods: The required information was identified and preparatory discussion with four experts refined the questions they would be asked. In individual elicitation sessions they quantified their opinions, mainly in the form of point and interval estimates for specified variables. New methods have been developed for quantifying expert opinion and these were implemented in specialized software that uses interactive graphics. This software was used to elicit opinion about quantities related to measurable covariates. Results: Assessments for thirty-four quantities were elicited and available checks supported their validity. Eight points of good practice in eliciting and using expert judgment were evident. Parameters and probability distributions needed for the pathway model were determined from the elicited assessments. Simulation results from the pathway model were used to inform policy on bowel cancer service provision. Conclusions: The study illustrates that quantifying and using expert judgment can be acceptable in real problems of practical importance. For full benefit to be gained from expert knowledge, elicitation must be conducted carefully and should be reported in detail

Infliximab, adalimumab and golimumab for treating moderately to severely active ulcerative colitis after the failure of conventional therapy (including a review of TA140 and TA262): clinical effectiveness systematic review and economic model.

BACKGROUND: Ulcerative colitis (UC) is the most common form of inflammatory bowel disease in the UK. UC can have a considerable impact on patients' quality of life. The burden for the NHS is substantial. OBJECTIVES: To evaluate the clinical effectiveness and safety of interventions, to evaluate the incremental cost-effectiveness of all interventions and comparators (including medical and surgical options), to estimate the expected net budget impact of each intervention, and to identify key research priorities. DATA SOURCES: Peer-reviewed publications, European Public Assessment Reports and manufacturers' submissions. The following databases were searched from inception to December 2013 for clinical effectiveness searches and from inception to January 2014 for cost-effectiveness searches for published and unpublished research evidence: MEDLINE, EMBASE, Cumulative Index to Nursing and Allied Health Literature, The Cochrane Library including the Cochrane Systematic Reviews Database, Cochrane Controlled Trials Register, Database of Abstracts of Reviews of Effects, the Health Technology Assessment database and NHS Economic Evaluation Database; ISI Web of Science, including Science Citation Index, and the Conference Proceedings Citation Index-Science and Bioscience Information Service Previews. The US Food and Drug Administration website and the European Medicines Agency website were also searched, as were research registers, conference proceedings and key journals. REVIEW METHODS: A systematic review [including network meta-analysis (NMA)] was conducted to evaluate the clinical effectiveness and safety of named interventions. The health economic analysis included a review of published economic evaluations and the development of a de novo model. RESULTS: Ten randomised controlled trials were included in the systematic review. The trials suggest that adult patients receiving infliximab (IFX) [Remicade(®), Merck Sharp & Dohme Ltd (MSD)], adalimumab (ADA) (Humira(®), AbbVie) or golimumab (GOL) (Simponi(®), MSD) were more likely to achieve clinical response and remission than those receiving placebo (PBO). Hospitalisation data were limited, but suggested more favourable outcomes for ADA- and IFX-treated patients. Data on the use of surgical intervention were sparse, with a potential benefit for intervention-treated patients. Data were available from one trial to support the use of IFX in paediatric patients. Safety issues identified included serious infections, malignancies and administration site reactions. Based on the NMA, in the induction phase, all biological treatments were associated with statistically significant beneficial effects relative to PBO, with the greatest effect associated with IFX. For patients in response following induction, all treatments except ADA and GOL 100 mg at 32-52 weeks were associated with beneficial effects when compared with PBO, although these were not significant. The greatest effects at 8-32 and 32-52 weeks were associated with 100 mg of GOL and 5 mg/kg of IFX, respectively. For patients in remission following induction, all treatments except ADA at 8-32 weeks and GOL 50 mg at 32-52 weeks were associated with beneficial effects when compared with PBO, although only the effect of ADA at 32-52 weeks was significant. The greatest effects were associated with GOL (at 8-32 weeks) and ADA (at 32-52 weeks). The economic analysis suggests that colectomy is expected to dominate drug therapies, but for some patients, colectomy may not be considered acceptable. In circumstances in which only drug options are considered, IFX and GOL are expected to be ruled out because of dominance, while the incremental cost-effectiveness ratio for ADA versus conventional treatment is approximately £50,300 per QALY gained. LIMITATIONS: The health economic model is subject to several limitations: uncertainty associated with extrapolating trial data over a lifetime horizon, the model does not consider explicit sequential pathways of non-biological treatments, and evidence relating to complications of colectomy was identified through consideration of approaches used within previous models rather than a full systematic review. CONCLUSIONS: Adult patients receiving IFX, ADA or GOL were more likely to achieve clinical response and remission than those receiving PBO. Further data are required to conclusively demonstrate the effect of interventions on hospitalisation and surgical outcomes. The economic analysis indicates that colectomy is expected to dominate medical treatments for moderate to severe UC. STUDY REGISTRATION: This study is registered as PROSPERO CRD42013006883. FUNDING: The National Institute for Health Research Health Technology Assessment programme

The multiple sclerosis risk sharing scheme monitoring study - early results and lessons for the future

Background: Risk sharing schemes represent an innovative and important approach to the problems of rationing and achieving cost-effectiveness in high cost or controversial health interventions. This study aimed to assess the feasibility of risk sharing schemes, looking at long term clinical outcomes, to determine the price at which high cost treatments would be acceptable to the NHS. Methods: This case study of the first NHS risk sharing scheme, a long term prospective cohort study of beta interferon and glatiramer acetate in multiple sclerosis ( MS) patients in 71 specialist MS centres in UK NHS hospitals, recruited adults with relapsing forms of MS, meeting Association of British Neurologists (ABN) criteria for disease modifying therapy. Outcome measures were: success of recruitment and follow up over the first three years, analysis of baseline and initial follow up data and the prospect of estimating the long term cost-effectiveness of these treatments. Results: Centres consented 5560 patients. Of the 4240 patients who had been in the study for a least one year, annual review data were available for 3730 (88.0%). Of the patients who had been in the study for at least two years and three years, subsequent annual review data were available for 2055 (78.5%) and 265 (71.8%) patients respectively. Baseline characteristics and a small but statistically significant progression of disease were similar to those reported in previous pivotal studies. Conclusion: Successful recruitment, follow up and early data analysis suggest that risk sharing schemes should be able to deliver their objectives. However, important issues of analysis, and political and commercial conflicts of interest still need to be addressed

Cost-effectiveness analysis of 3-D computerized tomography colonography versus optical colonoscopy for imaging symptomatic gastroenterology patients.

BACKGROUND: When symptomatic gastroenterology patients have an indication for colonic imaging, clinicians have a choice between optical colonoscopy (OC) and computerized tomography colonography with three-dimensional reconstruction (3-D CTC). 3-D CTC provides a minimally invasive and rapid evaluation of the entire colon, and it can be an efficient modality for diagnosing symptoms. It allows for a more targeted use of OC, which is associated with a higher risk of major adverse events and higher procedural costs. A case can be made for 3-D CTC as a primary test for colonic imaging followed if necessary by targeted therapeutic OC; however, the relative long-term costs and benefits of introducing 3-D CTC as a first-line investigation are unknown. AIM: The aim of this study was to assess the cost effectiveness of 3-D CTC versus OC for colonic imaging of symptomatic gastroenterology patients in the UK NHS. METHODS: We used a Markov model to follow a cohort of 100,000 symptomatic gastroenterology patients, aged 50 years or older, and estimate the expected lifetime outcomes, life years (LYs) and quality-adjusted life years (QALYs), and costs (£, 2010-2011) associated with 3-D CTC and OC. Sensitivity analyses were performed to assess the robustness of the base-case cost-effectiveness results to variation in input parameters and methodological assumptions. RESULTS: 3D-CTC provided a similar number of LYs (7.737 vs 7.739) and QALYs (7.013 vs 7.018) per individual compared with OC, and it was associated with substantially lower mean costs per patient (£467 vs £583), leading to a positive incremental net benefit. After accounting for the overall uncertainty, the probability of 3-D CTC being cost effective was around 60 %, at typical willingness-to-pay values of £20,000-£30,000 per QALY gained. CONCLUSION: 3-D CTC is a cost-saving and cost-effective option for colonic imaging of symptomatic gastroenterology patients compared with OC

Statistical methods for adjusting estimates of treatment effectiveness for patient nonadherence in the context of time-to-event outcomes and health technology assessment: A systematic review of methodological papers

Introduction. Medication nonadherence can have a significant negative impact on treatment effectiveness. Standard intention-to-treat analyses conducted alongside clinical trials do not make adjustments for nonadherence. Several methods have been developed that attempt to estimate what treatment effectiveness would have been in the absence of nonadherence. However, health technology assessment (HTA) needs to consider effectiveness under real-world conditions, where nonadherence levels typically differ from those observed in trials. With this analytical requirement in mind, we conducted a review to identify methods for adjusting estimates of treatment effectiveness in the presence of patient nonadherence to assess their suitability for use in HTA. Methods. A “Comprehensive Pearl Growing” technique, with citation searching and reference checking, was applied across 7 electronic databases to identify methodological papers for adjusting time-to-event outcomes for nonadherence using individual patient data. A narrative synthesis of identified methods was conducted. Methods were assessed in terms of their ability to reestimate effectiveness based on alternative, suboptimal adherence levels. Results. Twenty relevant methodological papers covering 12 methods and 8 extensions to those methods were identified. Methods are broadly classified into 4 groups: 1) simple methods, 2) principal stratification methods, 3) generalized methods (g-methods), and 4) pharmacometrics-based methods using pharmacokinetics and pharmacodynamics (PKPD) analysis. Each method makes specific assumptions and has associated limitations. Five of the 12 methods are capable of adjusting for real-world nonadherence, with only g-methods and PKPD considered appropriate for HTA. Conclusion. A range of statistical methods is available for adjusting estimates of treatment effectiveness for nonadherence, but most are not suitable for use in HTA. G-methods and PKPD appear to be more appropriate to estimate effectiveness in the presence of real-world adherence

Assessing methods for dealing with treatment switching in randomised controlled trials: a simulation study

<p>Abstract</p> <p>Background</p> <p>We investigate methods used to analyse the results of clinical trials with survival outcomes in which some patients switch from their allocated treatment to another trial treatment. These included simple methods which are commonly used in medical literature and may be subject to selection bias if patients switching are not typical of the population as a whole. Methods which attempt to adjust the estimated treatment effect, either through adjustment to the hazard ratio or via accelerated failure time models, were also considered. A simulation study was conducted to assess the performance of each method in a number of different scenarios.</p> <p>Results</p> <p>16 different scenarios were identified which differed by the proportion of patients switching, underlying prognosis of switchers and the size of true treatment effect. 1000 datasets were simulated for each of these and all methods applied. Selection bias was observed in simple methods when the difference in survival between switchers and non-switchers were large. A number of methods, particularly the AFT method of Branson and Whitehead were found to give less biased estimates of the true treatment effect in these situations.</p> <p>Conclusions</p> <p>Simple methods are often not appropriate to deal with treatment switching. Alternative approaches such as the Branson & Whitehead method to adjust for switching should be considered.</p

Multiple-frequency bioimpedance devices for fluid management in people with chronic kidney disease receiving dialysis : a systematic review and economic evaluation

The National Institute for Health Research Health Technology Assessment programme. Acknowledgements The authors are grateful to Lara Kemp for her secretarial support. The authors would also like to thank the members of the specialist committee assembled to support this assessment: Dr Andrew Davenport (Royal Free Hospital, London), Dr Simon Roe (Nottingham University Hospitals NHS Trust), Dr Elizabeth Lindley (St James’s University Hospital), Dr Wesley Hayes (Great Ormond Street Hospital), Ms Joanne Prince (Central Manchester University Hospitals NHS Foundation Trust), Mr Nick McAleer (Royal Devon & Exeter NHS Foundation Trust), Dr Kay Tyerman (Leeds General Infirmary), Dr Graham Woodrow (St James’s University Hospital) and Mr Paul Taylor (lay specialist committee member). The Health Services Research Unit, Health Economics Research Unit and Institute of Applied Health Sciences, University of Aberdeen are all core funded by the Chief Scientist Office of the Scottish Government Health DirectoratesPeer reviewedPublisher PD

Using resource modelling to inform decision making and service planning: the case of colorectal cancer screening in Ireland

Background - Organised colorectal cancer screening is likely to be cost-effective, but cost-effectiveness results alone may not help policy makers to make decisions about programme feasibility or service providers to plan programme delivery. For these purposes, estimates of the impact on the health services of actually introducing screening in the target population would be helpful. However, these types of analyses are rarely reported. As an illustration of such an approach, we estimated annual health service resource requirements and health outcomes over the first decade of a population-based colorectal cancer screening programme in Ireland. Methods - A Markov state-transition model of colorectal neoplasia natural history was used. Three core screening scenarios were considered: (a) flexible sigmoidoscopy (FSIG) once at age 60, (b) biennial guaiac-based faecal occult blood tests (gFOBT) at 55–74 years, and (c) biennial faecal immunochemical tests (FIT) at 55–74 years. Three alternative FIT roll-out scenarios were also investigated relating to age-restricted screening (55–64 years) and staggered age-based roll-out across the 55–74 age group. Parameter estimates were derived from literature review, existing screening programmes, and expert opinion. Results were expressed in relation to the 2008 population (4.4 million people, of whom 700,800 were aged 55–74). Results - FIT-based screening would deliver the greatest health benefits, averting 164 colorectal cancer cases and 272 deaths in year 10 of the programme. Capacity would be required for 11,095-14,820 diagnostic and surveillance colonoscopies annually, compared to 381–1,053 with FSIG-based, and 967–1,300 with gFOBT-based, screening. With FIT, in year 10, these colonoscopies would result in 62 hospital admissions for abdominal bleeding, 27 bowel perforations and one death. Resource requirements for pathology, diagnostic radiology, radiotherapy and colorectal resection were highest for FIT. Estimates depended on screening uptake. Alternative FIT roll-out scenarios had lower resource requirements. Conclusions - While FIT-based screening would quite quickly generate attractive health outcomes, it has heavy resource requirements. These could impact on the feasibility of a programme based on this screening modality. Staggered age-based roll-out would allow time to increase endoscopy capacity to meet programme requirements. Resource modelling of this type complements conventional cost-effectiveness analyses and can help inform policy making and service planning