Uncertainty, evidence and irrecoverable costs: informing approval, pricing and research decisions for health technologies

The general issue of balancing the value of evidence about the performance of a technology and the value of access to a technology can be seen as central to a number of policy questions. Establishing the key principles of what assessments are needed, as well as how they should be made, will enable them to be addressed in an explicit and transparent manner. This report presents the key finding from MRC and NHIR funded research which aimed to: i) Establish the key principles of what assessments are needed to inform an only in research (OIR) or Approval with Research (AWR) recommendation. ii) Evaluate previous NICE guidance where OIR or AWR recommendations were made or considered. iii) Evaluate a range of alternative options to establish the criteria, additional information and/or analysis which could be made available to help the assessment needed to inform an OIR or AWR recommendation. iv) Provide a series of final recommendations, with the involvement of key stakeholders, establishing both the key principles and associated criteria that might guide OIR and AWR recommendations, identifying what, if any, additional information or analysis might be included in the Technology Appraisal process and how such recommendations might be more likely to be implemented through publicly funded and sponsored research. The key principles and the assessments and judgments required are discussed in Section 2. The sequence of assessment and judgment is represented as an algorithm, which can also be summarised as a simple set of explicit criteria or a seven point checklist of assessments. The application of the check list of assessment to a series of four case studies in Section 3 can inform considerations of whether such assessments can be made based on existing information and analysis in current NICE appraisal and in what circumstances could additional information and/or analysis be useful. In Section 4, some of the implications that this more explicit assessment of OIR and AWR might have for policy (e.g., NICE guidance and drug pricing), the process of appraisal (e.g., greater involvement of research commissioners) and methods of appraisal (e.g., should additional information, evidence and analysis be required) are drawn together

Acupuncture for chronic pain and depression in primary care : a programme of research

Abstract Background There has been an increase in the utilisation of acupuncture in recent years, yet the evidence base is insufficiently well established to be certain about its clinical effectiveness and cost-effectiveness. Addressing the questions related to the evidence base will reduce uncertainty and help policy- and decision-makers with regard to whether or not wider access is appropriate and provides value for money. Aim Our aim was to establish the most reliable evidence on the clinical effectiveness and cost-effectiveness of acupuncture for chronic pain by drawing on relevant evidence, including recent high-quality trials, and to develop fresh evidence on acupuncture for depression. To extend the evidence base we synthesised the results of published trials using robust systematic review methodology and conducted a randomised controlled trial (RCT) of acupuncture for depression. Methods and results We synthesised the evidence from high-quality trials of acupuncture for chronic pain, consisting of musculoskeletal pain related to the neck and low back, osteoarthritis of the knee, and headache and migraine, involving nearly 18,000 patients. In an individual patient data (IPD) pairwise meta-analysis, acupuncture was significantly better than both sham acupuncture (p < 0.001) and usual care (p < 0.001) for all conditions. Using network meta-analyses, we compared acupuncture with other physical therapies for osteoarthritis of the knee. In both an analysis of all available evidence and an analysis of a subset of better-quality trials, using aggregate-level data, we found acupuncture to be one of the more effective therapies. We developed new Bayesian methods for analysing multiple individual patient-level data sets to evaluate heterogeneous continuous outcomes. An accompanying cost-effectiveness analysis found transcutaneous electrical nerve stimulation (TENS) to be cost-effective for osteoarthritis at a threshold of £20,000 per quality-adjusted life-year when all trials were synthesised. When the analysis was restricted to trials of higher quality with adequate allocation concealment, acupuncture was cost-effective. In a RCT of acupuncture or counselling compared with usual care for depression, in which half the patients were also experiencing comorbid pain, we found acupuncture and counselling to be clinically effective and acupuncture to be cost-effective. For patients in whom acupuncture is inappropriate or unavailable, counselling is cost-effective. Conclusion We have provided the most robust evidence from high-quality trials on acupuncture for chronic pain. The synthesis of high-quality IPD found that acupuncture was more effective than both usual care and sham acupuncture. Acupuncture is one of the more clinically effective physical therapies for osteoarthritis and is also cost-effective if only high-quality trials are analysed. When all trials are analysed, TENS is cost-effective. Promising clinical and economic evidence on acupuncture for depression needs to be extended to other contexts and settings. For the conditions we have investigated, the drawing together of evidence on acupuncture from this programme of research has substantially reduced levels of uncertainty. We have identified directions for further research. Our research also provides a valuable basis for considering the potential role of acupuncture as a referral option in health care and enabling providers and policy-makers to make decisions based on robust sources of evidence

Optimising the Diagnosis of Prostate Cancer in the Era of Multiparametric Magnetic Resonance Imaging : A Cost-effectiveness Analysis Based on the Prostate MR Imaging Study (PROMIS)

Background The current recommendation of using transrectal ultrasound-guided biopsy (TRUSB) to diagnose prostate cancer misses clinically significant (CS) cancers. More sensitive biopsies (eg, template prostate mapping biopsy [TPMB]) are too resource intensive for routine use, and there is little evidence on multiparametric magnetic resonance imaging (MPMRI). Objective To identify the most effective and cost-effective way of using these tests to detect CS prostate cancer. Design, setting, and participants Cost-effectiveness modelling of health outcomes and costs of men referred to secondary care with a suspicion of prostate cancer prior to any biopsy in the UK National Health Service using information from the diagnostic Prostate MR Imaging Study (PROMIS). Intervention Combinations of MPMRI, TRUSB, and TPMB, using different definitions and diagnostic cut-offs for CS cancer. Outcome measurements and statistical analysis Strategies that detect the most CS cancers given testing costs, and incremental cost-effectiveness ratios (ICERs) in quality-adjusted life years (QALYs) given long-term costs. Results and limitations The use of MPMRI first and then up to two MRI-targeted TRUSBs detects more CS cancers per pound spent than a strategy using TRUSB first (sensitivity = 0.95 [95% confidence interval {CI} 0.92–0.98] vs 0.91 [95% CI 0.86–0.94]) and is cost effective (ICER = £7,076 [€8350/QALY gained]). The limitations stem from the evidence base in the accuracy of MRI-targeted biopsy and the long-term outcomes of men with CS prostate cancer. Conclusions An MPMRI-first strategy is effective and cost effective for the diagnosis of CS prostate cancer. These findings are sensitive to the test costs, sensitivity of MRI-targeted TRUSB, and long-term outcomes of men with cancer, which warrant more empirical research. This analysis can inform the development of clinical guidelines. Patient summary We found that, under certain assumptions, the use of multiparametric magnetic resonance imaging first and then up to two transrectal ultrasound-guided biopsy is better than the current clinical standard and is good value for money. The use of multiparametric magnetic resonance imaging before transrectal ultrasound-guided biopsy can detect more clinically significant prostate cancer and be cost effective compared with the use of imaging post-biopsy

Tumour necrosis factor-α inhibitors for ankylosing spondylitis and non-radiographic axial spondyloarthritis : a systematic review and economic evaluation

BACKGROUND: Tumour necrosis factor (TNF)-α inhibitors (anti-TNFs) are typically used when the inflammatory rheumatologic diseases ankylosing spondylitis (AS) and non-radiographic axial spondyloarthritis (nr-AxSpA) have not responded adequately to conventional therapy. Current National Institute for Health and Care Excellence (NICE) guidance recommends treatment with adalimumab, etanercept and golimumab in adults with active (severe) AS only if certain criteria are fulfilled but it does not recommend infliximab for AS. Anti-TNFs for patients with nr-AxSpA have not previously been appraised by NICE. OBJECTIVE: To determine the clinical effectiveness, safety and cost-effectiveness within the NHS of adalimumab, certolizumab pegol, etanercept, golimumab and infliximab, within their licensed indications, for the treatment of severe active AS or severe nr-AxSpA (but with objective signs of inflammation). DESIGN: Systematic review and economic model. DATA SOURCES: Fifteen databases were searched for relevant studies in July 2014. REVIEW METHODS: Clinical effectiveness data from randomised controlled trials (RCTs) were synthesised using Bayesian network meta-analysis methods. Results from other studies were summarised narratively. Only full economic evaluations that compared two or more options and considered both costs and consequences were included in the systematic review of cost-effectiveness studies. The differences in the approaches and assumptions used across the studies, and also those in the manufacturer's submissions, were examined in order to explain any discrepancies in the findings and to identify key areas of uncertainty. A de novo decision model was developed with a generalised framework for evidence synthesis that pooled change in disease activity (BASDAI and BASDAI 50) and simultaneously synthesised information on function (BASFI) to determine the long-term quality-adjusted life-year and cost burden of the disease in the economic model. The decision model was developed in accordance with the NICE reference case. The model has a lifetime horizon (60 years) and considers costs from the perspective of the NHS and personal social services. Health effects were expressed in terms of quality-adjusted life-years. RESULTS: In total, 28 eligible RCTs were identified and 26 were placebo controlled (mostly up to 12 weeks); 17 extended into open-label active treatment-only phases. Most RCTs were judged to have a low risk of bias overall. In both AS and nr-AxSpA populations, anti-TNFs produced clinically important benefits to patients in terms of improving function and reducing disease activity; for AS, the relative risks for ASAS 40 ranged from 2.53 to 3.42. The efficacy estimates were consistently slightly smaller for nr-AxSpA than for AS. Statistical (and clinical) heterogeneity was more apparent in the nr-AxSpA analyses than in the AS analyses; both the reliability of the nr-AxSpA meta-analysis results and their true relevance to patients seen in clinical practice are questionable. In AS, anti-TNFs are approximately equally effective. Effectiveness appears to be maintained over time, with around 50% of patients still responding at 2 years. Evidence for an effect of anti-TNFs delaying disease progression was limited; results from ongoing long-term studies should help to clarify this issue. Sequential treatment with anti-TNFs can be worthwhile but the drug survival response rates and benefits are reduced with second and third anti-TNFs. The de novo model, which addressed many of the issues of earlier evaluations, generated incremental cost-effectiveness ratios ranging from £19,240 to £66,529 depending on anti-TNF and modelling assumptions. CONCLUSIONS: In both AS and nr-AxSpA populations anti-TNFs are clinically effective, although more so in AS than in nr-AxSpA. Anti-TNFs may be an effective use of NHS resources depending on which assumptions are considered appropriate. FUTURE WORK RECOMMENDATIONS: Randomised trials are needed to identify the nr-AxSpA population who will benefit the most from anti-TNFs. STUDY REGISTRATION: This study is registered as PROSPERO CRD42014010182. FUNDING: The National Institute for Health Research Health Technology Assessment programme

When does NICE recommend the use of health technologies within a programme of evidence development?

This article is made available through the Brunel Open Access Publishing Fund. This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.This article has been made available through the Brunel Open Access Publishing Fund.Background: There is growing interest internationally in linking reimbursement decisions with recommendations for further research. In the UK, the National Institute for Health and Clinical Excellence (NICE) can issue guidance to approve the routine use of a health intervention, reject routine use or recommend use within a research programme. These latter recommendations have restricted use to ‘only in research’ (OIR) or have recommended further research alongside routine use (‘approval with research’ or AWR). However, it is not currently clear when such recommendations are likely to be made. Objectives: This study aims to identify NICE technology appraisals where OIR or AWR recommendations were made and to examine the key considerations that led to those decisions. Methods: Draft and final guidance including OIR/AWR recommendations were identified. The documents were reviewed to establish the characteristics of the technology appraisal, the cost effectiveness of the technologies, the key considerations that led to the recommendations and the types of research required. Results: In total, 29 final and 31 draft guidance documents included OIR/AWR recommendations up to January 2010. Overall, 86 % of final guidance included OIR recommendations. Of these, the majority were for technologies considered to be cost ineffective (83 %) and the majority of final guidance (66 %) specified the need for further evidence on relative effectiveness. The use of OIR/AWR recommendations is decreasing over time and they have rarely been used in appraisals conducted through the single technology appraisal process. Conclusion: NICE has used its ability to recommend technologies within research programmes, although predominantly within the multiple technology appraisal process. OIR recommendations have been most frequently issued for technologies considered cost ineffective and the most frequently cited consideration is uncertainty related to relative effectiveness. Key considerations cited for most AWR recommendations and some OIR recommendations included a need for further evidence on long-term outcomes and adverse effects of treatment.Medical Research Counci

Dependence as a Unifying Construct in Defining Alzheimer's Disease Severity

This article reviews measures of Alzheimer's disease (AD) progression in relation to patient dependence and offers a unifying conceptual framework for dependence in AD. Clinicians typically characterize AD by symptomatic impairments in three domains: cognition, function, and behavior. From a patient's perspective, changes in these domains, individually and in concert, ultimately lead to increased dependence and loss of autonomy. Examples of dependence in AD range from a need for reminders (early AD) to requiring safety supervision and assistance with basic functions (late AD). Published literature has focused on the clinical domains as somewhat separate constructs and has given limited attention to the concept of patient dependence as a descriptor of AD progression. This article presents the concept of dependence on others for care needs as a potential method for translating the effect of changes in cognition, function, and behavior into a more holistic, transparent description of AD progression