Conducting retrospective impact analysis to inform a medical research charity’s funding strategies: The case of Asthma UK

© 2013 Hanney et al.; licensee BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.This article has been made available through the Brunel Open Access Publishing Fund.BACKGROUND: Debate is intensifying about how to assess the full range of impacts from medical research. Complexity increases when assessing the diverse funding streams of funders such as Asthma UK, a charitable patient organisation supporting medical research to benefit people with asthma. This paper aims to describe the various impacts identified from a range of Asthma UK research, and explore how Asthma UK utilised the characteristics of successful funding approaches to inform future research strategies. METHODS: We adapted the Payback Framework, using it both in a survey and to help structure interviews, documentary analysis, and case studies. We sent surveys to 153 lead researchers of projects, plus 10 past research fellows, and also conducted 14 detailed case studies. These covered nine projects and two fellowships, in addition to the innovative case studies on the professorial chairs (funded since 1988) and the MRC-Asthma UK Centre in Allergic Mechanisms of Asthma (the ‘Centre’) which together facilitated a comprehensive analysis of the whole funding portfolio. We organised each case study to capture whatever academic and wider societal impacts (or payback) might have arisen given the diverse timescales, size of funding involved, and extent to which Asthma UK funding contributed to the impacts. RESULTS: Projects recorded an average of four peer-reviewed journal articles. Together the chairs reported over 500 papers. All streams of funding attracted follow-on funding. Each of the various categories of societal impacts arose from only a minority of individual projects and fellowships. Some of the research portfolio is influencing asthma-related clinical guidelines, and some contributing to product development. The latter includes potentially major breakthroughs in asthma therapies (in immunotherapy, and new inhaled drugs) trialled by university spin-out companies. Such research-informed guidelines and medicines can, in turn, contribute to health improvements. The role of the chairs and the pioneering collaborative Centre is shown as being particularly important. CONCLUSIONS: We systematically demonstrate that all types of Asthma UK’s research funding assessed are making impacts at different levels, but the main societal impacts from projects and fellowships come from a minority of those funded. Asthma UK used the study’s findings, especially in relation to the Centre, to inform research funding strategies to promote the achievement of impact.This study was funded by Asthma UK

Diagnostic Efficacy of PET/CT Plus Brain MR Imaging for Detection of Extrathoracic Metastases in Patients with Lung Adenocarcinoma

We aimed to evaluate prospectively the efficacy of positron emission tomography (PET)/computed tomography (CT) plus brain magnetic resonance imaging (MRI) for detecting extrathoracic metastases in lung adenocarcinoma. Metastatic evaluations were feasible for 442 consecutive patients (M:F=238:204; mean age, 54 yr) with a lung adenocarcinoma who underwent PET/CT (CT, without IV contrast medium injection) plus contrast-enhanced brain MRI. The presence of metastases in the brain was evaluated by assessing brain MRI or PET/CT, and in other organs by PET/CT. Diagnostic efficacies for metastasis detection with PET/CT plus brain MRI and with PET/CT only were calculated on a per-patient basis and compared from each other. Of 442 patients, 88 (20%, including 50 [11.3%] with brain metastasis) had metastasis. Regarding sensitivity of overall extrathoracic metastasis detection, a significant difference was found between PET/CT and PET/CT plus brain MRI (68% vs. 84%; P=0.03). As for brain metastasis detection sensitivity, brain MRI was significantly higher than PET/CT (88% vs. 24%; P<0.001). By adding MRI to PET/CT, brain metastases were detected in additional 32 (7% of 442 patients) patients. In lung adenocarcinoma patients, significant increase in sensitivity can be achieved for detecting extrathoracic metastases by adding dedicated brain MRI to PET/CT and thus enhancing brain metastasis detection

Supplemental Information 2: TB Mortality and Census Data

Late 19th century epidemics of tuberculosis (TB) in Western Canadian First Nations resulted in peak TB mortality rates more than six times the highest rates recorded in Europe. Using a mathematical modeling approach and historical TB mortality time series, we investigate potential causes of high TB mortality and rapid epidemic decline in First Nations from 1885 to 1940. We explore two potential causes of dramatic epidemic dynamics observed in this setting: first, we explore effects of famine prior to 1900 on both TB and population dynamics. Malnutrition is recognized as an individual-level risk factor for TB progression and mortality; its population-level effects on TB epidemics have not been explored previously. Second, we explore effects of heterogeneity in susceptibility to TB in two ways: modeling heterogeneity in susceptibility to infection, and heterogeneity in risk of developing disease once infected. Our results indicate that models lacking famine-related changes in TB parameters or heterogeneity result in an implausibly poor fit to both the TB mortality time series and census data; the inclusion of these features allows for the characteristic decline and rise in population observed in First Nations during this time period and confers improved fits to TB mortality data

Target for improvement: a cluster randomised trial of public involvement in quality-indicator prioritisation (intervention development and study protocol)

<p>Abstract</p> <p>Background</p> <p>Public priorities for improvement often differ from those of clinicians and managers. Public involvement has been proposed as a way to bridge the gap between professional and public clinical care priorities but has not been studied in the context of quality-indicator choice. Our objective is to assess the feasibility and impact of public involvement on quality-indicator choice and agreement with public priorities.</p> <p>Methods</p> <p>We will conduct a cluster randomised controlled trial comparing quality-indicator prioritisation with and without public involvement. In preparation for the trial, we developed a 'menu' of quality indicators, based on a systematic review of existing validated indicator sets. Participants (public representatives, clinicians, and managers) will be recruited from six participating sites. In intervention sites, public representatives will be involved through direct participation (public representatives, clinicians, and managers will deliberate together to agree on quality-indicator choice and use) and consultation (individual public recommendations for improvement will be collected and presented to decision makers). In control sites, only clinicians and managers will take part in the prioritisation process. Data on quality-indicator choice and intended use will be collected. Our primary outcome will compare quality-indicator choice and agreement with public priorities between intervention and control groups. A process evaluation based on direct observation, videorecording, and participants' assessment will be conducted to help explain the study's results. The marginal cost of public involvement will also be assessed.</p> <p>Discussion</p> <p>We identified 801 quality indicators that met our inclusion criteria. An expert panel agreed on a final set of 37 items containing validated quality indicators relevant for chronic disease prevention and management in primary care. We pilot tested our public-involvement intervention with 27 participants (11 public representatives and 16 clinicians and managers) and our study instruments with an additional 21 participants, which demonstrated the feasibility of the intervention and generated important insights and adaptations to engage public representatives more effectively. To our knowledge, this study is the first trial of public involvement in quality-indicator prioritisation, and its results could foster more effective upstream engagement of patients and the public in clinical practice improvement.</p> <p>Trial registration</p> <p><a href="http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=2496">NTR2496</a> (Netherlands National Trial Register, <url>http://www.trialregister.nl</url>).</p

Referrals for positive tuberculin tests in new health care workers and students: a retrospective cohort study

<p>Abstract</p> <p>Background</p> <p>Documentation of test results for latent tuberculosis (TB) infection is important for health care workers and students before they begin work. A negative result provides a baseline for comparison with future tests. A positive result affords a potential opportunity for treatment of latent infection when appropriate. We sought to evaluate the yield of the referral process for positive baseline tuberculin tests, among persons beginning health care work or studies.</p> <p>Methods</p> <p>Retrospective cohort study. We reviewed the charts of all new health care students and workers referred to the Montreal Chest Institute in 2006 for positive baseline tuberculin skin tests (≥10 mm). Health care workers and students evaluated for reasons other than positive baseline test results were excluded.</p> <p>Results</p> <p>630 health care students and workers were evaluated. 546 (87%) were foreign-born, and 443 (70%) reported previous Bacille Calmette-Guérin (BCG) vaccination. 420 (67%) were discharged after their first evaluation without further treatment. 210 (33%) were recommended treatment for latent TB infection, of whom 165 (79%) began it; of these, 115 (70%) completed adequate treatment with isoniazid or rifampin. Treatment discontinuation or interruption occurred in a third of treated subjects, and most often reflected loss to follow-up, or abdominal discomfort. No worker or student had active TB.</p> <p>Conclusions</p> <p>Only a small proportion of health care workers and students with positive baseline tuberculin tests were eligible for, and completed treatment for latent TB infection. We discuss recommendations for improving the referral process, so as to better target workers and students who require specialist evaluation and treatment for latent TB infection. Treatment adherence also needs improvement.</p

Feasibility and effects of adapted cardiac rehabilitation after stroke: a prospective trial

Abstract Background Despite the cardiovascular etiology of stroke, exercise and risk factor modification programs akin to cardiac rehabilitation (CR) are not available. This study aimed to establish the feasibility of adapting a CR model for individuals with mild to moderate stroke disability. A secondary objective was to determine the program's effects on aerobic and walking capacity, and stroke risk factors. Methods A repeated measures design was used with a 3-month baseline period and 6-month adapted CR intervention (n = 43, mean ± SD age 65 ± 12 years, 30 ± 28 months post stroke). Feasibility was determined by the number of participants who completed the study, occurrence of adverse events and frequency, duration and intensity of exercise performed. To determine effectiveness of the program, outcomes measured included aerobic capacity (VO2peak, ventilatory threshold), 6-Minute Walk Test (6MWT) distance, and risk factors. Descriptive statistics characterized the classes attended and number and intensity of exercise sessions. Paired t-tests, one-factor repeated measures analyses of variance contrasts and chi-square analyses were used to compare changes over time. Results Two participants withdrew during the baseline period. Of the remaining 41 participants who commenced the program, 38 (93%) completed all aspects. No serious adverse effects occurred. Post-intervention, VO2peak improved relative to the stable baseline period (P = 0.046) and the increase in ventilatory threshold approached significance (P = 0.062). Conclusions CR is feasible after stroke and may be adapted to accommodate for those with a range of post-stroke disability. It is effective in increasing aerobic capacity. CR may be an untapped opportunity for stroke survivors to access programs of exercise and risk factor modification to lower future event risk. Trial registration ClinicalTrials.gov registration number: NCT0106749

Automated telephone communication systems for preventive healthcare and management of long-term conditions

Background Automated telephone communication systems (ATCS) can deliver voice messages and collect health-related information from patients using either their telephone’s touch-tone keypad or voice recognition software. ATCS can supplement or replace telephone contact between health professionals and patients. There are four different types of ATCS: unidirectional (one-way, non-interactive voice communication), interactive voice response (IVR) systems, ATCS with additional functions such as access to an expert to request advice (ATCS Plus) and multimodal ATCS, where the calls are delivered as part of a multicomponent intervention. Objectives To assess the effects of ATCS for preventing disease and managing long-term conditions on behavioural change, clinical, process, cognitive, patient-centred and adverse outcomes. Search methods We searched 10 electronic databases (the Cochrane Central Register of Controlled Trials; MEDLINE; Embase; PsycINFO; CINAHL; Global Health; WHOLIS; LILACS; Web of Science; and ASSIA); three grey literature sources (Dissertation Abstracts, Index to Theses, Australasian Digital Theses); and two trial registries (www.controlled-trials.com; www.clinicaltrials.gov) for papers published between 1980 and June 2015. Selection criteria Randomised, cluster- and quasi-randomised trials, interrupted time series and controlled before-and-after studies comparing ATCS interventions, with any control or another ATCS type were eligible for inclusion. Studies in all settings, for all consumers/carers, in any preventive healthcare or long term condition management role were eligible. Data collection and analysis We used standard Cochrane methods to select and extract data and to appraise eligible studies. Main results We included 132 trials (N = 4,669,689). Studies spanned across several clinical areas, assessing many comparisons based on evaluation of different ATCS types and variable comparison groups. Forty-one studies evaluated ATCS for delivering preventive healthcare, 84 for managing long-term conditions, and seven studies for appointment reminders. We downgraded our certainty in the evidence primarily because of the risk of bias for many outcomes. We judged the risk of bias arising from allocation processes to be low for just over half the studies and unclear for the remainder. We considered most studies to be at unclear risk of performance or detection bias due to blinding, while only 16% of studies were at low risk. We generally judged the risk of bias due to missing data and selective outcome reporting to be unclear. For preventive healthcare, ATCS (ATCS Plus, IVR, unidirectional) probably increase immunisation uptake in children (risk ratio (RR) 1.25, 95% confidence interval (CI) 1.18 to 1.32; 5 studies, N = 10,454; moderate certainty) and to a lesser extent in adolescents (RR 1.06, 95% CI 1.02 to 1.11; 2 studies, N = 5725; moderate certainty). The effects of ATCS in adults are unclear (RR 2.18, 95% CI 0.53 to 9.02; 2 studies, N = 1743; very low certainty). For screening, multimodal ATCS increase uptake of screening for breast cancer (RR 2.17, 95% CI 1.55 to 3.04; 2 studies, N = 462; high certainty) and colorectal cancer (CRC) (RR 2.19, 95% CI 1.88 to 2.55; 3 studies, N = 1013; high certainty) versus usual care. It may also increase osteoporosis screening. ATCS Plus interventions probably slightly increase cervical cancer screening (moderate certainty), but effects on osteoporosis screening are uncertain. IVR systems probably increase CRC screening at 6 months (RR 1.36, 95% CI 1.25 to 1.48; 2 studies, N = 16,915; moderate certainty) but not at 9 to 12 months, with probably little or no effect of IVR (RR 1.05, 95% CI 0.99, 1.11; 2 studies, 2599 participants; moderate certainty) or unidirectional ATCS on breast cancer screening. Appointment reminders delivered through IVR or unidirectional ATCS may improve attendance rates compared with no calls (low certainty). For long-term management, medication or laboratory test adherence provided the most general evidence across conditions (25 studies, data not combined). Multimodal ATCS versus usual care showed conflicting effects (positive and uncertain) on medication adherence. ATCS Plus probably slightly (versus control; moderate certainty) or probably (versus usual care; moderate certainty) improves medication adherence but may have little effect on adherence to tests (versus control). IVR probably slightly improves medication adherence versus control (moderate certainty). Compared with usual care, IVR probably improves test adherence and slightly increases medication adherence up to six months but has little or no effect at longer time points (moderate certainty). Unidirectional ATCS, compared with control, may have little effect or slightly improve medication adherence (low certainty). The evidence suggested little or no consistent effect of any ATCS type on clinical outcomes (blood pressure control, blood lipids, asthma control, therapeutic coverage) related to adherence, but only a small number of studies contributed clinical outcome data. The above results focus on areas with the most general findings across conditions. In condition-specific areas, the effects of ATCS varied, including by the type of ATCS intervention in use. Multimodal ATCS probably decrease both cancer pain and chronic pain as well as depression (moderate certainty), but other ATCS types were less effective. Depending on the type of intervention, ATCS may have small effects on outcomes for physical activity, weight management, alcohol consumption, and diabetes mellitus. ATCS have little or no effect on outcomes related to heart failure, hypertension, mental health or smoking cessation, and there is insufficient evidence to determine their effects for preventing alcohol/ substance misuse or managing illicit drug addiction, asthma, chronic obstructive pulmonary disease, HIV/AIDS, hypercholesterolaemia, obstructive sleep apnoea, spinal cord dysfunction or psychological stress in carers. Only four trials (3%) reported adverse events, and it was unclear whether these were related to the intervention

Surviving Sepsis Campaign: International guidelines for management of severe sepsis and septic shock: 2008

SCOPUS: ar.jinfo:eu-repo/semantics/publishe

Interventions to improve contact tracing for tuberculosis in specific groups and in wider populations: an evidence synthesis

Background The tracing and screening of people who have had contact with an active case of tuberculosis (TB) is an important element of TB control strategies. Objectives This study aimed to carry out a review of evidence regarding TB contact tracing, with a particular emphasis on research that was applicable to TB contact tracing in specific population groups in the UK. Design An evidence synthesis of literature of any study design on TB contact tracing in developed countries was carried out. Setting Any setting. Population Individuals found to have active TB disease, and people who have come into contact with them. Interventions Contact-tracing investigations. Main outcome measures Any outcome related to TB infection, contact investigations and/or the views of staff, people with TB disease, or their contacts. Data sources Searches for research published 1995 onwards were undertaken in the following databases: MEDLINE via Ovid SP, EMBASE via Ovid SP, EconLit via Ovid SP, PsycINFO via Ovid SP, Social Policy and Practice via Ovid SP, Cumulative Index to Nursing and Allied Health Literature via EBSCOhost, Science and Social Science Citation Indices via Web of Science and The Cochrane Library via Wiley Online Library. Review methods The study comprised a review of TB contact tracing in specific population groups and a review in wider populations. A narrative synthesis was completed and a logic model was developed from the literature. Results There were 112 articles in the review: 23 related to specific populations and 89 related to wider populations. The literature was of limited quality, with much general description of investigations. We identified only two (uncontrolled) studies that could be considered evaluative. Although the limitations of the evidence should be recognised, the review suggested the following: the value of a location-based approach, working with local communities and the media, partnership working, using molecular epidemiological testing, ensuring adequate systems and addressing fear of stigma. The literature on investigations for specific populations has much concordance with that reporting findings from wider population groups. The recognised limitations of conventional investigation methods may, however, be exacerbated in specific populations. Limitations The English-language inclusion criterion may have limited the breadth of countries represented. A meta-analysis was not possible owing to the nature of the literature. Relevant studies may have been missed by our searches, which used terminology relating to contact tracing rather than to active case finding or screening. Conclusions The review identified a sizeable volume of literature relating to contact investigations. However, it is currently predominantly descriptive, with little evaluative work underpinning investigations in either specific or wider populations. Our findings are, therefore, based on limited evidence. Further research is required if robust conclusions are to be made. Future work Research should further explore the development of measures that can be used to compare the effectiveness of different contact investigations, in studies using evaluative designs