Conducting retrospective impact analysis to inform a medical research charity’s funding strategies: The case of Asthma UK

© 2013 Hanney et al.; licensee BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.This article has been made available through the Brunel Open Access Publishing Fund.BACKGROUND: Debate is intensifying about how to assess the full range of impacts from medical research. Complexity increases when assessing the diverse funding streams of funders such as Asthma UK, a charitable patient organisation supporting medical research to benefit people with asthma. This paper aims to describe the various impacts identified from a range of Asthma UK research, and explore how Asthma UK utilised the characteristics of successful funding approaches to inform future research strategies. METHODS: We adapted the Payback Framework, using it both in a survey and to help structure interviews, documentary analysis, and case studies. We sent surveys to 153 lead researchers of projects, plus 10 past research fellows, and also conducted 14 detailed case studies. These covered nine projects and two fellowships, in addition to the innovative case studies on the professorial chairs (funded since 1988) and the MRC-Asthma UK Centre in Allergic Mechanisms of Asthma (the ‘Centre’) which together facilitated a comprehensive analysis of the whole funding portfolio. We organised each case study to capture whatever academic and wider societal impacts (or payback) might have arisen given the diverse timescales, size of funding involved, and extent to which Asthma UK funding contributed to the impacts. RESULTS: Projects recorded an average of four peer-reviewed journal articles. Together the chairs reported over 500 papers. All streams of funding attracted follow-on funding. Each of the various categories of societal impacts arose from only a minority of individual projects and fellowships. Some of the research portfolio is influencing asthma-related clinical guidelines, and some contributing to product development. The latter includes potentially major breakthroughs in asthma therapies (in immunotherapy, and new inhaled drugs) trialled by university spin-out companies. Such research-informed guidelines and medicines can, in turn, contribute to health improvements. The role of the chairs and the pioneering collaborative Centre is shown as being particularly important. CONCLUSIONS: We systematically demonstrate that all types of Asthma UK’s research funding assessed are making impacts at different levels, but the main societal impacts from projects and fellowships come from a minority of those funded. Asthma UK used the study’s findings, especially in relation to the Centre, to inform research funding strategies to promote the achievement of impact.This study was funded by Asthma UK

The effectiveness and efficiency of diabetes screening in Ontario, Canada: a population-based cohort study

<p>Abstract</p> <p>Background</p> <p>Little is known about the efficiency and effectiveness of the current level of diabetes screening activity in Ontario where there is universal access to health services. Our study aims were to: (i) determine how often Ontarians are screened for diabetes; (ii) estimate screening efficiency based on the number needed to screen (NNS) to diagnosis one diabetes case; (iii) examine the population effectiveness of screening as estimated by the number of undiagnosed diabetes cases.</p> <p>Methods</p> <p>Ontario respondents of the Canadian Community Health Survey who agreed to have their responses linked to health care data (n = 37,400) provided the cohort. The five-year probabilities of glucose testing and diabetes diagnoses were estimated using a Cox Proportional Hazards Model. We defined NNS as the ratio of diabetes tests to number of diabetes diagnoses over the study period. We estimated the number of undiagnosed diabetes by dividing the number not tested at the end of study period by the NNS.</p> <p>Results</p> <p>80% of women and 66% of men had a blood glucose test within 5 years. The efficiency of screening was estimated by a NNS of 14 among men and 22 among women. 127,100 cases of undiagnosed diabetes were estimated, representing 1.4% of the Ontario adult population. Increasing age, hypertension, immigrant and non-white ethnicity, and number of general practitioner visits were associated with an increased likelihood of having a glucose test (LR χ2 p < 0.001). Low income men were less likely to be tested.</p> <p>Conclusions</p> <p>Diabetes screening was high in this population-based cohort of Ontarians. Screening efficiency varied considerably in the population. Undiagnosed diabetes continues to be prevalent and remains concentrated in the highest risk groups for diabetes, especially among men.</p

Increased incidence of glucose disorders during pregnancy is not explained by pre-pregnancy obesity in London, Canada

<p>Abstract</p> <p>Background</p> <p>The increasing incidence of impaired glucose tolerance (IGT), gestational diabetes (GDM) and type 2 diabetes (T2D) during pregnancy was hypothesized to be associated with increases in pre-pregnancy body mass index (BMI). The aims were to 1) determine the prevalence of IGT/GDM/T2 D over a 10 year period; 2) examine the relationship between maternal overweight/obesity and IGT/GDM/T2D; and 3) examine the extent to which maternal metabolic complications impact maternal and fetal pregnancy outcomes.</p> <p>Methods</p> <p>Data arose from a perinatal database which contains maternal characteristics and perinatal outcome for all singleton infants born in London, Canada between January 1, 2000 and December 31, 2009. Univariable and multivariable odds ratios (OR) were estimated using logistic regression with IGT/GDM/T2 D being the outcome of interest.</p> <p>Results</p> <p>A total of 36,597 women were included in the analyses. Population incidence of IGT, GDM and T2 D rose from 0.7%, 2.9% and 0.5% in 2000 to 1.2%, 4.2% and 0.9% in 2009. The univariable OR for IGT, GDM and T2 D were 1.65, 1.52 and 2.06, respectively, over the ten year period. After controlling for maternal age, parity and pre-pregnancy BMI the OR did not decrease. Although there was a positive relationship between pre-pregnancy BMI and prevalence of IGT/GDM/T2 D, this did not explain the time trends in the latter. Diagnosis of IGT/GDM/T2 D increased the risk of having an Apgar score <7 at 5 minutes, which was partially explained by gestational hypertension, high placental ratio, gestational age and large for gestational age babies.</p> <p>Conclusions</p> <p>We found a significant increase in the incidence of IGT/GDM/T2 D for the decade between 2000-2009 which was not explained by rising prevalence of maternal overweight/obesity.</p

International Diabetes Federation guideline for management of postmeal glucose: a review of recommendations

Diabetes is a significant and growing concern, with over 246 million people around the world living with the disease and another 308 million with impaired glucose tolerance. Depending on the resources of different nations, intervention has generally focused on optimizing overall glycaemic control as assessed by glycated haemoglobin (HbA1c) and fasting plasma glucose (FPG) values. Nevertheless, increasing evidence supports the importance of controlling all three members of the glucose triad, namely HbA1c, FPG and postmeal glucose (PMG) in order to improve outcome in diabetes. As part of its global mission to promote diabetes care and prevention and to find a cure, the International Diabetes Federation (IDF) recently developed a guideline that reviews evidence to date on PMG and the development of diabetic complications. Based on an extensive database search of the literature, and guided by a Steering and Development Committee including experts from around the world, the IDF Guideline for Management of Postmeal Glucose offers recommendations for appropriate clinical management of PMG. These recommendations are intended to help clinicians and organizations in developing strategies for effective management of PMG in individuals with Type 1 and Type 2 diabetes. The following review highlights the recommendations of the guideline, the supporting evidence provided and the major conclusions drawn. The full guideline is available for download at http://www.idf.org

Investigating concordance in diabetes diagnosis between primary care charts (electronic medical records) and health administrative data: a retrospective cohort study

<p>Abstract</p> <p>Background</p> <p>Electronic medical records contain valuable clinical information not readily available elsewhere. Accordingly, they hold important potential for contributing to and enhancing chronic disease registries with the goal of improving chronic disease management; however a standard for diagnoses of conditions such as diabetes remains to be developed. The purpose of this study was to establish a validated electronic medical record definition for diabetes.</p> <p>Methods</p> <p>We constructed a retrospective cohort using health administrative data from the Institute for Clinical Evaluative Sciences Ontario Diabetes Database linked with electronic medical records from the Deliver Primary Healthcare Information Project using data from 1 April 2006 - 31 March 2008 (N = 19,443). We systematically examined eight definitions for diabetes diagnosis, both established and proposed.</p> <p>Results</p> <p>The definition that identified the highest number of patients with diabetes (N = 2,180) while limiting to those with the highest probability of having diabetes was: individuals with ≥2 abnormal plasma glucose tests, or diabetes on the problem list, or insulin prescription, or ≥2 oral anti-diabetic agents, or HbA1c ≥6.5%. Compared to the Ontario Diabetes Database, this definition identified 13% more patients while maintaining good sensitivity (75%) and specificity (98%).</p> <p>Conclusions</p> <p>This study establishes the feasibility of developing an electronic medical record standard definition of diabetes and validates an algorithm for use in this context. While the algorithm may need to be tailored to fit available data in different electronic medical records, it contributes to the establishment of validated disease registries with the goal of enhancing research, and enabling quality improvement in clinical care and patient self-management.</p

Metformin treatment in diabetes and heart failure: when academic equipoise meets clinical reality

<p>Abstract</p> <p>Objective</p> <p>Metformin has had a 'black box' contraindication in diabetic patients with heart failure (HF), but many believe it to be the treatment of choice in this setting. Therefore, we attempted to conduct a pilot study to evaluate the feasibility of undertaking a large randomized controlled trial with clinical endpoints.</p> <p>Study Design</p> <p>The pilot study was a randomized double blinded placebo controlled trial. Patients with HF and type 2 diabetes were screened in hospitals and HF clinics in Edmonton, Alberta, Canada (population ~1 million). Major exclusion criteria included the current use of insulin or high dose metformin, decreased renal function, or a glycosylated hemoglobin <7%. Patients were to be randomized to 1500 mg of metformin daily or matching placebo and followed for 6 months for a variety of functional outcomes, as well as clinical events.</p> <p>Results</p> <p>Fifty-eight patients were screened over a six month period and all were excluded. Because of futility with respect to enrollment, the pilot study was abandoned. The mean age of screened patients was 77 (SD 9) years and 57% were male. The main reasons for exclusion were: use of insulin therapy (n = 23; 40%), glycosylated hemoglobin <7% (n = 17; 29%) and current use of high dose metformin (n = 12; 21%). Overall, contraindicated metformin therapy was the most commonly prescribed oral antihyperglycemic agent (n = 27; 51%). On average, patients were receiving 1,706 mg (SD 488 mg) of metformin daily and 12 (44%) used only metformin.</p> <p>Conclusion</p> <p>Despite uncertainty in the scientific literature, there does not appear to be clinical uncertainty with regards to the safety or effectiveness of metformin in HF making a definitive randomized trial virtually impossible.</p> <p>Trial registration</p> <p>ClinicalTrials.gov Identifier: NCT00325910</p

Factors Influencing Physical Activity Behavior among Iranian Women with Type 2 Diabetes Using the Extended Theory of Reasoned Action

BackgroundFindings of most studies indicate that the only way to control diabetes and prevent its debilitating effects is through the continuous performance of self-care behaviors. Physical activity is a non-pharmacological method of diabetes treatment and because of its positive effects on diabetic patients, it is being increasingly considered by researchers and practitioners. This study aimed at determining factors influencing physical activity among diabetic women in Iran, using the extended theory of reasoned action in Iran.MethodsA sample of 352 women with type 2 diabetes, referring to a Diabetes Clinic in Khoy, Iran, participated in the study. Appropriate instruments were designed to measure the desired variables (knowledge of diabetes, personal beliefs, subjective norms, perceived self-efficacy, behavioral intention and physical activity behavior). The reliability and validity of the instruments were examined and approved. Statistical analyses of the study were conducted by inferential statistical techniques (independent t-test, correlations and regressions) using the SPSS package.ResultsThe findings of this investigation indicated that among the constructs of the model, self efficacy was the strongest predictor of intentions among women with type 2 diabetes and both directly and indirectly affected physical activity. In addition to self efficacy, diabetic patients' physical activity also was influenced by other variables of the model and sociodemographic factors.ConclusionOur findings suggest that the high ability of the theory of reasoned action extended by self-efficacy in forecasting and explaining physical activity can be a base for educational intervention. Educational interventions based on the proposed model are necessary for improving diabetics' physical activity behavior and controlling disease

Self-reported diabetes is associated with self-management behaviour: a cohort study

<p>Abstract</p> <p>Background</p> <p>The purposes of this cohort study were to establish how frequently people with physician-diagnosed diabetes self-reported the disease, to determine factors associated with self-reporting of diabetes, and to evaluate subsequent differences in self-management behaviour, health care utilisation and clinical outcomes between people who do and do not report their disease.</p> <p>Methods</p> <p>We used a registry of physician-diagnosed diabetes as a reference standard. We studied respondents to a 2000/01 population-based health survey who were in the registry (n = 1,812), and we determined the proportion who reported having diabetes during the survey. Baseline factors associated with self-report and subsequent behavioural, utilisation and clinical differences between those who did and did not self-report were defined from the survey responses and from linkage with administrative data sources.</p> <p>Results</p> <p>Only 75% of people with physician-diagnosed diabetes reported having the disease. People who did self-report were more likely to be male, to live in rural areas, to have longer disease duration and to have received specialist physician care. People who did not report having diabetes in the survey were markedly less likely to perform capillary blood glucose monitoring in the subsequent two years (OR 0.05, 95% CI 0.02 to 0.08). They were also less likely to receive specialist physician care (OR 0.55, 95% CI 0.37 to 0.86), and were less likely to require hospital care for hypo- or hyperglycaemia (OR 0.09, 95% CI 0.01 to 0.28).</p> <p>Conclusion</p> <p>Many people with physician-diagnosed diabetes do not report having the disease, but most demographic and clinical features do not distinguish these individuals. These individuals are much less likely to perform capillary glucose monitoring, suggesting that their diabetes self-management is inadequate. Clinicians may be able to use the absence of glucose monitoring as a screening tool to identify people needing a detailed evaluation of their disease knowledge.</p

Target for improvement: a cluster randomised trial of public involvement in quality-indicator prioritisation (intervention development and study protocol)

<p>Abstract</p> <p>Background</p> <p>Public priorities for improvement often differ from those of clinicians and managers. Public involvement has been proposed as a way to bridge the gap between professional and public clinical care priorities but has not been studied in the context of quality-indicator choice. Our objective is to assess the feasibility and impact of public involvement on quality-indicator choice and agreement with public priorities.</p> <p>Methods</p> <p>We will conduct a cluster randomised controlled trial comparing quality-indicator prioritisation with and without public involvement. In preparation for the trial, we developed a 'menu' of quality indicators, based on a systematic review of existing validated indicator sets. Participants (public representatives, clinicians, and managers) will be recruited from six participating sites. In intervention sites, public representatives will be involved through direct participation (public representatives, clinicians, and managers will deliberate together to agree on quality-indicator choice and use) and consultation (individual public recommendations for improvement will be collected and presented to decision makers). In control sites, only clinicians and managers will take part in the prioritisation process. Data on quality-indicator choice and intended use will be collected. Our primary outcome will compare quality-indicator choice and agreement with public priorities between intervention and control groups. A process evaluation based on direct observation, videorecording, and participants' assessment will be conducted to help explain the study's results. The marginal cost of public involvement will also be assessed.</p> <p>Discussion</p> <p>We identified 801 quality indicators that met our inclusion criteria. An expert panel agreed on a final set of 37 items containing validated quality indicators relevant for chronic disease prevention and management in primary care. We pilot tested our public-involvement intervention with 27 participants (11 public representatives and 16 clinicians and managers) and our study instruments with an additional 21 participants, which demonstrated the feasibility of the intervention and generated important insights and adaptations to engage public representatives more effectively. To our knowledge, this study is the first trial of public involvement in quality-indicator prioritisation, and its results could foster more effective upstream engagement of patients and the public in clinical practice improvement.</p> <p>Trial registration</p> <p><a href="http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=2496">NTR2496</a> (Netherlands National Trial Register, <url>http://www.trialregister.nl</url>).</p