Institutional strategies for capturing socio-economic impact of academic research

Evaluation of socio-economic impact is an emerging theme for publicly-funded academic research. Within this context the paper suggests that the concept of institutional research capital be expanded to include the capture and evaluation of socio-economic impact. Furthermore, it argues that understanding the typology of impacts and the tracking from research to impact will assist the formulation of institutional strategies for capturing socio-economic impact. A three-stage approach is proposed for capturing and planning activities to enhance the generation of high-quality impact. Stage one outlines the critical role of user engagement that facilitates the tracking of such impact. Stage two employs an analytical framework based on the criteria of ‘depth’ and ‘spread’ to evaluate impacts that have been identified. Stage three utilizes the outcomes of the framework to devise strategies, consisting of either further research (to increase depth) or more engagement (to increase spread) that will improve the generation of higher quality impact

Factor structure and construct validity of the Adult Social Care Outcomes Toolkit for Carers (ASCOT-Carer)

Background: The ASCOT-Carer is a self-report instrument designed to measure social care-related quality of life (SCRQoL). This article presents the psychometric testing and validation of the ASCOT-Carer four response-level interview (INT4) in a sample of unpaid carers of adults who receive publicly-funded social care services in England. Methods: Unpaid carers were identified through a survey of users of publicly-funded social care services in England. 387 carers completed a face-to-face or telephone interview. Data on variables hypothesised to be related to SCRQoL (for example, characteristics of the carer, cared-for person and care situation) and measures of carer experience, strain, health-related quality of life and overall QoL were collected. Relationships between these variables and overall SCRQoL score were evaluated through correlation, ANOVA and regression analysis to test the construct validity of the scale. Internal reliability was assessed using Cronbach’s alpha and feasibility by the number of missing responses. Results: The construct validity was supported by statistically significant relationships between SCRQoL and scores on instruments of related constructs, as well as with characteristics of the carer and care recipient in univariate and multivariate analyses. A Cronbach’s alpha of 0.87 (7 items) indicates that the internal reliability of the instrument is satisfactory and a low number of missing responses (<1%) indicates a high level of acceptance. Conclusions: The results provide evidence to support the construct validity, factor structure, internal reliability and feasibility of the ASCOT-Carer INT4 as an instrument for measuring social care-related quality of life of unpaid carers who care for adults with a variety of long-term conditions, disability or problems related to old age

Comparing research investment to United Kingdom institutions and published outputs for tuberculosis, HIV and malaria: A systematic analysis across 1997-2013

Background: The "Unfinished Agenda" of infectious diseases is of great importance to policymakers and research funding agencies that require ongoing research evidence on their effective management. Journal publications help effectively share and disseminate research results to inform policy and practice. We assess research investments to United Kingdom institutions in HIV, tuberculosis and malaria, and analyse these by numbers of publications and citations and by disease and type of science. Methods: Information on infection-related research investments awarded to United Kingdom institutions across 1997-2010 were sourced from funding agencies and individually categorised by disease and type of science. Publications were sourced from the Scopus database via keyword searches and filtered to include only publications relating to human disease and containing a United Kingdom-based first and/or last author. Data were matched by disease and type of science categories. Investment (United Kingdom pounds) and publications were compared to generate an 'investment per publication' metric; similarly, an 'investment per citation' metric was also developed as a measure of the usefulness of research. Results: Total research investment for all three diseases was £1.4 billion, and was greatest for HIV (£651.4 million), followed by malaria (£518.7 million) and tuberculosis (£239.1 million). There were 17,271 included publications, with 9,322 for HIV, 4,451 for malaria, and 3,498 for tuberculosis. HIV publications received the most citations (254,949), followed by malaria (148,559) and tuberculosis (100,244). According to UK pound per publication, tuberculosis (£50,691) appeared the most productive for investment, compared to HIV (£61,971) and malaria (£94,483). By type of science, public health research was most productive for HIV (£27,296) and tuberculosis (£22,273), while phase I-III trials were most productive for malaria (£60,491). According to UK pound per citation, tuberculosis (£1,797) was the most productive area for investment, compared to HIV (£2,265) and malaria (£2,834). Public health research was the most productive type of science for HIV (£2,265) and tuberculosis (£1,797), whereas phase I-III trials were most productive for malaria (£1,713). Conclusions: When comparing total publications and citations with research investment to United Kingdom institutions, tuberculosis research appears to perform best in terms of efficiency. There were more public health-related publications and citations for HIV and tuberculosis than other types of science. These findings demonstrate the diversity of research funding and outputs, and provide new evidence to inform research investment strategies for policymakers, funders, academic institutions, and healthcare organizations.Infectious Disease Research Networ

The political process of constructing a sustainable London Olympics sports development legacy

This study attempts to develop a research agenda for understanding the process of constructing a sustainable Olympic sports development legacy. The research uses a social constructivist perspective to examine the link between the 2012 London Olympic Games and sustainable sports development. The first part of the paper provides justification for the study of sport policy processes using a constructivist lens. This is followed by a section which critically unpacks sustainable sports development drawing on Mosse’s (1998) ideas of process-oriented research and Searle’s conceptualisation of the construction of social reality. Searle’s (1995) concepts of the assignment of function, collective intentionality, collective rules, and human capacity to cope with the environment are considered in relation to the events and discourses emerging from the legacy vision(s) associated with the 2012 London Olympic Games. The paper concludes by proposing a framework for engaging in process oriented research and highlights key elements, research questions, and methodological issues. The proposed constructivist approach can be used to inform policy, practice, and research on sustainable Olympic sports development legacy

Dutch translation and cross-cultural validation of the Adult Social Care Outcomes Toolkit (ASCOT)

Background: The Adult Social Care Outcomes Toolkit was developed to measure outcomes of social care in England. In this study, we translated the four level self-completion version (SCT-4) of the ASCOT for use in the Netherlands and performed a cross-cultural validation. Methods: The ASCOT SCT-4 was translated into Dutch following international guidelines, including two forward and back translations. The resulting version was pilot tested among frail older adults using think-aloud interviews. Furthermore, using a subsample of the Dutch ACT-study, we investigated test-retest reliability and construct validity and compared response distributions with data from a comparable English study. Results: The pilot tests showed that translated items were in general understood as intended, that most items were reliable, and that the response distributions of the Dutch translation and associations with other measures were comparable to the original English version. Based on the results of the pilot tests, some small modifications and a revision of the Dignity items were proposed for the final translation, which were approved by the ASCOT development team. The complete original English version and the final Dutch translation can be obtained after registration on the ASCOT website (http://www.pssru.ac.uk/ascot). Conclusions: This study provides preliminary evidence that the Dutch translation of the ASCOT is valid, reliable and comparable to the original English version. We recommend further research to confirm the validity of the modified Dutch ASCOT translation

Understanding factors associated with the translation of cardiovascular research: A multinational case study approach

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.This article has been made available through the Brunel Open Access Publishing Fund.Background: Funders of health research increasingly seek to understand how best to allocate resources in order to achieve maximum value from their funding. We built an international consortium and developed a multinational case study approach to assess benefits arising from health research. We used that to facilitate analysis of factors in the production of research that might be associated with translating research findings into wider impacts, and the complexities involved. Methods: We built on the Payback Framework and expanded its application through conducting co-ordinated case studies on the payback from cardiovascular and stroke research in Australia, Canada and the United Kingdom. We selected a stratified random sample of projects from leading medical research funders. We devised a series of innovative steps to: minimize the effect of researcher bias; rate the level of impacts identified in the case studies; and interrogate case study narratives to identify factors that correlated with achieving high or low levels of impact. Results: Twenty-nine detailed case studies produced many and diverse impacts. Over the 15 to 20 years examined, basic biomedical research has a greater impact than clinical research in terms of academic impacts such as knowledge production and research capacity building. Clinical research has greater levels of wider impact on health policies, practice, and generating health gains. There was no correlation between knowledge production and wider impacts. We identified various factors associated with high impact. Interaction between researchers and practitioners and the public is associated with achieving high academic impact and translation into wider impacts, as is basic research conducted with a clinical focus. Strategic thinking by clinical researchers, in terms of thinking through pathways by which research could potentially be translated into practice, is associated with high wider impact. Finally, we identified the complexity of factors behind research translation that can arise in a single case. Conclusions: We can systematically assess research impacts and use the findings to promote translation. Research funders can justify funding research of diverse types, but they should not assume academic impacts are proxies for wider impacts. They should encourage researchers to consider pathways towards impact and engage potential research users in research processes. © 2014 Wooding et al.; licensee BioMed Central Ltd.RAND Europe and HERG, with subsequent funding from the NHFA, the HSFC and the CIHR. This research was also partially supported by the Policy Research Programme in the English Department of Health

Are reasons for caregiving related to carers’ care-related quality of life and strain? Evidence from a survey of carers in England

In England, choice and control is promoted for service users in relation to social care services. Increased choice and control has also been promoted for unpaid carers, although this is still relatively underdeveloped. There is limited recognition of carers’ choice in terms of the decision of whether to provide care. Alongside the promotion of choice and control, there has also been a focus on quality of life as an outcome of social care for care-recipients and their carers. While it is known that carer choice (in terms of the decision of whether or not to provide care) is related to increased burden and poorer psychological health, there is limited evidence of the relationship between reasons for caring and care-related quality of life (CRQoL) and subjective strain in England. In this study, 387 carers were surveyed across 22 English local authorities between June 2013 and March 2014. Multiple regression analysis explored the relationship between carer-reported reasons for caring and CRQoL and strain, whilst controlling for individual characteristics (e.g. age). Reasons for caring were important predictors of CRQoL and strain. Where people were carers because social services suggested it or the care-recipient would not want help from anyone else, this was related to lower CRQoL. By contrast, where carers took on caregiving because they had time to care, this was significantly associated with better CRQoL. Carers reported greater strain where they provided care because it was expected of them. These findings are relevant to policy and practice because they indicate that, while social care systems rely on carers, the limiting of carers’ choice of whether to provide care is related to worse outcomes. Increased awareness of this relationship would be beneficial in developing policy and practice that improves the QoL of care-recipients and also their carers. What is known about the topic • Social care policy in England seeks to promote choice for service users and carers • Carer choice in terms of whether to provide care is often unacknowledged • Reasons for providing care are related to subjective burden and psychological health. What the paper adds • Caring because of social services’ or care-recipients’ expectations was related to lower care-related quality of life, which is a key outcome of adult social care • Providing care because it is expected of the carer was related to greater carer strain • Increased awareness of the relationship between carers’ reasons for caring and outcomes may usefully inform policy and practice that seeks to improve carers’ quality of life

Estimating the returns to UK publicly funded cancer-related research in terms of the net value of improved health outcomes

© 2014 Glover et al.; licensee BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.Background - Building on an approach developed to assess the economic returns to cardiovascular research, we estimated the economic returns from UK public and charitable funded cancer-related research that arise from the net value of the improved health outcomes. Methods - To assess these economic returns from cancer-related research in the UK we estimated: 1) public and charitable expenditure on cancer-related research in the UK from 1970 to 2009; 2) net monetary benefit (NMB), that is, the health benefit measured in quality adjusted life years (QALYs) valued in monetary terms (using a base-case value of a QALY of GB£25,000) minus the cost of delivering that benefit, for a prioritised list of interventions from 1991 to 2010; 3) the proportion of NMB attributable to UK research; 4) the elapsed time between research funding and health gain; and 5) the internal rate of return (IRR) from cancer-related research investments on health benefits. We analysed the uncertainties in the IRR estimate using sensitivity analyses to illustrate the effect of some key parameters. Results - In 2011/12 prices, total expenditure on cancer-related research from 1970 to 2009 was £15 billion. The NMB of the 5.9 million QALYs gained from the prioritised interventions from 1991 to 2010 was £124 billion. Calculation of the IRR incorporated an estimated elapsed time of 15 years. We related 17% of the annual NMB estimated to be attributable to UK research (for each of the 20 years 1991 to 2010) to 20 years of research investment 15 years earlier (that is, for 1976 to 1995). This produced a best-estimate IRR of 10%, compared with 9% previously estimated for cardiovascular disease research. The sensitivity analysis demonstrated the importance of smoking reduction as a major source of improved cancer-related health outcomes. Conclusions - We have demonstrated a substantive IRR from net health gain to public and charitable funding of cancer-related research in the UK, and further validated the approach that we originally used in assessing the returns from cardiovascular research. In doing so, we have highlighted a number of weaknesses and key assumptions that need strengthening in further investigations. Nevertheless, these cautious estimates demonstrate that the returns from past cancer research have been substantial, and justify the investments made during the period 1976 to 1995.Wellcome Trust, Cancer Research UK, the National Institute of Health Research, and the Academy of Medical Sciences

Genome-wide association study of primary open-angle glaucoma in continental and admixed African populations.

Primary open angle glaucoma (POAG) is a complex disease with a major genetic contribution. Its prevalence varies greatly among ethnic groups, and is up to five times more frequent in black African populations compared to Europeans. So far, worldwide efforts to elucidate the genetic complexity of POAG in African populations has been limited. We conducted a genome-wide association study in 1113 POAG cases and 1826 controls from Tanzanian, South African and African American study samples. Apart from confirming evidence of association at TXNRD2 (rs16984299; OR[T] 1.20; P = 0.003), we found that a genetic risk score combining the effects of the 15 previously reported POAG loci was significantly associated with POAG in our samples (OR 1.56; 95% CI 1.26-1.93; P = 4.79 × 10-5). By genome-wide association testing we identified a novel candidate locus, rs141186647, harboring EXOC4 (OR[A] 0.48; P = 3.75 × 10-8), a gene transcribing a component of the exocyst complex involved in vesicle transport. The low frequency and high degree of genetic heterogeneity at this region hampered validation of this finding in predominantly West-African replication sets. Our results suggest that established genetic risk factors play a role in African POAG, however, they do not explain the higher disease load. The high heterogeneity within Africans remains a challenge to identify the genetic commonalities for POAG in this ethnicity, and demands studies of extremely large size

Learning from the UK’s research impact assessment exercise: a case study of a retrospective impact assessment exercise and questions for the future

National governments spend significant amounts of money supporting public research. However, in an era where the international economic climate has led to budget cuts, policymakers increasingly are looking to justify the returns from public investments, including in science and innovation. The so-called ‘impact agenda’ which has emerged in many countries around the world is part of this response; an attempt to understand and articulate for the public what benefits arise from the research that is funded. The United Kingdom is the most progressed in implementing this agenda and in 2014 the national research assessment exercise, the Research Excellence Framework, for the first time included the assessment of research impact as a component. For the first time within a dual funding system, funding would be awarded not only on the basis of the academic quality of research, but also on the wider impacts of that research. In this paper we outline the context and approach taken by the UK government, along with some of the core challenges that exist in implementing such an exercise. We then synthesise, together for the first time, the results of the only two national evaluations of the exercise and offer reflections for future exercises both in the UK and internationally