Research impact evaluation, a wider context: Findings from a research impact pilot

In the face of increasing pressure to demonstrate the socio-economic impact of funded research, whether it is funded directly by research councils or indirectly by governmental research block grants, institutions have to tackle the complexity of understanding, tracking, collecting, and analysing the impact of all their research activities. This paper attempts to encapsulate the wider context of research impact by delineating a broad definition of what might be classified as impact. It also suggests a number of different dimensions that can help in the development of a systematic research impact assessment framework. The paper then proceeds to indicate how boundaries and criteria around the definition of impact and these dimensions can be used to refine the impact assessment framework in order to focus on the objectives of the assessor. A pilot project, run at Brunel University, was used to test the validity of the approach and possible consequences. A tool specifically developed for the pilot, the Brunel Research Impact Device for Evaluation (BRIDE), is used for the analysis of research impact collected during the pilot. The paper reports on the findings of the analysis produced by BRIDE and confirms how a number of areas might be greatly affected by the boundaries set on definition and dimensions of research impact. The pilot project shows that useful information on impacts can be generated and it also provides a way to identify areas of work from each unit of assessment for which it would be worth developing narrative case studies. The pilot project has illustrated that it is feasible to make progress in terms of assessing impact, but that there are many difficulties to be addressed before impact assessment can be incorporated into a system of assessing the impact from the university sector as a whole. The paper concludes with an institutional perspective of the value of the approach and highlights possible applications. It also confirms the intention to expand the pilot and introduce new lines of investigation

Quantum Scaling Approach to Nonequilibrium Models

Stochastic nonequilibrium exclusion models are treated using a real space scaling approach. The method exploits the mapping between nonequilibrium and quantum systems, and it is developed to accommodate conservation laws and duality symmetries, yielding exact fixed points for a variety of exclusion models. In addition, it is shown how the asymmetric simple exclusion process in one dimension can be written in terms of a classical Hamiltonian in two dimensions using a Suzuki-Trotter decomposition.Comment: 17 page

Phase Transition in Two Species Zero-Range Process

We study a zero-range process with two species of interacting particles. We show that the steady state assumes a simple factorised form, provided the dynamics satisfy certain conditions, which we derive. The steady state exhibits a new mechanism of condensation transition wherein one species induces the condensation of the other. We study this mechanism for a specific choice of dynamics.Comment: 8 pages, 3 figure

Interaction driven real-space condensation

We study real-space condensation in a broad class of stochastic mass transport models. We show that the steady state of such models has a pair-factorised form which generalizes the standard factorized steady states. The condensation in this class of models is driven by interactions which give rise to a spatially extended condensate that differs fundamentally from the previously studied examples. We present numerical results as well as a theoretical analysis of the condensation transition and show that the criterion for condensation is related to the binding-unbinding transition of solid-on-solid interfaces.Comment: 4 page

Assessing the impact of health technology assessment in the Netherlands

Copyright © Cambridge University Press 2008Objectives: Investments in health research should lead to improvements in health and health care. This is also the remit of the main HTA program in the Netherlands. The aims of this study were to assess whether the results of this program have led to such improvements and to analyze how best to assess the impact from health research.Methods: We assessed the impact of individual HTA projects by adapting the "payback framework" developed in the United Kingdom. We conducted dossier reviews and sent a survey to principal investigators of forty-three projects awarded between 2000 and 2003. We then provided an overview of documented output and outcome that was assessed by ten HTA experts using a scoring method. Finally, we conducted five case studies using information from additional dossier review and semistructured key informant interviews.Results: The findings confirm that the payback framework is a useful approach to assess the impact of HTA projects. We identified over 101 peer reviewed papers, more than twenty-five PhDs, citations of research in guidelines (six projects), and implementation of new treatment strategies (eleven projects). The case studies provided greater depth and understanding about the levels of impact that arise and why and how they have been achieved.Conclusions: It is generally too early to determine whether the HTA program led to actual changes in healthcare policy and practice. However, the results can be used as a baseline measurement for future evaluation and can help funding organizations or HTA agencies consider how to assess impact, possibly routinely. This, in turn, could help inform research strategies and justify expenditure for health research.This research is funded by ZonMw, the Netherlands organization for health research and development (project 945-15-001)

Real-space renormalisation group approach to driven diffusive systems

We introduce a real-space renormalisation group procedure for driven diffusive systems which predicts both steady state and dynamic properties. We apply the method to the boundary driven asymmetric simple exclusion process and recover exact results for the steady state phase diagram, as well as the crossovers in the relaxation dynamics for each phase.Comment: 10 pages, 5 figure

Condensation transitions in a model for a directed network with weighted links

An exactly solvable model for the rewiring dynamics of weighted, directed networks is introduced. Simulations indicate that the model exhibits two types of condensation: (i) a phase in which, for each node, a finite fraction of its total out-strength condenses onto a single link; (ii) a phase in which a finite fraction of the total weight in the system is directed into a single node. A virtue of the model is that its dynamics can be mapped onto those of a zero-range process with many species of interacting particles -- an exactly solvable model of particles hopping between the sites of a lattice. This mapping, which is described in detail, guides the analysis of the steady state of the network model and leads to theoretical predictions for the conditions under which the different types of condensation may be observed. A further advantage of the mapping is that, by exploiting what is known about exactly solvable generalisations of the zero-range process, one can infer a number of generalisations of the network model and dynamics which remain exactly solvable.Comment: 23 pages, 8 figure

The information sources and journals consulted or read by UK paediatricians to inform their clinical practice and those which they consider important: a questionnaire survey

Background: Implementation of health research findings is important for medicine to be evidence-based. Previous studies have found variation in the information sources thought to be of greatest importance to clinicians but publication in peer-reviewed journals is the traditional route for dissemination of research findings. There is debate about whether the impact made on clinicians should be considered as part of the evaluation of research outputs. We aimed to determine first which information sources are generally most consulted by paediatricians to inform their clinical practice, and which sources they considered most important, and second, how many and which peer-reviewed journals they read. Methods: We enquired, by questionnaire survey, about the information sources and academic journals that UK medical paediatric specialists generally consulted, attended or read and considered important to their clinical practice. Results: The same three information sources – professional meetings & conferences, peerreviewed journals and medical colleagues – were, overall, the most consulted or attended and ranked the most important. No one information source was found to be of greatest importance to all groups of paediatricians. Journals were widely read by all groups, but the proportion ranking them first in importance as an information source ranged from 10% to 46%. The number of journals read varied between the groups, but Archives of Disease in Childhood and BMJ were the most read journals in all groups. Six out of the seven journals previously identified as containing best paediatric evidence are the most widely read overall by UK paediatricians, however, only the two most prominent are widely read by those based in the community. Conclusion: No one information source is dominant, therefore a variety of approaches to Continuing Professional Development and the dissemination of research findings to paediatricians should be used. Journals are an important information source. A small number of key ones can be identified and such analysis could provide valuable additional input into the evaluation of clinical research outputs

Health research improves healthcare: now we have the evidence and the chance to help the WHO spread such benefits globally

There has been a dramatic increase in the body of evidence demonstrating the benefits that come from health research. In 2014, the funding bodies for higher education in the UK conducted an assessment of research using an approach termed the Research Excellence Framework (REF). As one element of the REF, universities and medical schools in the UK submitted 1,621 case studies claiming to show the impact of their health and other life sciences research conducted over the last 20 years. The recently published results show many case studies were judged positively as providing examples of the wide range and extensive nature of the benefits from such research, including the development of new treatments and screening programmes that resulted in considerable reductions in mortality and morbidity. Analysis of specific case studies yet again illustrates the international dimension of progress in health research; however, as has also long been argued, not all populations fully share the benefits. In recognition of this, in May 2013 the World Health Assembly requested the World Health Organization (WHO) to establish a Global Observatory on Health Research and Development (R&D) as part of a strategic work-plan to promote innovation, build capacity, improve access, and mobilise resources to address diseases that disproportionately affect the world’s poorest countries. As editors of Health Research Policy and Systems (HARPS), we are delighted that our journal has been invited to help inform the establishment of the WHO Global Observatory through a Call for Papers covering a range of topics relevant to the Observatory, including topics on which HARPS has published articles over the last few months, such as approaches to assessing research results, measuring expenditure data with a focus on R&D, and landscape analyses of platforms for implementing R&D. Topics related to research capacity building may also be considered. The task of establishing a Global Observatory on Health R&D to achieve the specified objectives will not be easy; nevertheless, this Call for Papers is well timed – it comes just at the point where the evidence of the benefits from health research has been considerably strengthened