Can programme theory be used as a 'translational tool’ to optimise health service delivery in a national early years’ initiative in Scotland: a case study

Background Theory-based evaluation (TBE) approaches are heralded as supporting formative evaluation by facilitating increased use of evaluative findings to guide programme improvement. It is essential that learning from programme implementation is better used to improve delivery and to inform other initiatives, if interventions are to be as effective as they have the potential to be. Nonetheless, few studies describe formative feedback methods, or report direct instrumental use of findings resulting from TBE. This paper uses the case of Scotland’s, National Health Service, early years’, oral health improvement initiative (Childsmile) to describe the use of TBE as a framework for providing feedback on delivery to programme staff and to assess its impact on programmatic action.<p></p> Methods In-depth, semi-structured interviews and focus groups with key stakeholders explored perceived deviations between the Childsmile programme 'as delivered’ and its Programme Theory (PT). The data was thematically analysed using constant comparative methods. Findings were shared with key programme stakeholders and discussions around likely impact and necessary actions were facilitated by the authors. Documentary review and ongoing observations of programme meetings were undertaken to assess the extent to which learning was acted upon.<p></p> Results On the whole, the activities documented in Childsmile’s PT were implemented as intended. This paper purposefully focuses on those activities where variation in delivery was evident. Differences resulted from the stage of roll-out reached and the flexibility given to individual NHS boards to tailor local implementation. Some adaptations were thought to have diverged from the central features of Childsmile’s PT, to the extent that there was a risk to achieving outcomes. The methods employed prompted national service improvement action, and proposals for local action by individual NHS boards to address this.<p></p> Conclusions The TBE approach provided a platform, to direct attention to areas of risk within a national health initiative, and to agree which intervention components were 'core’ to its hypothesised success. The study demonstrates that PT can be used as a 'translational tool’ to facilitate instrumental use of evaluative findings to optimise implementation within a complex health improvement programme.<p></p&gt

Building the capacity to solve complex health challenges in Sub-Saharan Africa : CARTA’s multidisciplinary PhD training

Objectives: To develop a curriculum (Joint Advanced Seminars- JAS) that produced PhD fellows who understood that health is an outcome of multiple determinants within complex environments and that approaches from a range of disciplines is required to address health and development within the Consortium for Advanced Research Training in Africa. We sought to attract PhD fellows, supervisors and teaching faculty from a range of disciplines into the program. Methods: Multidisciplinary teams developed the JAS curriculum. CARTA PhD fellowships were open to academics in consortium member institutions, irrespective of primary discipline, interested in doing a PhD in public and population health. Supervisors and JAS faculty were recruited from CARTA institutions. We use routine JAS evaluation data (closed and open ended questions) collected from PhD fellows at every JAS, a survey of one CARTA cohort and an external evaluation of CARTA to assess the impact of the JAS curriculum on learning. Results: We describe our pedagogic approach arguing its centrality to an appreciation of multiple disciplines and illustrate how it promotes working in multidisciplinary ways. CARTA has attracted PhD fellows, supervisors and JAS teaching faculty from across a range of disciplines. Evaluations indicate PhD fellows have a greater appreciation of how disciplines other than their own are important to understand health and its determinants and an appreciation and capacity to employ mixed methods research. Conclusions: In the short-term, we have been effective in promoting an understanding of multidisciplinarity resulting in fellows using methods from beyond their discipline of origin. This curriculum has international application

Understanding the implementation and effectiveness of a group-based early parenting intervention : a process evaluation protocol

BACKGROUND: Group-based early parenting interventions delivered through community-based services may be a potentially effective means of promoting infant and family health and wellbeing. Process evaluations of these complex interventions provide vital information on how they work, as well as the conditions which shape and influence outcomes. This information is critical to decision makers and service providers who wish to embed prevention and early interventions in usual care settings. In this paper, a process evaluation protocol for an early years parenting intervention, the Parent and Infant (PIN) program, is described. This program combines a range of developmentally-appropriate supports, delivered in a single intervention process, for parents and infants (0–2 years) and aimed at enhancing parental competence, strengthening parent-infant relationships and improving infant wellbeing and adjustment. METHODS: The process evaluation is embedded within a controlled trial and accompanying cost-effectiveness evaluation. Building from extant frameworks and evaluation methods, this paper presents a systematic approach to the process evaluation of the PIN program and its underlying change principles, the implementation of the program, the context of implementation and the change mechanisms which influence and shape parent and infant outcomes. We will use a multi-method strategy, including semi-structured interviews and group discussions with key stakeholders, documentary analysis and survey methodology. DISCUSSION: The integration of innovations into existing early years systems and services is a challenging multifaceted undertaking. This process evaluation will make an important contribution to knowledge about the implementation of such programs, while also providing an example of how theory-based research can be embedded within the evaluation of community-based interventions. We discuss the strengths of the research, such as the adoption of a collaborative approach to data collection, while we also identify potential challenges, including capturing and assessing complex aspects of the intervention. TRIAL REGISTRATION: ISRCTN17488830 (Date of registration: 27/11/15). This trial was retrospectively registered. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1186/s12913-016-1737-3) contains supplementary material, which is available to authorized users

Conceptual frameworks and empirical approaches used to assess the impact of health research: an overview of reviews

<p>Abstract</p> <p>Background</p> <p>How to assess the impact of research is of growing interest to funders, policy makers and researchers mainly to understand the value of investments and to increase accountability. Broadly speaking the term "research impact" refers to the contribution of research activities to achieve desired societal outcomes. The aim of this overview is to identify the most common approaches to research impact assessment, categories of impact and their respective indicators.</p> <p>Methods</p> <p>We systematically searched the relevant literature (PubMed, The Cochrane Library (1990-2009)) and funding agency websites. We included systematic reviews, theoretical and methodological papers, and empirical case-studies on how to evaluate research impact. We qualitatively summarised the included reports, as well the conceptual frameworks.</p> <p>Results</p> <p>We identified twenty-two reports belonging to four systematic reviews and 14 primary studies. These publications reported several theoretical frameworks and methodological approaches (bibliometrics, econometrics, ad hoc case studies). The "payback model" emerged as the most frequently used. Five broad categories of impact were identified: a) advancing knowledge, b) capacity building, c) informing decision-making, d) health benefits, e) broad socio-economic benefits. For each proposed category of impact we summarized a set of indicators whose pros and cons are presented and briefly discussed.</p> <p>Conclusions</p> <p>This overview is a comprehensive, yet descriptive, contribution to summarize the conceptual framework and taxonomy of an heterogeneous and evolving area of research. A shared and comprehensive conceptual framework does not seem to be available yet and its single components (epidemiologic, economic, and social) are often valued differently in different models.</p