Can programme theory be used as a 'translational tool’ to optimise health service delivery in a national early years’ initiative in Scotland: a case study

Background Theory-based evaluation (TBE) approaches are heralded as supporting formative evaluation by facilitating increased use of evaluative findings to guide programme improvement. It is essential that learning from programme implementation is better used to improve delivery and to inform other initiatives, if interventions are to be as effective as they have the potential to be. Nonetheless, few studies describe formative feedback methods, or report direct instrumental use of findings resulting from TBE. This paper uses the case of Scotland’s, National Health Service, early years’, oral health improvement initiative (Childsmile) to describe the use of TBE as a framework for providing feedback on delivery to programme staff and to assess its impact on programmatic action.<p></p> Methods In-depth, semi-structured interviews and focus groups with key stakeholders explored perceived deviations between the Childsmile programme 'as delivered’ and its Programme Theory (PT). The data was thematically analysed using constant comparative methods. Findings were shared with key programme stakeholders and discussions around likely impact and necessary actions were facilitated by the authors. Documentary review and ongoing observations of programme meetings were undertaken to assess the extent to which learning was acted upon.<p></p> Results On the whole, the activities documented in Childsmile’s PT were implemented as intended. This paper purposefully focuses on those activities where variation in delivery was evident. Differences resulted from the stage of roll-out reached and the flexibility given to individual NHS boards to tailor local implementation. Some adaptations were thought to have diverged from the central features of Childsmile’s PT, to the extent that there was a risk to achieving outcomes. The methods employed prompted national service improvement action, and proposals for local action by individual NHS boards to address this.<p></p> Conclusions The TBE approach provided a platform, to direct attention to areas of risk within a national health initiative, and to agree which intervention components were 'core’ to its hypothesised success. The study demonstrates that PT can be used as a 'translational tool’ to facilitate instrumental use of evaluative findings to optimise implementation within a complex health improvement programme.<p></p&gt

Understanding the theoretical underpinning of the exercise component in a fall prevention programme for older adults with mild dementia: a realist review protocol

Background Older adults with mild dementia are at an increased risk of falls. Preventing those at risk from falling requires complex interventions involving patient-tailored strength- and balance-challenging exercises, home hazard assessment, visual impairment correction, medical assessment and multifactorial combinations. Evidence for these interventions in older adults with mild cognitive problems is sparse and not as conclusive as the evidence for the general community-dwelling older population. The objectives of this realist review are (i) to identify the underlying programme theory of strength and balance exercise interventions targeted at those individuals that have been identified as falling and who have a mild dementia and (ii) to explore how and why that intervention reduces falls in that population, particularly in the context of a community setting. This protocol will explain the rationale for using a realist review approach and outline the method. Methods A realist review is a methodology that extends the scope of a traditional narrative or systematic evidence review. Increasingly used in the evaluation of complex interventions, a realist enquiry can look at the wider context of the intervention, seeking more to explain than judge if the intervention is effective by investigating why, what the underlying mechanism is and the necessary conditions for success. In this review, key rough programme theories were articulated and defined through discussion with a stakeholder group. The six rough programme theories outlined within this protocol will be tested against the literature found using the described comprehensive search strategy. The process of data extraction, appraisal and synthesis is outlined and will lead to the production of an explanatory programme theory. Discussion As far as the authors are aware, this is the first realist literature review within fall prevention research and adds to the growing use of this methodology within healthcare. This synthesis of evidence will provide a valuable addition to the evidence base surrounding the exercise component of a fall intervention programme for older adults with mild dementia and will ultimately provide clinically relevant recommendations for improving the care of people with dementia

Understanding the implementation and effectiveness of a group-based early parenting intervention : a process evaluation protocol

BACKGROUND: Group-based early parenting interventions delivered through community-based services may be a potentially effective means of promoting infant and family health and wellbeing. Process evaluations of these complex interventions provide vital information on how they work, as well as the conditions which shape and influence outcomes. This information is critical to decision makers and service providers who wish to embed prevention and early interventions in usual care settings. In this paper, a process evaluation protocol for an early years parenting intervention, the Parent and Infant (PIN) program, is described. This program combines a range of developmentally-appropriate supports, delivered in a single intervention process, for parents and infants (0–2 years) and aimed at enhancing parental competence, strengthening parent-infant relationships and improving infant wellbeing and adjustment. METHODS: The process evaluation is embedded within a controlled trial and accompanying cost-effectiveness evaluation. Building from extant frameworks and evaluation methods, this paper presents a systematic approach to the process evaluation of the PIN program and its underlying change principles, the implementation of the program, the context of implementation and the change mechanisms which influence and shape parent and infant outcomes. We will use a multi-method strategy, including semi-structured interviews and group discussions with key stakeholders, documentary analysis and survey methodology. DISCUSSION: The integration of innovations into existing early years systems and services is a challenging multifaceted undertaking. This process evaluation will make an important contribution to knowledge about the implementation of such programs, while also providing an example of how theory-based research can be embedded within the evaluation of community-based interventions. We discuss the strengths of the research, such as the adoption of a collaborative approach to data collection, while we also identify potential challenges, including capturing and assessing complex aspects of the intervention. TRIAL REGISTRATION: ISRCTN17488830 (Date of registration: 27/11/15). This trial was retrospectively registered. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1186/s12913-016-1737-3) contains supplementary material, which is available to authorized users

Realist evaluation of an enhanced health visiting programme

The health visitors' role in many countries is changing. In Scotland, the role has undergone substantial changes through the introduction of an enhanced health visiting programme, which includes increased, structured home visits. This evaluation was conducted within NHS Ayrshire and Arran, one of the 14 Scottish Health Boards. Our aim was to understand and explain how, and why, the programme could contribute to improving health and wellbeing outcomes for children and families.We used a realist evaluation approach, conducted in three phases. In phase one, eight managerial staff involved in developing and implementing the programme provided data, which were used to develop initial programme theories. In phase two, the programme theories were tested using qualitative data from 25 health visitors and 22 parents. The programme theories were refined through analyses and interpretation of data in phase three.The home visiting context provided by the programme interacted with the mechanisms of the programme and produced outcomes such as early identification of health and wellbeing issues amongst families who needed more support, leading to referral and engagement with sources of additional help. The home visits facilitated development of parent-health visitor relationships, and parents considered health visitors as their first point of contact on children's wellbeing and developmental-related issues. Moreover, the programme provided more clarity to health visitors' role, which in turn enhanced partnership working. However, there were aspects of the programme that may require further development. For instance, both parents and health visitors were concerned about the wide gaps between some home visits.The enhanced health visiting programme increased opportunities for monitoring and early identification of health and wellbeing concerns. It created structures for a more efficient partnership working and ensured that the needs of children and families were supported. These benefits need to be evaluated further in an effectiveness study

A realist approach to eliciting the initial programme theory of the antiretroviral treatment adherence club intervention in the Western Cape Province, South Africa

BACKGROUND: The successful initiation of people living with HIV/AIDS on antiretroviral therapy (ART) in South Africa has engendered challenges of poor retention in care and suboptimal adherence to medication. The adherence club intervention was implemented in the Metropolitan area of the Western Cape Province to address these challenges. The adherence club programme has shown potential to relieve clinic congestion, improve retention in care and enhance treatment adherence in the context of rapidly growing HIV patient populations being initiated on ART. Nevertheless, how and why the adherence club intervention works is not clearly understood. We aimed to elicit an initial programme theory as the first phase of the realist evaluation of the adherence club intervention in the Western Cape Province. METHODS: The realist evaluation approach guided the elicitation study. First, information was obtained from an exploratory qualitative study of programme designers’ and managers’ assumptions of the intervention. Second, a document review of the design, rollout, implementation and outcome of the adherence clubs followed. Third, a systematic review of available studies on group-based ART adherence support models in Sub-Saharan Africa was done, and finally, a scoping review of social, cognitive and behavioural theories that have been applied to explain adherence to ART. We used the realist evaluation heuristic tool (Intervention-context-actors-mechanism-outcome) to synthesise information from the sources into a configurational map. The configurational mapping, alignment of a specific combination of attributes, was based on the generative causality logic – retroduction. RESULTS: We identified two alternative theories: The first theory supposes that patients become encouraged, empowered and motivated, through the adherence club intervention to remain in care and adhere to the treatment. The second theory suggests that stable patients on ART are being nudged through club rules and regulations to remain in care and adhere to the treatment with the goal to decongest the primary health care facilities. CONCLUSION: The initial programme theory describes how (dynamics) and why (theories) the adherence club intervention is expected to work. By testing theories in “real intervention cases” using the realist evaluation approach, the theories can be modified, refuted and/or reconstructed to elicit a refined theory of how and why the adherence club intervention works