A realistic evaluation : the case of protocol-based care

Background 'Protocol based care' was envisioned by policy makers as a mechanism for delivering on the service improvement agenda in England. Realistic evaluation is an increasingly popular approach, but few published examples exist, particularly in implementation research. To fill this gap, within this paper we describe the application of a realistic evaluation approach to the study of protocol-based care, whilst sharing findings of relevance about standardising care through the use of protocols, guidelines, and pathways. Methods Situated between positivism and relativism, realistic evaluation is concerned with the identification of underlying causal mechanisms, how they work, and under what conditions. Fundamentally it focuses attention on finding out what works, for whom, how, and in what circumstances. Results In this research, we were interested in understanding the relationships between the type and nature of particular approaches to protocol-based care (mechanisms), within different clinical settings (context), and what impacts this resulted in (outcomes). An evidence review using the principles of realist synthesis resulted in a number of propositions, i.e., context, mechanism, and outcome threads (CMOs). These propositions were then 'tested' through multiple case studies, using multiple methods including non-participant observation, interviews, and document analysis through an iterative analysis process. The initial propositions (conjectured CMOs) only partially corresponded to the findings that emerged during analysis. From the iterative analysis process of scrutinising mechanisms, context, and outcomes we were able to draw out some theoretically generalisable features about what works, for whom, how, and what circumstances in relation to the use of standardised care approaches (refined CMOs). Conclusions As one of the first studies to apply realistic evaluation in implementation research, it was a good fit, particularly given the growing emphasis on understanding how context influences evidence-based practice. The strengths and limitations of the approach are considered, including how to operationalise it and some of the challenges. This approach provided a useful interpretive framework with which to make sense of the multiple factors that were simultaneously at play and being observed through various data sources, and for developing explanatory theory about using standardised care approaches in practice

Impact of the Brush Day & Night Programme on Well-Being, Plaque, and Dental Caries in Children

Objectives: Poor oral hygiene can have an adverse effect on quality of life. School-based interventions can establish positive behaviours that reduce the likelihood of dental caries later in life. The Brush Day & Night programme aims to encourage good oral health behaviour and improve oral health and quality-of-life outcomes. In this article, we report the effect of the programme on well-being and oral hygiene measured by plaque levels at 3, 8, and 24 weeks and dental caries at 24 weeks after programme start date. Methods: This was a superiority cluster randomised trial of children 6-12 years of age from Indonesia (N = 2021) and Nigeria (N = 2104). All children were provided with toothpaste and a toothbrush. Children in the intervention group received the 21-day Brush Day & Night programme, whereas those in the control group did not. Children completed a questionnaire addressing the objectives at all time points. Their oral hygiene was assessed using the Oral Hygiene Index-Simplified (OHI-S). Additionally, at baseline and 24 weeks their caries status was recorded using the decayed, missing, and filled teeth (DMFT) index. Results: In Indonesia, after participation in the programme children demonstrated a 45% increased probability of no worsening in the occurrence of decayed, missing, or filled teeth. In Nigeria, children had a 71% higher probability of having confidence in their smile and the proportion of children with good oral hygiene doubled from 40% to 80% at 24 weeks. Conclusions: The Brush Day & Night programme was successful in improving well-being and oral hygiene in children in Nigeria and reduced the likelihood of worsening in the occurrence of decayed, missing, or filled teeth in children in Indonesia.This article is published as part of a supplement sponsored by Unilever. Medical writing assistance, in the form of preparation and revision of the manuscript, as well as support of the conduct of the research, was supported financially by Unilever

The move beyond edutainment: have we learnt our lessons from the entertainment industry?

Serious games (SGs) have been used in the education of students and professionals for decades, but still have not reached their full potential, despite the large consensus they have gained recently. The entertainment game industry is a rapidly developing phenomenon, with a high market potential, enabled and enhanced by technological innovation. The question examined in this paper is: Did serious game designers learn from Entertainment Game (EG) designers in building a successful game? This paper presents three case study examples of games that have good learning outcomes to explore this question. This paper discusses the salient aspects and the differences between the examples and suggests how SGs could learn more from successful EGs

Endogenous fantasy and learning in digital games.

Many people believe that educational games are effective because they motivate children to actively engage in a learning activity as part of playing the game. However, seminal work by Malone (1981), exploring the motivational aspects of digital games, concluded that the educational effectiveness of a digital game depends on the way in which learning content is integrated into the fantasy context of the game. In particular, he claimed that content which is intrinsically related to the fantasy will produce better learning than that which is merely extrinsically related. However, this distinction between intrinsic and extrinsic (or endogenous and exogenous) fantasy is a concept that has developed a confused standing over the following years. This paper will address this confusion by providing a review and critique of the empirical and theoretical foundations of endogenous fantasy, and its relevance to creating educational digital games. Substantial concerns are raised about the empirical basis of this work and a theoretical critique of endogenous fantasy is offered, concluding that endogenous fantasy is a misnomer, in so far as the "integral and continuing relationship" of fantasy cannot be justified as a critical means of improving the effectiveness of educational digital games. An alternative perspective on the intrinsic integration of learning content is described, incorporating game mechanics, flow and representations

Brush Day & Night Phase III to Phase IV: ensuring that good oral health habits are sustainable

Over the past 10 years, the FDI-Unilever Brush Day & Night partnership has significantly influenced the life of children worldwide through the implementation of school programmes for oral health education and prevention. This article reports the key facts and outcomes of Phase III of the partnership, and announces the launch of Phase IV. During Phase III, the expert advisors of the Brush Day & Night partnership conducted a longitudinal study to evaluate the impact of the '21 Day' programme in almost 8,000 children in 10 countries. Analysis revealed the effectiveness of the 21 Day programme in sustainably educating children to brush their teeth twice a day, with the greatest impact observed in children aged 7-9 years. With the launch of Phase IV, the Brush Day & Night partnership will continue to deliver its oral health school programme for 7-9 year-old children with a strengthened methodology, including randomized sampling and control groups. The scope of the evaluation will be broadened to include oral health-related quality of life indicators, and monitoring of the oral health knowledge of children's parents/carers.The work presented in this article was made possible through an unrestricted grant from Unilever Oral Care. All authors are grateful to Mr Sean Taylor for his editorial review of this article