A realistic evaluation : the case of protocol-based care

Background 'Protocol based care' was envisioned by policy makers as a mechanism for delivering on the service improvement agenda in England. Realistic evaluation is an increasingly popular approach, but few published examples exist, particularly in implementation research. To fill this gap, within this paper we describe the application of a realistic evaluation approach to the study of protocol-based care, whilst sharing findings of relevance about standardising care through the use of protocols, guidelines, and pathways. Methods Situated between positivism and relativism, realistic evaluation is concerned with the identification of underlying causal mechanisms, how they work, and under what conditions. Fundamentally it focuses attention on finding out what works, for whom, how, and in what circumstances. Results In this research, we were interested in understanding the relationships between the type and nature of particular approaches to protocol-based care (mechanisms), within different clinical settings (context), and what impacts this resulted in (outcomes). An evidence review using the principles of realist synthesis resulted in a number of propositions, i.e., context, mechanism, and outcome threads (CMOs). These propositions were then 'tested' through multiple case studies, using multiple methods including non-participant observation, interviews, and document analysis through an iterative analysis process. The initial propositions (conjectured CMOs) only partially corresponded to the findings that emerged during analysis. From the iterative analysis process of scrutinising mechanisms, context, and outcomes we were able to draw out some theoretically generalisable features about what works, for whom, how, and what circumstances in relation to the use of standardised care approaches (refined CMOs). Conclusions As one of the first studies to apply realistic evaluation in implementation research, it was a good fit, particularly given the growing emphasis on understanding how context influences evidence-based practice. The strengths and limitations of the approach are considered, including how to operationalise it and some of the challenges. This approach provided a useful interpretive framework with which to make sense of the multiple factors that were simultaneously at play and being observed through various data sources, and for developing explanatory theory about using standardised care approaches in practice

Endogenous fantasy and learning in digital games.

Many people believe that educational games are effective because they motivate children to actively engage in a learning activity as part of playing the game. However, seminal work by Malone (1981), exploring the motivational aspects of digital games, concluded that the educational effectiveness of a digital game depends on the way in which learning content is integrated into the fantasy context of the game. In particular, he claimed that content which is intrinsically related to the fantasy will produce better learning than that which is merely extrinsically related. However, this distinction between intrinsic and extrinsic (or endogenous and exogenous) fantasy is a concept that has developed a confused standing over the following years. This paper will address this confusion by providing a review and critique of the empirical and theoretical foundations of endogenous fantasy, and its relevance to creating educational digital games. Substantial concerns are raised about the empirical basis of this work and a theoretical critique of endogenous fantasy is offered, concluding that endogenous fantasy is a misnomer, in so far as the "integral and continuing relationship" of fantasy cannot be justified as a critical means of improving the effectiveness of educational digital games. An alternative perspective on the intrinsic integration of learning content is described, incorporating game mechanics, flow and representations

WLAN Channel Selection Without Communication

In this paper we consider how a group of wireless access-points can self-configure their channel choice so as to avoid interference between one another and thereby maximise network capacity. We make the observation that communication between access points is not necessary, although it is a feature of almost all published channel allocation algorithms. We argue that this observation is of key practical importance as, except in special circumstances, interfering WLANs need not all lie in the same administrative domain and/or may be beyond wireless communication distance (although within interference distance). We demonstrate the feasibility of the communicationfree paradigm via a new class of decentralized algorithms that are simple, robust and provably correct for arbitrary interference graphs. The algorithm requires only standard hardware and we demonstrate its effectiveness via experimental measurements

A case study evaluation of implementation of a care pathway to support normal birth in one English birth centre: anticipated benefits and unintended consequences

Background: The policy drive for the UK National Health Service (NHS) has focused on the need for high quality services informed by evidence of best practice. The introduction of care pathways and protocols to standardise care and support implementation of evidence into practice has taken place across the NHS with limited evaluation of their impact. A multi-site case study evaluation was undertaken to assess the impact of use of care pathways and protocols on clinicians, service users and service delivery. One of the five sites was a midwifery-led Birth Centre, where an adapted version of the All Wales Clinical Pathway for Normal Birth had been implemented. Methods: The overarching framework was realistic evaluation. A case study design enabled the capture of data on use of the pathway in the clinical setting, use of multiple methods of data collection and opportunity to study and understand the experiences of clinicians and service users whose care was informed by the pathway. Women attending the Birth Centre were recruited at their 36 week antenatal visit. Episodes of care during labour were observed, following which the woman and the midwife who cared for her were interviewed about use of the pathway. Interviews were also held with other key stakeholders from the study site. Qualitative data were content analysed. Results: Observations were undertaken of four women during labour. Eighteen interviews were conducted with clinicians and women, including the women whose care was observed and the midwives who cared for them, senior midwifery managers and obstetricians. The implementation of the pathway resulted in a number of anticipated benefits, including increased midwifery confidence in skills to support normal birth and promotion of team working. There were also unintended consequences, including concerns about a lack of documentation of labour care and negative impact on working relationships with obstetric and other midwifery colleagues. Women were unaware their care was informed by a care pathway. Conclusion: Care pathways are complex interventions which generate a number of consequences for practice. Those considering introduction of pathways need to ensure all relevant stakeholders are engaged with this and develop robust evaluation strategies to accompany implementation

Use of Otolith Strontium:Calcium Ratios for Hindcasting Larval Cod Gadus Morhua Distributions Relative to Water Masses on Georges Bank

The concentration ratios of strontium to calcium in laboratory-reared larval cod otoliths are shown to be related to the water temperature (T) at the time of otolith precipitation. This relationship is curvilinear, and is best described by a simple exponential equation of the form (Sr/Ca x 1000 = a exp(-T/b). We show that when Sr/Ca elemental analyses are related to the daily growth increments in the larval otoliths, relative temperature histories of individual field-caught larvae can be reconstructed from the egg stage to the time of capture. We present preliminary examples of how such reconstructed temperature histories of Atlantic cod Gadus morhua larvae, collected on Georges Bank during April and May 1993, may be interpreted in relation to the broad-scale larval distributions and the hydrography of the Bank

Experimental implementation of optimal WLAN channel selection without communication

Proposed a simple decentralised algorithm for channel allocation that is provably correct and requires no message passing or common administrative control between interfering WLANs. In this paper we implement this algorithm using a standard 802.11 hardware testbed and demonstrate that it does indeed offer the potential for effective channel allocation in realistic environments. This includes environments with complex, spatially varying noise and channel dependent propagation behaviour and with time-varying load

A survey on the English FA heading guidelines for youth soccer: Evidence of compliance, but with limited knowledge of safety

Soccer heading may be problematic for neurocognitive function. The English Football Association (FA) recently introduced guidelines in order to limit the number of headers within training for youth soccer. However, it remains to be seen what the influence of these guidelines has been on the leaders of soccer teams that are primarily responsible for implementing the guidelines. Thus, we aimed to explore grassroot youth coaches’ knowledge of, views on, and adherence to the heading guidelines. An online survey was distributed to team representatives across Local County FAs. The survey comprised of three sections: (1) background information, (2) heading practices including details on heading activities and views on heading safety, and (3) heading guidelines including levels of awareness, knowledge, and compliance. 240 coaches responded by stating they rarely (21%) or never (73%) practiced heading, although they mostly perceived heading as being somewhat safe (36%). While respondents indicated being only somewhat aware of the guidelines (43%), they scored very high on their perceived (92%) and actual (based on retrospective accounts of heading) (87%) compliance with the guidelines. There was a mixed perceived change within practice following the introduction of the guidelines (disagree = 26% vs. agree = 22%), and they were perceived as safe (86%) and appropriate (81%). Factors that were identified as being potential barriers were only marginally agreed upon (<30%) and tended to be related to in-game rules. While there is scope to successfully implement heading guidelines, there is some discrepancy between the requirements for heading safety and coaches’ knowledge

Absorbent products for urinary/faecal incontinence: a comparative evaluation of key product designs

Background: The UK health service, nursing homes and public spend around £94 million per year on incontinence pads (absorbent products) to contain urine and/or faeces, but the research base for making informed choices between different product designs is very weak.Objectives: The aim of this trial was to compare the performance and cost-effectiveness of the key absorbent product designs to provide a more solid basis for guiding selection and purchase.A further aim was to carry out the first stage in the development of a quality of life instrument for measuring the impact of absorbent product use on users' lives.Design: The work involved three clinical trials focusing on the three biggest market sectors. Each trial had a similar crossover design in which each participant tested all products within their group in random order.Settings, participants and methods: In Trial 1, 85 women with light urinary incontinence living in the community tested three products from each of the four design categories available (total of 12 test products): disposable inserts (pads); menstrual pads; washable pants with integral pad; and washable inserts. In Trial 2a, 85 moderate/heavily incontinent adults (urinary or urinary/faecal) living in the community (49 men and 36 women) tested three (or two) products from each of the five design categories available (total of 14 test products): disposable inserts (with mesh pants); disposable diapers (nappies); disposable pull-ups (similar to toddlers' trainer pants); disposable T-shaped diapers (nappies with waist-band); and washable diapers. All products were provided in a daytime and a (mostly more absorbent) night-time variant. In these first two trials, the test products were selected on the basis of data from pilot studies. In Trial 2b, 100 moderate/heavily incontinent adults (urinary or urinary/faecal) living in 10 nursing homes (27 men and 73 women) evaluated one product from each of the four disposable design categories from Trial 2a. Products were selected on the basis of product performance in Trial 2a and, again, daytime and night-time variants were provided. The first phase of work to develop a quality of life tool for measuring the impact of using different pad designs was carried out by interviewing participants from Trials 1 and 2a.Outcome measures: Product performance was characterised using validated questionnaires, which asked the participants (in Trials 1 and 2a) or carers (all participants in Trial 2b, except for the few who could report for themselves) to evaluate various aspects of pad performance (leakage, ease of putting on, discreetness, etc.) using a five-point scale (very good–very poor) at the end of the week (or 2 weeks for Trial 2b) of product testing. In addition, participants/carers were asked to save individual used pads in bags for weighing and to indicate the severity of any leakage from them on a three-point scale (none, a little, a lot). These data were used to determine differences in leakage performance. Numbers of laundry items and pads used were recorded to estimate costs, and skin health changes were recorded by the participant or by the researchers (Trial 2b). At the end of testing, participants were interviewed and ranked their preferences (with and without costs), stated the acceptability of each design (highly acceptable–totally unacceptable) and recorded their overall opinion on a visual analogue scale (VAS) of 0–100 points (worst design–best design). This VAS score was used with product costs to estimate cost-effectiveness. In addition, a timed pad changing exercise was conducted with 10 women from Trial 2b to determine any differences between product designs.Results: Results presented are for statistically and clinically significant findings.<br/