A realistic evaluation : the case of protocol-based care

Background 'Protocol based care' was envisioned by policy makers as a mechanism for delivering on the service improvement agenda in England. Realistic evaluation is an increasingly popular approach, but few published examples exist, particularly in implementation research. To fill this gap, within this paper we describe the application of a realistic evaluation approach to the study of protocol-based care, whilst sharing findings of relevance about standardising care through the use of protocols, guidelines, and pathways. Methods Situated between positivism and relativism, realistic evaluation is concerned with the identification of underlying causal mechanisms, how they work, and under what conditions. Fundamentally it focuses attention on finding out what works, for whom, how, and in what circumstances. Results In this research, we were interested in understanding the relationships between the type and nature of particular approaches to protocol-based care (mechanisms), within different clinical settings (context), and what impacts this resulted in (outcomes). An evidence review using the principles of realist synthesis resulted in a number of propositions, i.e., context, mechanism, and outcome threads (CMOs). These propositions were then 'tested' through multiple case studies, using multiple methods including non-participant observation, interviews, and document analysis through an iterative analysis process. The initial propositions (conjectured CMOs) only partially corresponded to the findings that emerged during analysis. From the iterative analysis process of scrutinising mechanisms, context, and outcomes we were able to draw out some theoretically generalisable features about what works, for whom, how, and what circumstances in relation to the use of standardised care approaches (refined CMOs). Conclusions As one of the first studies to apply realistic evaluation in implementation research, it was a good fit, particularly given the growing emphasis on understanding how context influences evidence-based practice. The strengths and limitations of the approach are considered, including how to operationalise it and some of the challenges. This approach provided a useful interpretive framework with which to make sense of the multiple factors that were simultaneously at play and being observed through various data sources, and for developing explanatory theory about using standardised care approaches in practice

'Working the system'. Achieving change through partnership working: an evaluation of cancer partnership groups

Aims and objectives: to investigate the characteristics and achievements of cancer partnership groups – collaborative service improvement groups formed of NHS staff and service users – in the 34 cancer networks in England, and in particular to explore the influence that such groups had on local cancer services.Design: a qualitative approach employing a structured telephone survey, face-to-face interviews and documentary analysis.Participants and setting: thirty cancer networks in England with an active Partnership Group completed the telephone survey. From these 30 networks, six networks were subsequently selected from which service users and NHS professionals involved in partnership groups and NHS professionals who were non-members were recruited to take part in face-to-face interviews.Results and conclusions: partnership groups were established in the majority of cancer networks. Typically, these groups were at network level, been established for less than a year, met once every 2 months, and were populated with both service users and health-care professionals. Five common activities and achievements were identified: establishment of the group itself; acting as a 'reference' group for consultation; networking and representation on other groups; patient information and communication and proactive influencing. Activities progressed in scale and complexity as groups evolved. Groups had learnt the basics of change management and some identified a more sophisticated understanding of change processes in the NHS as essential for the group's motivation and survival. When gauging the impact of involvement strategies it would seem important to subscribe to broad indicators of success that include both process and outcome measure

The art of auscultation: evaluating a patient's respiratory pathology

This article considers national policy drivers promoting the development of advanced assessment skills and practical procedures for the safe and effective use of the stethoscope in the clinical area. The evidence base underpinning effective use of the stethoscope in clinical practice is explored, including the preparation of the patient and the environment, applying infection control policies, and placing an emphasis on privacy and dignity. This is followed by a practical guide to auscultation technique of the respiratory system for nurses developing advanced practice skills