Systematic evaluation of implementation fidelity of complex interventions in health and social care

<p>Abstract</p> <p>Background</p> <p>Evaluation of an implementation process and its fidelity can give insight into the 'black box' of interventions. However, a lack of standardized methods for studying fidelity and implementation process have been reported, which might be one reason for the fact that few prior studies in the field of health service research have systematically evaluated interventions' implementation processes.</p> <p>The aim of this project is to systematically evaluate implementation fidelity and possible factors influencing fidelity of complex interventions in health and social care.</p> <p>Methods</p> <p>A modified version of The Conceptual Framework for Implementation Fidelity will be used as a conceptual model for the evaluation. The modification implies two additional moderating factors: context and recruitment. A systematic evaluation process was developed. Multiple case study method is used to investigate implementation of three complex health service interventions. Each case will be investigated in depth and longitudinally, using both quantitative and qualitative methods.</p> <p>Discussion</p> <p>This study is the first attempt to empirically test The Conceptual Framework for Implementation Fidelity. The study can highlight mechanism and factors of importance when implementing complex interventions. Especially the role of the moderating factors on implementation fidelity can be clarified.</p> <p>Trial Registration</p> <p>Supported Employment, SE, among people with severe mental illness -- a randomized controlled trial: NCT00960024.</p

Fidelity and moderating factors in complex interventions: a case study of a continuum of care program for frail elderly people in health and social care

<p>Abstract</p> <p>Background</p> <p>Prior studies measuring fidelity of complex interventions have mainly evaluated adherence, and not taken factors affecting adherence into consideration. A need for studies that clarify the concept of fidelity and the function of factors moderating fidelity has been emphasized. The aim of the study was to systematically evaluate implementation fidelity and possible factors influencing fidelity of a complex care continuum intervention for frail elderly people.</p> <p>Methods</p> <p>The intervention was a systematization of the collaboration between a nurse with geriatric expertise situated at the emergency department, the hospital ward staff, and a multi-professional team with a case manager in the municipal care services for older people. Implementation was evaluated between September 2008 and May 2010 with observations of work practices, stakeholder interviews, and document analysis according to a modified version of The Conceptual Framework for Implementation Fidelity.</p> <p>Results</p> <p>A total of 16 of the 18 intervention components were to a great extent delivered as planned, while some new components were added to the model. No changes in the frequency or duration of the 18 components were observed, but the dose of the added components varied over time. Changes in fidelity were caused in a complex, interrelated fashion by all the moderating factors in the framework, i.e., context, staff and participant responsiveness, facilitation, recruitment, and complexity.</p> <p>Discussion</p> <p>The Conceptual Framework for Implementation Fidelity was empirically useful and included comprehensive measures of factors affecting fidelity. Future studies should focus on developing the framework with regard to how to investigate relationships between the moderating factors and fidelity over time.</p> <p>Trial registration</p> <p>ClinicalTrials.gov, <a href="http://www.clinicaltrials.gov/ct2/show/NCT01260493">NCT01260493</a>.</p

The Effects of Two Types of Sleep Deprivation on Visual Working Memory Capacity and Filtering Efficiency

Sleep deprivation has adverse consequences for a variety of cognitive functions. The exact effects of sleep deprivation, though, are dependent upon the cognitive process examined. Within working memory, for example, some component processes are more vulnerable to sleep deprivation than others. Additionally, the differential impacts on cognition of different types of sleep deprivation have not been well studied. The aim of this study was to examine the effects of one night of total sleep deprivation and 4 nights of partial sleep deprivation (4 hours in bed/night) on two components of visual working memory: capacity and filtering efficiency. Forty-four healthy young adults were randomly assigned to one of the two sleep deprivation conditions. All participants were studied: 1) in a well-rested condition (following 6 nights of 9 hours in bed/night); and 2) following sleep deprivation, in a counter-balanced order. Visual working memory testing consisted of two related tasks. The first measured visual working memory capacity and the second measured the ability to ignore distractor stimuli in a visual scene (filtering efficiency). Results showed neither type of sleep deprivation reduced visual working memory capacity. Partial sleep deprivation also generally did not change filtering efficiency. Total sleep deprivation, on the other hand, did impair performance in the filtering task. These results suggest components of visual working memory are differentially vulnerable to the effects of sleep deprivation, and different types of sleep deprivation impact visual working memory to different degrees. Such findings have implications for operational settings where individuals may need to perform with inadequate sleep and whose jobs involve receiving an array of visual information and discriminating the relevant from the irrelevant prior to making decisions or taking actions (e.g., baggage screeners, air traffic controllers, military personnel, health care providers)

Implementing the LifeSkills Training drug prevention program: factors related to implementation fidelity

<p>Abstract</p> <p>Background</p> <p>Widespread replication of effective prevention programs is unlikely to affect the incidence of adolescent delinquency, violent crime, and substance use until the quality of implementation of these programs by community-based organizations can be assured.</p> <p>Methods</p> <p>This paper presents the results of a process evaluation employing qualitative and quantitative methods to assess the extent to which 432 schools in 105 sites implemented the LifeSkills Training (LST) drug prevention program with fidelity. Regression analysis was used to examine factors influencing four dimensions of fidelity: adherence, dosage, quality of delivery, and student responsiveness.</p> <p>Results</p> <p>Although most sites faced common barriers, such as finding room in the school schedule for the program, gaining full support from key participants (i.e., site coordinators, principals, and LST teachers), ensuring teacher participation in training workshops, and classroom management difficulties, most schools involved in the project implemented LST with very high levels of fidelity. Across sites, 86% of program objectives and activities required in the three-year curriculum were delivered to students. Moreover, teachers were observed using all four recommended teaching practices, and 71% of instructors taught all the required LST lessons. Multivariate analyses found that highly rated LST program characteristics and better student behavior were significantly related to a greater proportion of material taught by teachers (adherence). Instructors who rated the LST program characteristics as ideal were more likely to teach all lessons (dosage). Student behavior and use of interactive teaching techniques (quality of delivery) were positively related. No variables were related to student participation (student responsiveness).</p> <p>Conclusion</p> <p>Although difficult, high implementation fidelity by community-based organizations can be achieved. This study suggests some important factors that organizations should consider to ensure fidelity, such as selecting programs with features that minimize complexity while maximizing flexibility. Time constraints in the classroom should be considered when choosing a program. Student behavior also influences program delivery, so schools should train teachers in the use of classroom management skills. This project involved comprehensive program monitoring and technical assistance that likely facilitated the identification and resolution of problems and contributed to the overall high quality of implementation. Schools should recognize the importance of training and technical assistance to ensure quality program delivery.</p

Study protocol for a group randomized controlled trial of a classroom-based intervention aimed at preventing early risk factors for drug abuse: integrating effectiveness and implementation research

<p>Abstract</p> <p>Background</p> <p>While a number of preventive interventions delivered within schools have shown both short-term and long-term impact in epidemiologically based randomized field trials, programs are not often sustained with high-quality implementation over time. This study was designed to support two purposes. The first purpose was to test the effectiveness of a universal classroom-based intervention, the Whole Day First Grade Program (WD), aimed at two early antecedents to drug abuse and other problem behaviors, namely, aggressive, disruptive behavior and poor academic achievement. The second purpose--the focus of this paper--was to examine the utility of a multilevel structure to support high levels of implementation during the effectiveness trial, to sustain WD practices across additional years, and to train additional teachers in WD practices.</p> <p>Methods</p> <p>The WD intervention integrated three components, each previously tested separately: classroom behavior management; instruction, specifically reading; and family-classroom partnerships around behavior and learning. Teachers and students in 12 schools were randomly assigned to receive either the WD intervention or the standard first-grade program of the school system (SC). Three consecutive cohorts of first graders were randomized within schools to WD or SC classrooms and followed through the end of third grade to test the effectiveness of the WD intervention. Teacher practices were assessed over three years to examine the utility of the multilevel structure to support sustainability and scaling-up.</p> <p>Discussion</p> <p>The design employed in this trial appears to have considerable utility to provide data on WD effectiveness and to inform the field with regard to structures required to move evidence-based programs into practice.</p> <p>Trial Registration</p> <p><b>Clinical Trials Registration Number</b>: NCT00257088</p

Leading Mindfully: Two Studies of the Influence of Supervisor Trait Mindfulness on Employee Well-Being and Performance

10.1007/s12671-012-0144-zMindfulness5136-4

The influence of a short-term mindfulness meditation intervention on emotion and visual attention

It has been suggested that mindfulness meditation (MM) improves psychological wellbeing via the focusing and broadening of attention. Whilst studies show that short term MM interventions can improve focused attention there is little evidence to support the broadening of attention. The current study investigated the influence of a short-term MM intervention on emotion and the scope of visual attention. Seventy participants completed a global-local processing task separated into three blocks of trials, with a ten minute break between each one. During the breaks a MM group engaged in a breath counting task and a control group engaged in a task of their choosing. Response times to global and local targets and a measure of self-reported emotional affect were recorded for each block. Mindfulness had no impact on attention however both positive and negative affect decreased for the MM group across the course of the experiment. The results suggest that MM can reduce the focus on negative (and positive) thoughts, indicating possible changes to focused attention, yet a short-term intervention is not sufficient to broaden attentio