Fidelity protocol for the Action Success Knowledge (ASK) trial: A psychosocial intervention administered by speech and language therapists to prevent depression in people with post-stroke aphasia

Introduction: Treatment fidelity is a complex, multifaceted evaluative process which refers to whether a studied intervention was delivered as intended. Monitoring and enhancing fidelity is one recommendation of the TiDIER (Template for Intervention Description and Replication) checklist, as fidelity can inform interpretation and conclusions drawn about treatment effects. Despite the methodological and translational benefits, fidelity strategies have been used inconsistently within health behaviour intervention studies; in particular, within aphasia intervention studies, reporting of fidelity remains relatively rare. This paper describes the development of a fidelity protocol for the Action Success Knowledge (ASK) study, a current cluster randomised trial investigating an early mood intervention for people with aphasia (a language disability caused by stroke). Methods and analysis: A novel fidelity protocol and tool was developed to monitor and enhance fidelity within the two arms (experimental treatment and attention control) of the ASK study. The ASK fidelity protocol was developed based on the National Institutes of Health Behaviour Change Consortium fidelity framework. Ethics and dissemination: The study protocol was approved by the Darling Downs Hospital and Health Service Human Research Ethics Committee in Queensland, Australia under the National Mutual Acceptance scheme of multicentre human research projects. Specific ethics approval was obtained for those participating sites who were not under the National Mutual Agreement at the time of application. The monitoring and ongoing conduct of the research project is in line with requirements under the National Mutual Acceptance. On completion of the trial, findings from the fidelity reviews will be disseminated via publications and conference presentations. Trial registration number ACTRN12614000979651

Positive Thinking Training Intervention for Caregivers of Persons with Autism: Establishing Fidelity

More than 3.5 million in the US are diagnosed with autism spectrum disorder (ASD) and caregivers experience stress that adversely affects their well-being. Positive thinking training (PTT) intervention can minimize that stress. However, before testing the effectiveness of PTT, its fidelity must be established. This pilot intervention trial examined fidelity of an online PTT intervention for ASD caregivers with a random assignment of 73 caregivers to either the online PTT intervention or to the control group. Quantitative data [Positive Thinking Skills Scale (PTSS)] and qualitative data (online weekly homework) were collected. The mean scores for the PTSS improved for the intervention group and decreased for the control group post intervention. Evidence for use of PTT was found in caregivers\u27 online weekly homework. The findings provide evidence of the implementation fidelity of PTT intervention and support moving forward to test PTT effectiveness in promoting caregivers\u27 well-being

Translating a walking intervention for health professional delivery within primary care: a mixed methods treatment fidelity assessment

ObjectivesExisting fidelity studies of physical activity interventions are limited in methodological quality and rigour, particularly those delivered by healthcare providers in clinical settings. The present study aimed to enhance and assess the fidelity of a walking intervention delivered by healthcare providers within general practice in line with the NIH Behavior Change Consortium treatment fidelity framework.Design Two practice nurses and six healthcare assistants delivered a theory-based walking intervention to 63 patients in their own practices. A cross-sectional mixed methods study assessed fidelity related to treatment delivery and treatment receipt, from the perspectives of healthcare providers and patients.MethodsAll providers received training and demonstrated delivery competence prior to the trial. Delivery of intervention content was coded from audio-recordings using a standardised checklist. Qualitative interviews with 12 patients were conducted to assess patient perspectives of treatment receipt and analysed using Framework Analysis.Results Overall, 78% of intervention components were delivered as per the protocol (range 36-91%), with greater fidelity for components requiring active engagement from patients (e.g. completion of worksheets). The qualitative data highlighted differences in patients’ comprehension of specific intervention components. Understanding of, and engagement with, motivational components aimed at improving self-efficacy was poorer than for volitional planning components.Conclusions High levels of fidelity of delivery were demonstrated. However, patient, provider and component level factors impacted on treatment delivery and receipt. We recommend that methods for the enhancement and assessment of treatment fidelity are consistently implemented to enhance the rigour of physical activity intervention research. <br/

A modified theoretical framework to assess implementation fidelity of adaptive public health interventions

Background: One of the major debates in implementation research turns around fidelity and adaptation. Fidelity is the degree to which an intervention is implemented as intended by its developers. It is meant to ensure that the intervention maintains its intended effects. Adaptation is the process of implementers or users bringing changes to the original design of an intervention. Depending on the nature of the modifications brought, adaptation could either be potentially positive or could carry the risk of threatening the theoretical basis of the intervention, resulting in a negative effect on expected outcomes. Adaptive interventions are those for which adaptation is allowed or even encouraged. Classical fidelity dimensions and conceptual frameworks do not address the issue of how to adapt an intervention while still maintaining its effectiveness. Discussion: We support the idea that fidelity and adaptation co-exist and that adaptations can impact either positively or negatively on the intervention's effectiveness. For adaptive interventions, research should answer the question how an adequate fidelity-adaptation balance can be reached. One way to address this issue is by looking systematically at the aspects of an intervention that are being adapted. We conducted fidelity research on the implementation of an empowerment strategy for dengue prevention in Cuba. In view of the adaptive nature of the strategy, we anticipated that the classical fidelity dimensions would be of limited use for assessing adaptations. The typology we used in the assessment-implemented, not-implemented, modified, or added components of the strategy-also had limitations. It did not allow us to answer the question which of the modifications introduced in the strategy contributed to or distracted from outcomes. We confronted our empirical research with existing literature on fidelity, and as a result, considered that the framework for implementation fidelity proposed by Carroll et al. in 2007 could potentially meet our concerns. We propose modifications to the framework to assess both fidelity and adaptation. Summary: The modified Carroll et al.'s framework we propose may permit a comprehensive assessment of the implementation fidelity-adaptation balance required when implementing adaptive interventions, but more empirical research is needed to validate it

An empirical study of multidimensional fidelity of COMPASS consultation

Consultation is essential to the daily practice of school psychologists (National Association of School Psychologist, 2010). Successful consultation requires fidelity at both the consultant (implementation) and consultee (intervention) levels. We applied a multidimensional, multilevel conception of fidelity (Dunst, Trivette, & Raab, 2013) to a consultative intervention called the Collaborative Model for Promoting Competence and Success (COMPASS) for students with autism. The study provided 3 main findings. First, multidimensional, multilevel fidelity is a stable construct and increases over time with consultation support. Second, mediation analyses revealed that implementation-level fidelity components had distant, indirect effects on student Individualized Education Program (IEP) outcomes. Third, 3 fidelity components correlated with IEP outcomes: teacher coaching responsiveness at the implementation level, and teacher quality of delivery and student responsiveness at the intervention levels. Implications and future directions are discussed. (PsycINFO Database Record

Digital technology to facilitate Proactive Assessment of Obesity Risk during Infancy (ProAsk): a feasibility study

OBJECTIVE: To assess the feasibility and acceptability of using digital technology for Proactive Assessment of Obesity Risk during Infancy (ProAsk) with the UK health visitors (HVs) and parents. DESIGN: Multicentre, pre- and post-intervention feasibility study with process evaluation. SETTING: Rural and urban deprived settings, UK community care. PARTICIPANTS: 66 parents of infants and 22 HVs. INTERVENTION: ProAsk was delivered on a tablet device. It comprises a validated risk prediction tool to quantify overweight risk status and a therapeutic wheel detailing motivational strategies for preventive parental behaviour. Parents were encouraged to agree goals for behaviour change with HVs who received motivational interviewing training. OUTCOME MEASURES: We assessed recruitment, response and attrition rates. Demographic details were collected, and overweight risk status. The proposed primary outcome measure was weight-for-age z-score. The proposed secondary outcomes were parenting self-efficacy, maternal feeding style, infant diet and exposure to physical activity/sedentary behaviour. Qualitative interviews ascertained the acceptability of study processes and intervention fidelity. RESULTS: HVs screened 324/589 infants for inclusion in the study and 66/226 (29%) eligible infants were recruited. Assessment of overweight risk was completed on 53 infants and 40% of these were identified as above population risk. Weight-for-age z-score (SD) between the infants at population risk and those above population risk differed significantly at baseline (-0.67 SD vs 0.32 SD). HVs were able to collect data and calculate overweight risk for the infants. Protocol adherence and intervention fidelity was a challenge. HVs and parents found the information provided in the therapeutic wheel appropriate and acceptable. CONCLUSION: Study recruitment and protocol adherence were problematic. ProAsk was acceptable to most parents and HVs, but intervention fidelity was low. There was limited evidence to support the feasibility of implementing ProAsk without significant additional resources. A future study could evaluate ProAsk as a HV-supported, parent-led intervention. TRIAL REGISTRATION NUMBER: NCT02314494 (Feasibility Study Results)

Reporting quality of music intervention research in healthcare: A systematic review

INTRODUCTION: Concomitant with the growth of music intervention research, are concerns about inadequate intervention reporting and inconsistent terminology, which limits validity, replicability, and clinical application of findings. OBJECTIVE: Examine reporting quality of music intervention research, in chronic and acute medical settings, using the Checklist for Reporting Music-based Interventions. In addition, describe patient populations and primary outcomes, intervention content and corresponding interventionist qualifications, and terminology. METHODS: Searching MEDLINE, PubMed, CINAHL, HealthSTAR, and PsycINFO we identified articles meeting inclusion/exclusion criteria for a five-year period (2010-2015) and extracted relevant data. Coded material included reporting quality across seven areas (theory, content, delivery schedule, interventionist qualifications, treatment fidelity, setting, unit of delivery), author/journal information, patient population/outcomes, and terminology. RESULTS: Of 860 articles, 187 met review criteria (128 experimental; 59 quasi-experimental), with 121 publishing journals, and authors from 31 countries. Overall reporting quality was poor with <50% providing information for four of the seven checklist components (theory, interventionist qualifications, treatment fidelity, setting). Intervention content reporting was also poor with <50% providing information about the music used, decibel levels/volume controls, or materials. Credentialed music therapists and registered nurses delivered most interventions, with clear differences in content and delivery. Terminology was varied and inconsistent. CONCLUSIONS: Problems with reporting quality impedes meaningful interpretation and cross-study comparisons. Inconsistent and misapplied terminology also create barriers to interprofessional communication and translation of findings to patient care. Improved reporting quality and creation of shared language will advance scientific rigor and clinical relevance of music intervention research

Fidelity in complex behaviour change interventions : a standardised approach to evaluate intervention integrity

Objectives: The aim of this study was to (1) demonstrate the development and testing of tools and procedures designed to monitor and assess the integrity of a complex intervention for chronic pain (COping with persistent Pain, Effectiveness Research into Self-management (COPERS) course); and (2) make recommendations based on our experiences. Design: Fidelity assessment of a two-arm randomised controlled trial intervention, assessing the adherence and competence of the facilitators delivering the intervention. Setting: The intervention was delivered in the community in two centres in the UK: one inner city and one a mix of rural and urban locations. Participants: 403 people with chronic musculoskeletal pain were enrolled in the intervention arm and 300 attended the self-management course. Thirty lay and healthcare professionals were trained and 24 delivered the courses (2 per course). We ran 31 courses for up to 16 people per course and all were audio recorded. Interventions: The course was run over three and a half days; facilitators delivered a semistructured manualised course. Outcomes: We designed three measures to evaluate fidelity assessing adherence to the manual, competence and overall impression. Results: We evaluated a random sample of four components from each course (n=122). The evaluation forms were reliable and had good face validity. There were high levels of adherence in the delivery: overall adherence was two (maximum 2, IQR 1.67–2.00), facilitator competence exhibited more variability, and overall competence was 1.5 (maximum 2, IQR 1.25–2.00). Overall impression was three (maximum 4, IQR 2.00–3.00). Conclusions: Monitoring and assessing adherence and competence at the point of intervention delivery can be realised most efficiently by embedding the principles of fidelity measurement within the design stage of complex interventions and the training and assessment of those delivering the intervention. More work is necessary to ensure that more robust systems of fidelity evaluation accompany the growth of complex interventions

Fidelity Assessment in Community Programs: An Approach to Validating Simplified Methodology.

Fidelity to intervention protocol is linked to best outcomes for individuals with autism spectrum disorder (ASD; see Boyd &amp; Corley [Autism 5(4):430-441, 2001]; Pellecchia et al. [J Autism Dev Disord 45(9):2917-2927, 2015]); however, fidelity measurement tools that are both accurate and feasible for community use are often not available. In this paper we explore methods for validated simplification of fidelity assessment procedures toward the goal of increased use in clinical practice. Video recordings (n = 36) of therapists working with children with ASD were coded using three variations of fidelity assessment methodology (trial-by-trial, 5-point Likert Scale, and 3-point Likert Scale), and the results were compared for exact agreement, mastery criterion agreement, and overall reliability. The results indicated overall a very high percentage of exact agreement (mean 99.44%, range 94.4-100%) and excellent reliability (mean Krippendorff's alpha [Kα] 1.0) between the trial-by-trial and 5-point Likert Scale across all components; however, the 3-point method may be viewed as being the more feasible strategy within community programs

The Prevention and Reactivation Care Program: intervention fidelity matters.

The Prevention and Reactivation Care Program (PReCaP) entails an innovative multidisciplinary, integrated and goal oriented approach aimed at reducing hospital related functional decline among elderly patients. Despite calls for process evaluation as an essential component of clinical trials in the geriatric care field, studies assessing fidelity lag behind the number of effect studies. The threefold purpose of this study was (1) to systematically assess intervention fidelity of the hospital phase of the PReCaP in the first year of the intervention delivery; (2) to improve our understanding of the moderating factors and modifications affecting intervention fidelity; and (3) to explore the feasibility of the PReCaP fidelity assessment in view of the modifications. Based on the PReCaP description we developed a fidelity instrument incorporating nineteen (n=19) intervention components. A combination of data collection methods was utilized, i.e. data collection from patient records and individual Goal Attainment Scaling care plans, in-depth interviews with stakeholders, and non-participant observations. Descriptive analysis was performed to obtain levels of fidelity of each of the nineteen PReCaP components. Moderating factors were identified by using the Conceptual Framework for Implementation Fidelity. Ten of the nineteen intervention components were always or often delivered to the group of twenty elderly patients. Moderating factors, suc