Assessing fidelity of a community based psychosocial intervention for people with mild dementia within a large randomised controlled trial

Abstract: Background: Understanding intervention delivery as intended, particularly in complex interventions, should be underpinned by good quality fidelity assessment. We present the findings from a fidelity assessment embedded as part of a trial of a complex community-based psychosocial intervention, Journeying through Dementia (JtD). The intervention was designed to equip individuals with the knowledge and skills to successfully self-manage, maintain independence, and live well with dementia and involves both group and individual sessions. The methodological challenges of developing a conceptual framework for fidelity assessment and creating and applying purposely designed measures derived from this framework are discussed to inform future studies. Methods: A conceptual fidelity framework was created out of core components of the intervention (including the intervention manual and training for delivery), associated trial protocols and pre-defined fidelity standards and criteria against which intervention delivery and receipt could be measured. Fidelity data collection tools were designed and piloted for reliability and usability. Data collection in four selected sites (fidelity sites) was via non-participatory observations of the group aspect of the intervention, attendance registers and interventionist (facilitator and supervisor) self-report. Results: Interventionists from all four fidelity sites attended intervention training. The majority of group participants at the four sites (71%) received the therapeutic dose of 10 out of 16 sessions. Weekly group meeting attendance (including at ‘out of venue’ sessions) was excellent at 80%. Additionally, all but one individual session was attended by the participants who completed the intervention. It proved feasible to create tools derived from the fidelity framework to assess in-venue group aspects of this complex intervention. Results of fidelity assessment of the observed groups were good with substantial inter-rater reliability between researchers KAPPA 0.68 95% CI (0.58–0.78). Self-report by interventionists concurred with researcher assessments. Conclusions: There was good fidelity to training and delivery of the group aspect of the intervention at four sites. However, the methodological challenges of assessing all aspects of this complex intervention could not be overcome due to practicalities, assessment methods and ethical considerations. Questions remain regarding how we can assess fidelity in community-based complex interventions without impacting upon intervention or trial delivery. Trial registration: ISRCTN17993825

"I just keep thinking that I don't want to rely on people." a qualitative study of how people living with dementia achieve and maintain independence at home: stakeholder perspectives

YesBACKGROUND: Most people living with dementia want to remain in their own homes, supported by family and paid carers. Care at home often breaks down, necessitating transition to a care home and existing interventions are limited. To inform the development of psychosocial interventions to enable people with dementia to live well for longer at home, we qualitatively explored the views of people living with dementia, family carers and health and social care professionals, on how to achieve and maintain independence at home and what impedes this. METHODS: We conducted an inductive thematic analysis of qualitative interviews with 11 people living with dementia, 19 professionals and 22 family carers in England. RESULTS: We identified four overarching themes: being in a safe and familiar environment, enabling not disabling care, maintaining relationships and community connectedness, and getting the right support. For people living with dementia, the realities of staying active were complex: there was a tension between accepting support that enabled independence and a feeling that in doing so they were accepting dependency. Their and professionals' accounts prioritised autonomy and 'living well with dementia', while family carers prioritised avoiding harm. Professionals promoted positive risk-taking and facilitating independence, whereas family carers often felt they were left holding this risk. DISCUSSION: Psychosocial interventions must accommodate tensions between positive risk-taking and avoiding harm, facilitating autonomy and providing support. They should be adaptive and collaborative, combining self-management with flexible support. Compassionate implementation of rights-based dementia care must consider the emotional burden for family carers of supporting someone to live positively with risk.This work was supported by the Alzheimer’s Society (UK) and was carried out within the UCL Alzheimer’s Society Centre of Excellence for Independence at home, NIDUS (New Interventions in Dementia Study) programme (Alzheimer’s Society Centre of Excellence grant 330). This project is also part-funded funded by The National Institute for Health Research Applied Research Collaboration North West Coast (ARC NWC)

Developing the New Interventions for independence in Dementia Study (NIDUS) theoretical model for supporting people to live well with dementia at home for longer: a systematic review of theoretical models and Randomised Controlled Trial evidence

YesPurpose: To build an evidence-informed theoretical model describing how to support people with dementia to live well or for longer at home. Methods: We searched electronic databases to August 2018 for papers meeting predetermined inclusion criteria in two reviews that informed our model. We scoped literature for theoretical models of how to enable people with dementia to live at home independently, with good life quality or for longer. We systematically reviewed Randomised Controlled Trials (RCTs) reporting psychosocial intervention effects on time lived with dementia at home. Two researchers independently rated risk of bias. We developed our theoretical model through discussions with experts by personal, clinical and academic experiences, informed by this evidence base. Results: Our scoping review included 52 studies. We divided models identified into: values and approaches (relational and recovery models; optimising environment and activities; family carer skills and support); care strategies (family carer-focused; needs and goal-based; self-management); and service models (case management; integrated; consumer-directed). The 11 RCTs included in our systematic review, all judged at low risk of bias, described only two interventions that increased time people with dementia lived in their own homes. These collectively encompassed all these components except for consumer-directed and integrated care. We developed and revised our model, using review evidence and expert consultation to define the final model. Conclusions: Our theoretical model describes values, care strategies and service models that can be used in the design of interventions to enable people with dementia to live well and for longer at home.This work forms the first phase of the NIDUS (New Interventions in Dementia Study), which is hosted within the Alzheimer’s Society Centre of Excellence for Independence at home (Centre of Excellence grant 330)

The Journeying through Dementia psychosocial intervention versus usual care study: a two-arm, phase 3, superiority randomised controlled trial

Background There is an urgent clinical need for evidence based psychosocial interventions for people with mild dementia. We aimed to determine clinical and cost-effectiveness of Journeying through Dementia (JtD), an intervention designed to promote wellbeing and independence in people with mild dementia. Methods We conducted a phase 3, two-arm parallel group, superiority, individually randomised controlled trial. Thirteen NHS sites across England recruited community-dwelling people with mild dementia and Mini-Mental State Examination score of ≥18. Centralised randomisation (1:1) was conducted for participants to receive JtD plus usual care or usual care (control), stratified by site. The JtD Intervention comprised 12 group and four one-to-one sessions, delivered in the community at each site. The primary endpoint was Dementia Related Quality of Life (DEMQOL), eight-months postrandomisation. Only outcome assessors were blinded. Analysis was by intention-to-treat. Costeffectiveness analysis reported cost per quality adjusted life year (QALY) from a UK NHS and social care perspective. Findings In total 480 people were randomised to intervention (241) or control (239) arms. Intervention adherence was very good. Mean DEMQOL scores at eight months were intervention arm 93·3 (SD 13·0, n=191) and control 91·9 (SD 14·6, n=197). Difference in means was 0·9 (95% CI -1·2 to 3·0) after adjustment for covariates, lower than that identified as clinically meaningful. Incremental cost per QALY ranged from £88K to -£205K, indicating that JtD was not cost-effective. Unrelated serious adverse events were experienced by 17% (40/241) of intervention and 15% (35/239) of control participants. Interpretation In common with other recently reported studies the JtD intervention was not provenly effective. However, this complex trial successfully recruited and retained people with dementia without necessarily involving carers, and people with dementia they were actively involved as participants and study advisors throughout. Further research into methods of measuring small, meaningful changes in this population is needed. Questions remain regarding how services can match the complex, diverse and individual needs of people with mild dementia, and how interventions to meet such needs can be delivered at scale

Identifying perinatal depression with case-finding instruments : a mixed-methods study (BaBY PaNDA – Born and Bred in Yorkshire PeriNatal Depression Diagnostic Accuracy)

Background: Perinatal depression is well recognised as a mental health condition but < 50% of cases are identified in routine practice. A case-finding strategy using the Whooley questions is currently recommended by the National Institute for Health and Care Excellence. Objectives: To determine the diagnostic accuracy, acceptability and cost-effectiveness of the Whooley questions and the Edinburgh Postnatal Depression Scale (EPDS) to identify perinatal depression. Design: A prospective diagnostic accuracy cohort study, with concurrent qualitative and economic evaluations. Setting: Maternity services in England. Participants: A total of 391 pregnant women. Main outcome measures: Women completed the Whooley questions, EPDS and a diagnostic reference standard (Clinical Interview Schedule – Revised) during pregnancy (20 weeks) and postnatally (3–4 months). Qualitative interviews were conducted with health professionals (HPs) and a subsample of women. Results: Diagnostic accuracy results: depression prevalence rates were 10.3% during pregnancy and 10.5% postnatally. The Whooley questions and EPDS (cut-off point of ≥ 10) performed reasonably well, with comparable sensitivity [pregnancy: Whooley questions 85.0%, 95% confidence interval (CI) 70.2% to 94.3%; EPDS 82.5%, 95% CI 67.2% to 92.7%; postnatally: Whooley questions 85.7%, 95% CI 69.7% to 95.2%; EPDS 82.9%, 95% CI 66.4% to 93.4%] and specificity (pregnancy: Whooley questions 83.7%, 95% CI 79.4% to 87.4%; EPDS 86.6%, 95% CI 82.5% to 90.0%; postnatally: Whooley questions 80.6%, 95% CI 75.7% to 84.9%; EPDS 87.6%, 95% CI 83.3% to 91.1%). Diagnostic accuracy of the EPDS (cut-off point of ≥ 13) was poor at both time points (pregnancy: sensitivity 45%, 95% CI 29.3% to 61.5%, and specificity 95.7%, 95% CI 93.0% to 97.6%; postnatally: sensitivity 62.9%, 95% CI 44.9% to 78.5%, and specificity 95.7%, 95% CI 92.7% to 97.7%). Qualitative evaluation: women and HPs were supportive of screening/case-finding for perinatal depression. The EPDS was preferred to the Whooley questions by women and HPs, mainly because of its ‘softer’ wording. Whooley question 1 was thought to be less acceptable, largely because of the terms ‘depressed’ and ‘hopeless’, leading to women not revealing their depressive symptoms. HPs identified a ‘patient-centred’ environment that focused on the mother and baby to promote discussion about mental health. Cost-effectiveness results: screening/case-finding using the Whooley questions or the EPDS alone was not the most cost-effective strategy. A two-stage strategy, ‘Whooley questions followed by the Patient Health Questionnaire’ (a measure assessing depression symptomatology), was the most cost-effective strategy in the range between £20,000 and £30,000 per quality-adjusted life-year in both the prenatal and postnatal decision models. Limitations: Perinatal depression diagnosis was not cross-referenced with women’s medical records so the proportion of new cases identified is unknown. The clinical effectiveness and cost-effectiveness of screening/case-finding strategies was not assessed as part of a randomised controlled trial. Conclusions: The Whooley questions and EPDS had acceptable sensitivity and specificity, but their use in practice might be limited by low predictive value and variation in their acceptability. A two-stage strategy was more cost-effective than single-stage strategies. Neither case-finding instrument met National Screening Committee criteria. Future work: The yield of screening/case-finding should be established with reference to health-care records. The clinical effectiveness and cost-effectiveness of screening/case-finding for perinatal depression needs to be tested in a randomised controlled trial. Funding: The National Institute for Health Research Health Services and Delivery Research programme

How does the delivery of paid home care compare to the care plan for clients living with dementia?

Many people living with dementia choose to remain in their own homes, supported by home‐care workers, who provide care that is specified in care plans. We explored how care plans of clients living with dementia, compared with ethnographic observations of home care they received. In a secondary, reflexive thematic analysis, we reviewed care plans for 17 clients living with dementia and transcripts from 100 h of observations with 16 home‐care workers delivering care to them. Our overarching theme was: Care plans as a starting point but incomplete repository. Clients’ care plans provided useful background information but did not reflect a wealth of knowledge home‐care workers built through practice. Two sub‐themes described: (a) Person‐centred care planning: whether and how the care plan supported tailoring of care to clients’ needs and (b) Filling in the gaps: home‐care workers often worked beyond the scope of vague, incomplete or out‐of‐date care plans. We found considerable inconsistencies between care plans and the care that was delivered. Care plans that were comprehensive about care needs, and rich in person‐specific information aided the delivery of person‐centred care. Lack of documentation was sometimes associated with observed failures in person‐centred care, as helpful information and strategies were not shared. Including information in care plans about how, as well as what care tasks, should be completed, and frequently discussing and updating care plans can create more person‐centred plans that reflect changing needs. Electronic care planning systems may support this

A systematic review of observational studies of adult home care

The home‐care workforce is in high demand globally. Home‐care workers provide care for people at home, including practical and personal care, as well as other tasks such as medication management. We conducted a systematic review with the aims of understanding methods of observation that have been employed to study home care and to explore how these methods have enabled researchers to understand the quality of home care. We searched the literature using PubMed and CINAHL databases in May 2018, with no limits applied to date of publication. We searched for MeSH terms of ‘Home Care Services’, ‘Home Health Care’, ‘Home Nursing’ and ‘Observation*’. Across 15 eligible studies, the types of observation methods employed were categorised as structured, guided and unstructured. The characteristics of these methods, such as the level of participation adopted by the observer, varied across the studies. Three themes were developed through a narrative synthesis of the included studies’ findings: ‘The impact of care delivery and organisational factors’, ‘Observing relationships and communications’, and ‘People and places behind closed doors’. We conclude that methods of observation are a fairly novel, yet rich and meaningful way of exploring home‐care practice. Researchers undertaking observations should consider elements such as the number of researchers observing and the potential for variations, how and when to record the observations, possible triangulation of data, the researcher's reflective stance as an observer, as well as ethical considerations

Effects of nonpharmacological interventions on functioning of people living with dementia at home: A systematic review of randomised controlled trials

Objective: Slowing functional decline could enable people living with dementia to live for longer and more independently in their own homes. We aimed to update previous syntheses examining the effectiveness of nonpharmacological interventions in reducing functional decline (activities of daily living, activity‐specific physical functioning, or function‐specific goal attainment) in people living in their own homes with dementia. Methods: We systematically searched electronic databases from January 2012 to May 2018; two researchers independently rated risk of bias of randomised controlled trials (RCTs) fitting predetermined inclusion criteria using a checklist; we narratively synthesised findings, prioritising studies judged to have a lower risk of bias. Results: Twenty‐nine papers (describing 26 RCTs) met eligibility criteria, of which we judged 13 RCTs to have a lower risk of bias. Study interventions were evaluated in four groups: physical exercise, occupational, multicomponent, and cognition‐oriented interventions. Four out of 13 RCTs reported functional ability as a primary outcome. In studies judged to have a lower risk of bias, in‐home tailored exercise, individualised cognitive rehabilitation, and in‐home activities‐focussed occupational therapy significantly reduced functional decline relative to control groups in individual studies. There was consistent evidence from studies at low risk of bias that group‐based exercise and reminiscence therapies were ineffective at reducing functional decline. Conclusion: We found no replicated evidence of intervention effectiveness in decreasing functional decline. Interventions associated with slower functional decline in individual trials have been individually delivered and tailored to the needs of the person with dementia. This is consistent with previous findings. Future intervention trials should prioritise these approaches

Supporting independence at home for people living with dementia: a qualitative ethnographic study of homecare

PURPOSE: The aim of this ethnographic study was to investigate how homecare workers support or inhibit independence in people living with dementia. METHODS: We undertook 100 h of participant observations with homecare workers (n = 16) supporting people living with dementia (n = 17); and 82 qualitative interviews with people living with dementia (n = 11), family carers (n = 22), homecare managers and support staff (n = 11), homecare workers (n = 19) and health and social care professionals (n = 19). We triangulated data and analysed findings thematically. RESULTS: We developed three themes: (1) independence and the home environment, highlighting ongoing negotiations between familiarity, suitability and safety for care; (2) independence and identity, exploring how homecare workers' understanding of their clients' identity can enable active participation in tasks and meaningful choices; and (3) independence and empowerment, considering the important position of homecare workers to advocate for clients living with dementia while navigating authoritative power amongst proxy decision-makers. CONCLUSION: We consider that person-centred care should also be home-centred, respecting the client's home as an extension of self. Homecare workers can use their understanding of clients' identities, alongside skills in providing choice and developing relationships of interdependence to engage clients in everyday tasks. Homecare workers are well placed to advocate for their client's voice within the care network, although their ability to do so is limited by their position within power structures