Measuring what matters to patients: Using goal content to inform measure choice and development

Introduction: Personalised care requires personalised outcomes and ways of feeding back clinically useful information to clinicians and practitioners, but it is not clear how to best personalise outcome measurement and feedback using existing standardised outcome measures. / Method: The constant comparison method of grounded theory was used to compare goal themes derived from goals set at the outset of therapy for 180 children aged between 4 and 17 years, visiting eight child and adolescent mental health services, to existing standardised outcome measures used as part of common national datasets. / Results: In all, 20 out of 27 goal themes corresponded to items on at least one commonly used outcome measure. Discussion: Consideration of goal themes helped to identify potential relevant outcome measures. However, there were several goal themes that were not captured by items on standardised outcome measures. These seemed to be related to existential factors such as understanding, thinking about oneself and future planning. / Conclusion: This presents a powerful framework for how clinicians can use goals to help select a standardised outcome measure (where this is helpful) in addition to the use of a goal-based outcome measure and personalise choices. There may be areas not captured by standardised outcome measures that may be important for children and young people and which may only be currently captured in goal measurement. There is an indication that we may not be measuring what is important to children and young people. We may need to develop or look for new measures that capture these areas

When is Sessional Monitoring More Likely in Child and Adolescent Mental Health Services?

Sessional monitoring of patient progress or experience of therapy is an evidence-based intervention recommended by healthcare systems internationally. It is being rolled out across child and adolescent mental health services (CAMHS) in England to inform clinical practice and service evaluation. We explored whether patient demographic and case characteristics were associated with the likelihood of using sessional monitoring. Multilevel regressions were conducted on N = 2609 youths from a routinely collected dataset from 10 CAMHS. Girls (odds ratio, OR 1.26), older youths (OR 1.10), White youths (OR 1.35), and youths presenting with mood (OR 1.46) or anxiety problems (OR 1.59) were more likely to have sessional monitoring. In contrast, youths under state care (OR 0.20) or in need of social service input (OR 0.39) were less likely to have sessional monitoring. Findings of the present research may suggest that sessional monitoring is more likely with common problems such as mood and anxiety problems but less likely with more complex cases, such as those involving youths under state care or those in need of social service input

Service-level variation, patient-level factors, and treatment outcome in those seen by child mental health services

Service comparison is a policy priority but is not without controversy. This paper aims to investigate the amount of service-level variation in outcomes in child mental health, whether it differed when examining outcomes unadjusted vs. adjusted for expected change over time, and which patient-level characteristics were associated with the difference observed between services. Multilevel regressions were used on N = 3256 young people (53% male, mean age 11.33 years) from 13 child mental health services. Outcome was measured using the parent-reported Strengths and Difficulties Questionnaire. The results showed there was 4-5% service-level variation in outcomes. Findings were broadly consistent across unadjusted vs. adjusted outcomes. Young people with autism or infrequent case characteristics (e.g., substance misuse) had greater risk of poor outcomes. Comparison of services with high proportions of young people with autism or infrequent case characteristics requiring specialist input needs particular caution as these young people may be at greater risk of poor outcomes

Patient reported outcome measures in child and adolescent mental health services: associations between clinician demographic characteristics, attitudes and efficacy

BACKGROUND: Policy recommends using patient reported outcome measures (PROMs), yet their use is persistently low. Our aim was to examine the association between PROM use and clinician demographic characteristics, attitudes and efficacy. METHOD: A sample of N = 109 clinicians completed an online survey. RESULTS: Clinicians who reported higher levels of use of cognitive behaviour or humanistic approaches had higher levels of PROM use than clinicians who reported lower levels of use of these approaches. Clinicians who reported having received training had higher levels of self-efficacy regarding PROMs than clinicians who reported not having received training, but the effects of training on PROM attitudes and use were not significant. Still, clinicians with more positive attitudes or self-efficacy regarding PROMs had higher levels of PROM use than clinicians with less positive attitudes or self-efficacy regarding PROMs. CONCLUSION: Clinicians should be supported to have the knowledge, skills and confidence to effectively use PROMs in their clinical practice

Facilitators and Barriers to Person-centred Care in Child and Young People Mental Health Services: A Systematic Review

Implementation of person-centred care has been widely advocated across various health settings and patient populations, including recent policy for child and family services. Nonetheless, evidence suggests that service users are rarely involved in decision-making, whilst their preferences and goals may be often unheard. The aim of the present research was to systematically review factors influencing person-centred care in mental health services for children, young people and families examining perspectives from professionals, service users and carers. This was conducted according to best practice guidelines, and seven academic databases were searched. Overall, 23 qualitative studies were included. Findings from the narrative synthesis of the facilitators and barriers are discussed in light of a recently published systematic review examining person-centred care in mental health services for adults. Facilitators and barriers were broadly similar across both settings. Training professionals in person-centred care, supporting them to use it flexibly to meet the unique needs of service users whilst also being responsive to times when it may be less appropriate and improving both the quantity and quality of information for service users and carers are key recommendations to facilitate person-centred care in mental health services with children, young people and families

A qualitative exploration of attitudes towards the use of outcome measures in child and adolescent mental health services

The aim of the present research was to explore clinician attitudes to outcome measures and, in particular, the facilitators and barriers to implementing outcome measures. An up-to-date exploration of clinician attitudes is especially needed in the context of recent policies on the implementation of outcome measures in child and adolescent mental health services (CAMHS), and because evidence suggests that there is a disparity between policy recommendations and the use of outcome measures in clinical practice. Semi-structured interviews were conducted with nine CAMHS clinicians from a Mental Health Trust in South London. Two levels of implementation emerged from the analysis: (1) the service level, regarding the implementation of outcome measures across a service to inform service improvement and (2) the session level, regarding the implementation of outcome measures within individual clinical sessions. The present research described training and ongoing support as a crucial facilitator of use at both service and session levels. This included help overcoming local contextual barriers, such as resources, information systems and administrative processes. The research showed that a balance is needed between a mandatory and uniform approach across a service and providing clinicians with support to use outcome measures with all service users for whom they are appropriate

Cost calculation and prediction in adult intensive care: A ground-up utilization study

Publisher's copy made available with the permission of the publisherThe ability of various proxy cost measures, including therapeutic activity scores (TISS and Omega) and cumulative daily severity of illness scores, to predict individual ICU patient costs was assessed in a prospective “ground-up” utilization costing study over a six month period in 1991. Daily activity (TISS and Omega scores) and utilization in consecutive admissions to three adult university associated ICUs was recorded by dedicated data collectors. Cost prediction used linear regression with determination (80%) and validation (20%) data sets. The cohort, 1333 patients, had a mean (SD) age 57.5 (19.4) years, (41% female) and admission APACHE III score of 58 (27). ICU length of stay and mortality were 3.9 (6.1) days and 17.6% respectively. Mean total TISS and Omega scores were 117 (157) and 72 (113) respectively. Mean patient costs per ICU episode (1991 $AUS) were$6801 ($10311), with median costs of$2534, range $106 to$95,602. Dominant cost fractions were nursing 43.3% and overheads 16.9%. Inflation adjusted year 2002 (mean) costs were $9343 ($ AUS). Total costs in survivors were predicted by Omega score, summed APACHE III score and ICU length of stay; determination R2, 0.91; validation 0.88. Omega was the preferred activity score. Without the Omega score, predictors were age, summed APACHE III score and ICU length of stay; determination R2, 0.73; validation 0.73. In non-survivors, predictors were age and ICU length of stay (plus interaction), and Omega score (determination R2, 0.97; validation 0.91). Patient costs may be predicted by a combination of ICU activity indices and severity scores.J. L. Moran, A. R. Peisach, P. J. Solomon, J. Martinhttp://www.aaic.net.au/Article.asp?D=200403

Notes from the youth mental health field: Using movement towards goals as a potential indicator of service change and quality improvement

The aim of this paper is to report our notes from the field on using movement toward goals at an aggregate level as an inference of service effectiveness. Analysis of routinely collected data from UK youth mental health services was conducted (N = 8,172, age M = 13.8, 67% female, 32% male) to explore the impact of including goal-based outcome data in combined calculations of standardized measures based on the principles of reliable change (“measurable change”). Due to the broad nature of standardized measures, inferred validity becomes diluted in any team or service level aggregate analysis. To make inferences that are closer to the person's interpretation of their difficulties, we argue that Idiographic Patient Reported Outcome Measures (I-PROMs) counterbalance these limitations. This is supported by our findings. The measurable change metric is the first step towards enabling national analysis of aggregated I-PROMs. I-PROMs, supplemented by standardized measures should be used to consider service evaluation

Perspectives of paediatric hospital staff on factors influencing the sustainability and spread of a safety quality improvement programme

OBJECTIVE: Situation Awareness For Everyone (SAFE) is a quality improvement programme aiming to improve situation awareness in paediatric clinical teams. The aim of our study was to examine hospital staff perceptions of the facilitators and barriers/challenges to the sustaining and subsequent spread of the huddle, the key intervention of the SAFE programme. SETTING: Interviews were held on two wards in two children hospitals and on two children wards in two district general hospitals. METHOD: Semistructured interviews were conducted with 23 staff members from four National Health Service paediatric wards. A deductive thematic analysis was conducted, drawing on an existing framework, which groups the factors influencing programme sustainability into four categories: innovation, leadership, process and context. PARTICIPANTS: 23 staff in two children’s hospitals and two children’s wards across four UK hospitals, comprising of nurses and doctors, administration or housekeeping staff, ward managers and matrons, and allied professionals. PRIMARY OUTCOME: Understanding factors contributing to the sustaining and spread of a quality improvement intervention. RESULTS: Perceptions of the benefits, purpose and fit of the huddle, team commitment, sharing learning, adaptation of the method and senior leadership were identified as facilitators. High staff turnover, large multiple specialty medical staff teams, lack of senior leadership and dislike of change were identified as barriers/challenges. CONCLUSIONS: Sustaining and spreading quality improvement interventions in a complex clinical setting requires understanding of the interplay between the actual innovation and existing leadership, process and contextual factors. These must be considered at the planning stage of an innovation to maximise the potential for sustainability and spread to other settings

A systematic review of shared decision making interventions in child and youth mental health: synthesising the use of theory, intervention functions, and behaviour change techniques

Reviews around interventions to improve shared decision making (SDM) for child and youth mental health have produced inconclusive findings on what approaches increase participation. Importantly, the previous reviews did not explore the use of theory, as well as mechanisms of change (intervention functions) and active units of change (behaviour change techniques). The aim of this review was to explore these factors and ascertain how, if at all, these contribute to SDM. Five databases were searched up until April 2020. Studies met inclusion criteria if they were: (a) an intervention to facilitate SDM; (b) aimed at children, adolescence, or young people aged up to 25, with a mental health difficulty, or their parents/guardians; and (c) included a control group. Data were extracted on patient characteristics, study design, intervention, theoretical background, intervention functions, behaviour change techniques, and SDM. Quality assessment of the studies was undertaken using the Effective Public Health Practice Project (EPHPP) quality assessment tool. Eight different interventions met inclusion criteria. The role of theory to increase SDM remains unclear. Specific intervention functions, such as 'education' on SDM and treatment options and 'environmental restructuring' using decision aids, are being used in SDM interventions, as well as 'training' for clinicians. Similarly, behaviour change techniques linked to these, such as 'adding objects to the environment', 'discussing pros/cons', and clinicians engaging in 'behavioural practice/rehearsal'. However, as most studies scored low on the quality assessment criteria, as well as a small number of studies included and a low number of behaviour change techniques utilised, links between behaviour change techniques, intervention functions and increased participation remain tentative. Intervention developers and clinicians may wish to consider specific intervention functions and behaviour change techniques to facilitate SDM