Are there valid proxy measures of clinical behaviour?

Background: Accurate measures of health professionals' clinical practice are critically important to guide health policy decisions, as well as for professional self-evaluation and for research-based investigation of clinical practice and process of care. It is often not feasible or ethical to measure behaviour through direct observation, and rigorous behavioural measures are difficult and costly to use. The aim of this review was to identify the current evidence relating to the relationships between proxy measures and direct measures of clinical behaviour. In particular, the accuracy of medical record review, clinician self-reported and patient-reported behaviour was assessed relative to directly observed behaviour. Methods: We searched: PsycINFO; MEDLINE; EMBASE; CINAHL; Cochrane Central Register of Controlled Trials; science/social science citation index; Current contents (social & behavioural med/clinical med); ISI conference proceedings; and Index to Theses. Inclusion criteria: empirical, quantitative studies; and examining clinical behaviours. An independent, direct measure of behaviour (by standardised patient, other trained observer or by video/audio recording) was considered the 'gold standard' for comparison. Proxy measures of behaviour included: retrospective self-report; patient-report; or chart-review. All titles, abstracts, and full text articles retrieved by electronic searching were screened for inclusion and abstracted independently by two reviewers. Disagreements were resolved by discussion with a third reviewer where necessary. Results: Fifteen reports originating from 11 studies met the inclusion criteria. The method of direct measurement was by standardised patient in six reports, trained observer in three reports, and audio/video recording in six reports. Multiple proxy measures of behaviour were compared in five of 15 reports. Only four of 15 reports used appropriate statistical methods to compare measures. Some direct measures failed to meet our validity criteria. The accuracy of patient report and chart review as proxy measures varied considerably across a wide range of clinical actions. The evidence for clinician self-report was inconclusive. Conclusion: Valid measures of clinical behaviour are of fundamental importance to accurately identify gaps in care delivery, improve quality of care, and ultimately to improve patient care. However, the evidence base for three commonly used proxy measures of clinicians' behaviour is very limited. Further research is needed to better establish the methods of development, application, and analysis for a range of both direct and proxy measures of behaviour

Do self-reported intentions predict clinicians behaviour: a systematic review.

Background: Implementation research is the scientific study of methods to promote the systematic uptake of clinical research findings into routine clinical practice. Several interventions have been shown to be effective in changing health care professionals' behaviour, but heterogeneity within interventions, targeted behaviours, and study settings make generalisation difficult. Therefore, it is necessary to identify the 'active ingredients' in professional behaviour change strategies. Theories of human behaviour that feature an individual's "intention" to do something as the most immediate predictor of their behaviour have proved to be useful in non-clinical populations. As clinical practice is a form of human behaviour such theories may offer a basis for developing a scientific rationale for the choice of intervention to use in the implementation of new practice. The aim of this review was to explore the relationship between intention and behaviour in clinicians and how this compares to the intention-behaviour relationship in studies of non-clinicians. Methods: We searched: PsycINFO, MEDLINE, EMBASE, CINAHL, Cochrane Central Register of Controlled Trials, Science/Social science citation index, Current contents (social & behavioural med/clinical med), ISI conference proceedings, and Index to Theses. The reference lists of all included papers were checked manually. Studies were eligible for inclusion if they had: examined a clinical behaviour within a clinical context, included measures of both intention and behaviour, measured behaviour after intention, and explored this relationship quantitatively. All titles and abstracts retrieved by electronic searching were screened independently by two reviewers, with disagreements resolved by discussion. Discussion: Ten studies were found that examined the relationship between intention and clinical behaviours in 1623 health professionals. The proportion of variance in behaviour explained by intention was of a similar magnitude to that found in the literature relating to non-health professionals. This was more consistently the case for studies in which intention-behaviour correspondence was good and behaviour was self-reported. Though firm conclusions are limited by a smaller literature, our findings are consistent with that of the non-health professional literature. This review, viewed in the context of the larger populations of studies, provides encouragement for the contention that there is a predictable relationship between the intentions of a health professional and their subsequent behaviour. However, there remain significant methodological challenges

Developing an Intervention for Fall-Related Injuries in Dementia (DIFRID): an integrated, mixed-methods approach

Background Falls in people with dementia can result in a number of physical and psychosocial consequences. However, there is limited evidence to inform how best to deliver services to people with dementia following a fall. The aim of the DIFRID study was to determine the feasibility of developing and implementing a new intervention to improve outcomes for people with dementia with fall-related injuries; this encompasses both short-term recovery and reducing the likelihood of future falls. This paper details the development of the DIFRID intervention. Methods The intervention was designed using an integrated, mixed-methods approach. This involved a realist synthesis of the literature and qualitative data gathered through interviews and focus groups with health and social care professionals (n=81). An effectiveness review and further interviews and observation were also conducted and are reported elsewhere. A modified Delphi panel approach with 24 experts was then used to establish a consensus on how the findings should translate into a new intervention. After feedback from key stakeholders (n=15) on the proposed model, the intervention was manualised and training developed. Results We identified key components of a new intervention covering three broad areas: • Ensuring that the circumstances of rehabilitation are optimised for people with dementia • Compensating for the reduced ability of people with dementia to self-manage • Equipping the workforce with the necessary skills and information to care for this patient group Consensus was achieved on 54 of 69 statements over two rounds of the Delphi surveys. The statements were used to model the intervention and finalise the accompanying manual and protocol for a feasibility study. Stakeholder feedback was generally positive and the majority of suggested intervention components were approved. The proposed outcome was a 12-week complex multidisciplinary intervention primarily based at the patient’s home. Conclusions A new intervention has been developed to improve outcomes for people with dementia following a fall requiring healthcare attention. The feasibility of this intervention is currently being tested. Trial registration ISRCTN41760734 (16/11/2015

Caring for older people as a social determinant of health: findings from a scoping review of observational studies

Background: Unpaid care is a critical source of support for people with health and social care needs. Unpaid carers are a group facing increasing demands and are at risk of adverse outcomes. Objectives: To assess the breadth of evidence on older carers/carers of older people in UK cohort studies. Methods: Using scoping review methods, we developed a targeted search strategy in three bibliographic databases (Medline, PsycInfo and CINAHL) for studies reporting carer characteristics and outcomes. Data were mapped using Evidence for Policy and Practice Information (EPPI) Reviewer, a web-based programme for managing and analysing data in reviews. The impacts of caring were explored and synthesised. Findings: Eighty-five studies were included. Where studies examined the impact of caring, outcomes were typically health-related; findings were inconsistent. Fewer studies reported the socioeconomic, disability-related, quality of life, or social impacts of caring. Fewer than half of studies reported subgroup analyses or care recipient information, and only five studies stratified carers’ outcomes by a measure of socioeconomic status. Limitations: Relying on data from observational studies means that key outcomes or caring pathways may be overlooked due to data collection methods. We therefore cannot infer causation/reverse causation regarding caring and carer outcomes. Implications: Our work highlights specific gaps in evidence regarding the social, economic, health and quality of life outcomes for carers. We also suggest methodological considerations to improve our understanding of care recipients, carers’ trajectories, and those at greatest risk of adverse outcomes. This information is vital to the development of research design, policies and interventions to support carers’ wellbeing

The Relationship between Habit and Healthcare Professional Behaviour in Clinical Practice: A Systematic Review and Meta-Analysis

Theories of behaviour used to understand healthcare professional behaviour often focus on the deliberative processes that drive their behaviour; however, less is known about the role that implicit processes such as habit have on healthcare professional behaviour. This systematic review aimed to critically appraise and synthesise research evidence investigating the association between habit and healthcare professional behaviour. A search of five databases (PsycINFO, EMBASE, Scopus and CINAHL) was conducted up until 29 February 2016 to identify studies reporting correlations between habit and healthcare professional behaviours. Meta-analyses were conducted to assess the overall habit-behaviour association across all behaviours. A subgroup analysis assessed whether the habit-behaviour relationship differed depending on whether the behaviour was objectively measured or assessed by self-report. We identified nine eligible studies involving 1975 healthcare professionals that included 28 habit-behaviour correlations. A combined mean r+ of 0.35 (medium effect) was observed between habit and healthcare professional behaviour. The habit-behaviour correlation was not affected by whether behaviour was measured objectively or by self-report. This review suggests that habit plays a significant role in healthcare professional behaviour. Findings may have implications for considering health professionals’ habit when promoting the provision of evidence-based health care, and for breaking existing habit when de-implementing outdated, non-evidence-based practices

Stakeholder Perspectives on Clinical Decision Support Tools to Inform Clinical Artificial Intelligence Implementation: Protocol for a Framework Synthesis for Qualitative Evidence

BACKGROUND: Quantitative systematic reviews have identified clinical artificial intelligence (AI)-enabled tools with adequate performance for real-world implementation. To our knowledge, no published report or protocol synthesizes the full breadth of stakeholder perspectives. The absence of such a rigorous foundation perpetuates the "AI chasm," which continues to delay patient benefit. OBJECTIVE: The aim of this research is to synthesize stakeholder perspectives of computerized clinical decision support tools in any health care setting. Synthesized findings will inform future research and the implementation of AI into health care services. METHODS: The search strategy will use MEDLINE (Ovid), Scopus, CINAHL (EBSCO), ACM Digital Library, and Science Citation Index (Web of Science). Following deduplication, title, abstract, and full text screening will be performed by 2 independent reviewers with a third topic expert arbitrating. The quality of included studies will be appraised to support interpretation. Best-fit framework synthesis will be performed, with line-by-line coding completed by 2 independent reviewers. Where appropriate, these findings will be assigned to 1 of 22 a priori themes defined by the Nonadoption, Abandonment, Scale-up, Spread, and Sustainability framework. New domains will be inductively generated for outlying findings. The placement of findings within themes will be reviewed iteratively by a study advisory group including patient and lay representatives. RESULTS: Study registration was obtained from PROSPERO (CRD42021256005) in May 2021. Final searches were executed in April, and screening is ongoing at the time of writing. Full text data analysis is due to be completed in October 2021. We anticipate that the study will be submitted for open-access publication in late 2021. CONCLUSIONS: This paper describes the protocol for a qualitative evidence synthesis aiming to define barriers and facilitators to the implementation of computerized clinical decision support tools from all relevant stakeholders. The results of this study are intended to expedite the delivery of patient benefit from AI-enabled clinical tools. TRIAL REGISTRATION: PROSPERO CRD42021256005; https://tinyurl.com/r4x3thvp. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/33145

Does health and social care provision for the community dwelling older population help to reduce unplanned secondary care, support timely discharge and improve patient well-being? A mixed method meta-review of systematic reviews

Background: This study aimed to identify and examine systematic review evidence of health and social care interventions for the community-dwelling older population regarding unplanned hospital admissions, timely hospital discharge and patient well-being. Methods: A meta-review was conducted using Joanna Briggs and PRISMA guidance. A search strategy was developed: eight bibliographic medical and social science databases were searched, and references of included studies checked. Searches were restricted to OECD countries and to systematic reviews published between January 2013–March 2018. Data extraction and quality appraisal was undertaken by one reviewer with a random sample screened independently by two others. Results: Searches retrieved 21,233 records; using data mining techniques, we identified 8,720 reviews. Following title and abstract and full-paper screening, 71 systematic reviews were included: 62 quantitative, seven qualitative and two mixed methods reviews. There were 52 reviews concerned with healthcare interventions and 19 reviews concerned with social care interventions. This meta-review summarises the evidence and evidence gaps of nine broad types of health and social care interventions. It scrutinises the presence of research in combined health and social care provision, finding it lacking in both definition and detail given. This meta-review debates the overlap of some of the person-centred support provided by community health and social care provision. Research recommendations have been generated by this process for both primary and secondary research. Finally, it proposes that research recommendations can be delivered on an ongoing basis if meta-reviews are conducted as living systematic reviews. Conclusions: This meta-review provides evidence of the effect of health and social care interventions for the community-dwelling older population and identification of evidence gaps. It highlights the lack of evidence for combined health and social care interventions and for the impact of social care interventions on health care outcomes. Registration: PROSPERO ID CRD42018087534; registered on 15 March 2018

Measuring frailty in younger populations:A rapid review of evidence

Objectives Frailty is typically assessed in older populations. Identifying frailty in adults aged under 60 years may also have value, if it supports the delivery of timely care. We sought to identify how frailty is measured in younger populations, including evidence of the impact on patient outcomes and care. Design A rapid review of primary studies was conducted. Data sources Four databases, three sources of grey literature and reference lists of systematic reviews were searched in March 2020. Eligibility criteria Eligible studies measured frailty in populations aged under 60 years using experimental or observational designs, published after 2000 in English. Data extraction and synthesis Records were screened against review criteria. Study data were extracted with 20% of records checked for accuracy by a second researcher. Data were synthesised using a narrative approach. Results We identified 268 studies that measured frailty in samples that included people aged under 60 years. Of these, 85 studies reported evidence about measure validity. No measures were identified that were designed and validated to identify frailty exclusively in younger groups. However, in populations that included people aged over and under 60 years, cumulative deficit frailty indices, phenotype measures, the FRAIL Scale, the Liver Frailty Index and the Short Physical Performance Battery all demonstrated predictive validity for mortality and/or hospital admission. Evidence of criterion validity was rare. The extent to which measures possess validity across the younger adult age (18-59 years) spectrum was unclear. There was no evidence about the impact of measuring frailty in younger populations on patient outcomes and care. Conclusions Limited evidence suggests that frailty measures have predictive validity in younger populations. Further research is needed to clarify the validity of measures across the adult age spectrum, and explore the utility of measuring frailty in younger groups.</p

Powered mobility interventions for very young children with mobility limitations to aid participation and positive development:the EMPoWER evidence synthesis

Background One-fifth of all disabled children have mobility limitations. Early provision of powered mobility for very young children (aged < 5 years) is hypothesised to trigger positive developmental changes. However, the optimum age at which to introduce powered mobility is unknown. Objective The aim of this project was to synthesise existing evidence regarding the effectiveness and cost-effectiveness of powered mobility for very young children, compared with the more common practice of powered mobility provision from the age of 5 years. Review methods The study was planned as a mixed-methods evidence synthesis and economic modelling study. First, evidence relating to the effectiveness, cost-effectiveness, acceptability, feasibility and anticipated outcomes of paediatric powered mobility interventions was reviewed. A convergent mixed-methods evidence synthesis was undertaken using framework synthesis, and a separate qualitative evidence synthesis was undertaken using thematic synthesis. The two syntheses were subsequently compared and contrasted to develop a logic model for evaluating the outcomes of powered mobility interventions for children. Because there were insufficient published data, it was not possible to develop a robust economic model. Instead, a budget impact analysis was conducted to estimate the cost of increased powered mobility provision for very young children, using cost data from publicly available sources. Data sources A range of bibliographic databases [Cumulative Index to Nursing and Allied Health Literature (CINHAL), MEDLINE, EMBASE™ (Elsevier, Amsterdam, the Netherlands), Physiotherapy Evidence Database (PEDro), Occupational Therapy Systematic Evaluation of Evidence (OTseeker), Applied Social Sciences Index and Abstracts (ASSIA), PsycINFO, Science Citation Index (SCI; Clarivate Analytics, Philadelphia, PA, USA), Social Sciences Citation Index™ (SSCI; Clarivate Analytics), Conference Proceedings Citation Index – Science (CPCI-S; Clarivate Analytics), Conference Proceedings Citation Index – Social Science & Humanities (CPCI-SSH; Clarivate Analytics), Cochrane Central Register of Controlled Trials (CENTRAL), Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effects (DARE), NHS Economic Evaluation Database (NHS EED), Health Technology Assessment (HTA) Database and OpenGrey] was systematically searched and the included studies were quality appraised. Searches were carried out in June 2018 and updated in October 2019. The date ranges searched covered from 1946 to September 2019. Results In total, 89 studies were included in the review. Only two randomised controlled trials were identified. The overall quality of the evidence was low. No conclusive evidence was found about the effectiveness or cost-effectiveness of powered mobility in children aged either < 5 or ≥ 5 years. However, strong support was found that powered mobility interventions have a positive impact on children’s movement and mobility, and moderate support was found for the impact on children’s participation, play and social interactions and on the safety outcome of accidents and pain. ‘Fit’ between the child, the equipment and the environment was found to be important, as were the outcomes related to a child’s independence, freedom and self-expression. The evidence supported two distinct conceptualisations of the primary powered mobility outcome, movement and mobility: the former is ‘movement for movement’s sake’ and the latter destination-focused mobility. Powered mobility should be focused on ‘movement for movement’s sake’ in the first instance. From the budget impact analysis, it was estimated that, annually, the NHS spends £1.89M on the provision of powered mobility for very young children, which is < 2% of total wheelchair service expenditure. Limitations The original research question could not be answered because there was a lack of appropriately powered published research. Conclusions Early powered mobility is likely to have multiple benefits for very young children, despite the lack of robust evidence to demonstrate this. Age is not the key factor; instead, the focus should be on providing developmentally appropriate interventions and focusing on ‘movement for movement’s sake’. Future work Future research should focus on developing, implementing, evaluating and comparing different approaches to early powered mobility. Study registration This study is registered as PROSPERO CRD42018096449. Funding This project was funded by the National Institute for Health Research (NIHR) Health Technology programme and will be published in full in Health Technology Assessment; Vol. 24, No. 50. See the NIHR Journals Library website for further project information