‘My Learning’: Results of pre-test, post-test evaluation Evaluation Program: Report No. 21 A white paper published by the Flinders Research Centre for Palliative Care, Death and Dying

Copyright Flinders UniversityFor professionals who are seeking to implement Evidence Based Practice (EBP), understanding how to use evidence in clinical practice can be difficult. While research evidence can be important in highlighting the efficacy of various treatments and therapies, translating available evidence into practice can be challenging for clinicians and act as an obstacle to the provision of high-quality care

Improving search filter development: a study of palliative care literature

Background It is difficult to systematically search for literature relevant to palliative care in general medical journals. A previously developed search filter for use on OVID Medline validated using a gold standard set of references identified through hand searching, achieved an unacceptably low sensitivity (45.4%). Retrieving relevant literature is integral to support evidence based practice, and understanding the nature of the incorrectly excluded citations (false negatives) using the filter may lead to improvement in the filter's performance. Methods The objectives were to describe the nature of subjects reflected in the false negative citations and to empirically improve the sensitivity of the search filter. A thematic analysis of MeSH terms by three independent reviewers was used to describe the subject coverage of the missed records. Using a frequency analysis of MeSH terms, those headings which could individually contribute at least 2.5% to sensitivity (occurring 19 or more times) were added to the search filter. All previously run searches were rerun at the same time as the revised filter, and results compared. Results Thematic analysis of MeSH terms identified thirteen themes reflected in the missing records, none of them intrinsically palliative. The addition of six MeSH terms to the existing search filter (physician-patient relations, prognosis, quality of life, survival rate, treatment outcome and attitude to health) led to an increase in sensitivity from 46.3% to 64.7%, offset by a decrease in precision from 72.6% to 21.9%. Conclusion The filter's sensitivity was successfully increased using frequency analysis of MeSH terms, offset by a decrease in precision. A thematic analysis of MeSH terms for the false negative citations confirmed the absence of any intrinsically palliative theme or term, suggesting that future improvements to search filters for palliative care literature will first depend on better identifying how clinicians and researchers conceptualise palliative care. It is suggested that a constellation of parameters: stage of disease (advanced or active), prospect of cure (little or none), and treatment goals (primarily quality of life) may ultimately inform search strategies. This may be similarly true for chronic diseases, which share the inherent passage of time which marks them apart from acute, and therefore more readily identifiable, episodes of care

Finding the Integrated Care Evidence Base in PubMed and Beyond: A Bibliometric Study of the Challenges

Introduction: Integrated care research evidence should be optimally visible and accessible to stakeholders. This study examines the contribution of specific databases to the discovery of integrated care evidence, and tests the usefulness of Medical Subject Heading (MeSH) indexing of this literature within PubMed. Methods: We used bibliometric methods to analyse the integrated care literature indexed within six databases between 2007 and 2016. An international expert advisory group assessed the relevance of citations randomly retrieved from PubMed using MeSH term ‘Delivery of Health Care, Integrated’. Results: Integrated care evidence is diffuse, spread across many journals. Between 2007 and 2016, integrated care citations grew substantially, with the rate of increase highest in Embase. PubMed contributes the largest proportion of unique citations (citations not included in any of the other databases analysed), followed by Embase, PsycINFO and CINAHL. On average, expert reviewers rated 42.5% of citations retrieved by MeSH term ‘Delivery of Health Care, Integrated’ as relevant to integrated care. When these citations were dual reviewed, inter-rater agreement was low. Conclusion: MeSH terms alone are insufficient to retrieve integrated care content from PubMed. Embase and CINAHL contain unique content not found in PubMed that should not be overlooked. A validated search filter is proposed to simplify the process of finding integrated care research for clinicians, managers and decision-makers

A systematic review of strategies used to increase recruitment of people with cancer or organ failure into clinical trials: implications for palliative care research

Context. The challenges of palliative care clinical trial recruitment are well documented. Objectives. The aim of the study was to review tested strategies to improve recruitment to trials of people with a range of conditions who may access palliative care services but are not explicitly stated to be ‘‘palliative.’’ Methods. This was a systematic review with narrative description. The Cochrane, Embase, PubMed, PsycINFO, and CINAHL electronic databases were searched (English; January 2002 to February 2014) for quasi-experimental and randomized controlled trials (RCTs) testing the effect of recruitment strategies on accrual to clinical trials of people with organ failure and cancer. Titles, abstracts, and retrieved articles were screened by two researchers and categorized by recruitment challenge: 1) patients with reduced cognition, 2) those requiring emergency treatment, and 3) willingness of patients and clinical staff to contribute to trials. Results. Of 549 articles identified, 15 were included. Thirteen reported RCTs and two papers reported three quasiexperimental studies. Five were cluster RCTs of recruiting sites/institutions. One was a randomized cluster, crossover, feasibility study. Seven studies recruited patients with cancer. Others included patients with dementia, stroke, cardiovascular disease, diabetes, frail elderly, and bereaved carers. Some interventions improved recruitment: memory aid, contact before arrival, cluster consent, ‘‘opt out’’ consent. Others either reduced recruitment (formal mental capacity assessment) or made no difference (advance research directive; a variety of educational, supportive, and advertising interventions). Conclusion. Successful strategies from other disciplines could be considered by palliative care researchers. Tailored, efficient, evidence-based strategies must be developed, acknowledging that strategies with face validity are not necessarily the most effective

Integration, coordination and multidisciplinary approaches in primary care: a systematic investigation of the literature

Australia's population is ageing and there is an increasing burden of chronic disease putting pressure on the health system. These challenges have raised interest and awareness of primary health care models of care, like the use of integrated, co-ordinated multidisciplinary team approaches. This review looked at the existence and effectiveness of these models in primary health care settings.The research reported in this paper is a project of the Australian Primary Health Care Research Institute, which is supported by a grant from the Australian Government Department of Health and Ageing under the Primary Health Care Research, Evaluation and Development Strategy

CareSearch: finding and evaluating Australia's missing palliative care literature

BACKGROUND: Palliative care is an evolving specialty with a growing evidence base. However, evidence is less accessible than it could be with a lower than average conversion of conference abstracts to articles in peer-reviewed journals and the need for more accessible tools to support evidence-based practice (EBP) in palliative care. The CareSearch project involved identifying, collecting and evaluating Australia's "grey" palliative care literature and identifying international published literature missing from the electronic indexing systems. The literature was then catalogued and made publicly available through the CareSearch website. RESULTS: To date over 2,500 items have been included in the CareSearch database and can be accessed and searched through a publicly available website. Nearly 2,000 items are conference abstracts and 178 are theses or government, organisational and planning documents. A further 410 items relate to articles from palliative journals that are not indexed on a major bibliographic database. The website also provides tools and facilities to support palliative care practice and research. CONCLUSION: CareSearch is a new evidence resource for palliative practitioners, educators and researchers. The palliative community now has access to a more comprehensive literature base as well as a resource that supports the integration of knowledge into practice. This specialised data repository enables users to access information on the body of work that has shaped palliative care development and prevents the potential loss or duplication of research work. It also provides a template for other emerging disciplines to use in capturing their literature and evidence

Practice change in chronic conditions care: an appraisal of theories

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.Background Management of chronic conditions can be complex and burdensome for patients and complex and costly for health systems. Outcomes could be improved and costs reduced if proven clinical interventions were better implemented, but the complexity of chronic care services appears to make clinical change particularly challenging. Explicit use of theories may improve the success of clinical change in this area of care provision. Whilst theories to support implementation of practice change are apparent in the broad healthcare arena, the most applicable theories for the complexities of practice change in chronic care have not yet been identified. Methods We developed criteria to review the usefulness of change implementation theories for informing chronic care management and applied them to an existing list of theories used more widely in healthcare. Results Criteria related to the following characteristics of chronic care: breadth of the field; multi-disciplinarity; micro, meso and macro program levels; need for field-specific research on implementation requirements; and need for measurement. Six theories met the criteria to the greatest extent: the Consolidate Framework for Implementation Research; Normalization Process Theory and its extension General Theory of Implementation; two versions of the Promoting Action on Research Implementation in Health Services framework and Sticky Knowledge. None fully met all criteria. Involvement of several care provision organizations and groups, involvement of patients and carers, and policy level change are not well covered by most theories. However, adaptation may be possible to include multiple groups including patients and carers, and separate theories may be needed on policy change. Ways of qualitatively assessing theory constructs are available but quantitative measures are currently partial and under development for all theories. Conclusions Theoretical bases are available to structure clinical change research in chronic condition care. Theories will however need to be adapted and supplemented to account for the particular features of care in this field, particularly in relation to involvement of multiple organizations and groups, including patients, and in relation to policy influence. Quantitative measurement of theory constructs may present difficulties

Multidisciplinary care planning in the primary care management of completed stroke: a systematic review

Background: Chronic disease management requires input from multiple health professionals, both specialist and primary care providers. This study sought to assess the impact of co-ordinated multidisciplinary care in primary care, represented by the delivery of formal care planning by primary care teams or shared across primary-secondary teams, on outcomes in stroke, relative to usual care

Development of a heart failure filter for Medline: an objective approach using evidence-based clinical practice guidelines as an alternative to hand searching

<p>Abstract</p> <p>Background</p> <p>Heart failure is a highly debilitating syndrome with a poor prognosis primarily affecting the elderly. Clinicians wanting timely access to heart failure evidence to provide optimal patient care can face many challenges in locating this evidence.</p> <p>This study developed and validated a search filter of high clinical utility for the retrieval of heart failure articles in OvidSP Medline.</p> <p>Methods</p> <p>A Clinical Advisory Group was established to advise study investigators. The study set of 876 relevant articles from four heart failure clinical practice guidelines was divided into three datasets: a Term Identification Set, a Filter Development Set, and a Filter Validation Set. A further validation set (the Cochrane Validation Set) was formed using studies included in Cochrane heart failure systematic reviews. Candidate search terms were identified via word frequency analysis. The filter was developed by creating combinations of terms and recording their performance in retrieving items from the Filter Development Set. The filter's recall was then validated in both the Filter Validation Set and the Cochrane Validation Set. A precision estimate was obtained post-hoc by running the filter in Medline and screening the first 200 retrievals for relevance to heart failure.</p> <p>Results</p> <p>The four-term filter achieved a recall of 96.9% in the Filter Development Set; 98.2% in the Filter Validation Set; and 97.8% in the Cochrane Validation Set. Of the first 200 references retrieved by the filter when run in Medline, 150 were deemed relevant and 50 irrelevant. The post-hoc precision estimate was therefore 75%.</p> <p>Conclusions</p> <p>This study describes an objective method for developing a validated heart failure filter of high recall performance and then testing its precision post-hoc. Clinical practice guidelines were found to be a feasible alternative to hand searching in creating a gold standard for filter development. Guidelines may be especially appropriate given their clinical utility. A validated heart failure filter is now available to support health professionals seeking reliable and efficient access to the heart failure literature.</p