Evidence-based practice educational intervention studies: A systematic review of what is taught and how it is measured

Abstract Background Despite the established interest in evidence-based practice (EBP) as a core competence for clinicians, evidence for how best to teach and evaluate EBP remains weak. We sought to systematically assess coverage of the five EBP steps, review the outcome domains measured, and assess the properties of the instruments used in studies evaluating EBP educational interventions. Methods We conducted a systematic review of controlled studies (i.e. studies with a separate control group) which had investigated the effect of EBP educational interventions. We used citation analysis technique and tracked the forward and backward citations of the index articles (i.e. the systematic reviews and primary studies included in an overview of the effect of EBP teaching) using Web of Science until May 2017. We extracted information on intervention content (grouped into the five EBP steps), and the outcome domains assessed. We also searched the literature for published reliability and validity data of the EBP instruments used. Results Of 1831 records identified, 302 full-text articles were screened, and 85 included. Of these, 46 (54%) studies were randomised trials, 51 (60%) included postgraduate level participants, and 63 (75%) taught medical professionals. EBP Step 3 (critical appraisal) was the most frequently taught step (63 studies; 74%). Only 10 (12%) of the studies taught content which addressed all five EBP steps. Of the 85 studies, 52 (61%) evaluated EBP skills, 39 (46%) knowledge, 35 (41%) attitudes, 19 (22%) behaviours, 15 (18%) self-efficacy, and 7 (8%) measured reactions to EBP teaching delivery. Of the 24 instruments used in the included studies, 6 were high-quality (achieved ≥3 types of established validity evidence) and these were used in 14 (29%) of the 52 studies that measured EBP skills; 14 (41%) of the 39 studies that measured EBP knowledge; and 8 (26%) of the 35 studies that measured EBP attitude. Conclusions Most EBP educational interventions which have been evaluated in controlled studies focus on teaching only some of the EBP steps (predominantly critically appraisal of evidence) and did not use high-quality instruments to measure outcomes. Educational packages and instruments which address all EBP steps are needed to improve EBP teaching

Development and psychometric testing of an instrument to evaluate cognitive skills of evidence based practice in student health professionals

<p>Abstract</p> <p>Background</p> <p>Health educators need rigorously developed instruments to evaluate cognitive skills relating to evidence based practice (EBP). Previous EBP evaluation instruments have focused on the acquisition and appraisal of the evidence and are largely based in the medical profession. The aim of this study was to develop and validate an EBP evaluation instrument to assess EBP cognitive skills for entry-level health professional disciplines.</p> <p>Methods</p> <p>The Fresno test of competence in evidence based medicine was considered in the development of the 'Knowledge of Research Evidence Competencies' instrument (K-REC). The K-REC was reviewed for content validity. Two cohorts of entry-level students were recruited for the pilot study, those who had been exposed to EBP training (physiotherapy students, n = 24), and who had not been exposed to EBP training (human movement students, n = 76). The K-REC was administered to one cohort of students (n = 24) on two testing occasions to evaluate test-retest reliability. Two raters independently scored the first test occasion (n = 24) to evaluate the inter-rater reliability of the marking guidelines. Construct validity was assessed by comparison of the two groups, 'exposed' and 'non-exposed', and the percentage of students achieving a 'pass' score in each of these groups. Item difficulty was established.</p> <p>Results</p> <p>Among the 100 participants (24 EBP 'exposed', and 76 EBP 'non-exposed' students), there was a statistically significant (<it>p </it>< 0.0001) difference in the total K-REC scores. The test-retest and inter-rater reliability of the individual items and total scores ranged from moderate to excellent (measured by Cohen's Kappa and ICC, range: 0.62 to perfect agreement).</p> <p>Conclusions</p> <p>The K-REC instrument is a valid and reliable evaluation instrument of cognitive skills of EBP in entry-level student health professionals. The instrument is quick to disseminate and easy to score, making it a suitable instrument for health educators to employ to evaluate students' knowledge of EBP or in the evaluation of entry-level EBP training.</p

Facing the Challenge of Data Transfer from Animal Models to Humans: the Case of Persistent Organohalogens

A well-documented fact for a group of persistent, bioaccumulating organohalogens contaminants, namely polychlorinated biphenyls (PCBs), is that appropriate regulation was delayed, on average, up to 50 years. Some of the delay may be attributed to the fact that the science of toxicology was in its infancy when PCBs were introduced in 1920's. Nevertheless, even following the development of modern toxicology this story repeats itself 45 years later with polybrominated diphenyl ethers (PBDEs) another compound of concern for public health. The question is why? One possible explanation may be the low coherence between experimental studies of toxic effects in animal models and human studies. To explore this further, we reviewed a total of 807 PubMed abstracts and full texts reporting studies of toxic effects of PCB and PBDE in animal models. Our analysis documents that human epidemiological studies of PBDE stand to gain little from animal studies due to the following: 1) the significant delay between the commercialisation of a substance and studies with animal models; 2) experimental exposure levels in animals are several orders of magnitude higher than exposures in the general human population; 3) the limited set of evidence-based endocrine endpoints; 4) the traditional testing sequence (adult animals – neonates – foetuses) postpones investigation of the critical developmental stages; 5) limited number of animal species with human-like toxicokinetics, physiology of development and pregnancy; 6) lack of suitable experimental outcomes for the purpose of epidemiological studies. Our comparison of published PCB and PBDE studies underscore an important shortcoming: history has, unfortunately, repeated itself. Broadening the crosstalk between the various branches of toxicology should therefore accelerate accumulation of data to enable timely and appropriate regulatory action

Promoting physical therapists' of research evidence to inform clinical practice: Part 1 - Theoretical foundation, evidence, and description of the PEAK program

Background: There is a need for theoretically grounded and evidence-based interventions that enhance the use of research evidence in physical therapist practice. This paper and its companion paper introduce the Physical therapist-driven Education for Actionable Knowledge translation (PEAK) program, an educational program designed to promote physical therapists’ integration of research evidence into clinical decision-making. The pedagogical foundations for the PEAK educational program include Albert Bandura’s social cognitive theory and Malcolm Knowles’s adult learning theory. Additionally, two complementary frameworks of knowledge translation, the Promoting Action on Research Implementation in Health Services (PARiHS) and Knowledge to Action (KTA) Cycle, were used to inform the organizational elements of the program. Finally, the program design was influenced by evidence from previous attempts to facilitate the use of research in practice at the individual and organizational levels. Discussion: The 6-month PEAK program consisted of four consecutive and interdependent components. First, leadership support was secured and electronic resources were acquired and distributed to participants. Next, a two-day training workshop consisting of didactic and small group activities was conducted that addressed the five steps of evidence based practice. For five months following the workshop, participants worked in small groups to review and synthesize literature around a group-selected area of common clinical interest. Each group contributed to the generation of a “Best Practices List” - a list of locally generated, evidence-based, actionable behaviors relevant to the groups’ clinical practice. Ultimately, participants agreed to implement the Best Practices List in their clinical practice. Summary: This, first of two companion papers, describes the underlying pedagogical theories, knowledge translation frameworks, and research evidence used to derive the PEAK program – an educational program designed to promote the use of research evidence to inform physical therapist practice. The four components of the program are described in detail. The companion paper reports the results of a mixed methods feasibility analysis of this complex educational intervention. </p