Evidence-based practice educational intervention studies: A systematic review of what is taught and how it is measured

Abstract Background Despite the established interest in evidence-based practice (EBP) as a core competence for clinicians, evidence for how best to teach and evaluate EBP remains weak. We sought to systematically assess coverage of the five EBP steps, review the outcome domains measured, and assess the properties of the instruments used in studies evaluating EBP educational interventions. Methods We conducted a systematic review of controlled studies (i.e. studies with a separate control group) which had investigated the effect of EBP educational interventions. We used citation analysis technique and tracked the forward and backward citations of the index articles (i.e. the systematic reviews and primary studies included in an overview of the effect of EBP teaching) using Web of Science until May 2017. We extracted information on intervention content (grouped into the five EBP steps), and the outcome domains assessed. We also searched the literature for published reliability and validity data of the EBP instruments used. Results Of 1831 records identified, 302 full-text articles were screened, and 85 included. Of these, 46 (54%) studies were randomised trials, 51 (60%) included postgraduate level participants, and 63 (75%) taught medical professionals. EBP Step 3 (critical appraisal) was the most frequently taught step (63 studies; 74%). Only 10 (12%) of the studies taught content which addressed all five EBP steps. Of the 85 studies, 52 (61%) evaluated EBP skills, 39 (46%) knowledge, 35 (41%) attitudes, 19 (22%) behaviours, 15 (18%) self-efficacy, and 7 (8%) measured reactions to EBP teaching delivery. Of the 24 instruments used in the included studies, 6 were high-quality (achieved ≥3 types of established validity evidence) and these were used in 14 (29%) of the 52 studies that measured EBP skills; 14 (41%) of the 39 studies that measured EBP knowledge; and 8 (26%) of the 35 studies that measured EBP attitude. Conclusions Most EBP educational interventions which have been evaluated in controlled studies focus on teaching only some of the EBP steps (predominantly critically appraisal of evidence) and did not use high-quality instruments to measure outcomes. Educational packages and instruments which address all EBP steps are needed to improve EBP teaching

Rhagoletis cerasi: Oviposition reduction effects of oil products

The European cherry fruit fly, Rhagoletis cerasi (L.) (Diptera: Tephritidae), is a highly destructive pest. Methods to control it are limited and alternatives are needed.Observations of cherry fruit flies suggest that females exert much effort to penetrate cherries at color change stage (from green to yellow) for oviposition. Therefore, the question arose as to whether a physical barrier on the fruit surface could reduce oviposition. The effects of different commercial horticultural oil products on R. cerasi oviposition were evaluated in a series of laboratory, semi-field and field experiments. In the laboratory experiments, the rate of successful oviposition on fruits treated with 0.25% v/v of the rapeseed oil product Telmion was significantly reduced by 90% compared to the untreated control. In semi-field experiments, deposits of 1% of rapeseed, mineral and paraffinic oil significantly reduced oviposition for up to 3 days. Semi-field experiments indicated that the oil products lose efficacy within 3 to 6 days after application due to degradation. Although treatments with the rapeseed oil product Telmion reduced infestation rates in an on-farm field experiment, the infested fruit clearly exceeded the level of market tolerance of 2%. Further research is needed to assess whether combinations of oil products, higher application rates and different formulations might improve field efficacy

Development and validation of the ACE tool: Assessing medical trainees' competency in evidence based medicine

BACKGROUND: While a variety of instruments have been developed to assess knowledge and skills in evidence based medicine (EBM), few assess all aspects of EBM - including knowledge, skills attitudes and behaviour - or have been psychometrically evaluated. The aim of this study was to develop and validate an instrument that evaluates medical trainees’ competency in EBM across knowledge, skills and attitude. METHODS: The ‘Assessing Competency in EBM’ (ACE) tool was developed by the authors, with content and face validity assessed by expert opinion. A cross-sectional sample of 342 medical trainees representing ‘novice’, ‘intermediate’ and ‘advanced’ EBM trainees were recruited to complete the ACE tool. Construct validity, item difficulty, internal reliability and item discrimination were analysed. RESULTS: We recruited 98 EBM-novice, 108 EBM-intermediate and 136 EBM-advanced participants. A statistically significant difference in the total ACE score was observed and corresponded to the level of training: on a 0-15-point test, the mean ACE scores were 8.6 for EBM-novice; 9.5 for EBM-intermediate; and 10.4 for EBM-advanced (p < 0.0001). Individual item discrimination was excellent (Item Discrimination Index ranging from 0.37 to 0.84), with internal reliability consistent across all but three items (Item Total Correlations were all positive ranging from 0.14 to 0.20). CONCLUSION: The 15-item ACE tool is a reliable and valid instrument to assess medical trainees’ competency in EBM. The ACE tool provides a novel assessment that measures user performance across the four main steps of EBM. To provide a complete suite of instruments to assess EBM competency across various patient scenarios, future refinement of the ACE instrument should include further scenarios across harm, diagnosis and prognosis

Assessing differential attrition in clinical trials: self-monitoring of oral anticoagulation and type II diabetes

Background: Analyzing drop out rates and when they occur may give important information about the patient characteristics and trial characteristics that affect the overall uptake of an intervention. Methods: We searched Medline and the Cochrane library from the beginning of the databases to May 2006 for published systematic reviews that compared the effects of self-monitoring (self-testing) or self-management (self-testing and self-dosage) of oral anticoagulation or self-monitored blood glucose in type 2 diabetics who were not using insulin. We assessed all study withdrawals pre-randomization and post randomization and sought information on the reasons for discontinuation of all participants. To measure the differential between groups in attrition we used the relative attrition (RA), which is equivalent to relative risk but uses attrition as the outcome (i.e. attrition in intervention group/ attrition in control group). We determined the percentage drop outs for control and intervention groups and used DerSimonian and Laird random effects models to estimate a pooled relative attrition. L'abbe type plots created in R (version 2.0.2) were used to represent the difference in the relative attrition among the trials with 95% confidence areas and weights derived from the random effects model. Results: With self-monitoring of blood glucose in type 2 diabetes, attrition ranged from 2.3% to 50.0% in the intervention groups and 0% to 40.4% in the control groups. There was no significant difference between the intervention and control, with an overall RA of 1.18 [95% CI, 0.70-2.01]. With self-monitoring of oral anticoagulation attrition ranged from 0% to 43.2% in the intervention groups, and 0% to 21.4% in the control group. The RA was significantly greater in the intervention group, combined RA, 6.05 [95% CI, 2.53-14.49]. Conclusion: This paper demonstrates the use of relative attrition as a new tool in systematic review methodology which has the potential to identify patient, intervention and trial characteristics which influences attrition in trials

Multiple mating by females of two Bactrocera species (Diptera: Tephritidae: Dacinae)

Abstract Multiple mating was investigated in two tephritid species when females were under minimal male pressure because they were each confined with a single male in cages 20r20r20 cm and observed daily until they died. Laboratory-reared females of Bactrocera cucumis (French) lived up to 274 days and refractory periods averaged 59-63 days. However, the distribution of matings among B. cucumis females was not significantly different to that expected by chance. Wild females of Bactrocera cacuminata (Hering) reared from field-collected fruits of Solanum mauritianum Scopoli lived for up to 134 days and mated up to three times with refractory periods between matings averaging 27-39 days. The distribution of the number of matings among females of B. cacuminata was non-random because of the high proportion of non-maters (50%); but, when only females mating more than once were considered, there was no significant departure from random expectation

High Levels of Recombination among Streptococcus pneumoniae Isolates from the Gambia

We carried out multilocus sequence typing (MLST) on 148 pneumococcal carriage isolates collected from children <24 months old in the Upper River Division, the Gambia. MLST revealed a diverse population. Seventy-six different sequence types (STs) were found, the most common of which were 802 and 919, associated with 23F and 6A serotypes, respectively. Comparison with the MLST database showed that only 11 of the STs found in the present sample had been reported outside Africa. Six STs showed evidence of capsular switching (172, 802, 847, 1730, 1736, and 1737). Serotype switches were confirmed by microarrays that detected capsule genes. Of isolates analyzed by using microarrays, 40/69 (58%) harbored the tetM resistance determinant. A statistical genetic analysis to detect recombination found that 49/144 (34%) isolates showed significant (P < 0.05) evidence of admixture, which is greater than that observed in similar samples from the United Kingdom (5%) and Finland (2%). We hypothesize that large amounts of admixture could reflect the high prevalence of multiple carriage in this region, leading to more opportunities for homologous recombination between strains. This could have consequences for the population response to conjugate vaccination

Millions of historical monthly rainfall observations taken in the UK and Ireland rescued by citizen scientists

Recovering additional historical weather observations from known archival sources will improve understanding of how the climate is changing and enable detailed examination of unusual events within the historical record. The UK National Meteorological Archive recently scanned more than 66,000 paper sheets containing 5.28 million hand-written monthly rainfall observations taken across the UK and Ireland between 1677 and 1960. Only a small fraction of these observations were previously digitally available for climate scientists to analyse. More than 16,000 volunteer citizen scientists completed the transcription of these sheets of observations during early 2020 using the RainfallRescue.org website, built using the Zooniverse platform. A total of 3.34 million observations from more than 6000 locations have so far been quality controlled and made openly available. This has increased the total number of monthly rainfall observations that are available for this time period and region by a factor of six. The newly rescued observations will enable longer and much improved reconstructions of past variations in rainfall across the British and Irish Isles, including for periods of significant flooding and drought. Specifically, this data should allow the official gridded monthly rainfall reconstructions for the UK to be extended back to 1836, and even earlier for some regions

Predicting Phenotype and Emerging Strains among Chlamydia trachomatis Infections

Single nucleotide polymorphisms can be used for epidemiologic and evolutionary studies worldwide