Effect of an EBM course in combination with case method learning sessions: an RCT on professional performance, job satisfaction, and self-efficacy of occupational physicians

Objective An intervention existing of an evidence-based medicine (EBM) course in combination with case method learning sessions (CMLSs) was designed to enhance the professional performance, self-efficacy and job satisfaction of occupational physicians. Methods A cluster randomized controlled trial was set up and data were collected through questionnaires at baseline (T0), directly after the intervention (T1) and 7 months after baseline (T2). The data of the intervention group [T0 (n = 49), T1 (n = 31), T2 (n = 29)] and control group [T0 (n = 49), T1 (n = 28), T2 (n = 28)] were analysed in mixed model analyses. Mean scores of the perceived value of the CMLS were calculated in the intervention group. Results The overall effect of the intervention over time comparing the intervention with the control group was statistically significant for professional performance (p <0.001). Job satisfaction and self-efficacy changes were small and not statistically significant between the groups. The perceived value of the CMLS to gain new insights and to improve the quality of their performance increased with the number of sessions followed. Conclusion An EBM course in combination with case method learning sessions is perceived as valuable and offers evidence to enhance the professional performance of occupational physicians. However, it does not seem to influence their self-efficacy and job satisfactio

A clinically integrated curriculum in Evidence-based Medicine for just-in-time learning through on-the-job training: The EU-EBM project

Background: Over the last years key stake holders in the healthcare sector have increasingly recognised evidence based medicine (EBM) as a means to improving the quality of healthcare. However, there is considerable uncertainty about the best way to disseminate basic knowledge of EBM. As a result, huge variation in EBM educational provision, setting, duration, intensity, content, and teaching methodology exists across Europe and worldwide. Most courses for health care professionals are delivered outside the work context ('stand alone') and lack adaptation to the specific needs for EBM at the learners' workplace. Courses with modern 'adaptive' EBM teaching that employ principles of effective continuing education might fill that gap. We aimed to develop a course for post-graduate education which is clinically integrated and allows maximum flexibility for teachers and learners. Methods: A group of experienced EBM teachers, clinical epidemiologists, clinicians and educationalists from institutions from eight European countries participated. We used an established methodology of curriculum development to design a clinically integrated EBM course with substantial components of e-learning. An independent European steering committee provided input into the process. Results: We defined explicit learning objectives about knowledge, skills, attitudes and behaviour for the five steps of EBM. A handbook guides facilitator and learner through five modules with clinical and e-learning components. Focussed activities and targeted assignments round off the learning process, after which each module is formally assessed. Conclusion: The course is learner-centred, problem-based, integrated with activities in the workplace and flexible. When successfully implemented, the course is designed to provide just-in-time learning through on-the-job-training, with the potential for teaching and learning to directly impact on practice. </p

CareSearch: finding and evaluating Australia's missing palliative care literature

BACKGROUND: Palliative care is an evolving specialty with a growing evidence base. However, evidence is less accessible than it could be with a lower than average conversion of conference abstracts to articles in peer-reviewed journals and the need for more accessible tools to support evidence-based practice (EBP) in palliative care. The CareSearch project involved identifying, collecting and evaluating Australia's "grey" palliative care literature and identifying international published literature missing from the electronic indexing systems. The literature was then catalogued and made publicly available through the CareSearch website. RESULTS: To date over 2,500 items have been included in the CareSearch database and can be accessed and searched through a publicly available website. Nearly 2,000 items are conference abstracts and 178 are theses or government, organisational and planning documents. A further 410 items relate to articles from palliative journals that are not indexed on a major bibliographic database. The website also provides tools and facilities to support palliative care practice and research. CONCLUSION: CareSearch is a new evidence resource for palliative practitioners, educators and researchers. The palliative community now has access to a more comprehensive literature base as well as a resource that supports the integration of knowledge into practice. This specialised data repository enables users to access information on the body of work that has shaped palliative care development and prevents the potential loss or duplication of research work. It also provides a template for other emerging disciplines to use in capturing their literature and evidence

How residents and interns utilise and perceive the personal digital assistant and UpToDate

<p>Abstract</p> <p>Background</p> <p>In this era of evidence-based medicine, doctors are increasingly using information technology to acquire medical knowledge. This study evaluates how residents and interns utilise and perceive the personal digital assistant (PDA) and the online resource UpToDate.</p> <p>Methods</p> <p>This is a questionnaire survey of all residents and interns in a tertiary teaching hospital.</p> <p>Results</p> <p>Out of 168 doctors, 134 (79.8%) responded to the questionnaire. Only 54 doctors (40.3%) owned a PDA. Although these owners perceived that the PDA was most useful for providing drug information, followed by medical references, scheduling and medical calculators, the majority of them did not actually have medical software applications downloaded on their PDAs. The greatest concerns highlighted for the PDA were the fear of loss and breakage, and the preference for working with desktop computers and paper. Meanwhile, only 76 doctors (56.7%) used UpToDate, even though the hospital had an institutional subscription for it. Although 93.4% of these users would recommend UpToDate to a colleague, only 57.9% stated that the use of UpToDate had led to a change in their management of patients.</p> <p>Conclusion</p> <p>Although UpToDate and various PDA software applications were deemed useful by some of the residents and interns in our study, both digital tools were under-utilised. More should be done to facilitate the use of medical software applications on PDAs, to promote awareness of tools for evidence-based medicine such as UpToDate, and to facilitate the application of evidence-based medicine in daily clinical practice.</p

Illustrating risk difference and number needed to treat from a randomized controlled trial of spinal manipulation for cervicogenic headache

<p>Abstract</p> <p>Background</p> <p>The number needed to treat (NNT) for one participant to benefit is considered a useful, clinically meaningful way of reporting binary outcomes from randomized trials. Analysis of continuous data from our randomized controlled trial has previously demonstrated a significant and clinically important difference favoring spinal manipulation over a light massage control.</p> <p>Methods</p> <p>Eighty participants were randomized to receive spinal manipulation or a light massage control (n = 40/group). Improvements in cervicogenic headache pain (primary outcome), disability, and number in prior four weeks were dichotomized into binary outcomes at two thresholds: 30% representing minimal clinically important change and 50% representing clinical success. Groups were compared at 12 and 24-week follow-up using binomial regression (generalized linear models) to compute the adjusted risk difference (RD) between groups and number needed to treat (NNT) after adjusting for baseline differences between groups. Results were compared to logistic regression results.</p> <p>Results</p> <p>For headache pain, clinically important improvement (30% or 50%) was more likely for spinal manipulation: adjusted RD = 17% to 27% and NNT = 3.8 to 5.8 (p = .005 to .028). Some statistically significant results favoring manipulation were found for headache disability and number.</p> <p>Conclusion</p> <p>Spinal manipulation demonstrated a benefit in terms of a clinically important improvement of cervicogenic headache pain. The use of adjusted NNT is recommended; however, adjusted RD may be easier to interpret than NNT. The study demonstrated how results may depend on the threshold for dichotomizing variables into binary outcomes.</p> <p>Trial Registration</p> <p>ClinicalTrials.gov NLM identifier NCT00246350.</p

Meta-analysis of binary outcomes via generalized linear mixed models: a simulation study

Background: Systematic reviews and meta-analyses of binary outcomes are widespread in all areas of application. The odds ratio, in particular, is by far the most popular effect measure. However, the standard meta-analysis of odds ratios using a random-effects model has a number of potential problems. An attractive alternative approach for the meta-analysis of binary outcomes uses a class of generalized linear mixed models (GLMMs). GLMMs are believed to overcome the problems of the standard random-effects model because they use a correct binomial-normal likelihood. However, this belief is based on theoretical considerations, and no sufficient simulations have assessed the performance of GLMMs in meta-analysis. This gap may be due to the computational complexity of these models and the resulting considerable time requirements. Methods: The present study is the first to provide extensive simulations on the performance of four GLMM methods (models with fixed and random study effects and two conditional methods) for meta-analysis of odds ratios in comparison to the standard random effects model. Results: In our simulations, the hypergeometric-normal model provided less biased estimation of the heterogeneity variance than the standard random-effects meta-analysis using the restricted maximum likelihood (REML) estimation when the data were sparse, but the REML method performed similarly for the point estimation of the odds ratio, and better for the interval estimation. Conclusions: It is difficult to recommend the use of GLMMs in the practice of meta-analysis. The problem of finding uniformly good methods of the meta-analysis for binary outcomes is still open

How does study quality affect the results of a diagnostic meta-analysis?

Background: The use of systematic literature review to inform evidence based practice in diagnostics is rapidly expanding. Although the primary diagnostic literature is extensive, studies are often of low methodological quality or poorly reported. There has been no rigorously evaluated, evidence based tool to assess the methodological quality of diagnostic studies. The primary objective of this study was to determine the extent to which variations in the quality of primary studies impact the results of a diagnostic meta-analysis and whether this differs with diagnostic test type. A secondary objective was to contribute to the evaluation of QUADAS, an evidence-based tool for the assessment of quality in diagnostic accuracy studies. Methods: This study was conducted as part of large systematic review of tests used in the diagnosis and further investigation of urinary tract infection (UTI) in children. All studies included in this review were assessed using QUADAS, an evidence-based tool for the assessment of quality in systematic reviews of diagnostic accuracy studies. The impact of individual components of QUADAS on a summary measure of diagnostic accuracy was investigated using regression analysis. The review divided the diagnosis and further investigation of UTI into the following three clinical stages: diagnosis of UTI, localisation of infection, and further investigation of the UTI. Each stage used different types of diagnostic test, which were considered to involve different quality concerns. Results: Many of the studies included in our review were poorly reported. The proportion of QUADAS items fulfilled was similar for studies in different sections of the review. However, as might be expected, the individual items fulfilled differed between the three clinical stages. Regression analysis found that different items showed a strong association with test performance for the different tests evaluated. These differences were observed both within and between the three clinical stages assessed by the review. The results of regression analyses were also affected by whether or not a weighting (by sample size) was applied. Our analysis was severely limited by the completeness of reporting and the differences between the index tests evaluated and the reference standards used to confirm diagnoses in the primary studies. Few tests were evaluated by sufficient studies to allow meaningful use of meta-analytic pooling and investigation of heterogeneity. This meant that further analysis to investigate heterogeneity could only be undertaken using a subset of studies, and that the findings are open to various interpretations. Conclusion: Further work is needed to investigate the influence of methodological quality on the results of diagnostic meta-analyses. Large data sets of well-reported primary studies are needed to address this question. Without significant improvements in the completeness of reporting of primary studies, progress in this area will be limited

Pragmatic application of a clinical prediction rule in primary care to identify patients with low back pain with a good prognosis following a brief spinal manipulation intervention

BACKGROUND: Patients with low back pain are frequently encountered in primary care. Although a specific diagnosis cannot be made for most patients, it is likely that sub-groups exist within the larger entity of nonspecific low back pain. One sub-group that has been identified is patients who respond rapidly to spinal manipulation. The purpose of this study was to examine the association between two factors (duration and distribution of symptoms) and prognosis following a spinal manipulation intervention. METHODS: Data were taken from two previously published studies. Patients with low back pain underwent a standardized examination, including assessment of duration of the current symptoms in days, and the distal-most distribution of symptoms. Based on prior research, patients with symptoms of <16 days duration and no symptoms distal to the knee were considered to have a good prognosis following manipulation. All patients underwent up to two sessions of spinal manipulation treatment and a range of motion exercise. Oswestry disability scores were recorded before and after treatment. If ≥ 50% improvement on the Oswestry was achieved, the intervention was considered a success. Sensitivity, specificity, and positive likelihood ratio were calculated for the association of the two criteria with the outcome of the treatment. RESULTS: 141 patients (49% female, mean age = 35.5 (± 11.1) years) participated. Mean pre- and post-treatment Oswestry scores were 41.9 (± 10.9) and 24.1 (± 14.2) respectively. Sixty-three subjects (45%) had successful treatment outcomes. The sensitivity of the two criteria was 0.56 (95% CI: 0.43, 0.67), specificity was 0.92 (95% CI: 0.84, 0.96), and the positive likelihood ratio was 7.2 (95% CI: 3.2, 16.1). CONCLUSION: The results of this study demonstrate that two factors; symptom duration of less than 16 days, and no symptoms extending distal to the knee, were associated with a good outcome with spinal manipulation