Improving search filter development: a study of palliative care literature

Background It is difficult to systematically search for literature relevant to palliative care in general medical journals. A previously developed search filter for use on OVID Medline validated using a gold standard set of references identified through hand searching, achieved an unacceptably low sensitivity (45.4%). Retrieving relevant literature is integral to support evidence based practice, and understanding the nature of the incorrectly excluded citations (false negatives) using the filter may lead to improvement in the filter's performance. Methods The objectives were to describe the nature of subjects reflected in the false negative citations and to empirically improve the sensitivity of the search filter. A thematic analysis of MeSH terms by three independent reviewers was used to describe the subject coverage of the missed records. Using a frequency analysis of MeSH terms, those headings which could individually contribute at least 2.5% to sensitivity (occurring 19 or more times) were added to the search filter. All previously run searches were rerun at the same time as the revised filter, and results compared. Results Thematic analysis of MeSH terms identified thirteen themes reflected in the missing records, none of them intrinsically palliative. The addition of six MeSH terms to the existing search filter (physician-patient relations, prognosis, quality of life, survival rate, treatment outcome and attitude to health) led to an increase in sensitivity from 46.3% to 64.7%, offset by a decrease in precision from 72.6% to 21.9%. Conclusion The filter's sensitivity was successfully increased using frequency analysis of MeSH terms, offset by a decrease in precision. A thematic analysis of MeSH terms for the false negative citations confirmed the absence of any intrinsically palliative theme or term, suggesting that future improvements to search filters for palliative care literature will first depend on better identifying how clinicians and researchers conceptualise palliative care. It is suggested that a constellation of parameters: stage of disease (advanced or active), prospect of cure (little or none), and treatment goals (primarily quality of life) may ultimately inform search strategies. This may be similarly true for chronic diseases, which share the inherent passage of time which marks them apart from acute, and therefore more readily identifiable, episodes of care

Measurement properties of the Inventory of Cognitive Bias in Medicine (ICBM)

© 2008 Sladek et al; licensee BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.Background Understanding how doctors think may inform both undergraduate and postgraduate medical education. Developing such an understanding requires valid and reliable measurement tools. We examined the measurement properties of the Inventory of Cognitive Bias in Medicine (ICBM), designed to tap this domain with specific reference to medicine, but with previously questionable measurement properties. Methods First year postgraduate entry medical students at Flinders University, and trainees (postgraduate doctors in any specialty) and consultants (N = 348) based at two teaching hospitals in Adelaide, Australia, completed the ICBM and a questionnaire measuring thinking styles (Rational Experiential Inventory). Results Questions with the lowest item-total correlation were deleted from the original 22 item ICBM, although the resultant 17 item scale only marginally improved internal consistency (Cronbach's α = 0.61 compared with 0.57). A factor analysis identified two scales, both achieving only α = 0.58. Construct validity was assessed by correlating Rational Experiential Inventory scores with the ICBM, with some positive correlations noted for students only, suggesting that those who are naïve to the knowledge base required to "successfully" respond to the ICBM may profit by a thinking style in tune with logical reasoning. Conclusion The ICBM failed to demonstrate adequate content validity, internal consistency and construct validity. It is unlikely that improvements can be achieved without considered attention to both the audience for which it is designed and its item content. The latter may need to involve both removal of some items deemed to measure multiple biases and the addition of new items in the attempt to survey the range of biases that may compromise medical decision making

Magnetic Resonance Enterography Cannot Replace Upper Endoscopy in Pediatric Crohn Disease: An Imagekids Sub-study

Objectives: Although magnetic resonance enterography (MRE) can accurately reflect ileal inflammation in pediatric Crohn disease (CD), there are no pediatric data on the accuracy of MRE to detect upper gastrointestinal tract (UGI) lesions. We aimed to compare MRE and esophagogastroduodenoscopy (EGD) in detecting the spectrum and severity of UGI disease in children. Methods: This is an ancillary study of the prospective multi-center ImageKids study focusing on pediatric MRE. EGD was performed within 2 weeks of MRE (at disease onset or thereafter) and explicitly scored by SES-CD modified for the UGI and physician global assessment. Local and central radiologists scored the UGI region of the MRE blinded to the EGD. Accuracy of MRE compared with EGD was examined using correlational coefficients (r) and area under receiver operating characteristic curves (AUC). Results: One hundred and eighty-eight patients were reviewed (mean age 14 +/- 1 years, 103 [55%] boys);66 of 188 (35%) children had macroscopic ulcerations on EGD (esophagus, 13 [7%];stomach, 34 [18%];duodenum, 45 [24%]). Most children had aphthous ulcers, but 10 (5%) had larger ulcers (stomach, 2 [1%];duodenum, 8 [4%]). There was no agreement between local and central radiologists on the presence or absence of UGI inflammation on MRE (Kappa=0.02, P - 0.71). EGD findings were not accurately detected by MRE, read locally or centrally (r=-0.03 to 0.11, P = 0.18-0.88;AUC - 0.47-0.55, P = 0.53-1.00).No fistulae or narrowings were identified on either EGD or MRE. Conclusions: MRE cannot reliably assess the UGI in pediatric CD and cannot replace EGD for this purpose

Analysis of KLF transcription factor family gene variants in type 2 diabetes

<p>Abstract</p> <p>Background</p> <p>The Krüppel-like factor (<it>KLF</it>) family consists of transcription factors that can activate or repress different genes implicated in processes such as differentiation, development, and cell cycle progression. Moreover, several of these proteins have been implicated in glucose homeostasis, making them candidate genes for involvement in type 2 diabetes (T2D).</p> <p>Methods</p> <p>Variants of nine <it>KLF </it>genes were genotyped in T2D cases and controls and analysed in a two-stage study. The first case-control set included 365 T2D patients with a strong family history of T2D and 363 normoglycemic individuals and the second set, 750 T2D patients and 741 normoglycemic individuals, all of French origin. The SNPs of six <it>KLF </it>genes were genotyped by Taqman^®SNP Genotyping Assays. The other three <it>KLF </it>genes (KLF2, -15 and -16) were screened and the identified frequent variants of these genes were analysed in the case-control studies.</p> <p>Results</p> <p>Three of the 28 SNPs showed a trend to be associated with T2D in our first case-control set (P < 0.10). These SNPs, located in the <it>KLF2, KLF4 </it>and <it>KLF5 </it>gene were then analysed in our second replication set, but analysis of this set and the combined analysis of the three variants in all 2,219 individuals did not show an association with T2D in this French population. As the <it>KLF2</it>, -15 and -16 variants were representative for the genetic variability in these genes, we conclude they do not contribute to genetic susceptibility for T2D.</p> <p>Conclusion</p> <p>It is unlikely that variants in different members of the <it>KLF </it>gene family play a major role in T2D in the French population.</p

Development of a heart failure filter for Medline: an objective approach using evidence-based clinical practice guidelines as an alternative to hand searching

<p>Abstract</p> <p>Background</p> <p>Heart failure is a highly debilitating syndrome with a poor prognosis primarily affecting the elderly. Clinicians wanting timely access to heart failure evidence to provide optimal patient care can face many challenges in locating this evidence.</p> <p>This study developed and validated a search filter of high clinical utility for the retrieval of heart failure articles in OvidSP Medline.</p> <p>Methods</p> <p>A Clinical Advisory Group was established to advise study investigators. The study set of 876 relevant articles from four heart failure clinical practice guidelines was divided into three datasets: a Term Identification Set, a Filter Development Set, and a Filter Validation Set. A further validation set (the Cochrane Validation Set) was formed using studies included in Cochrane heart failure systematic reviews. Candidate search terms were identified via word frequency analysis. The filter was developed by creating combinations of terms and recording their performance in retrieving items from the Filter Development Set. The filter's recall was then validated in both the Filter Validation Set and the Cochrane Validation Set. A precision estimate was obtained post-hoc by running the filter in Medline and screening the first 200 retrievals for relevance to heart failure.</p> <p>Results</p> <p>The four-term filter achieved a recall of 96.9% in the Filter Development Set; 98.2% in the Filter Validation Set; and 97.8% in the Cochrane Validation Set. Of the first 200 references retrieved by the filter when run in Medline, 150 were deemed relevant and 50 irrelevant. The post-hoc precision estimate was therefore 75%.</p> <p>Conclusions</p> <p>This study describes an objective method for developing a validated heart failure filter of high recall performance and then testing its precision post-hoc. Clinical practice guidelines were found to be a feasible alternative to hand searching in creating a gold standard for filter development. Guidelines may be especially appropriate given their clinical utility. A validated heart failure filter is now available to support health professionals seeking reliable and efficient access to the heart failure literature.</p

Implementation science: a role for parallel dual processing models of reasoning?

BACKGROUND: A better theoretical base for understanding professional behaviour change is needed to support evidence-based changes in medical practice. Traditionally strategies to encourage changes in clinical practices have been guided empirically, without explicit consideration of underlying theoretical rationales for such strategies. This paper considers a theoretical framework for reasoning from within psychology for identifying individual differences in cognitive processing between doctors that could moderate the decision to incorporate new evidence into their clinical decision-making. DISCUSSION: Parallel dual processing models of reasoning posit two cognitive modes of information processing that are in constant operation as humans reason. One mode has been described as experiential, fast and heuristic; the other as rational, conscious and rule based. Within such models, the uptake of new research evidence can be represented by the latter mode; it is reflective, explicit and intentional. On the other hand, well practiced clinical judgments can be positioned in the experiential mode, being automatic, reflexive and swift. Research suggests that individual differences between people in both cognitive capacity (e.g., intelligence) and cognitive processing (e.g., thinking styles) influence how both reasoning modes interact. This being so, it is proposed that these same differences between doctors may moderate the uptake of new research evidence. Such dispositional characteristics have largely been ignored in research investigating effective strategies in implementing research evidence. Whilst medical decision-making occurs in a complex social environment with multiple influences and decision makers, it remains true that an individual doctor's judgment still retains a key position in terms of diagnostic and treatment decisions for individual patients. This paper argues therefore, that individual differences between doctors in terms of reasoning are important considerations in any discussion relating to changing clinical practice. SUMMARY: It is imperative that change strategies in healthcare consider relevant theoretical frameworks from other disciplines such as psychology. Generic dual processing models of reasoning are proposed as potentially useful in identifying factors within doctors that may moderate their individual uptake of evidence into clinical decision-making. Such factors can then inform strategies to change practice

Thinking styles and doctors' knowledge and behaviours relating to acute coronary syndromes guidelines

Background How humans think and make decisions is important in understanding behaviour. Hence an understanding of cognitive processes among physicians may inform our understanding of behaviour in relation to evidence implementation strategies. A personality theory, Cognitive-Experiential Self Theory (CEST) proposes a relationship between different ways of thinking and behaviour, and articulates pathways for behaviour change. However prior to the empirical testing of interventions based on CEST, it is first necessary to demonstrate its suitability among a sample of healthcare workers. Objectives To investigate the relationship between thinking styles and the knowledge and clinical practices of doctors directly involved in the management of acute coronary syndromes. Methods Self-reported doctors' thinking styles (N = 74) were correlated with results from a survey investigating knowledge, attitudes, and clinical practice, and evaluated against recently published acute coronary syndrome clinical guidelines. Results Guideline-discordant practice was associated with an experiential style of thinking. Conversely, guideline-concordant practice was associated with a higher preference for a rational style of reasoning. Conclusion Findings support that while guidelines might be necessary to communicate evidence, other strategies may be necessary to target discordant behaviours. Further research designed to examine the relationships found in the current study is required

Analysis of protein-coding genetic variation in 60,706 humans

Large-scale reference data sets of human genetic variation are critical for the medical and functional interpretation of DNA sequence changes. We describe the aggregation and analysis of high-quality exome (protein-coding region) sequence data for 60,706 individuals of diverse ethnicities generated as part of the Exome Aggregation Consortium (ExAC). This catalogue of human genetic diversity contains an average of one variant every eight bases of the exome, and provides direct evidence for the presence of widespread mutational recurrence. We have used this catalogue to calculate objective metrics of pathogenicity for sequence variants, and to identify genes subject to strong selection against various classes of mutation; identifying 3,230 genes with near-complete depletion of truncating variants with 72% having no currently established human disease phenotype. Finally, we demonstrate that these data can be used for the efficient filtering of candidate disease-causing variants, and for the discovery of human “knockout” variants in protein-coding genes