Methodological quality of systematic reviews of animal studies: a survey of reviews of basic research

BACKGROUND: Systematic reviews can serve as a tool in translation of basic life sciences research from laboratory to human research and healthcare. The extent to which reviews of animal research are systematic and unbiased is not known. METHODS: We searched, without language restrictions, Medline, Embase, bibliographies of known reviews (1996–2004) and contacted experts to identify citations of reviews of basic science literature which, as a minimum, performed search of a publicly available resource. From these we identified reviews of animal studies where laboratory variables were measured or where treatments were administered to live animals to examine their effects, and compared them with reviews of bench studies in which human or animal tissues, cell systems or organ preparations were examined in laboratories to better understand mechanisms of diseases. RESULTS: Systematic reviews of animal studies often lacked methodological features such as specification of a testable hypothesis (9/30, 30%); literature search without language restriction (8/30, 26.6%); assessment of publication bias (5/30, 16.6%), study validity (15/30, 50%) and heterogeneity (10/30, 33.3%); and meta-analysis for quantitative synthesis (12/30, 40%). Compared to reviews of bench studies, they were less prone to bias as they specified the question (96.6% vs. 80%, p = 0.04), searched multiple databases (60% vs. 26.6%, p = 0.01), assessed study quality (50% vs. 20%, p = 0.01), and explored heterogeneity (33.3% vs. 2.2%, p = 0.001) more often. CONCLUSION: There seems to be a gradient of frequency of methodological weaknesses among reviews: Attempted systematic reviews of whole animal research tend to be better than those of bench studies, though compared to systematic reviews of human clinical trials they are apparently poorer. There is a need for rigour when reviewing animal research

The quality case for information technology in healthcare

BACKGROUND: As described in the Institute of Medicine's Crossing the Quality Chasm report, the quality of health care in the U.S. today leaves much to be desired. DISCUSSION: One major opportunity for improving quality relates to increasing the use of information technology, or IT. Health care organizations currently invest less in IT than in any other information-intensive industry, and not surprisingly current systems are relatively primitive, compared with industries such as banking or aviation. Nonetheless, a number of organizations have demonstrated that quality can be substantially improved in a variety of ways if IT use is increased in ways that improve care. Specifically, computerization of processes that are error-prone and computerized decision support may substantially improve both efficiency and quality, as well as dramatically facilitate quality measurement. This report discusses the current levels of IT and quality in health care, how quality improvement and management are currently done, the evidence that more IT might be helpful, a vision of the future, and the barriers to getting there. SUMMARY: This report suggests that there are five key policy domains that need to be addressed: standards, incentives, security and confidentiality, professional involvement, and research, with financial incentives representing the single most important lever

Effect of promoter architecture on the cell-to-cell variability in gene expression

According to recent experimental evidence, the architecture of a promoter, defined as the number, strength and regulatory role of the operators that control the promoter, plays a major role in determining the level of cell-to-cell variability in gene expression. These quantitative experiments call for a corresponding modeling effort that addresses the question of how changes in promoter architecture affect noise in gene expression in a systematic rather than case-by-case fashion. In this article, we make such a systematic investigation, based on a simple microscopic model of gene regulation that incorporates stochastic effects. In particular, we show how operator strength and operator multiplicity affect this variability. We examine different modes of transcription factor binding to complex promoters (cooperative, independent, simultaneous) and how each of these affects the level of variability in transcription product from cell-to-cell. We propose that direct comparison between in vivo single-cell experiments and theoretical predictions for the moments of the probability distribution of mRNA number per cell can discriminate between different kinetic models of gene regulation.Comment: 35 pages, 6 figures, Submitte

Non-Surgical Interventions for Adolescents with Idiopathic Scoliosis: An Overview of Systematic Reviews

Non-surgical interventions for adolescents with idiopathic scoliosis remain highly controversial. Despite the publication of numerous reviews no explicit methodological evaluation of papers labeled as, or having a layout of, a systematic review, addressing this subject matter, is available.Analysis and comparison of the content, methodology, and evidence-base from systematic reviews regarding non-surgical interventions for adolescents with idiopathic scoliosis.Systematic overview of systematic reviews.Articles meeting the minimal criteria for a systematic review, regarding any non-surgical intervention for adolescent idiopathic scoliosis, with any outcomes measured, were included. Multiple general and systematic review specific databases, guideline registries, reference lists and websites of institutions were searched. The AMSTAR tool was used to critically appraise the methodology, and the Oxford Centre for Evidence Based Medicine and the Joanna Briggs Institute's hierarchies were applied to analyze the levels of evidence from included reviews.From 469 citations, twenty one papers were included for analysis. Five reviews assessed the effectiveness of scoliosis-specific exercise treatments, four assessed manual therapies, five evaluated bracing, four assessed different combinations of interventions, and one evaluated usual physical activity. Two reviews addressed the adverse effects of bracing. Two papers were high quality Cochrane reviews, Three were of moderate, and the remaining sixteen were of low or very low methodological quality. The level of evidence of these reviews ranged from 1 or 1+ to 4, and in some reviews, due to their low methodological quality and/or poor reporting, this could not be established.Higher quality reviews indicate that generally there is insufficient evidence to make a judgment on whether non-surgical interventions in adolescent idiopathic scoliosis are effective. Papers labeled as systematic reviews need to be considered in terms of their methodological rigor; otherwise they may be mistakenly regarded as high quality sources of evidence.CRD42013003538, PROSPERO

Divergent Roles of Salmonella Pathogenicity Island 2 and Metabolic Traits during Interaction of S. enterica Serovar Typhimurium with Host Cells

The molecular mechanisms of virulence of the gastrointestinal pathogen Salmonella enterica are commonly studied using cell culture models of infection. In this work, we performed a direct comparison of the interaction of S. enterica serovar Typhimurium (S. Typhimurium) with the non-polarized epithelial cell line HeLa, the polarized cell lines CaCo2, T84 and MDCK, and macrophage-like RAW264.7 cells. The ability of S. Typhimurium wild-type and previously characterized auxotrophic mutant strains to enter host cells, survive and proliferate within mammalian cells and deploy the Salmonella Pathogenicity Island 2-encoded type III secretion system (SPI2-T3SS) was quantified. We found that the entry of S. Typhimurium into polarized cells was much more efficient than entry into non-polarized cells or phagocytic uptake. While SPI2-T3SS dependent intracellular proliferation was observed in HeLa and RAW cells, the intracellular replication in polarized cells was highly restricted and not affected by defective SPI2-T3SS. The contribution of aromatic amino acid metabolism and purine biosynthesis to intracellular proliferation was distinct in the various cell lines investigated. These observations indicate that the virulence phenotypes of S. Typhimurium are significantly affected by the cell culture model applied

Instrumental variable meta-analysis of individual patient data: application to adjust for treatment non-compliance

<p>Abstract</p> <p>Background</p> <p>Intention-to-treat (ITT) is the standard data analysis method which includes all patients regardless of receiving treatment. Although the aim of ITT analysis is to prevent bias due to prognostic dissimilarity, it is also a counter-intuitive type of analysis as it counts patients who did not receive treatment, and may lead to "bias toward the null." As treated (AT) method analyzes patients according to the treatment actually received rather than intended, but is affected by the selection bias. Both ITT and AT analyses can produce biased estimates of treatment effect, so instrumental variable (IV) analysis has been proposed as a technique to control for bias when using AT data. Our objective is to correct for bias in non-experimental data from previously published individual patient data meta-analysis by applying IV methods</p> <p>Methods</p> <p>Center prescribing preference was used as an IV to assess the effects of methotrexate (MTX) in preventing debilitating complications of chronic graft-versus-host-disease (cGVHD) in patients who received peripheral blood stem cell (PBSCT) or bone marrow transplant (BMT) in nine randomized controlled trials (1107 patients). IV methods are applied using 2-stage logistic, 2-stage probit and generalized method of moments models.</p> <p>Results</p> <p>ITT analysis showed a statistically significant detrimental effect with the use of day 11 MTX, resulting in cGVHD odds ratio (OR) of 1.34 (95% CI 1.02-1.76). AT results showed no difference in the odds of cGVHD with the use of MTX [OR 1.31 (95%CI 0.99-1.73)]. IV analysis further corrected the results toward no difference in the odds of cGVHD between PBSCT vs. BMT, allowing for a possibility of beneficial effects of MTX in preventing cGVHD in PBSCT recipients (OR 1.14; 95%CI 0.83-1.56).</p> <p>Conclusion</p> <p>All instrumental variable models produce similar results. IV estimates correct for bias and do not exclude the possibility that MTX may be beneficial, contradicting the ITT analysis.</p

Association of Estimated Glomerular Filtration Rate and Urinary Uromodulin Concentrations with Rare Variants Identified by UMOD Gene Region Sequencing

Background: Recent genome-wide association studies (GWAS) have identified common variants in the UMOD region associated with kidney function and disease in the general population. To identify novel rare variants as well as common variants that may account for this GWAS signal, the exons and 4 kb upstream region of UMOD were sequenced. Methodology/Principal Findings Individuals (n = 485) were selected based on presence of the GWAS risk haplotype and chronic kidney disease (CKD) in the ARIC Study and on the extremes of of the UMOD gene product, uromodulin, in urine (Tamm Horsfall protein, THP) in the Framingham Heart Study (FHS). Targeted sequencing was conducted using capillary based Sanger sequencing (3730 DNA Analyzer). Variants were tested for association with THP concentrations and estimated glomerular filtration rate (eGFR), and identified non-synonymous coding variants were genotyped in up to 22,546 follow-up samples. Twenty-four and 63 variants were identified in the 285 ARIC and 200 FHS participants, respectively. In both studies combined, there were 33 common and 54 rare (MAF<0.05) variants. Five non-synonymous rare variants were identified in FHS; borderline enrichment of rare variants was found in the extremes of THP (SKAT p-value = 0.08). Only V458L was associated with THP in the FHS general-population validation sample (p = 9*10$^{−3}$, n = 2,522), but did not show direction-consistent and significant association with eGFR in both the ARIC (n = 14,635) and FHS (n = 7,520) validation samples. Pooling all non-synonymous rare variants except V458L together showed non-significant associations with THP and eGFR in the FHS validation sample. Functional studies of V458L revealed no alternations in protein trafficking. Conclusions/Significance: Multiple novel rare variants in the UMOD region were identified, but none were consistently associated with eGFR in two independent study samples. Only V458L had modest association with THP levels in the general population and thus could not account for the observed GWAS signal

Do decision support systems influence variation in prescription?

<p>Abstract</p> <p>Background</p> <p>Translating scientific evidence into daily practice is problematic. All kinds of intervention strategies, using educational and/or directive strategies, aimed at modifying behavior, have evolved, but have been found only partially successful. In this article the focus is on (computerized) decision support systems (DSSs). DSSs intervene in physicians' daily routine, as opposed to interventions that aim at influencing knowledge in order to change behavior. We examined whether general practitioners (GPs) are prescribing in accordance with the advice given by the DSS and whether there is less variation in prescription when the DSS is used.</p> <p>Methods</p> <p>Data were used from the Second Dutch National Survey of General Practice (DNSGP2), collected in 2001. A total of 82 diagnoses, 749811 contacts, 133 physicians, and 85 practices was included in the analyses. GPs using the DSS daily were compared to GPs who do not use the DSS. Multilevel analyses were used to analyse the data. Two outcome measures were chosen: whether prescription was in accordance with the advice of the DSS or not, and a measure of concentration, the Herfindahl-Hirschman Index (HHI).</p> <p>Results</p> <p>GPs who use the DSS daily prescribe more according to the advice given in the DSS than GPs who do not use the DSS. Contradictory to our expectation there was no significant difference between the HHIs for both groups: variation in prescription was comparable.</p> <p>Conclusion</p> <p>We studied the use of a DSS for drug prescribing in general practice in the Netherlands. The DSS is based on guidelines developed by the Dutch College of General Practitioners and implemented in the Electronic Medical Systems of the GPs. GPs using the DSS more often prescribe in accordance with the advice given in the DSS compared to GPs not using the DSS. This finding, however, did not mean that variation is lower; variation is the same for GPs using and for GPs not using a DSS. Implications of the study are that DSSs can be used to implement guidelines, but that it should not be expected that variation is limited.</p

Effectiveness of electronic guideline-based implementation systems in ambulatory care settings - a systematic review

<p>Abstract</p> <p>Background</p> <p>Electronic guideline-based decision support systems have been suggested to successfully deliver the knowledge embedded in clinical practice guidelines. A number of studies have already shown positive findings for decision support systems such as drug-dosing systems and computer-generated reminder systems for preventive care services.</p> <p>Methods</p> <p>A systematic literature search (1990 to December 2008) of the English literature indexed in the Medline database, Embase, the Cochrane Central Register of Controlled Trials, and CRD (DARE, HTA and NHS EED databases) was conducted to identify evaluation studies of electronic multi-step guideline implementation systems in ambulatory care settings. Important inclusion criterions were the multidimensionality of the guideline (the guideline needed to consist of several aspects or steps) and real-time interaction with the system during consultation. Clinical decision support systems such as one-time reminders for preventive care for which positive findings were shown in earlier reviews were excluded. Two comparisons were considered: electronic multidimensional guidelines versus usual care (comparison one) and electronic multidimensional guidelines versus other guideline implementation methods (comparison two).</p> <p>Results</p> <p>Twenty-seven publications were selected for analysis in this systematic review. Most designs were cluster randomized controlled trials investigating process outcomes more than patient outcomes. With success defined as at least 50% of the outcome variables being significant, none of the studies were successful in improving patient outcomes. Only seven of seventeen studies that investigated process outcomes showed improvements in process of care variables compared with the usual care group (comparison one). No incremental effect of the electronic implementation over the distribution of paper versions of the guideline was found, neither for the patient outcomes nor for the process outcomes (comparison two).</p> <p>Conclusions</p> <p>There is little evidence at the moment for the effectiveness of an increasingly used and commercialised instrument such as electronic multidimensional guidelines. After more than a decade of development of numerous electronic systems, research on the most effective implementation strategy for this kind of guideline-based decision support systems is still lacking. This conclusion implies a considerable risk towards inappropriate investments in ineffective implementation interventions and in suboptimal care.</p