An empirical study using permutation-based resampling in meta-regression

<p>Abstract</p> <p>Background</p> <p>In meta-regression, as the number of trials in the analyses decreases, the risk of false positives or false negatives increases. This is partly due to the assumption of normality that may not hold in small samples. Creation of a distribution from the observed trials using permutation methods to calculate <it>P </it>values may allow for less spurious findings. Permutation has not been empirically tested in meta-regression. The objective of this study was to perform an empirical investigation to explore the differences in results for meta-analyses on a small number of trials using standard large sample approaches verses permutation-based methods for meta-regression.</p> <p>Methods</p> <p>We isolated a sample of randomized controlled clinical trials (RCTs) for interventions that have a small number of trials (herbal medicine trials). Trials were then grouped by herbal species and condition and assessed for methodological quality using the Jadad scale, and data were extracted for each outcome. Finally, we performed meta-analyses on the primary outcome of each group of trials and meta-regression for methodological quality subgroups within each meta-analysis. We used large sample methods and permutation methods in our meta-regression modeling. We then compared final models and final <it>P </it>values between methods.</p> <p>Results</p> <p>We collected 110 trials across 5 intervention/outcome pairings and 5 to 10 trials per covariate. When applying large sample methods and permutation-based methods in our backwards stepwise regression the covariates in the final models were identical in all cases. The <it>P </it>values for the covariates in the final model were larger in 78% (7/9) of the cases for permutation and identical for 22% (2/9) of the cases.</p> <p>Conclusions</p> <p>We present empirical evidence that permutation-based resampling may not change final models when using backwards stepwise regression, but may increase <it>P </it>values in meta-regression of multiple covariates for relatively small amount of trials.</p

Recommendations by Cochrane Review Groups for assessment of the risk of bias in studies

<p>Abstract</p> <p>Background</p> <p>Assessing the risk of bias in individual studies in a systematic review can be done using individual components or by summarizing the study quality in an overall score.</p> <p>Methods</p> <p>We examined the instructions to authors of the 50 Cochrane Review Groups that focus on clinical interventions for recommendations on methodological quality assessment of studies.</p> <p>Results</p> <p>Forty-one of the review groups (82%) recommended quality assessment using components and nine using a scale. All groups recommending components recommended to assess concealment of allocation, compared to only two of the groups recommending scales (P < 0.0001). Thirty-five groups (70%) recommended assessment of sequence generation and 21 groups (42%) recommended assessment of intention-to-treat analysis. Only 28 groups (56%) had specific recommendations for using the quality assessment of studies analytically in reviews, with sensitivity analysis, quality as an inclusion threshold and subgroup analysis being the most commonly recommended methods. The scales recommended had problems in the individual items and some of the groups recommending components recommended items not related to bias in their quality assessment.</p> <p>Conclusion</p> <p>We found that recommendations by some groups were not based on empirical evidence and many groups had no recommendations on how to use the quality assessment in reviews. We suggest that all Cochrane Review Groups refer to the Cochrane Handbook for Systematic Reviews of Interventions, which is evidence-based, in their instructions to authors and that their own guidelines are kept to a minimum and describe only how methodological topics that are specific to their fields should be handled.</p

Evaluating heterogeneity in cumulative meta-analyses

BACKGROUND: Recently developed measures such as I(2 )and H allow the evaluation of the impact of heterogeneity in conventional meta-analyses. There has been no examination of the development of heterogeneity in the context of a cumulative meta-analysis. METHODS: Cumulative meta-analyses of five smoking cessation interventions (clonidine, nicotine replacement therapy using gum and patch, physician advice and acupuncture) were used to calculate I(2 )and H. These values were plotted by year of publication, control event rate and sample size to trace the development of heterogeneity over these covariates. RESULTS: The cumulative evaluation of heterogeneity varied according to the measure of heterogeneity used and the basis of cumulation. Plots produced from the calculations revealed areas of heterogeneity useful in the consideration of potential sources for further study. CONCLUSION: The examination of heterogeneity in conjunction with summary effect estimates in a cumulative meta-analysis offered valuable insight into the evolution of variation. Such information is not available in the context of conventional meta-analysis and has the potential to lead to the development of a richer picture of the effectiveness of interventions

The association between histamine 2 receptor antagonist use and Clostridium difficile infection: a systematic review and meta-analysis.

Background Clostridium difficile infection (CDI) is a major health problem. Epidemiological evidence suggests that there is an association between acid suppression therapy and development of CDI. Purpose We sought to systematically review the literature that examined the association between histamine 2 receptor antagonists (H2RAs) and CDI. Data source We searched Medline, Current Contents, Embase, ISI Web of Science and Elsevier Scopus from 1990 to 2012 for all analytical studies that examined the association between H2RAs and CDI. Study selection Two authors independently reviewed the studies for eligibility. Data extraction Data about studies characteristics, adjusted effect estimates and quality were extracted. Data synthesis Thirty-five observations from 33 eligible studies that included 201834 participants were analyzed. Studies were performed in 6 countries and nine of them were multicenter. Most studies did not specify the type or duration of H2RAs therapy. The pooled effect estimate was 1.44, 95% CI (1.22–1.7), I2 = 70.5%. This association was consistent across different subgroups (by study design and country) and there was no evidence of publication bias. The pooled effect estimate for high quality studies was 1.39 (1.15–1.68), I2 = 72.3%. Meta-regression analysis of 10 study-level variables did not identify sources of heterogeneity. In a speculative analysis, the number needed to harm (NNH) with H2RAs at 14 days after hospital admission in patients receiving antibiotics or not was 58, 95% CI (37, 115) and 425, 95% CI (267, 848), respectively. For the general population, the NNH at 1 year was 4549, 95% CI (2860, 9097). Conclusion In this rigorous systematic review and meta-analysis, we observed an association between H2RAs and CDI. The absolute risk of CDI associated with H2RAs is highest in hospitalized patients receiving antibiotics

SSE: a nucleotide and amino acid sequence analysis platform

<p>Abstract</p> <p>Background</p> <p>There is an increasing need to develop bioinformatic tools to organise and analyse the rapidly growing amount of nucleotide and amino acid sequence data in organisms ranging from viruses to eukaryotes.</p> <p>Finding</p> <p>A simple sequence editor (SSE) was developed to create an integrated environment where sequences can be aligned, annotated, classified and directly analysed by a number of built-in bioinformatic programs. SSE incorporates a sequence editor for the creation of sequence alignments, a process assisted by integrated CLUSTAL/MUSCLE alignment programs and automated removal of indels. Sequences can be fully annotated and classified into groups and annotated of sequences and sequence groups and access to analytical programs that analyse diversity, recombination and RNA secondary structure. Methods for analysing sequence diversity include measures of divergence and evolutionary distances, identity plots to detect regions of nucleotide or amino acid homology, reconstruction of sequence changes, mono-, di- and higher order nucleotide compositional biases and codon usage.</p> <p>Association Index calculations, GroupScans, Bootscanning and TreeOrder scans perform phylogenetic analyses that reconcile group membership with tree branching orders and provide powerful methods for examining segregation of alleles and detection of recombination events. Phylogeny changes across alignments and scoring of branching order differences between trees using the Robinson-Fould algorithm allow effective visualisation of the sites of recombination events.</p> <p>RNA secondary and tertiary structures play important roles in gene expression and RNA virus replication. For the latter, persistence of infection is additionally associated with pervasive RNA secondary structure throughout viral genomic RNA that modulates interactions with innate cell defences. SSE provides several programs to scan alignments for RNA secondary structure through folding energy thermodynamic calculations and phylogenetic methods (detection of co-variant changes, and structure conservation between divergent sequences). These analyses complement methods based on detection of sequence constraints, such as suppression of synonymous site variability.</p> <p>For each program, results can be plotted in real time during analysis through an integrated graphics package, providing publication quality graphs. Results can be also directed to tabulated datafiles for import into spreadsheet or database programs for further analysis.</p> <p>Conclusions</p> <p>SSE combines sequence editor functions with analytical tools in a comprehensive and user-friendly package that assists considerably in bioinformatic and evolution research.</p

Strengthening the reporting of observational studies in epidemiology using mendelian randomisation (STROBE-MR): explanation and elaboration.

Mendelian randomisation (MR) studies allow a better understanding of the causal effects of modifiable exposures on health outcomes, but the published evidence is often hampered by inadequate reporting. Reporting guidelines help authors effectively communicate all critical information about what was done and what was found. STROBE-MR (strengthening the reporting of observational studies in epidemiology using mendelian randomisation) assists authors in reporting their MR research clearly and transparently. Adopting STROBE-MR should help readers, reviewers, and journal editors evaluate the quality of published MR studies. This article explains the 20 items of the STROBE-MR checklist, along with their meaning and rationale, using terms defined in a glossary. Examples of transparent reporting are used for each item to illustrate best practices

Applying the Risk of Bias Tool in a Systematic Review of Combination Long-Acting Beta-Agonists and Inhaled Corticosteroids for Persistent Asthma

Background: The Risk of Bias (RoB) tool is used to assess internal validity of randomized controlled trials (RCTs). Our objectives were to: 1) evaluate inter-rater agreement of the RoB tool; 2) determine the time to access supplemental study information; 3) compare the RoB tool with the Jadad scale and Schulz allocation concealment (AC); and 4) examine the relationship between RoB and effect estimates. Methods: We conducted a systematic review of long-acting beta agonists (LABA) combined with inhaled corticosteroids (ICS) for adults with persistent asthma. Two reviewers independently assessed 107 trials using RoB, Jadad, and AC. One reviewer searched for study protocols. We assessed inter-rater agreement using weighted Kappa (k) and the correlation between tools using Kendall’s Tau (t). Mean differences in effect sizes for RCTs with different RoB were calculated using inverse variance method and random effects model. Results: Trials had good Jadad scores (median 4, IQR 3-4); however, 85 % had unclear AC and 87 % high RoB. The factor that most influenced RoB was the potential inappropriate influence of study sponsors (95 % industry funded). Agreement on RoB domains was fair (k = 0.40) to almost perfect (k = 0.86), and moderate for overall RoB (k = 0.41). Median time to complete RoB assessments was 21 minutes (IQR 14-27) and 12 minutes (IQR 9-16) to search for protocols. Protocols were identified for 5/42 studies (12%); in 3 cases the assessment of selective outcome reporting changed. There was low correlation between overall RoB vs. Jadad (t =0.04

Omega-3 supplementation in patients with sepsis: a systematic review and meta-analysis of randomized trials.

BACKGROUND: Nutritional supplementation of omega-3 fatty acids has been proposed to modulate the balance of pro- and anti-inflammatory mediators in sepsis. If proved to improve clinical outcomes in critically ill patients with sepsis, this intervention would be easy to implement. However, the cumulative evidence from several randomized clinical trials (RCTs) remains unclear. METHODS: We searched the Cochrane Library, MEDLINE, and EMBASE through December 2016 for RCTs on parenteral or enteral omega-3 supplementation in adult critically ill patients diagnosed with sepsis or septic shock. We analysed the included studies for mortality, intensive care unit (ICU) length of stay, and duration of mechanical ventilation, and used the Grading of Recommendations Assessment, Development and Evaluation approach to assess the quality of the evidence for each outcome. RESULTS: A total of 17 RCTs enrolling 1239 patients met our inclusion criteria. Omega-3 supplementation compared to no supplementation or placebo had no significant effect on mortality [relative risk (RR) 0.85; 95% confidence interval (CI) 0.71, 1.03; P = 0.10; I (2) = 0%; moderate quality], but significantly reduced ICU length of stay [mean difference (MD) -3.79 days; 95% CI -5.49, -2.09; P < 0.0001, I (2) = 82%; very low quality] and duration of mechanical ventilation (MD -2.27 days; 95% CI -4.27, -0.27; P = 0.03, I (2) = 60%; very low quality). However, sensitivity analyses challenged the robustness of these results. CONCLUSION: Omega-3 nutritional supplementation may reduce ICU length of stay and duration of mechanical ventilation without significantly affecting mortality, but the very low quality of overall evidence is insufficient to justify the routine use of omega-3 fatty acids in the management of sepsis

Effectiveness of en masse versus two-step retraction:a systematic review and meta-analysis

Abstract Background This review aims to compare the effectiveness of en masse and two-step retraction methods during orthodontic space closure regarding anchorage preservation and anterior segment retraction and to assess their effect on the duration of treatment and root resorption. Methods An electronic search for potentially eligible randomized controlled trials and prospective controlled trials was performed in five electronic databases up to July 2017. The process of study selection, data extraction, and quality assessment was performed by two reviewers independently. A narrative review is presented in addition to a quantitative synthesis of the pooled results where possible. The Cochrane risk of bias tool and the Newcastle-Ottawa Scale were used for the methodological quality assessment of the included studies. Results Eight studies were included in the qualitative synthesis in this review. Four studies were included in the quantitative synthesis. En masse/miniscrew combination showed a statistically significant standard mean difference regarding anchorage preservation − 2.55 mm (95% CI − 2.99 to − 2.11) and the amount of upper incisor retraction − 0.38 mm (95% CI − 0.70 to − 0.06) when compared to a two-step/conventional anchorage combination. Qualitative synthesis suggested that en masse retraction requires less time than two-step retraction with no difference in the amount of root resorption. Conclusions Both en masse and two-step retraction methods are effective during the space closure phase. The en masse/miniscrew combination is superior to the two-step/conventional anchorage combination with regard to anchorage preservation and amount of retraction. Limited evidence suggests that anchorage reinforcement with a headgear produces similar results with both retraction methods. Limited evidence also suggests that en masse retraction may require less time and that no significant differences exist in the amount of root resorption between the two methods