66 research outputs found

    Calculating the power to examine treatment-covariate interactions when planning an individual participant data meta-analysis of randomized trials with a binary outcome.

    Get PDF
    Before embarking on an individual participant data meta-analysis (IPDMA) project, researchers and funders need assurance it is worth their time and cost. This should include consideration of how many studies are promising their IPD and, given the characteristics of these studies, the power of an IPDMA including them. Here, we show how to estimate the power of a planned IPDMA of randomized trials to examine treatment-covariate interactions at the participant level (ie, treatment effect modifiers). We focus on a binary outcome with binary or continuous covariates, and propose a three-step approach, which assumes the true interaction size is common to all trials. In step one, the user must specify a minimally important interaction size and, for each trial separately (eg, as obtained from trial publications), the following aggregate data: the number of participants and events in control and treatment groups, the mean and SD for each continuous covariate, and the proportion of participants in each category for each binary covariate. This allows the variance of the interaction estimate to be calculated for each trial, using an analytic solution for Fisher's information matrix from a logistic regression model. Step 2 calculates the variance of the summary interaction estimate from the planned IPDMA (equal to the inverse of the sum of the inverse trial variances from step 1), and step 3 calculates the corresponding power based on a two-sided Wald test. Stata and R code are provided, and two examples given for illustration. Extension to allow for between-study heterogeneity is also considered

    Multivariate meta-analysis of multiple outcomes: characteristics and predictors of borrowing of strength from Cochrane reviews.

    Get PDF
    OBJECTIVES: Multivariate meta-analysis allows the joint synthesis of multiple outcomes accounting for their correlation. This enables borrowing of strength (BoS) across outcomes, which may lead to greater efficiency and even different conclusions compared to separate univariate meta-analyses. However, multivariate meta-analysis is complex to apply, so guidance is needed to flag (in advance of analysis) when the approach is most useful. STUDY DESIGN AND SETTING: We use 43 Cochrane intervention reviews to empirically investigate the characteristics of meta-analysis datasets that are associated with a larger BoS statistic (from 0 to 100%) when applying a bivariate meta-analysis of binary outcomes. RESULTS: Four characteristics were identified as strongly associated with BoS: the total number of studies, the number of studies with the outcome of interest, the percentage of studies missing the outcome of interest, and the largest absolute within-study correlation. Using these characteristics, we then develop a model for predicting BoS in a new dataset, which is shown to have good performance (an adjusted R2 of 50%). Applied examples are used to illustrate the use of the BoS prediction model. CONCLUSIONS: Cochrane reviewers mainly use univariate meta-analysis methods, but the identified characteristics associated with BoS and our subsequent prediction model for BoS help to flag when a multivariate meta-analysis may also be beneficial in Cochrane reviews with multiple binary outcomes. Extension to non-Cochrane reviews and other outcome types is still required

    Development and application of multivariate meta-analysis in medical research: borrowing strength across multiple correlated outcomes

    Get PDF
    Multivariate meta-analysis methods combine effect estimates for multiple correlated outcomes (such as systolic and diastolic blood pressure) from independent studies, utilising their between-study and within-study correlations. In contrast, a univariate meta-analysis pools effect estimates for each outcome independently. By using the multivariate over the univariate approach, there is a potential gain in information toward summary meta-analysis results, quantified by the Borrowing of Strength (BoS) statistic, a percentage reduction in the variance for the summary effect between the two approaches. This thesis examines BoS and multivariate meta-analysis applications in detail. Firstly, multivariate meta-analysis is applied to an individual participant data metaanalysis examining the effect of diet and exercise interventions during pregnancy. This shows results from the univariate and multivariate meta-analyses are similar. However, a review of 43 Cochrane reviews concludes that although results between the univariate and multivariate are often similar, a few multivariate meta-analyses do give important differences to results from univariate meta analyses, and these are shown to have a larger magnitude of BoS. This motivates research to identify predictors of BoS and to develop a model to predict BoS (in advance of analysis) to flag when researchers should consider multivariate meta-analysis. Additionally, an interactive tool is developed to investigate the relationship between the various characteristics and the magnitude of BoS. The magnitude of BoS is shown mathematically to be approximately bounded by the percentage of missing data for the outcome of interest. A novel application of bivariate meta-analysis is then proposed for trials with continuous outcomes analysed with final score or ANCOVA models, with examination in real examples and a simulation study. In conclusion, multivariate meta-analysis may provide important differences to univariate meta-analysis when BoS is large, and so researchers should consider the approach when BoS is expected to be large

    Two-stage or not two-stage? That is the question for IPD meta-analysis projects

    Get PDF
    Individual participant data meta-analysis (IPDMA) projects obtain, check, harmonise and synthesise raw data from multiple studies. When undertaking the meta-analysis, researchers must decide between a two-stage or a one-stage approach. In a two-stage approach, the IPD are first analysed separately within each study to obtain aggregate data (e.g., treatment effect estimates and standard errors); then, in the second stage, these aggregate data are combined in a standard meta-analysis model (e.g., common-effect or random-effects). In a one-stage approach, the IPD from all studies are analysed in a single step using an appropriate model that accounts for clustering of participants within studies and, potentially, between-study heterogeneity (e.g., a general or generalised linear mixed model). The best approach to take is debated in the literature, and so here we provide clearer guidance for a broad audience. Both approaches are important tools for IPDMA researchers and neither are a panacea. If most studies in the IPDMA are small (few participants or events), a one-stage approach is recommended due to using a more exact likelihood. However, in other situations, researchers can choose either approach, carefully following best practice. Some previous claims recommending to always use a one-stage approach are misleading, and the two-stage approach will often suffice for most researchers. When differences do arise between the two approaches, often it is caused by researchers using different modelling assumptions or estimation methods, rather than using one or two stages per se

    Effects of mechanical interventions in the management of knee osteoarthritis: Protocol for an OA Trial Bank systematic review and individual participant data meta-analysis

    Get PDF
    Introduction Knee osteoarthritis (OA) is a prevalent and disabling musculoskeletal condition. Biomechanical factors may play a key role in the aetiology of knee OA, therefore, a broad class of interventions involves the application or wear of devices designed to mechanically support knees with OA. These include gait aids, bracing, taping, orthotics and footwear. The literature regarding efficacy of mechanical interventions has been conflicting or inconclusive, and this may be because certain subgroups with knee OA respond better to mechanical interventions. Our primary aim is to identify subgroups with knee OA who respond favourably to mechanical interventions. Methods and analysis We will conduct a systematic review to identify randomised clinical trials of any mechanical intervention for the treatment of knee OA. We will invite lead authors of eligible studies to share individual participant data (IPD). We will perform an IPD meta-analysis for each type of mechanical intervention to evaluate efficacy, with our main outcome being pain. Where IPD are not available, this will be achieved using aggregate data. We will then evaluate five potential treatment effect modifiers using a two-stage approach. If data permit, we will also evaluate whether biomechanics mediate the effects of mechanical interventions on pain in knee OA. Ethics and dissemination No new data will be collected in this study. We will adhere to institutional, national and international regulations regarding the secure and confidential sharing of IPD, addressing ethics as indicated. We will disseminate findings via international conferences, open-source publication in peer-reviewed journals and summaries posted on websites serving the public and clinicians. PROSPERO registration number CRD42020155466
    corecore