Skip to main content
Article thumbnail
Location of Repository

A re-evaluation of random-effects meta-analysis

By Julian P T Higgins, Simon G Thompson and David J Spiegelhalter


Meta-analysis in the presence of unexplained heterogeneity is frequently undertaken by using a random-effects model, in which the effects underlying different studies are assumed to be drawn from a normal distribution. Here we discuss the justification and interpretation of such models, by addressing in turn the aims of estimation, prediction and hypothesis testing. A particular issue that we consider is the distinction between inference on the mean of the random-effects distribution and inference on the whole distribution. We suggest that random-effects meta-analyses as currently conducted often fail to provide the key results, and we investigate the extent to which distribution-free, classical and Bayesian approaches can provide satisfactory methods. We conclude that the Bayesian approach has the advantage of naturally allowing for full uncertainty, especially for prediction. However, it is not without problems, including computational intensity and sensitivity to a priori judgements. We propose a simple prediction interval for classical meta-analysis and offer extensions to standard practice of Bayesian meta-analysis, making use of an example of studies of ‘set shifting’ ability in people with eating disorders

Topics: Original Articles
Publisher: Blackwell Publishing Ltd
OAI identifier:
Provided by: PubMed Central

Suggested articles


  1. (2008). 222–227.Random-effects Meta-analysis 159
  2. (2005). A Bayesian semiparametric model for random-effects meta-analysis.
  3. (1993). A bivariate approach to meta-analysis.
  4. (1993). A comparison of the power of two tests for qualitative interactions.
  5. (1999). A general maximum likelihood analysis of variance components in generalized linear models.
  6. (1991). A general parametric approach to the meta-analysis of randomised clinical trials.
  7. (1996). A likelihood approach to meta-analysis with random effects.
  8. (2003). A meta-analysis of studies on the association of the platelet PlA polymorphism of glycoprotein IIIa and risk of coronary heart disease.
  9. (1995). A random-effects regression model for meta-analysis.
  10. (2007). A systematic review and metaanalysis of set-shifting ability in eating disorders.
  11. (1987). Accumulating evidence from independent studies—what we can win and what we can lose.
  12. (1998). Albumin Reviewers
  13. (1993). Analysis of binary data from a multicenter clinical-trial.
  14. (1998). Approximate Bayesian inference in random effects meta-analysis.
  15. (2006). Assessing the amount of heterogeneity in random-effects meta-analysis.
  16. (2001). Assessing the quality of controlled clinical trials.
  17. (1995). Bayes Factors.
  18. (2003). Bayesian approaches to multiple sources of evidence and uncertainty in complex cost-effectiveness modelling.
  19. (1995). Bayesian approaches to random-effects meta-analysis: a comparative study.
  20. (1995). Bayesian Data Analysis. Boca Raton: Chapman and Hall–CRC.
  21. (2002). Bayesian random effects meta-analysis of trials with binary outcomes: methods for the absolute risk difference and relative risk scales.
  22. (1997). Bias in meta-analysis detected by a simple, graphical test.
  23. (2006). Combination of data. In
  24. (2000). Computer-modeling and graphical strategies for meta-analysis.
  25. (2007). Confidence intervals for the amount of heterogeneity in meta-analysis.
  26. (1998). Detecting and describing heterogeneity in meta-analysis.
  27. (1989). Empirical Bayes confidence intervals for a series of related experiments.
  28. (1985). Empirical Bayes meta-analysis.
  29. (1990). Empirical Bayes methods in clinical trials meta-analysis.
  30. (1995). Exploratory or analytic meta-analysis: should we distinguish between them?
  31. (2007). Flexible random-effects models using Bayesian semi-parametric models: applications to institutional comparisons.
  32. (1995). Heterogeneity in meta-analysis of data from epidemiologic studies:
  33. (1992). Hierachical models for combining information and for meta-analysis.
  34. (1990). Hierarchical models for multicentre binary response studies.
  35. (2005). How vague is vague?: a simulation study of the impact of the use of vague prior distributions in MCMC using WinBUGS.
  36. (1956). Inadmissibility of the usual estimator of the mean of a multivariate distribution.
  37. (1997). Incorporating variability in estimates of heterogeneity in the random effects model in meta-analysis.
  38. (1992). Incorporating variations in the quality of individual randomized trials into meta-analysis.
  39. (1987). Inter-study differences—how should they influence the interpretation and analysis of results.
  40. (2002). Investigating causes of heterogeneity in systematic reviews.
  41. (1994). Kendall’s Advanced Theory of Statistics,
  42. (1999). Meta-analysis by random effect modelling in generalized linear models.
  43. (1992). Meta-analysis by the Confidence Profile Method. San Diego:
  44. (1986). Meta-analysis in clinical trials.
  45. (1998). Meta-analysis of clinical trials.
  46. (2002). Meta-analysis of Controlled Clinical Trials.
  47. (1995). Meta-analysis: statistical alchemy for the 21st century.
  48. (2000). Modeling and implementation issues in Bayesian meta-analysis.
  49. (2008). Models for potentially biased evidence in meta-analysis using empirically based priors.
  50. (2006). Much ado about nothing: a comparison of the performance of meta-analytical methods with rare events.
  51. (1998). Nonlinear regression, quasi likelihood, and overdispersion in generalized linear models.
  52. (1978). Nonparametric maximum likelihood estimation of a mixing distribution.
  53. (2001). On tests of the overall treatment effect in meta-analysis with normally distributed responses.
  54. (2006). Prior distributions for variance parameters in hierarchical models.
  55. (2002). Quantifying heterogeneity in a meta-analysis.
  56. (2007). Random-effects model for meta-analysis of clinical trials: an update.
  57. (1983). Some thoughts on empirical Bayes estimation.
  58. (2002). Statistical heterogeneity in systematic reviews of clinical trials: a critical appraisal of guidelines and practice.
  59. (1989). Statistical methods and heterogeneity in meta-analysis. Dissertation. Harvard School of Public Health,
  60. (1985). Statistical Methods for Meta-analysis.
  61. (1997). Test for qualitative interaction of clinical significance.
  62. (1985). Testing for qualitative interaction between treatment effects and patient subsets.
  63. (2005). The interpretation of random-effects meta-analysis in decision models.
  64. (1999). Toward evidence-based medical statistics, 2: the Bayes factor.
  65. (1991). Using Empirical Bayes methods in biopharmaceutical research.
  66. (1999). Valid inference in random effects meta-analysis.
  67. (1987). Why do we need systematic overviews of randomised trials?
  68. (1994). Why sources of heterogeneity in meta-analysis should be investigated.

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.