Skip to main content
Article thumbnail
Location of Repository

A generic algorithm for reducing bias in parametric estimation

By Ioannis Kosmidis and David Firth


A general iterative algorithm is developed for the computation\ud of reduced-bias parameter estimates in regular statistical models through\ud adjustments to the score function. The algorithm unifies and provides appealing new interpretation for iterative methods that have been published\ud previously for some specific model classes. The new algorithm can usefully be viewed as a series of iterative bias corrections, thus facilitating the\ud adjusted score approach to bias reduction in any model for which the first-\ud order bias of the maximum likelihood estimator has already been derived.\ud The method is tested by application to a logit-linear multiple regression\ud model with beta-distributed responses; the results confirm the effectiveness\ud of the new algorithm, and also reveal some important errors in the existing\ud literature on beta regression

Topics: QA
Publisher: Institute of Mathematical Statistics
Year: 2010
OAI identifier:

Suggested articles


  1. (2006). A better lemon squeezer? Maximum-likelihood regression with beta-distributed dependent variables. doi
  2. (1968). A general definition of residuals (with discussion).
  3. (2002). A modified score function estimator for multinomial logistic regression in small samples. doi
  4. (2005). A solution to separation in binary response models. doi
  5. (2004). A solution to the problem of monotone likelihood in Cox regression. doi
  6. (2002). A solution to the problem of separation in logistic regression. doi
  7. (2004). Beta regression for modelling rates and proportions. doi
  8. (2010). Beta regression in R. doi
  9. (1997). Bias correction for a class of multivariate nonlinear regression models. doi
  10. (1998). Bias correction for censored data with exponential lifetimes.
  11. (1995). Bias correction in generalised linear mixed models with a single component of dispersion. doi
  12. (1996). Bias correction in generalized linear mixed models with multiple components of dispersion. doi
  13. (1991). Bias correction in generalized linear models.
  14. (2008). Bias correction in generalized nonlinear models with dispersion covariates. doi
  15. (1983). Bias correction in maximum likelihood logistic regression. doi
  16. (1986). Bias in nonlinear regression. doi
  17. (2006). Bias prevention of maximum likelihood estimates for scalar skew normal and skew t distributions. doi
  18. (2009). Bias reduction in exponential family nonlinear models. doi
  19. (1993). Bias reduction of maximum likelihood estimates. doi
  20. (1992). Bias reduction, the Jeffreys prior doi
  21. (2008). Core Team doi
  22. (1975). Defining the curvature of a statistical problem (with applications to second order efficiency) (with discussion). doi
  23. (1956). Estimate gasoline yields from crudes.
  24. (2010). Improved estimators for a general class of beta regression models. doi
  25. (2006). Improved point and interval estimation for a beta regression model. doi
  26. (1995). Likelihood-based methods for bias reduction in limiting dilution assays. doi
  27. (2009). On iterative adjustment of responses for the reduction of bias in binary regression models.
  28. (1984). On the existence of maximum likelihood estimates in logistic regression models. doi
  29. (1997). Principles of Statistical Inference: From a Neo-Fisherian Perspective. London: World Scientific. doi
  30. (1987). Tensor Methods in Statistics. London: Chapman and Hall.
  31. (1985). The effect of bias, variance estimation, skewness and kurtosis of the empirical logit on weighted least squares analyses. doi
  32. (1974). Theoretical Statistics. doi

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.