Nonparametric Regression, Confidence Regions and Regularization

In this paper we offer a unified approach to the problem of nonparametric regression on the unit interval. It is based on a universal, honest and non-asymptotic confidence region which is defined by a set of linear inequalities involving the values of the functions at the design points. Interest will typically centre on certain simplest functions in that region where simplicity can be defined in terms of shape (number of local extremes, intervals of convexity/concavity) or smoothness (bounds on derivatives) or a combination of both. Once some form of regularization has been decided upon the confidence region can be used to provide honest non-asymptotic confidence bounds which are less informative but conceptually much simpler

Parameter estimation for the stochastic SIS epidemic model

In this paper we estimate the parameters in the stochastic SIS epidemic model by using pseudo-maximum likelihood estimation (pseudo-MLE) and least squares estimation. We obtain the point estimators and 100(1 − α)% confidence intervals as well as 100(1 − α)% joint confidence regions by applying least squares techniques. The pseudo-MLEs have almost the same form as the least squares case. We also obtain the exact as well as the asymptotic 100(1 − α)% joint confidence regions for the pseudo-MLEs. Computer simulations are performed to illustrate our theory

Robust regression with imprecise data

We consider the problem of regression analysis with imprecise data. By imprecise data we mean imprecise observations of precise quantities in the form of sets of values. In this paper, we explore a recently introduced likelihood-based approach to regression with such data. The approach is very general, since it covers all kinds of imprecise data (i.e. not only intervals) and it is not restricted to linear regression. Its result consists of a set of functions, reflecting the entire uncertainty of the regression problem. Here we study in particular a robust special case of the likelihood-based imprecise regression, which can be interpreted as a generalization of the method of least median of squares. Moreover, we apply it to data from a social survey, and compare it with other approaches to regression with imprecise data. It turns out that the likelihood-based approach is the most generally applicable one and is the only approach accounting for multiple sources of uncertainty at the same time

Impact of estimation techniques on regression analysis: an application to survey data on child nutritional status in five African countries

This paper illustrates the impact of ignoring survey design and hierarchical structure of survey data when fitting regression models. Data on child nutritional status from Ghana, Malawi, Tanzania, Zambia, and Zimbabwe are analysed using four techniques: ordinary least squares; weighted regression using standard statistical software; regression using specialist software that accounts for the survey design; and multilevel modelling. The impact of ignoring survey design on logistic and linear regression models is examined. The results show bias in estimates averaging between five and 17 per cent in linear models and between five and 22 per cent in logistic regression models. The standard errors are also under-estimated by up to 49 per cent in some countries. Socio-economic variables and service utilisation variables are poorly estimated when the survey design is ignored