Skip to main content
Article thumbnail
Location of Repository

Alternative approaches to multilevel modelling of survey non-contact and refusal

By Fiona Steele and Gabriele B. Durrant


We review three alternative approaches to modelling survey non-contact and refusal: multinomial, sequential, and sample selection (bivariate probit) models. We then propose a multilevel extension of the sample selection model to allow for both interviewer effects and dependency between non-contact and refusal rates at the household and interviewer level. All methods are applied and compared in an analysis of household non-response in the United Kingdom, using a data set with unusually rich information on both respondents and non-respondents from six major surveys. After controlling for household characteristics, there is little evidence of residual correlation between the unobserved characteristics affecting non-contact and refusal propensities at either the household or the interviewer level. We also find that the estimated coefficients of the multinomial and sequential models are surprisingly similar, which further investigation via a simulation study suggests is due to non-contact and refusal having largely different predictor

Topics: HA
Year: 2011
OAI identifier:
Provided by: e-Prints Soton

Suggested articles


  1. (1999). A multilevel exploration of the role of interviewers in survey nonresponse. doi
  2. (2002). A multilevel multinomial analysis of interviewer effects on various components of unit nonresponse.
  3. (1998). aML User's Guide and Reference Manual, Version 2. EconWare,
  4. (1996). An Introduction to Categorical Data Analysis. doi
  5. (2005). Assessing the use of sample selection models in the estimation of fertility postponement effects. doi
  6. (1993). Competing hazards with shared unmeasured risk factors. doi
  7. (2002). Econometric Analysis of Cross Section and Panel Data. doi
  8. (1998). Estimating models with sample selection bias: a survey. doi
  9. (2004). Exploring survey nonresponse in the UK: the Census Survey Nonresponse Link Study. In: Office for National Statistics, working paper 1-16 Ben Akiva
  10. (1999). Interviewers' calling strategies on face to face interview surveys.
  11. (2006). Modelling non response in the National Child Development Study. doi
  12. (2009). Multilevel modelling of refusal and noncontact nonresponse in household surveys: evidence from six UK government surveys. doi
  13. (2003). Multilevel Statistical Models. 3rd edn. doi
  14. (1998). Nonresponse in Household Interview Surveys. doi
  15. (2002). Nonresponse in longitudinal household surveys. In: Survey Nonresponse doi
  16. (1995). Problems with instrumental variable estimation when the correlation between the instruments and the endogenous explanatory variable is weak. doi
  17. (1986). Sample selection and male female earnings differentials in the graduate labour market. doi
  18. (1979). Sample selection bias as a specification error. doi
  19. (2002). Separating refusal bias and non contact bias: evidence from UK national surveys. doi
  20. (2007). So the reviewer told you to use a selection model? Selection models and the study of international relations.
  21. (2002). Stochastic dependence in competing risks. doi
  22. (2005). Survey nonresponse and survey characteristics: microlevel evidence from the European Community Household Panel. doi
  23. (1980). The Analysis of Cross-Classified Categorical Data. 2nd edn. doi
  24. (1981). The demand for deductibles in private health insurance: A probit model with sample selection. doi
  25. (2002). The effects of extended interviewer efforts on non response bias. In: Survey Nonresponse
  26. (2001). The effects of interviewer and respondent characteristics on response behavior in panel surveys. doi
  27. (2006). The formation and outcomes of cohabiting and marital partnerships in early adulthood: the role of previous partnership experience. doi
  28. (1988). Towards the development of optimal calling protocols for telephone surveys: a conditional probabilities approach.
  29. (2002). Trends in household survey nonresponse: a longitudinal and international comparison. In: Survey Nonresponse
  30. (2009). Using field process data to predict best times of contact conditioning on household and interviewer influences. In: S3RI Methodology Working Paper Series, M09/12,

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.