Location of Repository

Increasing response rates to lifestyle surveys: a review of methodology and 'good practice'.

By Serena McCluskey and Annie Topping

Abstract

Background\ud Lifestyle surveys are traditionally used for collecting detailed population information about\ud individual behaviours that impact on health. However, declining response rates and the\ud under-representation of certain population groups in lifestyle survey data has led to\ud uncertainty over the accuracy of any findings. In order to maximise response rates, a\ud mixed-methods approach is now recommended. This review was carried out in order to\ud examine the methodological literature related to the administration of lifestyle surveys and\ud the implications for response rates. It was envisaged that the results of this review could\ud provide a valuable resource for those involved in undertaking lifestyle surveys.\ud Methods\ud A review of the empirical evidence and published literature on the methodological\ud considerations associated with administration of lifestyle surveys, specifically in relation to\ud maximising response rates, was carried out. A search for ‘grey literature’ was also\ud conducted using the internet, and citation tracking was performed on all retrieved articles.\ud A request for examples of relevant lifestyle survey work, particularly those incorporating\ud mixed-methods designs and/or strategies to increase response rates, was distributed to\ud several Primary Care Trusts (PCTs) across England. The responses are illustrated as\ud ‘good practice’ case studies.\ud Results\ud The postal questionnaire remains an important lifestyle survey tool, but response rates\ud have decreased rapidly in recent years. Interviews and telephone surveys are\ud recommended in order to supplement data from postal questionnaires to overcome any\ud literacy and language barriers. These approaches are advocated to increase response\ud rates in some population groups, but costs may be prohibitive. Electronic surveys are a\ud cheaper alternative, but the evidence seems to suggest that the use of the internet does\ud not appear to increase overall response rates to surveys. Evidence on the use of\ud incentives suggests they can be effective at increasing response rates, but only if their use\ud is tailored to the design of the survey and to the characteristics of target populations.\ud Conclusions\ud The empirical evidence was not robust enough to make definitive recommendations, but\ud information from the published literature, along with examples of ‘good practice’ in lifestyle\ud survey work suggests that supplementing, or offering different survey modes, alongside\ud targeted maximisation strategies can increase coverage and also, with careful planning,\ud can prove to be cost-effective

Topics: H1
Publisher: University of Huddersfield
OAI identifier: oai:eprints.hud.ac.uk:6878

Suggested articles

Preview

Citations

  1. (2002). A comparison between mail and web surveys: response pattern, respondent profile, and data quality.
  2. (2004). A Comparison of Web and Mail Survey Response Rates. Public Opinion Quarterly doi
  3. (2000). A Meta-Analysis of Response Rates in Web- or Internet-Based Surveys. Educational and Psychological Measurement doi
  4. (1985). A useless raffle. doi
  5. (2002). A: Measurement of risk factors for cancer in ethnicity and health research: a case study of tobacco and alcohol. Report to the Scottish Cancer Group of the Scottish Executive. Edinburgh: Section of Public Health Sciences,
  6. (2004). Addressing ethnic diversity in health outcome measurement: a systematic and critical review of the literature.
  7. (2001). Adlis SA: The use of monetary incentives in a community survey: impact on response rates, data quality, and cost. Health Services Research
  8. (2001). Alberti KG: The performance of the Rose angina questionnaire in South Asian and European origin populations: a comparative study in doi
  9. (2005). An Experimental Comparison of Web and Telephone Surveys. Public Opinion Quarterly doi
  10. (2009). and mixed-mode surveys: the tailored design method. doi
  11. (1998). Breaking down language barriers. Some ethnic groups may have problems in getting as far as a consultation. BMJ
  12. (2003). Can findings from postal questionnaires be combined with interview results to improve the response rate among ethnic minority populations? Ethnicity & Health doi
  13. (2005). Changes in telephone survey non-response over the past quarter century. Public Opinion Quarterly doi
  14. (2009). Combining web-based and mail surveys improves response rates: a PBRN study from PRIME Net. Annals of Family Medicine doi
  15. (2008). Completion Time and Response Order Effects in Web Surveys. Public Opinion Quarterly doi
  16. (2006). Council tax valuation bands, socio-economic status and health outcome: a cross-sectional analysis from the Caerphilly Health and Social Needs Study. BMC Public Health
  17. (2000). DJ: The effect of a direct payment or a lottery on questionnaire response rates: a randomised controlled trial. doi
  18. (2008). Does a Probability-Based Household Panel Benefit from Assignment to Postal Response as an Alternative to Internet-Only? Public Opinion Quarterly doi
  19. (2003). Flaws JA: A randomized trial of incentives to improve response rates to a mailed women's health questionnaire. doi
  20. (1999). Increasing response rates for mailed surveys of Medicaid clients and other low-income populations. doi
  21. (2002). Increasing response rates to postal questionnaires: systematic review. BMJ doi
  22. (2002). Innovations in survey research: an application of web surveys. doi
  23. (2003). Introduction to survey quality. doi
  24. (2008). Loosveldt G: Face-to-Face versus Web Surveying in a High-Internet-Coverage Population: Differences in Response Quality. Public Opinion Quarterly doi
  25. (1994). Methods for epidemiological surveys of ethnic minority groups. doi
  26. Methods to increase response to postal and electronic questionnaires. doi
  27. (1988). Mishkel N: Effect of contact letter on control response rates in cancer studies.
  28. (1989). Molgaard CA: Recruiting survey respondents to mailed surveys: controlled trials of incentives and prompts.
  29. (1992). MP: Understanding the decision to participate in a survey. Public Opinion Quarterly doi
  30. (2002). Musculoskeletal pain is more generalised among people from ethnic minorities than among white people in Greater Manchester. Annals of the Rheumatic Diseases doi
  31. (2004). Neighbourhood inequalities in the patterns of admissions and their application to the targeting of health promotion campaigns.
  32. (1997). Non-response bias in a lifestyle survey. doi
  33. (2006). Personally addressed hand-signed letters increase questionnaire response: a meta-analysis of randomised controlled trials.
  34. (1998). Response rate to mailed epidemiologic questionnaires: a population-based randomized trial of variations in design and mailing routines. doi
  35. (2008). Securing recruitment and obtaining informed consent in minority ethnic groups in the UK. BMC Health Services Research doi
  36. (2003). Self reports in research with non-English speakers. BMJ doi
  37. (2005). Sharing stories: complex intervention for diabetes education in minority ethnic groups who do not speak English. doi
  38. (2009). Strategies for achieving a high response rate in a home interview survey. doi
  39. (1999). Talley NJ: The effects of lottery incentive and length of questionnaire on health survey response rates: a randomized study. doi
  40. (2004). The Role of Topic Interest in Survey Participation Decisions. Public Opinion Quarterly doi
  41. (2004). The use of incentives to motivate 'hard to get' households on the National Travel Survey.
  42. (2008). Web Survey Methods: Introduction. Public Opinion Quarterly doi
  43. (2008). Web surveys versus other survey modes: a meta-analysis comparing response rates.

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.