Separating Selection Bias and Non-coverage in Internet Panels using Propensity Matching.

Many internet-panels consist of self-selected respondents and hence cover a relatively small part of the population. Estimates based on Internet-panels therefore may suffer from non-coverage and self-selection bias. One way to correct for these biases is to use adjustment weighting(Lee, 2006). However, when Internet-panel respondents are intrinsically different from the general population, previous studies showed that weighting may result in an increase in bias (for example, see Loosveldt and Sonck, 2008). How can we show that panel-members are intrinsically different from respondents that take part in a conventional random-sample survey? To answer this question we compared the results of a volunteer Internet-panel to the results of a web-interview (WI) based on a random sample of the same population. First, differences in population coverage are studied. Secondly, we test if significant differences in coverage predict differences on dependent variables. Finally, we use propensity matching to test for self-selection bias. This contribution sheds light on the extent of coverage bias relative to self-selection bias in random- and volunteer opt-in Internet surveys. We use propensity score matching to answer our question. Propensity scores summarize the conditional probability of a respondent to be member of either the random or volunteer sample based on a set of covariates. When the propensity score includes relevant covariates, respondents with the same propensity scores can be matched. Remaining differences between dependent variables after matching cannot be caused by coverage errors, and are indicative for the size of self-selection bia

Estimating the prevalence of food risk increasing behaviours in UK kitchens

© 2017 Jones et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Foodborne disease poses a serious threat to public health. In the UK, half a million cases are linked to known pathogens and more than half of all outbreaks are associated with catering establishments. The UK Food Standards Agency (FSA) has initiated the UK Food Hygiene Rating Scheme in which commercial food establishments are inspected and scored with the results made public. In this study we investigate the prevalence of food risk increasing behaviours among chefs, catering students and the public. Given the incentive for respondents to misreport when asked about illegal or illicit behaviours we employed a Randomised Response Technique designed to elicit more accurate prevalence rates of such behaviours. We found 14% of the public not always hand-washing immediately after handling raw meat, poultry or fish; 32% of chefs and catering students had worked within 48 hours of suffering from diarrhoea or vomiting. 22% of the public admitted having served meat “on the turn” and 33% of chefs and catering students admitted working in kitchens where such meat was served; 12% of the public and 16% of chefs and catering students admitted having served chicken at a barbeque when not totally sure it was fully cooked. Chefs in fine-dining establishment were less likely to wash their hands after handling meat and fish and those who worked in award winning restaurants were more likely to have returned to work within 48 hours of suffering from diarrhoea and vomiting. We found no correlation between the price of a meal in an establishment, nor its Food Hygiene Rating Score, and the likelihood of any of the food malpractices occurring

Advances in estimation by the item sum technique using auxiliary information in complex surveys

To collect sensitive data, survey statisticians have designed many strategies to reduce nonresponse rates and social desirability response bias. In recent years, the item count technique (ICT) has gained considerable popularity and credibility as an alternative mode of indirect questioning survey, and several variants of this technique have been proposed as new needs and challenges arise. The item sum technique (IST), which was introduced by Chaudhuri and Christofides (2013) and Trappmann et al. (2014), is one such variant, used to estimate the mean of a sensitive quantitative variable. In this approach, sampled units are asked to respond to a two-list of items containing a sensitive question related to the study variable and various innocuous, nonsensitive, questions. To the best of our knowledge, very few theoretical and applied papers have addressed the IST. In this article, therefore, we present certain methodological advances as a contribution to appraising the use of the IST in real-world surveys. In particular, we employ a generic sampling design to examine the problem of how to improve the estimates of the sensitive mean when auxiliary information on the population under study is available and is used at the design and estimation stages. A Horvitz-Thompson type estimator and a calibration type estimator are proposed and their efficiency is evaluated by means of an extensive simulation study. Using simulation experiments, we show that estimates obtained by the IST are nearly equivalent to those obtained using “true data” and that in general they outperform the estimates provided by a competitive randomized response method. Moreover, the variance estimation may be considered satisfactory. These results open up new perspectives for academics, researchers and survey practitioners, and could justify the use of the IST as a valid alternative to traditional direct questioning survey modes.Ministerio de Economía y Competitividad of SpainMinisterio de Educacion, Cultura y Deporteproject PRIN-SURWE

A pilot study on peritraumatic dissociation and coping styles as risk factors for posttraumatic stress, anxiety and depression in parents after their child's unexpected admission to a Pediatric Intensive Care Unit

Aim: To study the prevalence of posttraumatic stress disorder (PTSD), anxiety and depression in parents three months after pediatric intensive care treatment of their child and examine if peritraumatic dissocation and coping styles are related to these mental health problems. Methods: This is a prospective cohort study and included parents of children unexpectedly admitted to the Pediatric Intensive Care Unit (PICU) from January 2006 to March 2007. At three months follow-up parents completed PTSD (n = 115), anxiety and depression (n = 128) questionnaires. Immediately after discharge, parents completed peritraumatic dissocation and coping questionnaires. Linear regression models with generalized estimating equations examined risk factors for mental health problems. Results: Over 10% of the parents were likely to meet criteria for PTSD and almost one quarter for subclinical PTSD. Respectively 15% to 23% of the parents reported clinically significant levels of depression and anxiety. Peritraumatic dissocation was most strongly associated with PTSD, anxiety as well as depression. Avoidance coping was primarily associated with PTSD. Conclusion: A significant number of parents have mental health problems three months after unexpected PICU treatment of their child. Improving detection and raise awareness of mental health problems is important to minimize the negative effect of these problems on parents' well-being. © 2009 Bronner et al; licensee BioMed Central Ltd

Applying an extended theoretical framework for data collection mode to health services research

<p>Abstract</p> <p>Background</p> <p>Over the last 30 years options for collecting self-reported data in health surveys and questionnaires have increased with technological advances. However, mode of data collection such as face-to-face interview or telephone interview can affect how individuals respond to questionnaires. This paper adapts a framework for understanding mode effects on response quality and applies it to a health research context.</p> <p>Discussion</p> <p>Data collection modes are distinguished by key features (whether the survey is self- or interviewer-administered, whether or not it is conducted by telephone, whether or not it is computerised, whether it is presented visually or aurally). Psychological appraisal of the survey request will initially entail factors such as the cognitive burden upon the respondent as well as more general considerations about participation. Subsequent psychological response processes will further determine how features of the data collection mode impact upon the quality of response provided. Additional antecedent factors which may further interact with the response generation process are also discussed. These include features of the construct being measured such as sensitivity, and of the respondent themselves (e.g. their socio-demographic characteristics). How features of this framework relate to health research is illustrated by example.</p> <p>Summary</p> <p>Mode features can affect response quality. Much existing evidence has a broad social sciences research base but is of importance to health research. Approaches to managing mode feature effects are discussed. Greater consideration must be given to how features of different data collection approaches affect response from participants in studies. Study reports should better clarify such features rather than rely upon global descriptions of data collection mode.</p