Using the Web to Collect Data on Sensitive Behaviours: A Study Looking at Mode Effects on the British National Survey of Sexual Attitudes and Lifestyles.

BACKGROUND: Interviewer-administered surveys are an important method of collecting population-level epidemiological data, but suffer from declining response rates and increasing costs. Web surveys offer more rapid data collection and lower costs. There are concerns, however, about data quality from web surveys. Previous research has largely focused on selection biases, and few have explored measurement differences. This paper aims to assess the extent to which mode affects the responses given by the same respondents at two points in time, providing information on potential measurement error if web surveys are used in the future. METHODS: 527 participants from the third British National Survey of Sexual Attitudes and Lifestyles (Natsal-3), which uses computer assisted personal interview (CAPI) and self-interview (CASI) modes, subsequently responded to identically-worded questions in a web survey. McNemar tests assessed whether within-person differences in responses were at random or indicated a mode effect, i.e. higher reporting of more sensitive responses in one mode. An analysis of pooled responses by generalized estimating equations addressed the impact of gender and question type on change. RESULTS: Only 10% of responses changed between surveys. However mode effects were found for about a third of variables, with higher reporting of sensitive responses more commonly found on the web compared with Natsal-3. CONCLUSIONS: The web appears a promising mode for surveys of sensitive behaviours, most likely as part of a mixed-mode design. Our findings suggest that mode effects may vary by question type and content, and by the particular mix of modes used. Mixed-mode surveys need careful development to understand mode effects and how to account for them

Beyond viral suppression: the quality of life of people living with HIV in Sweden

Sweden has one of the best HIV treatment outcomes in the world and an estimated 95% of all diagnosed people living with HIV are virally suppressed, but the quality of life (QoL) is understudied. The aim of this study was to examine the associations between variables within sociodemographic, behavioural, clinical, psychological, sexual life, social support and personal resource component and the QoL of people living with HIV in Sweden. Data were derived from a cross-sectional, nation-wide survey completed by 15% (n = 1096) of all people living with HIV and collected at 15 infectious disease clinics and 2 needle exchange sites during 2014. Ordinal univariate and multivariate logistic regression analyses were used to examine associations between potential contributors and QoL. Respondents reported high QoL: 63% rated their QoL 7 or higher on a scale ranging from 0 to 10. QoL was independent of gender, age, mode of HIV transmission and country of origin. Lower QoL was associated with recent homelessness, hazardous alcohol consumption, comorbidities, treatment side-effects, HIV-related physical symptoms, hopelessness, negative self-image, sexual dissatisfaction, and negative changes in sex life after HIV. The QoL of people living with HIV in Sweden was high overall, but still significantly influenced by HIV

Measuring health-related quality of life in adolescents and young adults: Swedish normative data for the SF-36 and the HADS, and the influence of age, gender, and method of administration

BACKGROUND: There is a paucity of research about health-related quality of life (HRQL) among adolescents, as studies have to a large extent focused on adults. The main aim was to provide information for future studies in this growing field by presenting normative data for the Short Form 36 (SF-36) and the Hospital Anxiety and Depression Scale (HADS) for Swedish adolescents and young adults. Additionally, the influence of age and gender, as well as method of administration, was investigated. METHODS: A sample of 585 persons aged 13–23 was randomly chosen from the general population, and stratified regarding age group (young adolescents: 13–15 years; older adolescents: 16–19 years, and young adults: 20–23 years) and gender (an equal amount of males and females). Within each stratum, the participants were randomized according to two modes of administration, telephone interview and postal questionnaire, and asked to complete the SF-36 and the HADS. Descriptive statistics are presented by survey mode, gender, and age group. A gender comparison was made by independent t-test; and one-way ANOVA was conducted to evaluate age differences. RESULTS: Effects of age and gender were found: males reported better health-related quality of life than females, and the young adolescents (13–15 years old) reported better HRQL than the two older age groups. The older participants (16–23 years old) reported higher scores when interviewed over the telephone than when they answered a postal questionnaire, a difference which was more marked among females. Interestingly, the 13–15-year-olds did not react to the mode of administration to the same extent. CONCLUSION: The importance of taking age, gender, and method of administration into consideration, both when planning studies and when comparing results from different groups, studies, or over time, is stressed

Better to ask online when it concerns intimate relationships? Survey mode differences in the assessment of relationship quality

Background: The assessment of relationship quality is a key construct in family research and relies on several indicators. As answer behavior for sensitive and subjective questions can be biased by the interview situation, the emerging switch from face-to-face mode to web or mixed mode in surveys challenges the comparability of measurements. Objective: This study investigates the impact of two modes of data collection - face-to-face mode and web mode - on central measurements of relationship quality in quantitative family research. Methods: In a German experimental pilot study (2018) within the Generations and Gender Programme, target persons were randomly assigned to face-to-face or online interviews. Mode differences are assessed by comparing distributions for various indicators of relationship quality. To adjust for confounders, post-stratification weighting and multivariate regression analysis are applied. Results: Findings reveal consistent mode effects for almost all indicators of relationship quality even after adjusting for confounders. Respondents in web mode assess their relationship quality substantially lower than respondents in face-to-face mode, thinking more often about breaking up and reporting lower satisfaction and more conflicts. Conclusions: Web mode seems to support less socially desirable reflections on respondents' relationships compared to face-to-face mode. Family researchers should consider survey design decisions when evaluating intimate relationships, particularly in longitudinal and cross-national studies. Contribution: Findings on the assessment of relationships in family research based on self-administered modes, such as web mode, can be considered more reliable than those based on interviewer-administered modes

It’s driving her mad: gender differences in the effects of commuting on psychological well-being

In this paper, we seek to explore the effects of commuting time on the psychological well-being of men and women in the UK. We use annual data from the British Household Panel Survey in a fixed effects panel framework that includes variables known to determine well-being, as well as factors which may provide compensation for commuting such as income, job satisfaction and housing quality. Our results show that, even after all these variables are considered, commuting still has an important detrimental effect on the well-being of women, but not men, and this result is robust to numerous different specifications. We explore possible explanations for this gender difference and can find no evidence that it is due to women´s shorter working hours or weaker occupational position. Rather women´s greater sensitivity to commuting time seems to be a result of their larger responsibility for day-to-day household tasks, including childcare

Effect of interview modes on measurement of identity

In this paper, we investigate the effect of interview mode on responses to attitudinal and autobiographical questions: a 13-item multidimensional identity module. We find small but significant mode effects of three to seven percentage points on the response pattern for the domains of national identity, religion, racial or ethnic background, political beliefs and sexual orientation. We also find very small but significant mode effects of one to two percentage points on item non-response for occupational identity and identification with father’s ethnic background. We conclude that mode effects on these questions can convincingly be interpreted as stemming from social desirability bias

Quality assurance of rectal cancer diagnosis and treatment - phase 3 : statistical methods to benchmark centres on a set of quality indicators

In 2004, the Belgian Section for Colorectal Surgery, a section of the Royal Belgian Society for Surgery, decided to start PROCARE (PROject on CAncer of the REctum), a multidisciplinary, profession-driven and decentralized project with as main objectives the reduction of diagnostic and therapeutic variability and improvement of outcome in patients with rectal cancer. All medical specialties involved in the care of rectal cancer established a multidisciplinary steering group in 2005. They agreed to approach the stated goal by means of treatment standardization through guidelines, implementation of these guidelines and quality assurance through registration and feedback. In 2007, the PROCARE guidelines were updated (Procare Phase I, KCE report 69). In 2008, a set of 40 process and outcome quality of care indicators (QCI) was developed and organized into 8 domains of care: general, diagnosis/staging, neoadjuvant treatment, surgery, adjuvant treatment, palliative treatment, follow-up and histopathologic examination. These QCIs were tested on the prospective PROCARE database and on an administrative (claims) database (Procare Phase II, KCE report 81). Afterwards, 4 QCIs were added by the PROCARE group. Centres have been receiving feedback from the PROCARE registry on these QCIs with a description of the distribution of the unadjusted centre-averaged observed measures and the centre’s position therein. To optimize this feedback, centres should ideally be informed of their risk-adjusted outcomes and be given some benchmarks. The PROCARE Phase III study is devoted to developing a methodology to achieve this feedback

Does mode of administration affect health-related quality-of-life outcomes after stroke?

Telephone interviews and postal surveys may be a resource-efficient way of assessing health-related quality-of-life post-stroke, if they produce data equivalent to face-to-face interviews. This study explored whether telephone interviews and postal surveys of the Stroke and Aphasia Quality of Life Scale (SAQOL-39g) yielded similar results to face-to-face interviews. Participants included people with aphasia and comprised two groups: group one (n =22) were 3-6 months post-stroke; group two (n =26) were ≥1 year post-stroke. They completed either a face-to-face and a telephone interview or a face-to-face interview and a postal survey of the SAQOL-39g. Response rates were higher for group two (87%) than for group one (72-77%). There were no significant differences between respondents and non-respondents on demographics, co-morbidities, stroke severity, or communication impairment. Concordance between face-to-face and telephone administrations (.90-.98) was excellent; and very good-excellent between face-to-face and postal administrations (.84-.96), although scores in postal administrations were lower (significant for psychosocial domain and overall SAQOL-39g in group two). These findings suggest that the SAQOL-39g yields similar results in different modes of administration. Researchers and clinicians may employ alternative modes, particularly in the longer term post-stroke, in order to reduce costs or facilitate clients with access difficulties