Internet Versus Mailed Questionnaires: A Randomized Comparison (2)

BACKGROUND Low response rates among surgeons can threaten the validity of surveys. Internet technologies may reduce the time, effort, and financial resources needed to conduct surveys. OBJECTIVE We investigated whether using Web-based technology could increase the response rates to an international survey. METHODS We solicited opinions from the 442 surgeon–members of the Orthopaedic Trauma Association regarding the treatment of femoral neck fractures. We developed a self-administered questionnaire after conducting a literature review, focus groups, and key informant interviews, for which we used sampling to redundancy techniques. We administered an Internet version of the questionnaire on a Web site, as well as a paper version, which looked similar to the Internet version and which had identical content. Only those in our sample could access the Web site. We alternately assigned the participants to receive the survey by mail (n=221) or an email invitation to participate on the Internet (n=221). Non-respondents in the mail arm received up to three additional copies of the survey, while non-respondents in the Internet arm received up to three additional requests, including a final mailed copy. All participants in the Internet arm had an opportunity to request an emailed Portable Document Format (PDF) version. RESULTS The Internet arm demonstrated a lower response rate (99/221, 45%) than the mail questionnaire arm (129/221, 58%) (absolute difference 13%, 95% confidence interval 4%-22%, P<0.01). CONCLUSIONS. Our Internet-based survey to surgeons resulted in a significantly lower response rate than a traditional mailed survey. Researchers should not assume that the widespread availability and potential ease of Internet-based surveys will translate into higher response rates.Department of Surgery, McMaster University, Hamilton, Ontario, Canad

Device effects on survey response quality. A comparison of smartphone, tablet and PC responses on a cross sectional probability sample

The increasing use of web surveys and different devices for survey completion calls for the examination of device effects on survey response quality. Whereas most existing studies are based on web panels, subgroups (e.g., students), or short questionnaires designed for device experiments, which compels participants to respond through specific devices, this study is based on two large, nationally representative cross-sectional samples (ISSP 2018 and ISSP 2019) in which the completion device was chosen by the respondent. Seven indicators of response quality are applied, which allows comparison among survey participants answering the questionnaire on a smartphone, tablet, or PC. The results are in line with previous findings: Respondents’ selfevaluated engagement in survey completion does not differ across devices, and only small, nonsystematic differences between devices on satisficing indicators, such as the tendency to agree regardless of question content (acquiescence), non-substantive answers, selection of mid-point response options and primacy effects, and straightlining are identified. Controlling the associations between response device and response quality indicators for self-selection biases did not change the overall result

Risk factors for COPD exacerbations in inhaled medication users: the COPDGene study biannual longitudinal follow-up prospective cohort.

BackgroundDespite inhaled medications that decrease exacerbation risk, some COPD patients experience frequent exacerbations. We determined prospective risk factors for exacerbations among subjects in the COPDGene Study taking inhaled medications.Methods2113 COPD subjects were categorized into four medication use patterns: triple therapy with tiotropium (TIO) plus long-acting beta-agonist/inhaled-corticosteroid (ICS ± LABA), tiotropium alone, ICS ± LABA, and short-acting bronchodilators. Self-reported exacerbations were recorded in telephone and web-based longitudinal follow-up surveys. Associations with exacerbations were determined within each medication group using four separate logistic regression models. A head-to-head analysis compared exacerbation risk among subjects using tiotropium vs. ICS ± LABA.ResultsIn separate logistic regression models, the presence of gastroesophageal reflux, female gender, and higher scores on the St. George's Respiratory Questionnaire were significant predictors of exacerbator status within multiple medication groups (reflux: OR 1.62-2.75; female gender: OR 1.53 - OR 1.90; SGRQ: OR 1.02-1.03). Subjects taking either ICS ± LABA or tiotropium had similar baseline characteristics, allowing comparison between these two groups. In the head-to-head comparison, tiotropium users showed a trend towards lower rates of exacerbations (OR = 0.69 [95 % CI 0.45, 1.06], p = 0.09) compared with ICS ± LABA users, especially in subjects without comorbid asthma (OR = 0.56 [95% CI 0.31, 1.00], p = 0.05).ConclusionsEach common COPD medication usage group showed unique risk factor patterns associated with increased risk of exacerbations, which may help clinicians identify subjects at risk. Compared to similar subjects using ICS ± LABA, those taking tiotropium showed a trend towards reduced exacerbation risk, especially in subjects without asthma.Trial registrationClinicalTrials.gov NCT00608764, first received 1/28/2008

Questionnaire surveys to discover academic staff and library staff perceptions of a National Union catalogue

During the feasibility study into a National Union catalogue for the UK (UKNUC), a questionnaire survey was undertaken of the needs of both academic staff in higher education and library staff. A response rate of 40-50 per cent was achieved, 846 questionnaires being returned for academics and 724 for librarians. The analysis suggests that a UKNUC would be highly valued and heavily used by all categories. Academics felt it would have a positive effect on their information searching, and wished to include the holdings of the British Library, and libraries of both the major research universities and the ``traditional’’ universities. They wanted it to be comprehensive and easy to use, to include locations of both books and journals, and to facilitate subject collection searching. Library staff have similar priorities to academics, although there are more variations by sector and a recognition of a UKNUC’s value as a potential source of bibliographic records

Using patient-reported measures to drive change in healthcare: the experience of the digital, continuous and systematic PREMs observatory in Italy

BACKGROUND: The use of Patient Reported Experience Measures (PREMs) has great potential in healthcare service improvement, but a limited use. This paper presents an empirical case of PREMs innovation in Italy, to foster patient data use up to the ward level, by keeping strengths and addressing weaknesses of previous PREMs survey experiences. The paper reports key lessons learned in this ongoing experience of action research, directly involving practitioners. METHODS: The aim of this paper is to present the results of an ongoing action research, encompassing the innovation of PREMs collection, reporting and use, currently adopted by 21 hospitals of two Italian regions. The continuous and systematic PREMs collection has been implemented between 2017 and 2019 and includes: a continuous web-based administration, using web-services; an&nbsp;augmented and positive questionnaire matching standard closed-ended questions with narrative sections; the&nbsp;inclusion and benchmarking of patient data within a shared performance evaluation system; public disclosure of aggregated anonymized data; a multi-level and real-time web-platform for reporting PREMs to professionals. The action research was carried out with practitioners in a real-life and complex context. The authors used multiple data sources and methods: observations, feedback of practitioners, collected during several workshops and meetings, and analysis of preliminary data on the survey implementation. RESULTS: A continuous and systematic PREMs observatory was developed and adopted in two Italian regions. PREMs participation and response rates tend to increase over time, reaching stable percentages after the first months. Narrative feedback provide a 'positive narration' of episodes and behaviours that made the difference to patients and can inform quality improvement actions. Real-time reporting of quantitative and qualitative data is enabling a gratifying process of service improvement and people management at all the hospitals' levels. CONCLUSIONS: The PREMs presented in this paper has been recognized by healthcare professionals and managers as a strategic and positive tool for improving an actual use of PREMs at system and ward levels, by measuring and highlighting positive deviances, such as compassionate behaviours

Surveying Persons with Disabilities: A Source Guide (Version 1)

As a collaborator with the Cornell Rehabilitation Research and Training Center on Disability Demographics and Statistics, Mathematica Policy Research, Inc. has been working on a project that identifies the strengths and limitations in existing disability data collection in both content and data collection methodology. The intended outcomes of this project include expanding and synthesizing knowledge of best practices and the extent existing data use those practices, informing the development of data enhancement options, and contributing to a more informed use of existing data. In an effort to provide the public with an up-to-date and easily accessible source of research on the methodological issues associated with surveying persons with disabilities, MPR has prepared a Source Guide of material related to this topic. The Source Guide contains 150 abstracts, summaries, and references, followed by a Subject Index, which cross references the sources from the Reference List under various subjects. The Source Guide is viewed as a “living document,” and will be periodically updated

Comparison of contact patterns relevant for transmission of respiratory pathogens in Thailand and the Netherlands using respondent-driven sampling

Understanding infection dynamics of respiratory diseases requires the identification and quantification of behavioural, social and environmental factors that permit the transmission of these infections between humans. Little empirical information is available about contact patterns within real-world social networks, let alone on differences in these contact networks between populations that differ considerably on a socio-cultural level. Here we compared contact network data that were collected in the Netherlands and Thailand using a similar online respondent-driven method. By asking participants to recruit contact persons we studied network links relevant for the transmission of respiratory infections. We studied correlations between recruiter and recruited contacts to investigate mixing patterns in the observed social network components. In both countries, mixing patterns were assortative by demographic variables and random by total numbers of contacts. However, in Thailand participants reported overall more contacts which resulted in higher effective contact rates. Our findings provide new insights on numbers of contacts and mixing patterns in two different populations. These data could be used to improve parameterisation of mathematical models used to design control strategies. Although the spread of infections through populations depends on more factors, found similarities suggest that spread may be similar in the Netherlands and Thailand

Consumer trust and willingness to pay for certified animal-friendly products

Increasing animal welfare standards requires changes along the supply chain which involve several stakeholders: scientists, farmers and people involved in transportation and slaughtering. The majority of researchers agree that compliance with these standards increases costs along the livestock value chain, especially for monitoring and certifying animal-friendly products. Knowledge of consumer willingness to pay (WTP) in such a decision context is paramount to understanding the magnitude of market incentives necessary to compensate all involved stakeholders. The market outcome of certification programs is dependent on consumer trust. Particularly, there is a need to understand to what extent consumers believe that stakeholders operating in the animal-friendly supply chain will respect certification standards. We examine these issues using a contingent valuation survey administered in five economically dominant EU countries. The implied WTP estimates are found to be sensitive to robust measures of consumer trust for certified animal-friendly products. Significant differences across countries are discussed