Methodological issues associated with collecting sensitive information over the telephone - experience from an Australian non-suicidal self-injury (NSSI) prevalence study

<p>Abstract</p> <p>Background</p> <p>Collecting population data on sensitive issues such as non-suicidal self-injury (NSSI) is problematic. Case note audits or hospital/clinic based presentations only record severe cases and do not distinguish between suicidal and non-suicidal intent. Community surveys have largely been limited to school and university students, resulting in little much needed population-based data on NSSI. Collecting these data via a large scale population survey presents challenges to survey methodologists. This paper addresses the methodological issues associated with collecting this type of data via CATI.</p> <p>Methods</p> <p>An Australia-wide population survey was funded by the Australian Government to determine prevalence estimates of NSSI and associations, predictors, relationships to suicide attempts and suicide ideation, and outcomes. Computer assisted telephone interviewing (CATI) on a random sample of the Australian population aged 10+ years of age from randomly selected households, was undertaken.</p> <p>Results</p> <p>Overall, from 31,216 eligible households, 12,006 interviews were undertaken (response rate 38.5%). The 4-week prevalence of NSSI was 1.1% (95% ci 0.9-1.3%) and lifetime prevalence was 8.1% (95% ci 7.6-8.6).</p> <p>Methodological concerns and challenges in regard to collection of these data included extensive interviewer training and post interview counselling. Ethical considerations, especially with children as young as 10 years of age being asked sensitive questions, were addressed prior to data collection. The solution required a large amount of information to be sent to each selected household prior to the telephone interview which contributed to a lower than expected response rate. Non-coverage error caused by the population of interest being highly mobile, homeless or institutionalised was also a suspected issue in this low prevalence condition. In many circumstances the numbers missing from the sampling frame are small enough to not cause worry, especially when compared with the population as a whole, but within the population of interest to us, we believe that the most likely direction of bias is towards an underestimation of our prevalence estimates.</p> <p>Conclusion</p> <p>Collecting valid and reliable data is a paramount concern of health researchers and survey research methodologists. The challenge is to design cost-effective studies especially those associated with low-prevalence issues, and to balance time and convenience against validity, reliability, sampling, coverage, non-response and measurement error issues.</p

Climate change and climate variability: personal motivation for adaptation and mitigation

BACKGROUND: Global climate change impacts on human and natural systems are predicted to be severe, far reaching, and to affect the most physically and economically vulnerable disproportionately. Society can respond to these threats through two strategies: mitigation and adaptation. Industry, commerce, and government play indispensable roles in these actions but so do individuals, if they are receptive to behavior change. We explored whether the health frame can be used as a context to motivate behavioral reductions of greenhouse gas emissions and adaptation measures. METHODS: In 2008, we conducted a cross-sectional survey in the United States using random digit dialing. Personal relevance of climate change from health threats was explored with the Health Belief Model (HBM) as a conceptual frame and analyzed through logistic regressions and path analysis. RESULTS: Of 771 individuals surveyed, 81% (n = 622) acknowledged that climate change was occurring, and were aware of the associated ecologic and human health risks. Respondents reported reduced energy consumption if they believed climate change could affect their way of life (perceived susceptibility), Odds Ratio (OR) = 2.4 (95% Confidence Interval (CI): 1.4-4.0), endanger their life (perceived severity), OR = 1.9 (95% CI: 1.1-3.1), or saw serious barriers to protecting themselves from climate change, OR = 2.1 (95% CI: 1.2-3.5). Perceived susceptibility had the strongest effect on reduced energy consumption, either directly or indirectly via perceived severity. Those that reported having the necessary information to prepare for climate change impacts were more likely to have an emergency kit OR = 2.1 (95% CI: 1.4-3.1) or plan, OR = 2.2 (95% CI: 1.5-3.2) for their household, but also saw serious barriers to protecting themselves from climate change or climate variability, either by having an emergency kit OR = 1.6 (95% CI: 1.1-2.4) or an emergency plan OR = 1.5 (95%CI: 1.0-2.2). CONCLUSIONS: Motivation for voluntary mitigation is mostly dependent on perceived susceptibility to threats and severity of climate change or climate variability impacts, whereas adaptation is largely dependent on the availability of information relevant to climate change. Thus, the climate change discourse could be framed from a health perspective to motivate behaviour change

Pre-Survey Text Messages (SMS) Improve Participation Rate in an Australian Mobile Telephone Survey: An Experimental Study

Mobile telephone numbers are increasingly being included in household surveys samples. As approach letters cannot be sent because many do not have address details, alternatives approaches have been considered. This study assesses the effectiveness of sending a short message service (SMS) to a random sample of mobile telephone numbers to increase response rates. A simple random sample of 9000 Australian mobile telephone numbers: 4500 were randomly assigned to be sent a pre-notification SMS, and the remaining 4500 did not have a SMS sent. Adults aged 18 years and over, and currently in paid employment, were eligible to participate. American Association for Public Opinion Research formulas were used to calculated response cooperation and refusal rates. Response and cooperation rate were higher for the SMS groups (12.4% and 28.6% respectively) than the group with no SMS (7.7% and 16.0%). Refusal rates were lower for the SMS group (27.3%) than the group with no SMS (35.9%). When asked, 85.8% of the pre-notification group indicated they remembered receiving a SMS about the study. Sending a pre-notification SMS is effective in improving participation in population-based surveys. Response rates were increased by 60% and cooperation rates by 79%

Applying an extended theoretical framework for data collection mode to health services research

<p>Abstract</p> <p>Background</p> <p>Over the last 30 years options for collecting self-reported data in health surveys and questionnaires have increased with technological advances. However, mode of data collection such as face-to-face interview or telephone interview can affect how individuals respond to questionnaires. This paper adapts a framework for understanding mode effects on response quality and applies it to a health research context.</p> <p>Discussion</p> <p>Data collection modes are distinguished by key features (whether the survey is self- or interviewer-administered, whether or not it is conducted by telephone, whether or not it is computerised, whether it is presented visually or aurally). Psychological appraisal of the survey request will initially entail factors such as the cognitive burden upon the respondent as well as more general considerations about participation. Subsequent psychological response processes will further determine how features of the data collection mode impact upon the quality of response provided. Additional antecedent factors which may further interact with the response generation process are also discussed. These include features of the construct being measured such as sensitivity, and of the respondent themselves (e.g. their socio-demographic characteristics). How features of this framework relate to health research is illustrated by example.</p> <p>Summary</p> <p>Mode features can affect response quality. Much existing evidence has a broad social sciences research base but is of importance to health research. Approaches to managing mode feature effects are discussed. Greater consideration must be given to how features of different data collection approaches affect response from participants in studies. Study reports should better clarify such features rather than rely upon global descriptions of data collection mode.</p

Social environmental impacts on survey cooperation

Social environmental influences on survey cooperation are explored using data from six national household surveys in the United States matched to 1990 decennial census data. Consistent with the past literature on prosocial behavior, cooperation rates in these six surveys are found to be lower in urban, densely populated, high crime rate areas. Measures of social cohesion show no evidence of influencing cooperation. The influence of the environmental variables is then observed after introducing statistical controls for household structure, race, age of household members, presence of children, and socioeconomic attributes of households. Over half of the measured influence of the environmental variables is explained by these household-level attributes. These findings have practical import for survey administrators and are informative for the construction of a theory of survey participation.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/43559/1/11135_2004_Article_BF00153986.pd

The Political Consequences of Perceived Threat and Felt Insecurity

We draw on data from a national RDD telephone sample of 1549 adult Americans conducted between October 15, 2001 and March 2, 2002 to explore the impact of a need for security on support for national security policies in the aftermath of the 911 terrorist attacks. In past research, an external threat has been assumed to have uniform impact on an affected population, a claim that has met with growing research scrutiny. We advance research on threat through an examination of the political effects of individual differences in one’s ability to feel secure in the aftermath of terrorism, exploring the interaction between perceived threat and felt security. Most Americans reported a sense of security after the 911 attacks. But a sense of insecurity among a minority of Americans coupled with a perceived threat of future terrorism increased support for both domestic and international security policy-- the curtailment of domestic civil liberties, tougher visa checks, and support for the war in Afghanistan. Our findings underscore the diverse ways in which individuals react politically to a common external threat. We draw on attachment (Bowlby 1982/1969) and terror management theory (Pyzszcynski et al 2002) to understand the origins of individual differences in felt security