The Role of Public Opinion Research in the Democratic Process: Insights from Politicians, Journalists, and the General Public

This study reveals the existence of a paradox in how the public views polling within the democratic process. Specifically, even though the public believes that it can influence poli­cymaking, it considers public opinion polls not as useful as other, less representative forms of public input, such as comments at town hall meetings. Analyzing data from multiple surveys conducted in the United States of America, we find no evidence for the demo­cratic representation hypothesis with respect to polling. Comparisons across stakeholders (public, journalists, and politicians) demonstrate that general perceptions of inputs into the democratic process are similar, which confirms the citizen-elite congruence hypothesis. However, unlike members of the public, experts are more likely to believe that public opin­ion polls are the optimal method by which the public can successfully inform policymak­ing, a finding consistent with the legitimization hypothesis. With respect to perceptions of politicians, we found substantial differences regarding party registration with Democrats and Independents favoring public opinion polling and Republicans preferring alternative methods (e.g., town hall meetings) of informing policymakers

Cultural variability in the effects of question design features on respondent comprehension

Um Charakteristika gleicher Fragen in Gesundheitsumfragen im Zusammenhang mit interkulturellen Unterschieden im Verständnis dieser Fragen zu identifizieren, analysieren die Verfasser Befragungen zum Gesundheitssystem, wobei die Befragten vier verschiedene kulturelle Subgruppen in den USA repräsentieren (weiße Nicht-Hispanics, Afroamerikaner, mexikanische Amerikaner und Puerto Ricaner) mit Hilfe des Instruments des Behaviour Coding. Untersucht werden die Auswirkungen von vier Merkmalen der Fragebogenkonstruktion auf kulturelle Schwierigkeiten beim Verständnis der Fragen. Die empirische Datenbasis bilden 13514 Antworten von 345 Befragten auf 42 Fragen. Es zeigt sich, dass das Antwortformat, die Länge der Frage sowie das Lese- und Abstraktionsniveau der Fragen einen wesentlichen Einfluss auf das Verständnis der Fragen bei den Befragten haben. Die Kultur der Befragen hatte einen moderierenden Einfluss auf die Effekte von Antwortformat, Fragenlänge und Leseniveau. Verschiedene Aspekte des Fragebogendesigns, die den Fragebogen allgemein verständlicher machen sollen, haben ebenfalls kulturspezifische Auswirkungen. (ICEÜbers

Current Knowledge and Considerations Regarding Survey Refusals: Executive Summary of the AAPOR Task Force Report on Survey Refusals

The landscape of survey research has arguably changed more significantly in the past decade than at any other time in its relatively brief history. In that short time, landline telephone ownership has dropped from some 98 percent of all households to less than 60 percent; cell-phone interviewing went from a novelty to a mainstay; address-based designs quickly became an accepted method of sampling the general population; and surveys via Internet panels became ubiquitous in many sectors of social and market research, even as they continue to raise concerns given their lack of random selection. Among these widespread changes, it is perhaps not surprising that the substantial increase in refusal rates has received comparatively little attention. As we will detail, it was not uncommon for a study conducted 20 years ago to have encountered one refusal for every one or two completed interviews, while today experiencing three or more refusals for every one completed interview is commonplace. This trend has led to several concerns that motivate this Task Force. As refusal rates have increased, refusal bias (as a component of nonresponse bias) is an increased threat to the validity of survey results. Of practical concern are the efficacy and cost implications of enhanced efforts to avert initial refusals and convert refusals that do occur. Finally, though no less significant, are the ethical concerns raised by the possibility that efforts to minimize refusals can be perceived as coercive or harassing potential respondents. Indeed, perhaps the most important goal of this document is to foster greater consideration by the reader of the rights of respondents in survey research

Chapter 17: Exploring the Antecedents and Consequences of Interviewer Reading Speed (IRS) at the Question Level. Appendix 17

Figure A17.A.1: Manipulation of Question Characteristics (Example Questions Shown) Figure A17.A.2: Response Latency Validity Options Provided to Interviewers after Each Question where Response Latencies were Measured Figure A17.A.3: Interviewer Behavior Codes Used to Identify Question Latency Problems Appendix 17.B: Measurement of Response and Question Latencies Table A17.B.1: Validity of Response Latency MeasurementTable A17.B.2: Validity of Question Latency MeasurementReferencesAppendix 17.C: Questions in CAPI Survey for which Response Latencies were Measure

Examining PhD and research masters theses

The examination of research theses has only relatively recently attracted research interest that has focused on what examiners do and how consistent they are. The research questions in this study address firstly whether PhD and research masters theses were treated by examiners as qualitatively different on 12 indicators of importance across the areas: contribution of the thesis, the literature review, approach and methodology, analyses and results and presentation. Secondly what was the examiner assessment of quality of a recently examined thesis on the same indicators and, finally, how well the indicators were reflected in a holistic assessment of thesis quality. The work reported here draws on the responses of 353 PhD and 74 research masters thesis examiners. Findings showed the examiners generally rated the relative importance of the indicators very similarly at both degree levels. Further the order of importance across indicators was essentially the same for the two levels of thesis. Anticipated differences did emerge with the examiners giving higher quality gradings for all contribution indicators for PhD as compared with research masters theses. The 12 specific quality indicators, individually and collectively were strongly related to the holistic assessment of thesis quality, particularly at the PhD level

Antecedents and Consequences of Interviewer Pace: Assessing Interviewer Speaking Pace at the Question Level

The pace at which interviewers read survey questions may vary considerably across interviewers (e.g., Cannell, Miller, & Oksenberg, 1981) and as a function of interviewer experience (Olson and Petchev, 2007). The pace at which interviews are conducted can influence respondent perceptions of the importance of interaction (Fowler, 1966). Interviewer training typically includes instructions to read questions slowly and clearly to respondents is based on the assumption that doing so maximizes data quality (e.g., Fowler and Mangione, 1990). In this research, we examine possible causes and consequences of interviewer pace using data from in person surveys conducted with respondents from four racial and ethnic groups: non-Hispanic White, non-Hispanic Black, Mexican-American, and Korean-American respondents. All respondents were interviewed by respondents of the same race. Using HLM models, we examine the extent to which question characteristics (e.g., length, sensitivity, etc.) influence interviewer pace and the extent to which pace is associated with interviewer (e.g., not reading the question completely) and respondent (e.g., giving a response that does not meet the question objective) behaviors believed to be associated with lowered survey data quality. We discuss implications of our findings for standardized interviewer training

Engineering in children's fiction: not a good story?

Responding to concerns that engineering is a poorly understood occupation and that young people are exposed to stereotyped images of scientists and engineers at an early age, this investigation sought to identify how science and engineering is portrayed in contemporary junior fiction (ages 8–12) and to what extent. An examination of 4,800 junior fiction titles in one region in New South Wales, Australia, identified as few as 71 titles that addressed themes related to engineering and the sciences. While the crazy, nerdy, scientific stereotype exists in these stories, mostly in humorous vein, we found that fictional characters were split between the nerdy, eccentric, and the more serious and professional types who were depicted as more popular. The emphasis was on male characters, but not exclusively so. There were limited details that could be associated with engineering. Where building, making, and working with machines featured, they were depicted as male activity and primarily connected to vehicles, mostly cars. We concluded that while young people, particularly girls, were unlikely to gain accurate or compelling images about engineering as an occupation from this source at present, as a medium for informing the young and their parents, the potential of fiction was considerable