Multi-mode question pretesting: Using traditional cognitive interviews and online testing as complementary methods

Questionnaire development, evaluation, and pretesting research is critical for ensuring that survey questions, materials, and data collection procedures produce the highest quality data possible. Interviewer-administered cognitive interviews is a common pretesting method used to collect rich, qualitative data. As technology has advanced, researchers can conduct similar research online in self-administered modes (Behr 2016), allowing for pretesting with larger samples. Each approach has strengths and limitations that researchers can leverage to address their pretesting goals. This research presents a multi-study, iterative project using traditional and online pretesting to evaluate new confidentiality language. Study 1 used traditional cognitive interviews to collect information on respondents’ qualitative reactions to, and comprehension of, the new language, but was limited by a small sample of prior survey respondents. Study 2 used online testing to help verify the previous findings with a larger sample, but was limited to hypothetical respondent behaviour. Study 3 used online testing over two waves of data collection to evaluate actual behaviour over time and expanded on the previous two studies by using an experimental design. We discuss the utility of using multiple pretesting methods to complement each other, providing research findings that would not be possible when using one alone

Representations of integers by the form x2 + xy + y2 + z2 + zt + t2

Electronic version of an article published in International Journal of Number Theory Volume 04, Issue 05, October 2008, pp. 709-714. DOI: 10.1142/S1793042108001638. Copyright © 2008 World Scientific Publishing Company: http://www.worldscientific.com/worldscinet/ijntWe give an elementary proof of the number of representations of an integer by the quaternary quadratic form x2 + xy + y2 + z2 + zt + t2

Exploring the Impact of Interviewer Perceptions and Interviewer-Respondent Interactions on the Survey of Income and Program Participation: Analysis of CARI recordings

Interviewers play a significant role in telephone and face-to-face interviews, including gaining respondent cooperation and administering survey questions. Increasingly, interviewers’ perceptions of the respondent and interview experience, such as cooperativeness and interest, are also being used to assess measurement error and make adjustments to data (West, 2013; Kirchner et al., 2017). Although interviewer perceptions are typically recorded at the end of the interview, interviewers are likely to begin forming perceptions about the household and respondent based on their first contact attempt (and continue developing them during the interview). We hypothesize that interview context factors, such as interviewer perceptions of the physical interview environment and the respondent’s reluctance, may interact with question characteristics, such as sensitivity and cognitive burden, to influence interviewer-respondent interactions. One survey that may be particularly impacted by context factors is the Survey of Income and Program Participation (SIPP). The SIPP is a multi-wave household survey that asks questions about economic well-being, family dynamics, and housing security, among other sensitive and cognitively burdensome topics. SIPP interviewers receive standardized training but they also implement individual strategies as they react to the questionnaire, respondent, and interview context. For example, interviewers may anticipate that some respondents will react sensitively to interview questions and proactively tailor questions to reduce sensitivity. The criteria that interviewers use to make these judgments may vary, resulting in differences in question-asking and probing behavior that may ultimately affect response distributions and respondent burden in unexpected ways. The purpose of the present study was to develop a framework of the interviewer-respondent interaction from the interviewer’s perspective. A primary goal was to investigate whether an interviewer’s question-asking or probing behavior differs between contexts that are sensitive or burdensome (e.g., sensitive and non-sensitive questions; reluctant and non-reluctant respondents). In addition, we identify the interviewer behaviors that appear to reduce respondent behaviors associated with measurement error. To do this, we combined several data sources from the 2014 SIPP Panel: computer audio-recorded interviewing (CARI) recordings, interviewer perceptions of the physical interview environment (Neighborhood Observation Instrument, NOI) and of respondent behaviors during contact attempts (Contact History Instrument, CHI), SIPP data including responses to survey questions and demographics, and interviewer characteristics. Three researchers independently transcribed and coded audio recordings of the full interaction for a sample of the targeted questions. Behavior codes included: whether the interviewer changed the survey question and what type of change was made (e.g., tailored the question to match the respondent’s situation), how the interviewer reacted to responses (used a suggestive probe); whether the respondent did not give a codeable response (a vague answer that does not unambiguously match a response option); and other codes that describe the interaction (pauses, interruptions). We plan to present descriptive analyses of interviewer and respondent behaviors, as well as modeling results that examine the extent to which (a) selected interview context factors predict interviewer behavior and (b) interviewing strategies predict response and interview outcomes. Implications for data quality, interviewer training, questionnaire design, and survey methods in general will be discussed

Forgetting feelings: Opposite biases in reports of the intensity of past emotion and mood.

Memory for feelings is subject to fading and bias over time. In 2 studies, the authors examined whether the magnitude and direction of bias depend on the type of feeling being recalled: emotion or mood. A few days after the U.S. Presidential elections in 2008 and 2012, participants reported how they felt about the election outcome (emotion) and how they felt in general (mood). A month after the elections, participants recalled their feelings. The intensity of past emotion was recalled more accurately than the intensity of past mood. Participants underestimated the intensity of emotion but overestimated the intensity of mood. Participants' appraisals of the importance of the election, which diminished over time, contributed to underestimating the intensity of emotion. In contrast, participants' strong emotional response to the election contributed to overestimating the intensity of mood. These opposing biases have important implications for decision making and clinical assessment

Predictors of personal polycyclic aromatic hydrocarbon exposures among pregnant minority women in New York City.

As part of a multiyear birth-cohort study examining the roles of pre- and postnatal environmental exposures on developmental deficits and asthma among children, we measured personal exposures to polycyclic aromatic hydrocarbons (PAHs) among 348 pregnant women in northern Manhattan and the South Bronx, New York. Nonsmoking African-American or Dominican women were identified and recruited into the study. During the third trimester of pregnancy, each subject wore a personal air monitor for 48 hr to determine exposure levels to nine PAH compounds. In this study, we examined levels of exposures to PAHs and tested for associations with potential predictor variables collected from questionnaires addressing socioeconomic factors and day-to-day activities during pregnancy as well as activities and environmental exposures during the 48-hr monitoring period. Reliable personal monitoring data for women who did not smoke during the monitoring period were available for 344 of 348 subjects. Mean PAH concentrations ranged from 0.06 ng/m3 for dibenz[a,h]anthracene to 4.1 ng/m3 for pyrene; mean benzo[a]pyrene concentration was 0.50 ng/m3. As found in previous studies, concentrations of most PAHs were higher in winter than in summer. Multiple linear regression analysis revealed associations between personal PAH exposures and several questionnaire variables, including time spent outdoors, residential heating, and indoor burning of incense. This is the largest study to date characterizing personal exposures to PAHs, a ubiquitous class of carcinogenic air contaminants in urban environments, and is unique in its focus on pregnant minority women

Neutrophil Extracellular Trap–Derived Enzymes Oxidize High‐Density Lipoprotein: An Additional Proatherogenic Mechanism in Systemic Lupus Erythematosus

Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/108351/1/art38703.pd

The autism inpatient collection: Methods and preliminary sample description

© 2015 Siegel et al. Background: Individuals severely affected by autism spectrum disorder (ASD), including those with intellectual disability, expressive language impairment, and/or self-injurious behavior (SIB), are underrepresented in the ASD literature and extant collections of phenotypic and biological data. An understanding of ASD's etiology and subtypes can only be as complete as the studied samples are representative. Methods: The Autism Inpatient Collection (AIC) is a multi-site study enrolling children and adolescents with ASD aged 4-20 years admitted to six specialized inpatient psychiatry units. Enrollment began March, 2014, and continues at a rate of over 400 children annually. Measures characterizing adaptive and cognitive functioning, communication, externalizing behaviors, emotion regulation, psychiatric co-morbidity, self-injurious behavior, parent stress, and parent self-efficacy are collected. ASD diagnosis is confirmed by the Autism Diagnostic Observation Schedule - 2 (ADOS-2) and extensive inpatient observation. Biological samples from probands and their biological parents are banked and processed for DNA extraction and creation of lymphoblastoid cell lines. Results: Sixty-one percent of eligible subjects were enrolled. The first 147 subjects were an average of 12.6 years old (SD 3.42, range 4-20); 26.5 % female; 74.8 % Caucasian, and 81.6 % non-Hispanic/non-Latino. Mean non-verbal intelligence quotient IQ = 70.9 (SD 29.16, range 30-137) and mean adaptive behavior composite score = 55.6 (SD 12.9, range 27-96). A majority of subjects (52.4 %) were non- or minimally verbal. The average Aberrant Behavior Checklist - Irritability Subscale score was 28.6, well above the typical threshold for clinically concerning externalizing behaviors, and 26.5 % of the sample engaged in SIB. Females had more frequent and severe SIB than males. Conclusions: Preliminary data indicate that the AIC has a rich representation of the portion of the autism spectrum that is understudied and underrepresented in extant data collections. More than half of the sample is non- or minimally verbal, over 40 % have intellectual disability, and over one quarter exhibit SIB. The AIC is a substantial new resource for study of the full autism spectrum, which will augment existing data on higher-functioning cohorts and facilitate the identification of genetic subtypes and novel treatment targets. The AIC investigators welcome collaborations with other investigators, and access to the AIC phenotypic data and biosamples may be requested through the Simons Foundation (www.sfari.org)

Cancer Incidence in World Trade Center Rescue and Recovery Workers, 2001–2008

Background: World Trade Center (WTC) rescue and recovery workers were exposed to a complex mix of pollutants and carcinogens. Objective: The purpose of this investigation was to evaluate cancer incidence in responders during the first 7 years after 11 September 2001. Methods: Cancers among 20,984 consented participants in the WTC Health Program were identified through linkage to state tumor registries in New York, New Jersey, Connecticut, and Pennsylvania. Standardized incidence ratios (SIRs) were calculated to compare cancers diagnosed in responders to predicted numbers for the general population. Multivariate regression models were used to estimate associations with degree of exposure. Results: A total of 575 cancers were diagnosed in 552 individuals. Increases above registry-based expectations were noted for all cancer sites combined (SIR = 1.15; 95% CI: 1.06, 1.25), thyroid cancer (SIR = 2.39; 95% CI: 1.70, 3.27), prostate cancer (SIR = 1.21; 95% CI: 1.01, 1.44), combined hematopoietic and lymphoid cancers (SIR = 1.36; 95% CI: 1.07, 1.71), and soft tissue cancers (SIR = 2.26; 95% CI: 1.13, 4.05). When restricted to 302 cancers diagnosed ≥ 6 months after enrollment, the SIR for all cancers decreased to 1.06 (95% CI: 0.94, 1.18), but thyroid and prostate cancer diagnoses remained greater than expected. All cancers combined were increased in very highly exposed responders and among those exposed to significant amounts of dust, compared with responders who reported lower levels of exposure. Conclusion: Estimates should be interpreted with caution given the short follow-up and long latency period for most cancers, the intensive medical surveillance of this cohort, and the small numbers of cancers at specific sites. However, our findings highlight the need for continued follow-up and surveillance of WTC responders