The Effect of Response Style on Self-Reported Conscientiousness Across 20 Countries

Rankings of countries on mean levels of self-reported Conscientiousness continue to puzzle researchers. Based on the hypothesis that cross-cultural differences in the tendency to prefer extreme response categories of ordinal rating scales over moderate categories can influence the comparability of self-reports, this study investigated possible effects of response style on the mean levels of self-reported Conscientiousness in 22 samples from 20 countries. Extreme and neutral responding were estimated based on respondents' ratings of 30 hypothetical people described in short vignettes. In the vignette ratings, clear cross-sample differences in extreme and neutral responding emerged. These responding style differences were correlated with mean self-reported Conscientiousness scores. Correcting self-reports for extreme and neutral responding changed sample rankings of Conscientiousness, as well as the predictive validities of these rankings for external criteria. The findings suggest that the puzzling country rankings of self-reported Conscientiousness may to some extent result from differences in response styles

Comparability of Self-Reported Conscientiousness Across 21 Countries

In cross-national studies, mean levels of self-reported phenomena are often not congruent with more objective criteria. One prominent explanation for such findings is that people make self-report judgements in relation to culture-specific standards (often called the reference group effect), thereby undermining the cross-cultural comparability of the judgements. We employed a simple method called anchoring vignettes in order to test whether people from 21 different countries have varying standards for Conscientiousness, a Big Five personality trait that has repeatedly shown unexpected nation-level relationships with external criteria. Participants rated their own Conscientiousness and that of 30 hypothetical persons portrayed in short vignettes. The latter type of ratings was expected to reveal individual differences in standards of Conscientiousness. The vignettes were rated relatively similarly in all countries, suggesting no substantial culture-related differences in standards for Conscientiousness. Controlling for the small differences in standards did not substantially change the rankings of countries on mean self-ratings or the predictive validities of these rankings for objective criteria. These findings are not consistent with mean self-rated Conscientiousness scores being influenced by culture-specific standards. The technique of anchoring vignettes can be used in various types of studies to assess the potentially confounding effects of reference levels. Copyright (c) 2011 John Wiley & Sons, Ltd