29 research outputs found
The unique contributions of perceiver and target characteristics in person perception
This research was partially supported by a SSHRC Institutional Grant and SSHRC Insight Development Grant (430-2016-00094) to EH and postdoctoral research support from the Australian Research Council Centre of Excellence in Cognition and its Disorders, University of Western Australia (CE110001021) and an Australian Research Council Discovery Project Grant (DP170104602) to CS.Peer reviewedPostprin
Looking our limitations in the eye: A call for more thorough and honest reporting of study limitations
The replication crisis and subsequent credibility revolution in psychology have highlighted many suboptimal research practices such as pâhacking, overgeneralizing, and a lack of transparency. These practices may have been employed reflexively but upon reflection, they are hard to defend. We suggest that current practices for reporting and discussing study limitations are another example of an area where there is much room for improvement. In this article, we call for more rigorous reporting of study limitations in social and personality psychology articles, and we offer advice for how to do this. We recommend that authors consider what the best argument is against their conclusions (which we call the âsteelâperson principleâ). We consider limitations as threats to construct, internal, external, and statistical conclusion validity (Shadish et al., 2002), and offer some examples for better practice reporting of common study limitations. Our advice has its own limitations â both our representation of current practices and our recommendations are largely based on our own metaresearch and opinions. Nevertheless, we hope that we can prompt researchers to write more deeply and clearly about the limitations of their research, and to hold each other to higher standards when reviewing each other's work
The Psychological Science Accelerator: Advancing Psychology Through a Distributed Collaborative Network
Source at https://doi.org/10.1177/2515245918797607.Concerns about the veracity of psychological research have been growing. Many findings in psychological science are based on studies with insufficient statistical power and nonrepresentative samples, or may otherwise be limited to specific, ungeneralizable settings or populations. Crowdsourced research, a type of large-scale collaboration in which one or more research projects are conducted across multiple lab sites, offers a pragmatic solution to these and other current methodological challenges. The Psychological Science Accelerator (PSA) is a distributed network of laboratories designed to enable and support crowdsourced research projects. These projects can focus on novel research questions or replicate prior research in large, diverse samples. The PSAâs mission is to accelerate the accumulation of reliable and generalizable evidence in psychological science. Here, we describe the background, structure, principles, procedures, benefits, and challenges of the PSA. In contrast to other crowdsourced research networks, the PSA is ongoing (as opposed to time limited), efficient (in that structures and principles are reused for different projects), decentralized, diverse (in both subjects and researchers), and inclusive (of proposals, contributions, and other relevant input from anyone inside or outside the network). The PSA and other approaches to crowdsourced psychological science will advance understanding of mental processes and behaviors by enabling rigorous research and systematic examination of its generalizability
To which world regions does the valenceâdominance model of social perception apply?
Over the past 10 years, Oosterhof and Todorovâs valenceâdominance model has emerged as the most prominent account of
how people evaluate faces on social dimensions. In this model, two dimensions (valence and dominance) underpin social
judgements of faces. Because this model has primarily been developed and tested in Western regions, it is unclear whether
these findings apply to other regions. We addressed this question by replicating Oosterhof and Todorovâs methodology across
11 world regions, 41 countries and 11,570 participants. When we used Oosterhof and Todorovâs original analysis strategy,
the valenceâdominance model generalized across regions. When we used an alternative methodology to allow for correlated
dimensions, we observed much less generalization. Collectively, these results suggest that, while the valenceâdominance
model generalizes very well across regions when dimensions are forced to be orthogonal, regional differences are revealed
when we use different extraction methods and correlate and rotate the dimension reduction solution.C.L. was supported by the Vienna Science and Technology Fund (WWTF VRG13-007);
L.M.D. was supported by ERC 647910 (KINSHIP); D.I.B. and N.I. received funding from
CONICET, Argentina; L.K., F.K. and Ă. Putz were supported by the European Social
Fund (EFOP-3.6.1.-16-2016-00004; âComprehensive Development for Implementing
Smart Specialization Strategies at the University of PĂ©csâ). K.U. and E. Vergauwe were
supported by a grant from the Swiss National Science Foundation (PZ00P1_154911 to E.
Vergauwe). T.G. is supported by the Social Sciences and Humanities Research Council
of Canada (SSHRC). M.A.V. was supported by grants 2016-T1/SOC-1395 (Comunidad
de Madrid) and PSI2017-85159-P (AEI/FEDER UE). K.B. was supported by a grant
from the National Science Centre, Poland (number 2015/19/D/HS6/00641). J. Bonick
and J.W.L. were supported by the Joep Lange Institute. G.B. was supported by the Slovak
Research and Development Agency (APVV-17-0418). H.I.J. and E.S. were supported
by a French National Research Agency âInvestissements dâAvenirâ programme grant
(ANR-15-IDEX-02). T.D.G. was supported by an Australian Government Research
Training Program Scholarship. The Raipur Group is thankful to: (1) the University
Grants Commission, New Delhi, India for the research grants received through its
SAP-DRS (Phase-III) scheme sanctioned to the School of Studies in Life Science;
and (2) the Center for Translational Chronobiology at the School of Studies in Life
Science, PRSU, Raipur, India for providing logistical support. K. Ask was supported by
a small grant from the Department of Psychology, University of Gothenburg. Y.Q. was
supported by grants from the Beijing Natural Science Foundation (5184035) and CAS
Key Laboratory of Behavioral Science, Institute of Psychology. N.A.C. was supported
by the National Science Foundation Graduate Research Fellowship (R010138018). We
acknowledge the following research assistants: J. Muriithi and J. Ngugi (United States
International University Africa); E. Adamo, D. Cafaro, V. Ciambrone, F. Dolce and E.
Tolomeo (Magna GrĂŠcia University of Catanzaro); E. De Stefano (University of Padova);
S. A. Escobar Abadia (University of Lincoln); L. E. Grimstad (Norwegian School of
Economics (NHH)); L. C. Zamora (Franklin and Marshall College); R. E. Liang and R.
C. Lo (Universiti Tunku Abdul Rahman); A. Short and L. Allen (Massey University, New
Zealand), A. AteĆ, E. GĂŒneĆ and S. Can Ăzdemir (BoÄaziçi University); I. Pedersen and T.
Roos (Ă
bo Akademi University); N. Paetz (Escuela de ComunicaciĂłn MĂłnica Herrera);
J. Green (University of Gothenburg); M. Krainz (University of Vienna, Austria); and B.
Todorova (University of Vienna, Austria). The funders had no role in study design, data
collection and analysis, decision to publish or preparation of the manuscript.https://www.nature.com/nathumbehav/am2023BiochemistryGeneticsMicrobiology and Plant Patholog
An Evaluation of the Alignment Method for Detecting Measurement Non-invariance in Noncognitive Scales
In recent years a new methodology, the alignment method (Asparouhov & Muthén, 2014), has surfaced for estimating measurement models and detecting measurement noninvariance (i.e., DIF) across many groups. The purpose of the current study was to investigate the alignment method for use with non-cognitive scales across groups of students from different educational contexts (e.g., schools or programs). Asparouhov and Muthén (2014) have investigated the method with continuous and binary item scales, thus I extended previous research by using simulation techniques to evaluate the method with polytomous items, which are often used to measure noncognitive constructs. I also evaluated the new tests of noninvariance produced by the alignment method to a greater extent than has been seen in previous research. Results indicate that the alignment method adequately recovers parameter estimates under small and moderate amounts of noninvariance, with issues only arising in the more extreme conditions. The tests of noninvariance were found to be too conservative for most items, with a near zero Type I error rate. The testing procedure showed appropriate power in polytomous items that were less skewed in the mean structure, which suggests that the psychometric properties of individual items have a large effect on the performance of the procedure
The purpose and practice of exploratory and confirmatory factor analysis in psychological research: Decisions for scale development and validation.
Recommended from our members
Disproportionate Use of Lethal Force in Policing Is Associated With Regional Racial Biases of Residents
Due to a lack of data, the demographic and psychological factors associated with lethal force by police officers have remained insufficiently explored. We develop the first predictive models of lethal force by integrating crowd-sourced and fact-checked lethal force databases with regional demographics and measures of geolocated implicit and explicit racial biases collected from 2,156,053 residents across the United States. Results indicate that only the implicit racial prejudices and stereotypes of White residents, beyond major demographic covariates, are associated with disproportionally more use of lethal force with Blacks relative to regional base rates of Blacks in the population. Thus, the current work provides the first macropsychological statistical models of lethal force, indicating that the context in which police officers work is significantly associated with disproportionate use of lethal force
Perceiver and target characteristics contribute to impression formation differently across race and gender.
Recommended from our members
Establishing construct validity evidence for regional measures of explicit and implicit racial bias.
Large-scale data collection has enabled social scientists to examine psychological constructs at broad, regional levels. However, because constructs and their measures initially operationalized at the individual level may have qualitatively and quantitatively different properties at other levels of analysis, the validity of constructs must be established when they are operationalized at new levels. To this end, the current research presents evidence of construct validity for explicit and implicit racial bias at region levels. Following classic measurement theory, we examine the substantive, structural, and external evidence of construct validity for regional biases. We do so with responses from âŒ2 million Black and White North Americans collected over 13 years. Though implicit measures typically demonstrate low retest reliability at the individual level, our analyses reveal conventionally acceptable levels of retest reliability at the highest levels of regional aggregation. Additionally, whereas previous meta-analyses find relatively low explicit-implicit correlations at the individual level, the present research uncovered strong explicit-implicit correlations at regional levels. The findings have implications for how we interpret measures of racial bias at regional levels. (PsycINFO Database Record (c) 2019 APA, all rights reserved)
Recommended from our members
Establishing construct validity evidence for regional measures of explicit and implicit racial bias.
Large-scale data collection has enabled social scientists to examine psychological constructs at broad, regional levels. However, because constructs and their measures initially operationalized at the individual level may have qualitatively and quantitatively different properties at other levels of analysis, the validity of constructs must be established when they are operationalized at new levels. To this end, the current research presents evidence of construct validity for explicit and implicit racial bias at region levels. Following classic measurement theory, we examine the substantive, structural, and external evidence of construct validity for regional biases. We do so with responses from âŒ2 million Black and White North Americans collected over 13 years. Though implicit measures typically demonstrate low retest reliability at the individual level, our analyses reveal conventionally acceptable levels of retest reliability at the highest levels of regional aggregation. Additionally, whereas previous meta-analyses find relatively low explicit-implicit correlations at the individual level, the present research uncovered strong explicit-implicit correlations at regional levels. The findings have implications for how we interpret measures of racial bias at regional levels. (PsycINFO Database Record (c) 2019 APA, all rights reserved)