129 research outputs found

    Many analysts, one data set: making transparent how variations in analytic choices affect results

    Get PDF
    Twenty-nine teams involving 61 analysts used the same data set to address the same research question: whether soccer referees are more likely to give red cards to dark-skin-toned players than to light-skin-toned players. Analytic approaches varied widely across the teams, and the estimated effect sizes ranged from 0.89 to 2.93 (Mdn = 1.31) in odds-ratio units. Twenty teams (69%) found a statistically significant positive effect, and 9 teams (31%) did not observe a significant relationship. Overall, the 29 different analyses used 21 unique combinations of covariates. Neither analysts’ prior beliefs about the effect of interest nor their level of expertise readily explained the variation in the outcomes of the analyses. Peer ratings of the quality of the analyses also did not account for the variability. These findings suggest that significant variation in the results of analyses of complex data may be difficult to avoid, even by experts with honest intentions. Crowdsourcing data analysis, a strategy in which numerous research teams are recruited to simultaneously investigate the same research question, makes transparent how defensible, yet subjective, analytic choices influence research results

    An examination of the factorial and convergent validity of four measures of conspiracist ideation, with recommendations for researchers

    Get PDF
    A number scales have been developed to measure conspiracist ideation, but little attention has been paid to the factorial validity of these scales. We reassessed the psychometric properties of four widely-used scales, namely the Belief in Conspiracy Theories Inventory (BCTI), the Conspiracy Mentality Questionnaire (CMQ), the Generic Conspiracist Beliefs Scale (GCBS), and the One-Item Conspiracy Measure (OICM). Eight-hundred-and-three U. S. adults completed all measures, along with measures of endorsement of 9/11 and anti- vaccination conspiracy theories. Through both exploratory and confirmatory factor analysis, we found that only the BCTI had acceptable factorial validity. We failed to confirm the factor structures of the CMQ and the GBCS, suggesting these measures had poor factorial valid- ity. Indices of convergent validity were acceptable for the BCTI, but weaker for the other measures. Based on these findings, we provide suggestions for the future refinement in the measurement of conspiracist ideation

    Supply chain sustainability performance measurement of small and medium sized enterprises using structural equation modeling

    Get PDF
    Sustainability of small and medium sized enterprises (SMEs) is significant as SMEs contribute to GDP substantially in every economy. This research develops an innovative sustainable supply chain performance measurement model for SMEs. Prior researches predominantly use balanced score card (BSC) approach that presume causal relationship of criteria and Data Envelopment Analysis (DEA), which derive efficiency of units from a few input and output criteria. While DEA is effective for policymakers, BSC is more suitable for individual SME. The proposed method that uses structural equation modeling (SEM) approach to derive the relationship of criteria and criteria weights formulates regression-type models for a specific region as well as for specific SME. The SEM-based supply chain sustainability performance measurement model is beneficial to policymakers as they can determine means for improvement at a regional level. The proposed method could also facilitate managers/owners of individual SMEs with measures for improving their supply chain sustainability performance. The method has been applied to three varied geographical locations in the UK, France and India in order to demonstrate its effectiveness

    An examination of the self-referent executive processing model of test anxiety: control, emotional regulation, self-handicapping, and examination performance

    Get PDF
    According to the self-referent executive processing (S-REF) model, test anxiety develops from interactions between three systems: executive self-regulation processes, self-beliefs, and maladaptive situational interactions. Studies have tended to examine one system at a time, often in conjunction with how test anxiety relates to achievement outcomes. The aim of this study was to enable a more thorough test of the S-REF model by examining one key construct from each of these systems simultaneously. These were control (a self-belief construct), emotional regulation through suppression and reappraisal (an executive process), and self-handicapping (a maladaptive situational interaction). Relations were examined from control, emotional regulation, and self-handicapping to cognitive test anxiety (worry), and subsequent examination performance on a high-stakes test. Data were collected from 273 participants in their final year of secondary education. A structural equation model showed that higher control was indirectly related to better examination performance through lower worry, higher reappraisal was indirectly related to worse examination performance through higher worry, and higher self-handicapping was related to worse examination performance through lower control and higher worry. These findings suggest that increasing control and reducing self-handicapping would be key foci for test anxiety interventions to incorporate. © 2018 The Author(s

    New evidence of factor structure and measurement invariance of the SDQ across five European nations

    Get PDF
    The main purpose of the present study was to test the internal structure and to study the measurement invariance of the Strength and Difficulties Questionnaire (SDQ), self-reported version, in five European countries. The sample consisted of 3012 adolescents aged between 12 and 17 years (M = 14.20; SD = 0.83). The five-factor model (with correlated errors added), and the five-factor model (with correlated errors added) with the reverse-worded items allowed to cross-load on the Prosocial subscale, displayed adequate goodness of-fit indices. Multi-group confirmatory factor analysis showed that the five-factor model had partial strong measurement invariance by countries. A total of 11 of the 25 items were non-invariant across samples. The level of internal consistency of the Total difficulties scores was .84, ranging between .69 and .78 for the SDQ subscales. The findings indicate that the SDQ's scales need to be modified in various ways for screening emotional and behavioural problems in the five European countries that were analyzed

    A modern network approach to revisiting the positive and negative affective schedule (PANAS) construct validity

    Get PDF
    Introduction: The factor structure of the Positive and Negative Affective Schedule (PANAS) is still a topic of debate. There are several reasons why using Exploratory Graph Analysis (EGA) for scale validation is advantageous and can help understand and resolve conflicting results in the factor analytic literature. Objective: The main objective of the present study was to advance the knowledge regarding the factor structure underlying the PANAS scores by utilizing the different functionalities of the EGA method. EGA was used to (1) estimate the dimensionality of the PANAS scores, (2) establish the stability of the dimensionality estimate and of the item assignments into the dimensions, and (3) assess the impact of potential redundancies across item pairs on the dimensionality and structure of the PANAS scores. Method: This assessment was carried out across two studies that included two large samples of participants. Results and Conclusion: In sum, the results are consistent with a two-factor oblique structure.Fil: Flores Kanter, Pablo Ezequiel. Universidad Empresarial Siglo XXI; Argentina. Consejo Nacional de Investigaciones CientĂ­ficas y TĂ©cnicas; ArgentinaFil: Garrido, Luis Eduardo. Pontificia Universidad CatĂłlica Madre y Maestra; RepĂșblica DominicanaFil: Moretti, Luciana SofĂ­a. Universidad Empresarial Siglo XXI; Argentina. Pontificia Universidad CatĂłlica Madre y Maestra; RepĂșblica Dominicana. Consejo Nacional de Investigaciones CientĂ­ficas y TĂ©cnicas; ArgentinaFil: Medrano, Leonardo. Universidad Empresarial Siglo XXI; Argentina. Pontificia Universidad CatĂłlica Madre y Maestra; RepĂșblica Dominicana. Consejo Nacional de Investigaciones CientĂ­ficas y TĂ©cnicas; Argentin
    • 

    corecore