“Use the Force!” Adaptation of Response Formats

The present paper features the adaptation of an existing Big Five questionnaire with a rating scale (RS) response format into a measure using a multidimensional forced choice (MFC) response format. Rating scale response formats have been criticized for their proneness to intentional and unintentional response distortions. Multidimensional forced choice response formats were suggested as a solution to mitigate several types of response sets and response styles by design. The Big Five Inventory of Personality in Occupational Situations (B5PS) is a situation-based questionnaire designed for personnel selection and development purposes which would benefit from fake-proof response formats. MFC response formats require special effort during test construction and calibration which will be laid out here. Changing the response format has severe consequences on item design and scoring. An inherent issue with MFC formats derives from their inability to yield interpersonal comparative results from standard (sum) scoring. This issue can be solved with item response theory (IRT)-based calibration during test construction. The Thurstonian IRT approach (TIRT) was developed by Brown and Maydeu-Olivares (2011), and aspects of MFC item design and TIRT calibrations are explored in this paper. Evidence on structural and construct validity are presented alongside recommendations on the test development processes. The results support the feasibility of the concept of MFC test construction with TIRT calibration in a contextualized and situation-based item format.Peer Reviewe

KONDISI FISIK PEMAIN SEPAKBOLA KLUB ASYABAB DI KABUPATEN SIDOARJO

Physical condition is a whole unit from components that cannot be separated off hand, whether the improvement or the maintenance. Problem that proposed in this research is how the physical condition of football player on ASYABAAB club at Sidoarjo District.Population in this research is the football player on ASYABAAB club at Sidoarjo District that amounted of 20 athletes. Research variable applying test item concerning physical condition of football player on ASYABAAB club at Sidoarjo District. The execution of research using 4 types test series namely MFT, 40 meter run, shuttle run, and ‘’jumping rope’’ 45 cm modification. Data analysis that applied in this research applies descriptivepercentage.From  the result of test series show that physical ability can obtained that MFT belong to moderate category as big as 75%, run test 40 meter belong to moderate category as big as 40%, shuttle run belong to good category as big as 45%, and jumping rope 45 cm modification belong to moderate category as big as 55%. So the physical condition of football player on ASYABAAB club at Sidoarjo District belongs to moderate category as big as.The conclusion from all test in this research is the physical condition of football player on ASYABAAB club at Sidoarjo District belongs to moderate category. Those physical developments still have not running well. The suggestion is to make athletes have their own motivation to train their physic based on their need. Keywords : Physical Condition, Footbal

KONDISI FISIK PEMAIN SEPAKBOLA KLUB ASYABAAB DI KABUPATEN SIDOARJO

THE PHYSICAL CONDITION OF FOOTBALL PLAYER ONASYABAB CLUB AT SIDOARJO DISTRICTDENI SETIAWANABSTRACTPhysical condition is a whole unit from components that cannot be separatedoff hand, whether the improvement or the maintenance. Problem that proposed inthis research is how the physical condition of football player on ASYABAABclub at Sidoarjo District.Population in this research is the football player onASYABAAB club at Sidoarjo District that amounted of 20 athletes. Researchvariable applying test item concerning physical condition of football player onASYABAAB club at Sidoarjo District. The execution of research using 4 typestest series namely MFT, 40 meter run, shuttle run, and ‘’jumping rope’’ 45 cmmodification. Data analysis that applied in this research applies descriptivepercentage.From the result of test series show that physical ability can obtainedthat MFT belong to moderate category as big as 75%, run test 40 meter belong tomoderate category as big as 40%, shuttle run belong to good category as big as45%, and jumping rope 45 cm modification belong to moderate category as big as55%. So the physical condition of football player on ASYABAAB club atSidoarjo District belongs to moderate category as big as.The conclusion from alltest in this research is the physical condition of football player on ASYABAABclub at Sidoarjo District belongs to moderate category. Those physicaldevelopments still have not running well. The suggestion is to make athletes havetheir own motivation to train their physic based on their need.Keywords : Physical Condition, Footbal

Measuring Individual Risk Attitudes in the Lab: Task or Ask? An Empirical Comparison

This paper compares two prominent empirical measures of individual risk attitudes - the Holt and Laury (2002) lottery-choice task and the multi-item questionnaire advocated by Dohmen, Falk, Huffman, Schupp, Sunde and Wagner (forthcoming) - with respect to (a) their within-subject stability over time (one year) and (b) their correlation with actual risk-taking behaviour in the lab - here the amount sent in a trust game (Berg, Dickaut, McCabe, 1995). As it turns out, the measures themselves are uncorrelated (both times) and, most importantly, only the questionnaire measure exhibits test-re-test stability (Ï = .78), while virtually no such stability is found in the lottery-choice task. In addition, only the questionnaire measure shows the expected correlations with a Big Five personality measure and is correlated with actual risk-taking behaviour. The results suggest that the questionnaire measure is a better measure of individual risk attitudes than the lottery-choice task. Moreover, with respect to trust, the high re-test stability of trust transfers (Ï = .70) further supports the conjecture that trusting behaviour indeed has a component which itself is a stable individual characteristic (Glaeser, Laibson, Scheinkman and Soutter, 2000).Risk Attitudes, Trust, Personality, Lab Experiments

Measuring Individual Risk Attitudes in the Lab: Task or Ask?: An Empirical Comparison

This paper compares two prominent empirical measures of individual risk attitudes - the Holt and Laury (2002) lottery-choice task and the multi-item questionnaire advocated by Dohmen, Falk, Huffman, Schupp, Sunde and Wagner (forthcoming) - with respect to (a) their within-subject stability over time (one year) and (b) their correlation with actual risk-taking behaviour in the lab - here the amount sent in a trust game (Berg, Dickaut, McCabe, 1995). As it turns out, the measures themselves are uncorrelated (both times) and, most importantly, only the questionnaire measure exhibits test-re-test stability ( · =.78), while virtually no such stability is found in the lottery-choice task. In addition, only the questionnaire measure shows the expected correlations with a Big Five personality measure and is correlated with actual risk-taking behaviour. The results suggest that the questionnaire is the more adequate measure of individual risk attitudes for the analysis of behaviour in economic (lab) experiments. Moreover, with respect to trust, the high re-test stability of trust transfers ( ·= .70) further supports the conjecture that trusting behaviour indeed has a component which itself is a stable individual characteristic (Glaeser, Laibson, Scheinkman and Soutter, 2000).Risk attitudes, trust, personality, lab experiments

Psychometric problems with the method of correlated vectors applied to item scores (including some nonsensical results)

Spearman's hypothesis stating that ethnic group differences on cognitive tests are most pronounced on the most highly g loaded tests has been commonly tested with Jensen's method of correlated vectors (MCV). This paper illustrates and explains why MCV applied to item-level data does not provide a test of measurement invariance and fails to provide accurate information about the role of g in group differences in test scores. I focus on studies that applied MCV to study group differences on items of Raven's Standard Progressive Matrices (SPM). In an empirical illustration of the psychometric problems with this method, I show that MCV applied to 60 SPM items incorrectly yields support for Spearman's hypothesis (so-called Jensen Effects suggesting that the group difference is on g) even when the items in the second group are not from the SPM but rather from a test composed of 60 items measuring either anxiety and anger or the big five personality traits. This shows that MCV applied to item level data does not accurately reflect the degree to which item bias or g plays a role in group differences. I conclude that MCV applied to items lacks both sensitivity and specificity

Emotional intelligence: an exploration of the construct in adolescents

Emotional intelligence is an emerging psychological construct with varying definitions, measures, and applications. According to the ability model of emotional intelligence, the construct can be defined as the set of abilities that explain how we perceive, understand, and express our emotions and those of others. Research with adults shows preliminary evidence for the discriminant validity of the construct from general intelligence, personality, and well-being and positive affect, but little research has been conducted which critically examines the construct amongst adolescents. This study explored the construct with adolescents by testing the discriminant validity of emotional intelligence scores with general intelligence, personality and well-being. The study involved adolescent students (N = 29) from a regional Australian high school aged 12 – 17 years (M = 14.5, SD = 1.2). The Shipley Institute of Living Scale (a measure of IQ), a new performance-based measure of emotional intelligence – the Mayer Salovey Caruso Emotional Intelligence Test: Youth Version (MSCEIT:YV), a 50-item pool of personality items related to the Big-Five Personality Factors as found on the International Personality Item Pool (IPIP) on the IPIP website, and, the Personal Wellbeing Index – School Children (PWI-SC) were administered in the above order. Surprisingly, no significant results were found for the multiple correlations between emotional intelligence and general intelligence, personality and well-being. However, the study had low power (Power = .38), and so the results should be interpreted with caution. To conclude, it would appear that emotional intelligence, as measured by the MSCEIT:YV, is independent and distinct from general intelligence, personality and well-being, which is in contrast to the adult research which shows a slight but definite overlap with these constructs and emotional intelligence

The role of big five personality dimensions in Indonesian teachers’ subjective career success

Teachers hold strategic roles in the education system, and their career success is important to make sure they are strongly motivated at work. The big five personality is one of the personality approaches to form one’s subjective career success. This study aimed to identify the role of each dimension of the big five personality in affecting teachers’ subjective career success in Indonesia. To this end, the subjective career success inventory and personality item pool-big five factor makers were employed. This quantitative correlational study involved 320 teachers as respondents. The data were analyzed using multiple linear regression test. The result showed that dimensions of extraversion (p<0.000), agreeableness (p<0.000), and conscientiousness (p<0.001) influence Indonesian teachers’ subjective career success. These three dimensions show that teachers in Indonesia tend to have personalities related to other people’s acceptance or awareness of their social environment to attain subjective career success. Such personalities help them consider their personality and its aspects in evaluating their career

El viaje desde los cuestionarios Likert a los cuestionarios de elección forzosa: evidencia de la invarianza de los parámetros de los ítems

Multidimensional forced-choice questionnaires are widely regarded in the personnel selection literature for their ability to control response biases. Recently developed IRT models usually rely on the assumption that item parameters remain invariant when they are paired in forced-choice blocks, without giving it much consideration. This study aims to test this assumption empirically on the MUPP-2PL model, comparing the parameter estimates of the forced-choice format to their graded-scale equivalent on a Big Five personality instrument. The assumption was found to hold reasonably well, especially for the discrimination parameters. In the cases in which it was violated, we briefly discuss the likely factors that may lead to non-invariance. We conclude discussing the practical implications of the results and providing a few guidelines for the design of forced-choice questionnaires based on the invariance assumptionLos cuestionarios de elección forzosa multidimensionales son bastante apreciados en la literatura de selección de personal por su capacidad para controlar los sesgos de respuesta. Los modelos de TRI desarrollados recientemente normalmente asumen que los parámetros de los ítems permanecen invariantes cuando se emparejan en bloques de elección forzosa, sin dedicarle mucha atención. Este estudio tiene como objetivo poner a prueba empíricamente este supuesto en el modelo MUPP-2PL, comparando las estimaciones de los parámetros del formato de elección forzosa con su equivalente en escala graduada, en un instrumento de personalidad Big Five. Se encontró que el supuesto se cumplía razonablemente bien, especialmente para los parámetros de discriminación. En los casos en los que no se cumplió se discuten brevemente los posibles factores que pueden dar lugar a no invarianza. Concluimos discutiendo las implicaciones prácticas de los resultados y proponiendo algunas pautas para el diseño de cuestionarios de elección forzosa basados en el supuesto de invarianzaThis research is funded by the Spanish government’s Ministerio de Economia y Competitividad, projects PSI 2015-65557-P and PSI 2017-85022-