Influence of Context on Item Parameters in Forced-Choice Personality Assessments

A fundamental assumption in computerized adaptive testing (CAT) is that item parameters are invariant with respect to context – items surrounding the administered item. This assumption, however, may not hold in forced-choice (FC) assessments, where explicit comparisons are made between items included in the same block. We empirically examined the influence of context on item parameters by comparing parameter estimates from two FC instruments. The first instrument was compiled of blocks of three items, whereas in the second, the context was manipulated by adding one item to each block, resulting in blocks of four. The item parameter estimates were highly similar. However, a small number of significant deviations were observed, confirming the importance of context when designing adaptive FC assessments. Two patterns of such deviations were identified, and methods to reduce their occurrences in a FC CAT setting were proposed. It was shown that with a small proportion of violations of the parameter invariance assumption, score estimation remained stable

Hyperarousal symptoms after traumatic and nontraumatic births

Background: Measurement is critical in postnatal posttraumatic stress disorder (PTSD) because symptoms may be influenced by normal postnatal phenomena such as physiological changes and fatigue. Objective: This study examined: (1) whether hyperarousal symptoms differ between women who have traumatic or nontraumatic births; (2) whether the construct of hyperarousal is coherent in postnatal women; and (3) whether hyperarousal symptoms are useful for identifying women who have traumatic births or PTSD. Methods: A survey of PTSD symptoms in 1,078 women recruited via the community or Internet who completed an online or paper questionnaire measuring childbirth-related PTSD symptoms between 1 and 36 months after birth. Women who had a traumatic birth as defined by DSM-IV criterion A (n = 458) were compared with women who did not have a traumatic birth (n = 591). Results: A one-factor dimension of hyperarousal was identified that included all five hyperarousal items. Diagnostic criteria of two or more hyperarousal symptoms in the previous week were reported by 75.3% of women with traumatic birth and 50.5% of women with nontraumatic births. The difference in mean hyperarousal symptoms between groups was substantial at 0.76 of a standard deviation (Hedge’s g, CI = 0.64, 0.89). A larger difference was observed between women with and without diagnostic PTSD (g = 1.64, CI 1.46, 1.81). However, receiver operating characteristic analyses showed hyperarousal symptoms have poor specificity and alternative ways of calculating symptoms did not improve this. Comparison with other PTSD symptoms found re-experiencing symptoms were most accurate at identifying women with traumatic births. Conclusions: Results suggest hyperarousal symptoms are associated with traumatic birth and are a coherent construct in postnatal women. However, they have poor specificity and should only be used as part of diagnostic criteria, not as a sole indicator

Measuring and Predicting Individual Differences in Executive Functions at 14 Months: A Longitudinal Study.

This study of 195 (108 boys) children seen twice during infancy (Time 1: 4.12 months; Time 2: 14.42 months) aimed to investigate the associations between and infant predictors of executive function (EF) at 14 months. Infants showed high levels of compliance with the EF tasks at 14 months. There was little evidence of cohesion among EF tasks but simple response inhibition was related to performance on two other EF tasks. Infant attention (but not parent-rated temperament) at 4 months predicted performance on two of the four EF tasks at 14 months. Results suggest that EF skills build on simpler component skills such as attention and response inhibition.ESR

An Item Response Curves Analysis of the Force Concept Inventory

Several years ago, we introduced the idea of item response curves (IRC), a simplistic form of item response theory (IRT), to the physics education research community as a way to examine item performance on diagnostic instruments such as the Force Concept Inventory (FCI). We noted that a full-blown analysis using IRT would be a next logical step, which several authors have since taken. In this paper, we show that our simple approach not only yields similar conclusions in the analysis of the performance of items on the FCI to the more sophisticated and complex IRT analyses but also permits additional insights by characterizing both the correct and incorrect answer choices. Our IRC approach can be applied to a variety of multiple-choice assessments but, as applied to a carefully designed instrument such as the FCI, allows us to probe student understanding as a function of ability level through an examination of each answer choice. We imagine that physics teachers could use IRC analysis to identify prominent misconceptions and tailor their instruction to combat those misconceptions, fulfilling the FCI authors\u27 original intentions for its use. Furthermore, the IRC analysis can assist test designers to improve their assessments by identifying nonfunctioning distractors that can be replaced with distractors attractive to students at various ability levels

Structural, item, and test generalizability of the psychopathology checklist - revised to offenders with intellectual disabilities

The Psychopathy Checklist–Revised (PCL-R) is the most widely used measure of psychopathy in forensic clinical practice, but the generalizability of the measure to offenders with intellectual disabilities (ID) has not been clearly established. This study examined the structural equivalence and scalar equivalence of the PCL-R in a sample of 185 male offenders with ID in forensic mental health settings, as compared with a sample of 1,212 male prisoners without ID. Three models of the PCL-R’s factor structure were evaluated with confirmatory factor analysis. The 3-factor hierarchical model of psychopathy was found to be a good fit to the ID PCL-R data, whereas neither the 4-factor model nor the traditional 2-factor model fitted. There were no cross-group differences in the factor structure, providing evidence of structural equivalence. However, item response theory analyses indicated metric differences in the ratings of psychopathy symptoms between the ID group and the comparison prisoner group. This finding has potential implications for the interpretation of PCL-R scores obtained with people with ID in forensic psychiatric settings

Conceptualising computerized adaptive testing for measurement of latent variables associated with physical objects

The notion of that more or less of a physical feature affects in different degrees the users' impression with regard to an underlying attribute of a product has frequently been applied in affective engineering. However, those attributes exist only as a premise that cannot directly be measured and, therefore, inferences based on their assessment are error-prone. To establish and improve measurement of latent attributes it is presented in this paper the concept of a stochastic framework using the Rasch model for a wide range of independent variables referred to as an item bank. Based on an item bank, computerized adaptive testing (CAT) can be developed. A CAT system can converge into a sequence of items bracketing to convey information at a user's particular endorsement level. It is through item banking and CAT that the financial benefits of using the Rasch model in affective engineering can be realised

Psychometrics versus Representational Theory of Measurement

Erik Angner has argued that simultaneous endorsement of the representational theory of measurement (RTM) and psychometrics leads to inconsistency. His claim rests on an implicit assumption: RTM and psychometrics are full-fledged approaches to measurement. I argue that RTM and psychometrics are only partial approaches that deal with different aspects of measurement, and that therefore simultaneous endorsement of the two is not inconsistent. The argument has implications for the improvement of measurement practices. The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: gratefully acknowledges research funding from the following institutions: Cambridge AHRC (Arts and Humanities Research Council) Doctoral Training Partnership; the British Society for the Philosophy of Science; Cambridge Commonwealth, European and International Trust; and Newnham College

A Natural Human Retrovirus Efficiently Complements Vectors Based on Murine Leukemia Virus

Background: Murine Leukemia Virus (MLV) is a rodent gammaretrovirus that serves as the backbone for common gene delivery tools designed for experimental and therapeutic applications. Recently, an infectious gammaretrovirus designated XMRV has been identified in prostate cancer patients. The similarity between the MLV and XMRV genomes suggests a possibility that the two viruses may interact when present in the same cell. Methodology/Principal Findings: We tested the ability of XMRV to complement replication-deficient MLV vectors upon coinfection of cultured human cells. We observed that XMRV can facilitate the spread of these vectors from infected to uninfected cells. This functional complementation occurred without any gross rearrangements in the vector structure, and the co-infected cells produced as many as 10 4 infectious vector particles per milliliter of culture medium. Conclusions/Significance: The possibility of encountering a helper virus when delivering MLV-based vectors to human cells in vitro and in vivo needs to be considered to ensure the safety of such procedures

Curtailment and Stochastic Curtailment to Shorten the CES-D

The Center for Epidemiologic Studies-Depression (CES-D) scale is a well-known self-report instrument that is used to measure depressive symptomatology. Respondents who take the full-length version of the CES-D are administered a total of 20 items. This article investigates the use of curtailment and stochastic curtailment (SC), two sequential analysis methods that have recently been proposed for health questionnaires, to reduce the respondent burden associated with taking the CES-D. A post hoc simulation based on 1,392 adolescents' responses to the CES-D was used to compare these methods with a previously proposed computerized adaptive testing (CAT) approach. Curtailment lowered average test lengths by as much as 22% while always matching the classification decision of the full-length CES-D. SC and CAT achieved further reductions in average test length, with SC's classifications exhibiting more concordance with the full-length CES-D than do CAT's. Advantages and disadvantages of each method are discussed. © The Author(s) 2012