An IRT–Multiple Indicators Multiple Causes (MIMIC) Approach as a Method of Examining Item Response Latency

The analysis of response time has received increasing attention during the last decades, since evidence from several studies supported the argument that there is a direct relationship between item response time and test performance. The aim of this study was to investigate whether item response latency affects person's ability parameters, in that it represents an adaptive or maladaptive practice. To examine the above research question data from 8,475 individuals completing the computerized version of the Postgraduate General Aptitude Test (PAGAT) were analyzed. To determine the extent to which response latency affects person's ability, we used a Multiple Indicators Multiple Causes (MIMIC) model, in which every item in a scale was linked to its corresponding covariate (i.e., item response latency). We ran the MIMIC model within the Item Response Theory (IRT) framework (2-PL model). The results supported the hypothesis that item response latency could provide valuable information for getting more accurate estimations for persons' ability levels. Results indicated that for individuals who invest more time on easy items, their likelihood of success does not improve, most likely because slow and fast responders have significantly different levels of ability (fast responders are of higher ability compared to slow responders). Consequently, investing more time for low ability individuals does not prove to be adaptive. The opposite was found for difficult items: individuals spending more time on difficult items increase their likelihood of success, more likely because they are high achievers (in difficult items individuals who spent more time were of significantly higher ability compared to fast responders). Thus, it appears that there is an interaction between the difficulty of the item and person abilities that explain the effects of response time on likelihood of success. We concluded that accommodating item response latency in a computerized assessment model, can inform test quality and test takers' behavior, and in that way, enhance score measurement accuracy

Examining the relationship between home literacy environment and neural correlates of phonological processing in beginning readers with and without a familial risk for dyslexia: an fMRI study

Developmental dyslexia is a language-based learning disability characterized by persistent difficulty in learning to read. While an understanding of genetic contributions is emerging, the ways the environment affects brain functioning in children with developmental dyslexia are poorly understood. A relationship between the home literacy environment (HLE) and neural correlates of reading has been identified in typically developing children, yet it remains unclear whether similar effects are observable in children with a genetic predisposition for dyslexia. Understanding environmental contributions is important given that we do not understand why some genetically at-risk children do not develop dyslexia. Here we investigate for the first time the relationship between HLE and the neural correlates of phonological processing in beginning readers with (FHD+, n=29) and without (FHD−, n=21) a family history of developmental dyslexia. We controlled for socio-economic status to isolate the neurobiological mechanism by which HLE affects reading development. Group differences revealed stronger correlation of HLE with brain activation in the left inferior/middle frontal and right fusiform gyri in FHD− compared to FHD+ children, suggesting greater impact of HLE on manipulation of phonological codes and recruitment of orthographic representations in typically developing children. In contrast, activation in the right precentral gyrus showed a significantly stronger correlation with HLE in FHD+ compared to FHD− children, suggesting emerging compensatory networks in genetically at-risk children. Overall, our results suggest that genetic predisposition for dyslexia alters contributions of HLE to early reading skills before formal reading instruction, which has important implications for educational practice and intervention models

Teacher biases in the identification of learning disabilities: an application of the logistic multilevel model

Abstract. The purpose of the present study was to investigate the presence of teacher biases with regard to identification of students with learning disabilities (LD). Factors related to teachers' gender, age, and experience, along with children's gender, were investigated. Results suggested that teachers' gender is associated with biases with regard to identification of learning disabilities by a factor of 2:1. In other words, every child who is rated by female teachers as having an LD (who actually has LD) corresponds two children when rated by male teachers. Students' gender, on the other hand, did not diff e rentially predict identification rates. Furthermore, teacher age and experience did not contribute significantly to student identification rates. The findings are discussed with regard to policy mandates and classification schemes

Examining Differences in Within- and Between-Person Simple Structures of an Engineering Qualification Test Using Multilevel MIMIC Structural Equation Modeling

The current study sought to meet three aims: (a) to understand the optimal factor structure of the Professional Engineering (ProfEng) test, a measure aiming to assess competency in engineering, within a multilevel (nested) perspective; (b) to examine the psychometric measurement invariance of the ProfEng test across levels due to nesting and across gender at the person level, and, (c) to examine the internal consistency of the engineering competency measure at both levels in the analysis. Data involved 1,696 individuals across 21 universities who took a national licensure test as part of the professional accreditation process to obtain a work permit and practice the engineering profession in the Kingdom of Saudi Arabia. Data were analyzed by use of Multilevel Structural Equation Modeling (MLSEM). Results indicated that a 2-factor model at both levels of analysis provided the best fit to the data. We also examined violation of measurement invariance across clusters (cluster bias). Results showed that all factor loadings were invariant across levels, suggesting the presence of strong measurement invariance. Last, invariance across gender was tested by use of the MIMIC multilevel model. Results pointed to the existence of significant differences between genders on levels of personal and professional skills with females having higher levels on personal skills and males on professional. Estimates of internal consistency reliability also varied markedly due to nesting. It is concluded that ignoring a multilevel structure is associated with errors and inaccuracies in the measurement of person abilities as both measurement wise and precision wise the multilevel model provides increased accuracy at each level in the analysis

The Impact of Non-Attempted and Dually-Attempted Items on Person Abilities and Scale Validity using Item Response Theory

The purpose of the present study was to relate response strategy with person ability estimates. Two behavioral strategies were examined: (a) the strategy to skip items in order to save time on timed tests, and, (b) the strategy to select two responses on an item, with the hope that one of them may be considered correct. Participants were 4,422 individuals who were administered a standardized achievement measure related to math, biology, chemistry, and physics. In the present evaluation, only the physics subscale was employed. Two analyses were conducted: (a) a person-based one to identify differences between groups and potential correlates of those differences, and, (b) a measure-based analysis in order to identify the parts of the measure that were responsible for potential group differentiation. For (a) person abilities the 2-PL model was employed and later the 3-PL and 4-PL models in order to estimate upper and lower asymptotes of person abilities. For (b) differential item functioning, differential test functioning, and differential distractor functioning were investigated. Results indicated that there were significant differences between groups with completers having the highest ability compared to both non-attempters and dual responders. There were no significant differences between no-attempters and dual responders. The present findings have implications for response strategy efficacy and measure evaluation, revision, and construction

Examining the relationship between home literacy environment and neural correlates of phonological processing in beginning readers with and without a familial risk for dyslexia: an fMRI study

Developmental dyslexia is a language-based learning disability characterized by persistent difficulty in learning to read. While an understanding of genetic contributions is emerging, the ways the environment affects brain functioning in children with developmental dyslexia are poorly understood. A relationship between the home literacy environment (HLE) and neural correlates of reading has been identified in typically developing children, yet it remains unclear whether similar effects are observable in children with a genetic predisposition for dyslexia. Understanding environmental contributions is important given that we do not understand why some genetically at-risk children do not develop dyslexia. Here we investigate for the first time the relationship between HLE and the neural correlates of phonological processing in beginning readers with (FHD+, n=29) and without (FHD−, n=21) a family history of developmental dyslexia. We controlled for socio-economic status to isolate the neurobiological mechanism by which HLE affects reading development. Group differences revealed stronger correlation of HLE with brain activation in the left inferior/middle frontal and right fusiform gyri in FHD− compared to FHD+ children, suggesting greater impact of HLE on manipulation of phonological codes and recruitment of orthographic representations in typically developing children. In contrast, activation in the right precentral gyrus showed a significantly stronger correlation with HLE in FHD+ compared to FHD− children, suggesting emerging compensatory networks in genetically at-risk children. Overall, our results suggest that genetic predisposition for dyslexia alters contributions of HLE to early reading skills before formal reading instruction, which has important implications for educational practice and intervention models

Classification of students with reading comprehension difficulties: The roles of motivation, affect, and psychopathology. Learning Disability Quarterly

Abstract. Attempts to evaluate the cognitive-motivational profiles of students with reading comprehension difficulties have been scarce. The purpose of the present study was twofold: (a) to assess the discriminatory validity of cognitive, motivational, affective, and psychopathological variables for identification of students with reading difficulties, and (b) to profile students with and without reading comprehension difficulties across those variables. Participants were 87 students who scored more than 1.3 SD below the mean on a standardized reading comprehension battery and 500 typical students in grades 2 through 4. Results using linear discriminant analyses indicated that students with re a d i n g comprehension difficulties could be accurately predicted by low cognitive skills and high competitiveness. Using cluster analysis, students with significant deficits in reading comprehension were mostly assigned to a low skill/low motivation group (termed helpless) or a low skill/high motivation group (termed motivated low achievers). Based on these findings, it was concluded that motivation, emotions, and psychopathology play a pivotal role in explaining the achievement tendencies of students with reading comprehension difficulties

The Impact of Non-attempted and Dually-Attempted Items on Person Abilities Using Item Response Theory

The purpose of the present study was to relate response strategy with person ability estimates. Two behavioral strategies were examined: (a) the strategy to skip items in order to save time on timed tests, and, (b) the strategy to select two responses on an item, with the hope that one of them may be considered correct. Participants were 4,422 individuals who were administered a standardized achievement measure related to math, biology, chemistry, and physics. In the present evaluation, only the physics subscale was employed. Two analyses were conducted: (a) a person-based one to identify differences between groups and potential correlates of those differences, and, (b) a measure-based analysis in order to identify the parts of the measure that were responsible for potential group differentiation. For (a) person abilities the 2-PL model was employed and later the 3-PL and 4-PL models in order to estimate upper and lower asymptotes of person abilities. For (b) differential item functioning, differential test functioning, and differential distractor functioning were investigated. Results indicated that there were significant differences between groups with completers having the highest ability compared to both non-attempters and dual responders. There were no significant differences between no-attempters and dual responders. The present findings have implications for response strategy efficacy and measure evaluation, revision, and construction