The Use of Nonparametric Item Response Theory to Explore Data Quality

The aim of this chapter is to provide insight into a number of commonly used nonparametric item response theory (NIRT) methods and to show how these methods can be used to describe and explore the psychometric quality of questionnaires used in patient-reported outcome measurement and, more in general, typical performance measurement (personality, mood, health-related constructs). NIRT is an extremely valuable tool for preliminary data analysis and for evaluating whether item response data are acceptable for parametric IRT modeling. This is in particular useful in the field of typical performance measurement where the construct being measured is often very different than in maximum performance measurement (education, intelligence; see Chapter 1 of this handbook). Our basic premise is that there are no “best tools” or “best models” and that the usefulness of psychometric modeling depends on the specific aims of the instrument (questionnaire, test) that is being used. Most important is, however, that it should be clear for a researcher how sensitive a specific method (for example, DETECT, or Mokken scaling) is to the assumptions that are being investigated. The NIRT literature is not always clear about this, and in this chapter we try to clarify some of these ambiguities

Stress Exposure and the Course of ADHD from Childhood to Young Adulthood:Comorbid Severe Emotion Dysregulation or Mood and Anxiety Problems

BACKGROUND: Compared to typically developing individuals, individuals with attention-deficit-hyperactivity disorder (ADHD) are on average more often exposed to stressful conditions (e.g., school failure, family conflicts, financial problems). We hypothesized that high exposure to stress relates to a more persistent and complex (i.e., multi-problem) form of ADHD, while low-stress exposure relates to remitting ADHD over the course of adolescence. METHOD: Longitudinal data (ages 11, 13, 16, and 19) came from the Tracking Adolescents' Individual Life Survey (TRAILS). We selected children diagnosed with ADHD (n = 244; 167 males; 77 females) from the TRAILS clinical cohort and children who screened positive (n = 365; 250 males; 115 females) and negative (gender-matched: n = 1222; 831 males; 391 females) for ADHD from the TRAILS general population sample cohort (total n = 1587). Multivariate latent class growth analysis was applied to parent- and self-ratings of stress exposure, core ADHD problems (attention problems, hyperactivity/impulsivity), effortful control, emotion dysregulation (irritability, extreme reactivity, frustration), and internalizing problems (depression, anxiety, somatic complaints). RESULTS: Seven distinct developmental courses in stress exposure and psychopathology were discerned, of which four related to ADHD. Two persistent ADHD courses of severely affected adolescents were associated with very high curvilinear stress exposure peaking in mid-adolescence: (1) Severe combined type with ongoing, severe emotional dysregulation, and (2) combined type with a high and increasing internalization of problems and elevated irritability; two partly remitting ADHD courses had low and declining stress exposure: (3) inattentive type, and (4) moderate combined type, both mostly without comorbid problems. CONCLUSIONS: High-stress exposure between childhood and young adulthood is strongly intertwined with a persistent course of ADHD and with comorbid problems taking the form of either severe and persistent emotion dysregulation (irritability, extreme reactivity, frustration) or elevated and increasing irritability, anxiety, and depression. Conversely, low and declining stress exposure is associated with remitting ADHD and decreasing internalizing and externalizing problems. Stress exposure is likely to be a facilitating and sustaining factor in these two persistent trajectories of ADHD with comorbid problems into young adulthood. Our findings suggest that a bidirectional, continuing, cycle of stressors leads to enhanced symptoms, in turn leading to more stressors, and so forth. Consideration of stressful conditions should, therefore, be an inherent part of the diagnosis and treatment of ADHD, to potentiate prevention and interruption of adverse trajectories

Group-level symptom networks in depression

To the Editor About 8 years ago, network models entered the field of psychiatry.1 In this approach, psychiatric disorders are conceptualized as a dynamic interplay between symptoms over time, contrasting the traditional disease model of an underlying common cause. With the intention to describe how symptoms give rise to each other, the network approach would deal with processes taking place at the level of the individual.1 Nevertheless, almost all studies on networks have investigated this phenomenon at the group level

The Psychometric Properties of an Internet-Administered Version of the Depression Anxiety and Stress Scales (DASS) in a Sample of Dutch Adults

Psychometric work on the widely used Depression Anxiety and Stress Scales (DASS) has mostly used classical psychometrics and ignored common internet-administered versions. Therefore, the present study used not only classical, but also modern psychometrics based on item response theory (IRT) to evaluate an internet-administered version of the DASS (Dutch translation). Internet-administered DASS data were collected as part of a large internet-based study in the Dutch adult population (n = 7972). Initially, external correlates (i.e. demographics other measures) and some classical psychometrics (internal consistency, convergent/divergent validity) of the DASS scales were evaluated. Next, IRT was used to investigate the scales' dimensionality, discrimination and item-functioning. Finally, the DASS depression scale was further investigated by linking it to the more clinically-oriented Quick Inventory of Depressive Symptomatology (QIDS) using item response theory (IRT). Initial classical psychometric analyses supported the scales' internal consistency (alpha = 0.94-0.98) and convergent/divergent validity. IRT analyses showed that each of the DASS scales was only suitable to measure variations in a very narrow and rather mild severity range. Linking the DASS depression scale with the QIDS also showed that the DASS depression scale discriminated best in the mild-moderate severity range, but not at higher severity levels that were covered by the QIDS. In conclusion, the scales of the internet-administered DASS show good internal consistency and validity. However, users should be aware that the scales discriminate best at mild-moderate severity ranges in the general population

Person-fit feedback on inconsistent symptom reports in clinical depression care

BACKGROUND: Depressive patients can present with complex and different symptom patterns in clinical care. Of these, some may report patterns that are inconsistent with typical patterns of depressive symptoms. This study aimed to evaluate the validity of person-fit statistics to identify inconsistent symptom reports and to assess the clinical usefulness of providing clinicians with person-fit score feedback during depression assessment. METHODS: Inconsistent symptom reports on the Inventory of Depressive Symptomatology Self-Report (IDS-SR) were investigated quantitatively with person-fit statistics for both intake and follow-up measurements in the Groningen University Center of Psychiatry (n = 2036). Subsequently, to investigate the causes and clinical usefulness of on-the-fly person-fit alerts, qualitative follow-up assessments were conducted with three psychiatrists about 20 of their patients that were randomly selected. RESULTS: Inconsistent symptom reports at intake (12.3%) were predominantly characterized by reporting of severe symptoms (e.g. psychomotor slowing) without mild symptoms (e.g. irritability). Person-fit scores at intake and follow-up were positively correlated (r = 0.45). Qualitative interviews with psychiatrists resulted in an explanation for the inconsistent response behavior (e.g. complex comorbidity, somatic complaints, and neurological abnormalities) for 19 of 20 patients. Psychiatrists indicated that if provided directly after the assessment, a person-fit alert would have led to new insights in 60%, and be reason for discussion with the patient in 75% of the cases. CONCLUSIONS: Providing clinicians with automated feedback when inconsistent symptom reports occur is informative and can be used to support clinical decision-making

Differential reporting of depressive symptoms across distinct clinical subpopulations:What DIFference does it make?

OBJECTIVE: To investigate the impact of differences in depressive symptom reporting across clinical groups (healthcare setting, chronic illness, depression diagnosis and anxiety diagnosis) on clinical interpretability and comparability of depression scores. METHODS: Participants from the Netherlands Study of Depression and Anxiety (n=2981) completed the self-report Inventory of Depressive Symptomatology (IDS-SR). Differences in depressive symptom reporting between distinct clinical subpopulations were assessed using a Differential Item Functioning (DIF) analysis. The effects of DIF on symptom level were evaluated by examining whether DIF-adjustment had clinically relevant effects. RESULTS: Significant DIF was detected across all tested clinical subpopulation groupings. Clinically relevant DIF was found on the symptom level for 13 IDS-SR items. However, impact of DIF on the aggregate level ranged from small to negligible: adjustment for DIF only led to salient changes in aggregate scores for 0.2-12.7% of individuals across tested sources of DIF. CONCLUSION: Differences in endorsement patterns of depressive symptoms were observed across clinical populations, challenging the assumptions regarding the measurement properties of self-reported depression. However, effects of DIF on the aggregate level of IDS-SR total scores were found to be minimal and not clinically important. The IDS-SR thus seems robust against DIF across clinical populations

Using a hybrid subtyping model to capture patterns and dimensionality of depressive and anxiety symptomatology in the general population

Background: Researchers have tried to identify more homogeneous subtypes of major depressive disorder (MDD) with latent class analyses (LCA). However, this approach does no justice to the dimensional nature of psychopathology. In addition, anxiety and functioning-levels have seldom been integrated in subtyping efforts. Therefore, this study used a hybrid discrete-dimensional approach to identify subgroups with shared patterns of depressive and anxiety symptomatology, while accounting for functioning-levels. Methods: The Comprehensive International Diagnostic Interview (CIDI) 1.1 was used to assess previous-year depressive and anxiety symptoms in the Netherlands Mental Health Survey and Incidence Study-1 (NEMESIS 1; n=5583). The data were analyzed with factor analyses, LCA and hybrid mixed-measurement item response theory (MM-IRT) with and without functioning covariates. Finally, the classes' predictors (measured one year earlier) and outcomes (measured two years later) were investigated. Results: A 3-class MM-IRT model with functioning covariates best described the data and consisted of a 'healthy class' (74.2%) and two symptomatic classes ('sleep/energy' [13.4%]; 'mood/anhedonia' [12.4%]). Factors including older age, urbanicity, higher severity and presence of 1-year MDD predicted membership of either symptomatic class vs. the healthy class. Both symptomatic classes showed poorer 2-year outcomes (i.e. disorders, poor functioning) than the healthy class. The odds of MDD after two years were especially increased in the mood/anhedonia class. Limitations: Symptoms were assessed for the past year whereas current functioning was assessed. Conclusions: Heterogeneity of depression and anxiety symptomatology are optimally captured by a hybrid discrete-dimensional subtyping model. Importantly, accounting for functioning-levels helps to capture clinically relevant interpersonal differences

Stress Exposure and the Course of ADHD from Childhood to Young Adulthood: Comorbid Severe Emotion Dysregulation or Mood and Anxiety Problems

BACKGROUND: Compared to typically developing individuals, individuals with attention-deficit-hyperactivity disorder (ADHD) are on average more often exposed to stressful conditions (e.g., school failure, family conflicts, financial problems). We hypothesized that high exposure to stress relates to a more persistent and complex (i.e., multi-problem) form of ADHD, while low-stress exposure relates to remitting ADHD over the course of adolescence. METHOD: Longitudinal data (ages 11, 13, 16, and 19) came from the Tracking Adolescents' Individual Life Survey (TRAILS). We selected children diagnosed with ADHD (n = 244; 167 males; 77 females) from the TRAILS clinical cohort and children who screened positive (n = 365; 250 males; 115 females) and negative (gender-matched: n = 1222; 831 males; 391 females) for ADHD from the TRAILS general population sample cohort (total n = 1587). Multivariate latent class growth analysis was applied to parent- and self-ratings of stress exposure, core ADHD problems (attention problems, hyperactivity/impulsivity), effortful control, emotion dysregulation (irritability, extreme reactivity, frustration), and internalizing problems (depression, anxiety, somatic complaints). RESULTS: Seven distinct developmental courses in stress exposure and psychopathology were discerned, of which four related to ADHD. Two persistent ADHD courses of severely affected adolescents were associated with very high curvilinear stress exposure peaking in mid-adolescence: (1) Severe combined type with ongoing, severe emotional dysregulation, and (2) combined type with a high and increasing internalization of problems and elevated irritability; two partly remitting ADHD courses had low and declining stress exposure: (3) inattentive type, and (4) moderate combined type, both mostly without comorbid problems. CONCLUSIONS: High-stress exposure between childhood and young adulthood is strongly intertwined with a persistent course of ADHD and with comorbid problems taking the form of either severe and persistent emotion dysregulation (irritability, extreme reactivity, frustration) or elevated and increasing irritability, anxiety, and depression. Conversely, low and declining stress exposure is associated with remitting ADHD and decreasing internalizing and externalizing problems. Stress exposure is likely to be a facilitating and sustaining factor in these two persistent trajectories of ADHD with comorbid problems into young adulthood. Our findings suggest that a bidirectional, continuing, cycle of stressors leads to enhanced symptoms, in turn leading to more stressors, and so forth. Consideration of stressful conditions should, therefore, be an inherent part of the diagnosis and treatment of ADHD, to potentiate prevention and interruption of adverse trajectories