Support for the higher-order factor structure of the WHODAS 2.0 self-report version in a Dutch outpatient psychiatric setting

PURPOSE: Previous studies of the World Health Organization Disability Assessment Schedule 2.0 (WHODAS 2.0) interview version suggested a second-order model, with a general disability factor and six factors on a lower level. The goal of this study is to investigate if we can find support for a similar higher-order factor structure of the 36-item self-report version of the WHODAS 2.0 in a Dutch psychiatric outpatient sample. We aim to give special attention to the differences between the non-working group sample and the working group sample. Additionally, we intend to provide preliminary norms for clinical interpretation of the WHODAS 2.0 scores in psychiatric settings. METHODS: Patients seeking specialized ambulatory treatment, primarily for depressive or anxiety symptoms, completed the WHODAS 2.0 as part of the initial interview. The total sample consisted of 770 patients with a mean age of 37.5 years (SD = 13.3) of whom 280 were males and 490 were females. Several factorial compositions (i.e., one unidimensional model and two second-order models) were modeled using confirmatory factor analysis (CFA). Descriptive statistics, model-fit statistics, reliability of the (sub)scales, and preliminary norms for interpreting test scores are reported. RESULTS: For the non-working group, the second-order model with a general disability factor and six factors on a lower level, provided an adequate fit. Whereas, for the working group, the second-order model with a general disability factor and seven factors on a lower level seemed more appropriate. The WHODAS 2.0 36-item self-report form showed adequate levels of reliability. Percentile ranks and normalized T-scores are provided to aid clinical evaluations. CONCLUSION: Our results lend support for a factorial structure of the WHODAS 2.0 36-item self-report version that is comparable to the interview version. While we conjecture that a seven-factor solution might give a better reflection of item content and item variance, further research is needed to assess the clinical relevance of such a model. At this point, we recommend using the second-order structure with six factors that matches past findings of the interview form

Pain, fatigue, depressive symptoms and sleep disturbance in young adults with cerebral palsy

Purpose: Investigate pain, fatigue, depressive symptoms and sleep disturbance in young adults with cerebral palsy compared to references. Materials and methods: Young adults with cerebral palsy (n = 97, aged 21-34 years) and age-matched references from the general population (n = 190) rated pain using a numeric rating scale and fatigue, depressive symptoms, sleep disturbance and global health using Patient-Reported Outcomes Measurement Information System (R) short forms. Scores were compared between cerebral palsy subgroups and the reference population. Correlation coefficients and linear regression analyses assessed interrelationships of health issues and associations with global health. Results: Individuals with Gross Motor Function Classification System level I had less pain, fatigue and depressive symptoms, while individuals with levels II and III-V had more pain (53% and 56%, p <0.001) and those with levels III-V more fatigue (39%, p = 0.035) than references (pain: 26%, fatigue: 14%). Pain and fatigue were more interrelated (correlation coefficients: 0.71 vs. 0.41) and stronger associated with global mental health in individuals with cerebral palsy. Conclusions: Young adults with Gross Motor Function Classification System levels II-V report more pain and those with levels III-V report more fatigue than references. Pain and fatigue are highly interrelated and specifically relate to mental health in individuals with cerebral palsy

Pain, fatigue, depressive symptoms and sleep disturbance in young adults with cerebral palsy

Purpose: Investigate pain, fatigue, depressive symptoms and sleep disturbance in young adults with cerebral palsy compared to references. Materials and methods: Young adults with cerebral palsy (n = 97, aged 21–34 years) and age-matched references from the general population (n = 190) rated pain using a numeric rating scale and fatigue, depressive symptoms, sleep disturbance and global health using Patient-Reported Outcomes Measurement Information System® short forms. Scores were compared between cerebral palsy subgroups and the reference population. Correlation coefficients and linear regression analyses assessed interrelationships of health issues and associations with global health. Results: Individuals with Gross Motor Function Classification System level I had less pain, fatigue and depressive symptoms, while individuals with levels II and III–V had more pain (53% and 56%, p < 0.001) and those with levels III–V more fatigue (39%, p = 0.035) than references (pain: 26%, fatigue: 14%). Pain and fatigue were more interrelated (correlation coefficients: 0.71 vs. 0.41) and stronger associated with global mental health in individuals with cerebral palsy. Conclusions: Young adults with Gross Motor Function Classification System levels II–V report more pain and those with levels III–V report more fatigue than references. Pain and fatigue are highly interrelated and specifically relate to mental health in individuals with cerebral palsy.Implications for rehabilitation Except for those in the highest level of motor function, young adults with cerebral palsy report higher levels of pain and fatigue compared to the general population of the same age. Pain and fatigue are strongly interrelated and associated with mental health in young adults with cerebral palsy. The present study recommends to monitor pain and fatigue in young adults with cerebral palsy with low levels of gross motor function. We advise rehabilitation professionals to consider combined treatment for both pain and fatigue

Practical Significance of Longitudinal Measurement Invariance Violations in the Dutch–Flemish PROMIS Item Banks for Depression and Anxiety: An Illustration With Ordered-Categorical Data

We investigated longitudinal measurement invariance in the Dutch–Flemish PROMIS adult v1.0 item banks for Depression and Anxiety using two clinical samples with mood and anxiety disorders (n = 640 and n = 528, respectively). Factor analysis was used to evaluate whether the item banks were sufficiently unidimensional at two test-occasions and whether the measured constructs remained the same over time. The results indicated that the item banks were sufficiently unidimensional, but the thresholds and residual variances of the constructs changed over time. However, using tentative rules of thumb, these invariance violations did not substantially affect the endorsement of a specific response category of a specific item at a specific test-occasion. Furthermore, the impact on the mean latent change scores of the item banks remained below the proposed cutoff value for substantial bias. These findings suggest that the invariance violations lacked practical significance for test-users, meaning that the item banks provide sufficiently invariant latent factor scores for use in clinical practice

Towards standardization of measuring anxiety and depression: Differential item functioning for language and Dutch reference values of PROMIS item banks

INTRODUCTION: The outcomes anxiety and depression are measured frequently by healthcare providers to assess the impact of a disease, but with numerous instruments. PROMIS item banks provide an opportunity for standardized measurement. Cross-cultural validity of measures and the availability of reference values are prerequisites for standardized measurement. METHODS: PROMIS Anxiety and Depression item banks were completed by 1002 representative Dutch persons. To evaluate cross-cultural validity, data from US participants in PROMIS wave 1 were used and differential item functioning (DIF) was investigated, using an iterative hybrid of logistic regression and item response theory. McFadden's pseudo R2-change of 2% was the critical threshold. The impact of any DIF on full item banks and short forms was investigated. To obtain Dutch reference values, T-scores for anxiety and depression were calculated for the complete Dutch sample, and age-group and gender subpopulations. Thresholds corresponding to normal limits, mild, moderate and severe symptoms were computed. RESULTS: In both item banks, two items had DIF but with minimal impact on population level T-scores for full item banks and short forms. The Dutch general population had a T-score of 49.9 for anxiety and 49.6 for depression, similar to the T-scores of 50.0 of the US general population. T-scores for age-group and gender subpopulations were also similar to T-scores of the US general population. Thresholds for mild, moderate and severe anxiety and depression were set to 55, 60 and 70, identical to US thresholds. CONCLUSIONS: The limited number of items with DIF and its minimal impact, enables the use of standard (US) item parameters and comparisons of scores between Dutch and US populations. The Dutch reference values provide an important tool for healthcare professionals and researchers to evaluate and interpret symptoms of anxiety and depression, stimulating the uptake of PROMIS measures, and contributing to standardized outcome measurement

Development of a Computerized Adaptive Test for Anxiety Based on the Dutch-Flemish Version of the PROMIS Item Bank

We used the Dutch-Flemish version of the USA PROMIS adult V1.0 item bank for Anxiety as input for developing a computerized adaptive test (CAT) to measure the entire latent anxiety continuum. First, psychometric analysis of a combined clinical and general population sample ( N = 2,010) showed that the 29-item bank has psychometric properties that are required for a CAT administration. Second, a post hoc CAT simulation showed efficient and highly precise measurement, with an average number of 8.64 items for the clinical sample, and 9.48 items for the general population sample. Furthermore, the accuracy of our CAT version was highly similar to that of the full item bank administration, both in final score estimates and in distinguishing clinical subjects from persons without a mental health disorder. We discuss the future directions and limitations of CAT development with the Dutch-Flemish version of the PROMIS Anxiety item bank

Construct validity, responsiveness, and utility of change indicators of the Dutch-Flemish PROMIS item banks for depression and anxiety administered as computerized adaptive test (CAT): A comparison with the Brief Symptom Inventory (BSI)

We evaluated construct validity, responsiveness, and utility of change indicators of the Dutch-Flemish PROMIS adult v1.0 item banks for Depression and Anxiety administered as computerized adaptive test (CAT). Specifically, the CATs were compared to the Brief Symptom Inventory (BSI) using pre- and re-test data of adult patients treated for common mental disorders (N = 400; median pre-to-re-test interval = 215 days). Construct validity was evaluated with Pearson’s correlations and Cohen’s ds; responsiveness with Pearson’s correlations and pre-post effect sizes (ES); utility of change indicators with kappa coefficients and percentages of (dis)agreement. The results showed that the PROMIS CATs measure similar constructs as matching BSI scales. Under the assumption of measuring similar constructs, the CAT and BSI Depression scales were similarly responsive. For the Anxiety scales, we found a higher responsiveness for CAT (ES = 0.64) compared to the BSI (ES = 0.50). Finally, both CATs categorized the change scores of more patients as changed compared to matching BSI scales, indicating that the PROMIS CATs may be more able to detect actual change than the BSI. Based on these findings, the PROMIS CATs may be considered a modest improvement over matching BSI scales as tools for reviewing treatment progress with patients. We discuss several additional differences between the PROMIS CATs and the BSI to help test users choose instruments. These differences include the adopted measurement theory (Item Response Theory vs. Classical Test Theory), the mode of administration (CAT vs. fixed items), and the area of application (universal vs. predominantly clinical)

Application of the Patient-Reported Outcomes Measurement Information System (PROMIS) item parameters for Anxiety and Depression in the Netherlands

Objectives The Patient-Reported Outcomes Measurement Information System (PROMIS) Health Organization has compiled and calibrated item banks for various domains in the United States, and these item banks have been translated into Dutch language. MethodsResultsThe item banks for Anxiety and Depression have been administered in two samples, one drawn from the Dutch general and one drawn from the Dutch clinical population. The aim of this study was to investigate the appropriateness of the official PROMIS item parameters for these item banks that have been estimated based on data collected in the United States for use in the Netherlands. For both domains, we determined the fit of U.S. item parameters, the effect on individual domain scores and levels, the effect on correlations with full item bank totals, and the effect on classification accuracies of adaptive test scores for diagnoses of anxiety and mood disorders. The results showed that especially in the clinical population sample, fit appeared to be problematic for many items. However, simulations revealed that both sets of item parameters (official PROMIS vs. unique Dutch) perform nearly equally well in practice. ConclusionWe tentatively conclude that the official PROMIS item parameters can be used for scaling respondents in the Netherlands

Differential item functioning of the PROMIS physical function, pain interference, and pain behavior item banks across patients with different musculoskeletal disorders and persons from the general population

Purpose: To investigate the validity of comparisons across patients with different musculoskeletal disorders and persons from the general population by evaluating differential item functioning (DIF) for the PROMIS physical function (PROMIS-PF), pain interference (PROMIS-PI), and pain behavior (PROMIS-PB) item banks. Methods: Patients with chronic pain, rheumatoid arthritis (RA), or osteoarthritis (OA); patients receiving physiotherapy (PT); and persons from the Dutch general population completed the full Dutch-Flemish PROMIS-PF (121-items), PROMIS-PI (40-items), or PROMIS-PB (39-items) banks. DIF was assessed with ordinal logistic regression models and McFadden’s pseudo R 2 -change of ≥ 2% as critical value. The impact of DIF on item scores and the T-scores per bank was examined by inspecting item characteristic curves (ICCs) and test characteristic curves (TCCs). Results: 2762 patients with chronic pain, 2029 with RA, 1247 with OA, 805 receiving PT, and 1310 healthy persons participated. For the PROMIS-PF, 25 out of 121 items were flagged for DIF, of which 10 items were flagged in multiple comparisons. For the PROMIS-PI, only 2 out of 40 items were flagged for DIF and for the PROMIS-PB, only 3 out of 39 items. Most DIF items had R 2 values just above the critical value of 2% and all showed uniform DIF. The ICCs and TCCs showed that the magnitude and impact of DIF on the item and T-scores were negligible. Conclusions: This study supports the universal applicability of PROMIS across (patient) populations. Comparisons across patients with different musculoskeletal disorders and persons from the general population are valid, when applying the PROMIS-PF, PROMIS-PI, and PROMIS-PB banks

Pain, fatigue, depressive symptoms and sleep disturbance in young adults with cerebral palsy

Purpose: Investigate pain, fatigue, depressive symptoms and sleep disturbance in young adults with cerebral palsy compared to references. Materials and methods: Young adults with cerebral palsy (n = 97, aged 21–34 years) and age-matched references from the general population (n = 190) rated pain using a numeric rating scale and fatigue, depressive symptoms, sleep disturbance and global health using Patient-Reported Outcomes Measurement Information System® short forms. Scores were compared between cerebral palsy subgroups and the reference population. Correlation coefficients and linear regression analyses assessed interrelationships of health issues and associations with global health. Results: Individuals with Gross Motor Function Classification System level I had less pain, fatigue and depressive symptoms, while individuals with levels II and III–V had more pain (53% and 56%, p < 0.001) and those with levels III–V more fatigue (39%, p = 0.035) than references (pain: 26%, fatigue: 14%). Pain and fatigue were more interrelated (correlation coefficients: 0.71 vs. 0.41) and stronger associated with global mental health in individuals with cerebral palsy. Conclusions: Young adults with Gross Motor Function Classification System levels II–V report more pain and those with levels III–V report more fatigue than references. Pain and fatigue are highly interrelated and specifically relate to mental health in individuals with cerebral palsy.Implications for rehabilitation Except for those in the highest level of motor function, young adults with cerebral palsy report higher levels of pain and fatigue compared to the general population of the same age. Pain and fatigue are strongly interrelated and associated with mental health in young adults with cerebral palsy. The present study recommends to monitor pain and fatigue in young adults with cerebral palsy with low levels of gross motor function. We advise rehabilitation professionals to consider combined treatment for both pain and fatigue