A Comparison of Adjacent Categories and Cumulative DSF Effect Estimators

The study of measurement invariance in polytomous items that targets individual score levels is known as differential step functioning (DSF; Penfield, 2007, 2008). DSF methods provide specific information describing the manifestation of the invariance effect within particular score levels and therefore serve a diagnostic role in identifying the individual score levels involved in the item\u27s invariance effect. The analysis of DSF requires the creation of a set of dichotomizations of the item response variable. There are two primary approaches for creating the set of dichotomizations to conduct a DSF analysis. The first approach, known as the adjacent categories approach, is consistent with the dichotomization scheme underlying the generalized partial credit model (GPCM; Muraki, 1992) and considers each pair of adjacent score levels while treating the other score levels as missing. The second approach, known as the cumulative approach, is consistent with the dichotomization scheme underlying the graded response model (GRM; Samejima, 1997) and includes data from every score level in each dichotomization. To date, there is limited research on how the cumulative and adjacent categories approaches compare within the context of DSF, particularly as applied to a real data set. The understanding of how the interpretation and practical outcomes may vary given these two approaches is also limited. The current study addressed these two issues. This study evaluated the results of a DSF analysis using both the adjacent categories and cumulative dichotomization schemes in order to determine if the two approaches yield similar results and interpretations of DSF. These approaches were applied to data from a polytomously scored alternate assessment administered to children with significant cognitive disabilities. The results of the DSF analyses revealed that the two approaches generally led to consistent results, particularly in the case where DSF effects were negligible. For steps where significant DSF was present, the two approaches generally guide analysts to the same location of the item. However, several aspects of the results rose questions about the use of the adjacent categories dichotomization scheme. First, there seemed to be a lack of independence of the adjacent categories method since large DSF effects at one step are often paired with large DSF effects in the opposite direction found in the previous step. Additionally, when a substantial DSF effect existed, it was more likely to be significant using the cumulative approach over the adjacent categories approach. This is likely due to the smaller standard errors that lead to greater stability of the cumulative approach. In sum, the results indicate that the cumulative approach is preferable over the adjacent categories approach when conducting a DSF analysis

A Comparison of Adjacent Categories and Cumulative Differential Step Functioning Effect Estimators

The study of measurement invariance in polytomous items that targets individual score levels is known as differential step functioning (DSF). The analysis of DSF requires the creation of a set of dichotomizations of the item response variable. There are two primary approaches for creating the set of dichotomizations to conduct a DSF analysis: the adjacent categories approach, and the cumulative approach. To date, there is limited research on how these two approaches compare within the context of DSF, particularly as applied to a real data set. This study evaluated the results of a DSF analysis using both dichotomization schemes in order to determine if the two approaches yield similar results. The results revealed that the two approaches generally led to consistent results, particularly in the case where DSF effects were negligible. However, when significant DSF effects were present, the two approaches occasionally led to differing conclusions

Impact of Living Arrangements of LGBTQ College Students During COVID-19

This study examines the relationships between living arrangements and educational outcomes, access to LGBTQ-affirming care, sexual and gender minority (SGM) stressors, and mental health. Bivariate analyses were implemented to examine relationships between living arrangements and academic outcomes, SGM stressors, access to care, and alcohol and substance use. Differences between undergraduate and graduate students are reported. Students who continued living on campus were less likely to report increased family rejection, transphobia, and identity concealment

Evaluation of the Battelle Developmental Inventory, 2nd Edition, Screening Test for Use in States’ Child Outcomes Measurement Systems Under the Individuals With Disabilities Education Act

This study evaluated the Battelle Developmental Inventory, 2nd Edition, Screening Test (BDI-2 ST) for use in states’ child outcomes accountability systems under the Individuals with Disabilities Education Act. Complete Battelle Developmental Inventory, 2nd Edition (BDI-2), assessment data were obtained for 142 children, ages 2 to 62 months, who had been referred for eligibility evaluation for early intervention or preschool special education services. Results of a Rasch measurement analysis provided evidence supporting the reliability and validity of the five domain scores and total BDI-2 ST score. A comparison of children’s classifications as either having or not having a developmental delay based on the BDI-2 ST and the BDI-2 full assessment—using cut scores of 1.0, 1.5, and 2.0 standard deviations below the mean—indicated acceptable sensitivity, specificity, and overall classification accuracy of the BDI-2 ST. Implications of the findings are discussed for accountability reporting and clinical practice

Hispanic Parental Experiences of Learning a Child Identifies as a Sexual Minority

Sexual minority youth (SMY) who do not feel loved and supported by their families face greater challenges and often experience various health disparities. The coming out process is often difficult for all SMY and their families. Although there is limited research on the impact of sexual orientation disclosure on families, there is even less that focuses exclusively on Hispanic families. This qualitative study explores the impact on a sample of Hispanic parents of having a child come out as lesbian, gay, or bisexual. The results demonstrate that although coming out is often challenging for SMY and their families, these challenges may be exacerbated for Hispanics due to cultural factors that contribute to children living at home longer and negative reactions to being gay. Parental reactions, impacts of disclosure on the family, and the impact of cultural factors are discussed. This study helps illuminate how cultural factors influence the coming out experience of Hispanic parents. These findings are important for understanding the experiences of these families to provide culturally appropriate resources for families navigating the coming out process

An NCME Instructional Module on Using Differential Step Functioning to Refine the Analysis of DIF in Polytomous Items

Traditional methods for examining differential item functioning (DIF) in polytomously scored test items yield a single item‐level index of DIF and thus provide no information concerning which score levels are implicated in the DIF effect. To address this limitation of DIF methodology, the framework of differential step functioning (DSF) has recently been proposed, whereby measurement invariance is examined within each step underlying the polytomous response variable. The examination of DSF can provide valuable information concerning the nature of the DIF effect (i.e., is the DIF an item‐level effect or an effect isolated to specific score levels), the location of the DIF effect (i.e., precisely which score levels are manifesting the DIF effect), and the potential causes of a DIF effect (i.e., what properties of the item stem or task are potentially biasing). This article presents a didactic overview of the DSF framework and provides specific guidance and recommendations on how DSF can be used to enhance the examination of DIF in polytomous items. An example with real testing data is presented to illustrate the comprehensive information provided by a DSF analysis

Examining Difference in Immigration Stress, Acculturation Stress and Mental Health Outcomes in Six Hispanic/Latino Nativity and Regional Groups

Little is known about the specific behavioral health impact of acculturation stressors that affect Hispanic/Latino immigrant sub-groups. These immigration-related stressors and traumatic events may have differential impact on depression depending on country/region of origin. Using a measure of immigration and acculturation stress, the current study sought to determine differences in the impact of stress on six sub-groups of Hispanic immigrants. Data on stress and depression were examined using a large, representative adult immigrant sample (N = 641). Controlling for age, gender and years in the US, factorial analysis of covariance revealed significant differences on total Hispanic Stress Inventory 2 (HSI2) stress appraisal scores based on country/region of origin. Pair wise comparisons between country/region of origin groups revealed that Mexicans had higher levels of stress compared to Cuban or Dominican immigrants. Several patterns of differential stress were also found within sub-domains of the HSI2. Using regression models, HSI2 stress appraisals and their interaction with country of origin proved to not be significant predictors of depression (PHQ9), while gender and age were significant. Differences in HSI2 stress that are based on nativity may be moderated by cultural resilience that ultimately serves a protective role to prevent the onset of depression

Modeling Item-Level and Step-Level Invariance Effects in Polytomous Items Using the Partial Credit Model

Measurement invariance is a common consideration in the evaluation of the validity and fairness of test scores when the tested population contains distinct groups of examinees, such as examinees receiving different forms of a translated test. Measurement invariance in polytomous items has traditionally been evaluated at the item-level, corresponding to what is broadly referred to as differential item functioning. However, recent advances in the study of measurement invariance in polytomous items has documented the value in examining invariance at the level of each step of the polytomous item, referred to as differential step functioning. To date, little documentation exists of methodology that can simultaneously evaluate both item-level and step-level invariance effects using a common parametric model. In this article, we describe how to use the partial credit model to simultaneously evaluate item-level and step-level invariance effects. A simulation study as well as a large empirical example are presented to demonstrate the use of this methodology applied to a large-scale administration of a translated test

Reducing the risk of unintended retained surgical sponges: A quality improvement project

•Unintended retained surgical sponges are detrimental never-events.•Application of education and technology augments the surgical count process.•Use of combined evidence-based strategies prevent unintended retained surgical sponges . Unintended retained surgical sponges (URSSs) are preventable catastrophic events that occur in the surgical environment. A community hospital in the southern United States sought to reduce the occurrence of URSSs by implementing a quality improvement initiative. We conducted a practice improvement project that incorporated safety-sponge technology preceded by education and training. Staff knowledge and practice expectations were assessed using a pre-post-intervention survey followed by internal audit. Staff knowledge significantly improved after the tailored education and training. A chart audit conducted 15 weeks after the intervention showed compliance with the technology was 99.4%, incorrect surgical counts went from 4% to 0.8%, and number of URSSs went from 2 to 0. The project demonstrated a reduced risk of incorrect surgical counts and URSSs in the facility