Article thumbnail

Applying Bayesian Modeling and Receiver Operating Characteristic Methodologies for Test Utility Analysis

By Qiu Wang, Matthew A. Diemer and Kimberly S. Maier

Abstract

This study integrated Bayesian hierarchical modeling and receiver operating charac-teristic analysis (BROCA) to evaluate how interest strength (IS) and interest differen-tiation (ID) predicted low–socioeconomic status (SES) youth’s interest-major congruence (IMC). Using large-scale Kuder Career Search online-assessment data, this study fit three models, the one-level BROCA, the two-level BROCA, and the ordinal Probit BROCA, to examine the moderating effects of gender and race/ethni-city. Both IS and ID displayed race/ethnicity differences in predicting low-SES females’ IMC. Gender difference was found only on IS in predicting low-SES youth’s IMC. Results suggested that low-SES White males and low-SES minority females may need help the most to develop stronger career interests and to differentiate their inter-ests. This study illustrated that BROCA can be a powerful tool for test evaluation and utility analysis in the field because of its capacity of analyzing continuous, nominal, and ordinal data; its graphical nature of result presentation; multiple statistical test options; and its little requirement of Level 2 sample sizes

Topics: classification analysis, utility analysis
Year: 2016
OAI identifier: oai:CiteSeerX.psu:10.1.1.828.579
Provided by: CiteSeerX
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • http://epm.sagepub.com/content... (external link)
  • http://epm.sagepub.com/content... (external link)
  • http://epm.sagepub.com/content... (external link)
  • http://epm.sagepub.com/content... (external link)
  • http://citeseerx.ist.psu.edu/v... (external link)
  • http://citeseerx.ist.psu.edu/v... (external link)
  • Suggested articles


    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.