Cross-National Measurement Invariance of the Teacher and Classmate Support Scale

The cross-national measurement invariance of the teacher and classmate support scale was assessed in a study of 23202 Grade 8 and 10 students from Austria, Canada, England, Lithuania, Norway, Poland, and Slovenia, participating in the Health Behaviour in School-aged Children (HBSC) 2001/2002 study. A multi-group means and covariance analysis supported configural and metric invariance across countries, but not full scalar equivalence. The composite reliability was adequate and highly consistent across countries. In all seven countries, teacher support showed stronger associations with school satisfaction than did classmate support, with the results being highly consistent across countries. The results indicate that the teacher and classmate support scale may be used in cross-cultural studies that focus on relationships between teacher and classmate support and other constructs. However, the lack of scalar equivalence indicates that direct comparison of the levels support across countries might not be warranted

An accurate and efficient identification of children with psychosocial problems by means of computerized adaptive testing

Background: Questionnaires used by health services to identify children with psychosocial problems are often rather short. The psychometric properties of such short questionnaires are mostly less than needed for an accurate distinction between children with and without problems. We aimed to assess whether a short Computerized Adaptive Test (CAT) can overcome the weaknesses of short written questionnaires when identifying children with psychosocial problems. Method: We used a Dutch national data set obtained from parents of children invited for a routine health examination by Preventive Child Healthcare with 205 items on behavioral and emotional problems (n = 2,041, response 84%). In a random subsample we determined which items met the requirements of an Item Response Theory (IRT) model to a sufficient degree. Using those items, item parameters necessary for a CAT were calculated and a cut-off point was defined. In the remaining subsample we determined the validity and efficiency of a Computerized Adaptive Test using simulation techniques, with current treatment status and a clinical score on the Total Problem Scale (TPS) of the Child Behavior Checklist as criteria. Results: Out of 205 items available 190 sufficiently met the criteria of the underlying IRT model. For 90% of the children a score above or below cut-off point could be determined with 95% accuracy. The mean number of items needed to achieve this was 12. Sensitivity and specificity with the TPS as a criterion were 0.89 and 0.91, respectively. Conclusion: An IRT-based CAT is a very promising option for the identification of psychosocial problems in children, as it can lead to an efficient, yet high-quality identification. The results of our simulation study need to be replicated in a real-life administration of this CAT