Toward a Dimensional Assessment of Externalizing Disorders in Children: Reliability and Validity of a Semi-Structured Parent Interview

Objective This study assesses the reliability and validity of the DSM-5-based, semi-structured Clinical Parent Interview for Externalizing Disorders in Children and Adolescents (ILF-EXTERNAL). Method Participant data were drawn from the ongoing ESCAschool intervention study. The ILF-EXTERNAL was evaluated in a clinical sample of 474 children and adolescents (aged 6-12 years, 92 females) with symptoms of attention-deficit/hyperactivity disorder (ADHD). To obtain interrater reliability, the one-way random-effects, absolute agreement models of the intraclass correlation (ICC) for single ICC(1,1) and average measurements ICC(1,3) were computed between the interviewers and two independent raters for 45 randomly selected interviews involving ten interviewers. Overall agreement on DSM-5 diagnoses was assessed using Fleiss' kappa. Further analyses evaluated internal consistencies, item-total correlations as well as correlations between symptom severity and the degree of functional impairment. Additionally, parents completed the German version of the Child Behavior Checklist (CBCL) and two DSM-5-based parent questionnaires for the assessment of ADHD symptoms and symptoms of disruptive behavior disorders (FBB-ADHS; FBB-SSV), which were used to evaluate convergent and divergent validity. Results ICC coefficients demonstrated very good to excellent interrater reliability on the item and scale level of the ILF-EXTERNAL [scale level: ICC(1,1) = 0.83-0.95; ICC(1,3) = 0.94-0.98]. Overall kappa agreement on DSM-5 diagnoses was substantial to almost perfect for most disorders (0.38 ≤ κ ≤ 0.94). With some exceptions, internal consistencies (0.60 ≤ α ≤ 0.86) and item-total correlations (0.21 ≤ r$_{it}$ ≤ 0.71) were generally satisfactory to good. Furthermore, higher symptom severity was associated with a higher degree of functional impairment. The evaluation of convergent validity revealed positive results regarding clinical judgment and parent ratings (FBB-ADHS; FBB-SSV). Correlations between the ILF-EXTERNAL scales and the CBCL Externalizing Problems were moderate to high. Finally, the ILF-EXTERNAL scales were significantly more strongly associated with the CBCL Externalizing Problems than with the Internalizing Problems, indicating divergent validity. Conclusion In clinically referred, school-age children, the ILF-EXTERNAL demonstrates sound psychometric properties. The ILF-EXTERNAL is a promising clinical interview and contributes to high-quality diagnostics of externalizing disorders in children and adolescents

Progress feedback in children and adolescents with internalizing and externalizing symptoms in routine care (OPTIE study): study protocol of a randomized parallel-group trial

Background: Progress feedback provides therapists with progress notes on a regular basis through the continuous assessment of participants throughout their treatment (e.g., symptoms, therapeutic alliance). While for adults the evidence base has increased over the years, progress feedback in the therapy of children and adolescents has not been sufficiently investigated. This manuscript describes the trial protocol of the OPTIE study: a randomized trial that tests the efficacy of a progress feedback system in children and adolescents under conditions of routine care. Methods: The study is based on a randomized parallel-group trial with two treatment groups (routine, feedback) at an outpatient unit of a university hospital. The target sample size is 439 families consisting of children and adolescents aged 6 to17 years old with internalizing and/or externalizing symptoms. Both the patients and the therapists are independently assigned to the treatment groups by stratified block randomization. In both treatment groups patients receive routine care behavioral therapy for a study-related 12 months; additionally, in the feedback group, a progress feedback system with three components is applied (monitoring, report, and supervision). For three informants (caregiver, child [>= 11 years], therapist) surveys are conducted every 6 weeks (e.g., symptoms, goals, motivation). For both treatment groups, comparison data is collected at baseline and at six and 12 months after the beginning of the intervention (pre, inter, post), and includes five informants (blinded clinician, therapist, caregiver, child [>= 11 years], teacher). Discussion: The OPTIE study will contribute to the evidence base of progress feedback in children and adolescents and has the potential to uncover treatments' effects in the small to medium range. Noteworthy features are the inclusion of children younger than 10 years old and the consideration of a blinded clinician rating

Toward a Dimensional Assessment of Externalizing Disorders in Children: Reliability and Validity of a Semi-Structured Parent Interview

Objective This study assesses the reliability and validity of the DSM-5-based, semi-structuredClinical Parent Interview for Externalizing Disorders in Children and Adolescents(ILF-EXTERNAL). Method Participant data were drawn from the ongoing ESCAschool intervention study. The ILF-EXTERNAL was evaluated in a clinical sample of 474 children and adolescents (aged 6-12 years, 92 females) with symptoms of attention-deficit/hyperactivity disorder (ADHD). To obtain interrater reliability, the one-way random-effects, absolute agreement models of the intraclass correlation (ICC) for single ICC(1,1) and average measurements ICC(1,3) were computed between the interviewers and two independent raters for 45 randomly selected interviews involving ten interviewers. Overall agreement on DSM-5 diagnoses was assessed using Fleiss' kappa. Further analyses evaluated internal consistencies, item-total correlations as well as correlations between symptom severity and the degree of functional impairment. Additionally, parents completed the German version of theChild Behavior Checklist(CBCL) and two DSM-5-based parent questionnaires for the assessment of ADHD symptoms and symptoms of disruptive behavior disorders (FBB-ADHS; FBB-SSV), which were used to evaluate convergent and divergent validity. Results ICC coefficients demonstrated very good to excellent interrater reliability on the item and scale level of the ILF-EXTERNAL [scale level: ICC(1,1) = 0.83-0.95; ICC(1,3) = 0.94-0.98]. Overall kappa agreement on DSM-5 diagnoses was substantial to almost perfect for most disorders (0.38 <= kappa <= 0.94). With some exceptions, internal consistencies (0.60 <= alpha <= 0.86) and item-total correlations (0.21 <= r(it)<= 0.71) were generally satisfactory to good. Furthermore, higher symptom severity was associated with a higher degree of functional impairment. The evaluation of convergent validity revealed positive results regarding clinical judgment and parent ratings (FBB-ADHS; FBB-SSV). Correlations between the ILF-EXTERNAL scales and the CBCLExternalizing Problemswere moderate to high. Finally, the ILF-EXTERNAL scales were significantly more strongly associated with the CBCLExternalizing Problemsthan with theInternalizing Problems, indicating divergent validity. Conclusion In clinically referred, school-age children, the ILF-EXTERNAL demonstrates sound psychometric properties. The ILF-EXTERNAL is a promising clinical interview and contributes to high-quality diagnostics of externalizing disorders in children and adolescents