Reliability and Validity of the KIPPPI: An Early Detection Tool for Psychosocial Problems in Toddlers

Background: The KIPPPI (Brief Instrument Psychological and Pedagogical Problem Inventory) is a Dutch questionnaire that measures psychosocial and pedagogical problems in 2-year olds and consists of a KIPPPI Total score, Wellbeing scale, Competence scale, and Autonomy scale. This study examined the reliability, validity, screening accuracy and clinical application of the KIPPPI. Methods: Parents of 5959 2-year-old children in the Rotterdam area, the Netherlands, were invited to participate in the study. Parents of 3164 children (53.1% of all invited parents) completed the questionnaire. The internal consistency was evaluated and in subsamples the test-retest reliability and concurrent validity with regard to the Child Behavioral Checklist (CBCL). Discriminative validity was evaluated by comparing scores of parents who worried about their child's upbringing and parent's that did not. Screening accuracy of the KIPPPI was evaluated against the CBCL by calculating the Receiver Operating Characteristic (ROC) curves. The clinical application was evaluated by the relation between KIPPPI scores and the clinical decision made by the child health professionals. Results: Psychometric properties of the KIPPPI Total score, Wellbeing scale, Competence scale and Autonomy scale were respectively: Cronbach's alphas: 0.88, 0.86, 0.83, 0.58. Test-rete

Maternal mental health predicts risk of developmental problems at 3 years of age: follow up of a community based trial

<p>Abstract</p> <p>Background</p> <p>Undetected and untreated developmental problems can have a significant economic and social impact on society. Intervention to ameliorate potential developmental problems requires early identification of children at risk of future learning and behaviour difficulties. The objective of this study was to estimate the prevalence of risk for developmental problems among preschool children born to medically low risk women and identify factors that influence outcomes.</p> <p>Methods</p> <p>Mothers who had participated in a prenatal trial were followed up three years post partum to answer a telephone questionnaire. Questions were related to child health and development, child care, medical care, mother's lifestyle, well-being, and parenting style. The main outcome measure was risk for developmental problems using the Parents' Evaluation of Developmental Status (PEDS).</p> <p>Results</p> <p>Of 791 children, 11% were screened by the PEDS to be at high risk for developmental problems at age three. Of these, 43% had previously been referred for assessment. Children most likely to have been referred were those born preterm. Risk factors for delay included: male gender, history of ear infections, a low income environment, and a mother with poor emotional health and a history of abuse. A child with these risk factors was predicted to have a 53% chance of screening at high risk for developmental problems. This predicted probability was reduced to 19% if the child had a mother with good emotional health and no history of abuse.</p> <p>Conclusion</p> <p>Over 10% of children were identified as high risk for developmental problems by the screening, and more than half of those had not received a specialist referral. Risk factors for problems included prenatal and perinatal maternal and child factors. Assessment of maternal health and effective screening of child development may increase detection of children at high risk who would benefit from early intervention.</p> <p>Trial registration</p> <p>Current Controlled Trials ISRCTN64070727</p

Parents' concerns about children are highly prevalent but often not confirmed by child doctors and nurses

<p>Abstract</p> <p>Background</p> <p>The aim of this study was to assess the prevalence in the general population of parents' concerns about the development of their child, to identify groups at risk and to assess the association between parents' concerns and professional judgement.</p> <p>Methods</p> <p>We obtained cross-sectional data on a Dutch nationally representative sample of children aged 14 months, 3 3/4, 5–6 and 8–12 years within the setting of routine well-child visits provided to the entire population. A total of 4,107 participated (response rate 85.3%). Data were about concerns that parents reported by questionnaire before the visit regarding behavioural and emotional problems, developmental delay, consequences of disease and contact with peers that needed professional assistance, and about the assessment of these domains by doctors and nurses during the visit. Moreover, we obtained data on parent-reported psychosocial problems using the Infant-Toddler Social and Emotional Assessment and the Child Behavior Checklist.</p> <p>Results</p> <p>Of all parents, 49.3% reported some concerns and 8.7% reported frequent concerns, most frequently on child behaviour. Frequent concerns were most likely to refer to young children, children from labour immigrant families, with fathers of medium educational level and in low-income families. The prevalence rates of professional-assessed parenting problems were much lower than parent-reported ones. The rates of psychosocial problems were highest in the case of shared concerns, but also higher if parents expressed concerns that were not confirmed by professionals.</p> <p>Conclusion</p> <p>A very large proportion of parents of young children have concerns regarding their child, but agreement on these concerns with child health professionals is relatively low.</p

Determinants of response to a parent questionnaire about development and behaviour in 3 year olds: European multicentre study of congenital toxoplasmosis.

Background: We aimed to determine how response to a parent-completed postal questionnaire measuring development, behaviour, impairment, and parental concerns and anxiety, varies in different European centres. Methods: Prospective cohort study of 3 year old children, with and without congenital toxoplasmosis, who were identified by prenatal or neonatal screening for toxoplasmosis in 11 centres in 7 countries. Parents were mailed a questionnaire that comprised all or part of existing validated tools. We determined the effect of characteristics of the centre and child on response, age at questionnaire completion, and response to child drawing tasks. Results: The questionnaire took 21 minutes to complete on average. 67% (714/1058) of parents responded. Few parents (60/1058) refused to participate. The strongest determinants of response were the score for organisational attributes of the study centre (such as direct involvement in follow up and access to an address register), and infection with congenital toxoplasmosis. Age at completion was associated with study centre, presence of neurological abnormalities in early infancy, and duration of prenatal treatment. Completion rates for individual questions exceeded 92% except for child completed drawings of a man (70%), which were completed more by girls, older children, and in certain centres. Conclusion: Differences in response across European centres were predominantly related to the organisation of follow up and access to correct addresses. The questionnaire was acceptable in all six countries and offers a low cost tool for assessing development, behaviour, and parental concerns and anxiety, in multinational studies

Reliability and Validity of the Dutch Version of the Brief Infant-Toddler Social and Emotional Assessment (BITSEA)

Background: The Brief Infant-Toddler Social and Emotional Assessment (BITSEA) is a relatively new and short (42-item) questionnaire that measures psychosocial problems in toddlers and consists of a Problem and a Competence scale. In this study the reliability and validity of the Dutch version of the BITSEA were examined for the whole group and for gender and ethnicity subgroups. Methods: Parents of 7140 two-year-old children were invited in the study, of which 3170 (44.4%) parents completed the BITSEA. For evaluation of the score distribution, the presence of floor/ceiling effects was determined. The internal consistency (Cronbach's alpha) was evaluated and in subsamples the test-retest, parent-childcare provider interrater reliability and concurrent validity with regard to the Child Behavioral Checklist (CBCL). Discriminative validity was evaluated by comparing scores of parents that worry and parents that do not worry about their child's development. Results: The BITSEA showed no floor or ceiling effects. Psychometric properties of the BITSEA Problem and Competence scale were respectively: Cronbach's alphas were 0.76 and 0.63. Test-retest correlations were 0.75 and 0.61. Interrater reliability correlations were 0.30 and 0.17. Concurrent validity was as hypothesised. The BITSEA was able to discriminate between parents that worry about their child and parents that do not worry. The psychometric properties of the BITSEA were comparable across gender and ethnic background. Conclusion: The results in this large-scale study of a diverse sample support the reliability and validity of the BITSEA Problem scale. The BITSEA Competence scale needs further study. The performance of the BITSEA appears to be similar in subgroups by gender and ethnic background

Examination of the cut-off scores determined by the Ages and Stages Questionnaire in a population-based sample of 6 month-old Norwegian infants

<p>Abstract</p> <p>Background</p> <p>Few population-based samples have previously published performance on the Ages and Stages Questionnaire (ASQ), a recommended screening tool to detect infant developmental delay. The aim of the study was to investigate performance on the ASQ in a population-based sample of 6-month-old infants.</p> <p>Methods</p> <p>In this population-based questionnaire study from Oslo, Norway, the 30 item ASQ 6 month Questionnaire (N = 1053) were included, however without the pictograms, and compared to the Norwegian reference sample (N.ref) (N = 169) and to US cut-off values. Exclusion criteria were maternal non-Scandinavian ethnicity, infant age < 5.0 or > 7.0 months (corrected age), twins, and birth weight < 2.5 kg. Cut-off = 2.5 percentile (equivalent to mean minus 2 standard deviations). Pearson's Chi square and Mann-Whitney U were used to compare items and areas, respectively, with N.ref.</p> <p>Results</p> <p>The reported ASQ scores were lower on all but one of the 10 significantly different items, and in all areas except Personal social, compared to the N.ref sample. The estimated cut-off values for suspected developmental delay (Communication 25, Gross motor 15, Fine motor 18, Problem solving 25 and Personal social 20) were lower than the recommended American (US) values in all areas, and lower than the Norwegian values in two areas. Scores indicating need for further assessment were reached by 13.8% or 20.5% of the infants (missing items scored according to the US or the Norwegian manual), and by 33.8% or 30.3% of the infants using the recommended US or the Norwegian cut-off values, in this population-based sample. The Fine motor area demonstrated a large variability depending on the different cut-off and scoring possibilities. Both among the items excluding pictograms and the items that do not have pictograms, approximately every third item differed significantly compared to the N.ref sample.</p> <p>Conclusion</p> <p>The psychomotor developmental scores were lower than in the reference samples in this study of ASQ 6 month Questionnaire; to our knowledge the first study to be both representative and comparatively large. Approximately every third child with birth weight above 2.5 kg, received scores suggesting further assessment using recommended ASQ cut-off scores.</p

An accurate and efficient identification of children with psychosocial problems by means of computerized adaptive testing

Background: Questionnaires used by health services to identify children with psychosocial problems are often rather short. The psychometric properties of such short questionnaires are mostly less than needed for an accurate distinction between children with and without problems. We aimed to assess whether a short Computerized Adaptive Test (CAT) can overcome the weaknesses of short written questionnaires when identifying children with psychosocial problems. Method: We used a Dutch national data set obtained from parents of children invited for a routine health examination by Preventive Child Healthcare with 205 items on behavioral and emotional problems (n = 2,041, response 84%). In a random subsample we determined which items met the requirements of an Item Response Theory (IRT) model to a sufficient degree. Using those items, item parameters necessary for a CAT were calculated and a cut-off point was defined. In the remaining subsample we determined the validity and efficiency of a Computerized Adaptive Test using simulation techniques, with current treatment status and a clinical score on the Total Problem Scale (TPS) of the Child Behavior Checklist as criteria. Results: Out of 205 items available 190 sufficiently met the criteria of the underlying IRT model. For 90% of the children a score above or below cut-off point could be determined with 95% accuracy. The mean number of items needed to achieve this was 12. Sensitivity and specificity with the TPS as a criterion were 0.89 and 0.91, respectively. Conclusion: An IRT-based CAT is a very promising option for the identification of psychosocial problems in children, as it can lead to an efficient, yet high-quality identification. The results of our simulation study need to be replicated in a real-life administration of this CAT

The five-item Brief-Symptom Rating Scale as a suicide ideation screening instrument for psychiatric inpatients and community residents

<p>Abstract</p> <p>Background</p> <p>An efficient screening instrument which can be used in diverse settings to predict suicide in different populations is vital. The aim of this study was to use the five-item Brief Symptom Rating Scale (BSRS-5) as a screening instrument for the prediction of suicide ideation in psychiatric, community and general medical settings.</p> <p>Methods</p> <p>Five hundred and one psychiatric, 1,040 community and 969 general medical participants were recruited. The community participants completed a structured telephone interview, and the other two groups completed the self-report BSRS-5 questionnaire.</p> <p>Results</p> <p>The logistic regression analysis showed that the predictors of suicide ideation for the psychiatric group were depression, hostility and inferiority (<it>p </it>< 0.001, <it>p </it>= 0.016, <it>p </it>= 0.011), for the community group, inferiority, hostility and insomnia (<it>p </it>< 0.001, <it>p </it>< 0.001, <it>p </it>= 0.003), and for the general medical group, inferiority, hostility, depression and insomnia (<it>p </it>< 0.001, <it>p </it>= 0.001, <it>p </it>= 0.020, <it>p </it>= 0.008). The structural equation model showed the same symptom domains that predicted suicide ideation for all three groups. The receiver operating characteristic curve using the significant symptom domains from logistic regression showed that for the psychiatric group, the optimal cut-off point was 4/5 for the total of the significant dimensions (positive predictive value [PPV] = 78.01%, negative predictive value [NPV] = 79.05%), for the community group, 7/8 (PPV = 68.75%, NPV = 96.09%), and for the general medical group, 12/13 (PPV = 92.86%, NPV = 88.48%).</p> <p>Conclusion</p> <p>The BSRS-5 is an efficient tool for the screening of suicide ideation-prone psychiatric inpatients, general medical patients, and community residents. Understanding the discriminative symptom domains for different groups and the relationship between them can help health care professionals in their preventative programs and clinical treatment.</p

Parent-Completed Developmental Screening in Premature Children: A Valid Tool for Follow-Up Programs

Our goals were to (1) validate the parental Ages and Stages Questionnaires (ASQ) as a screening tool for psychomotor development among a cohort of ex-premature infants reaching 2 years, and (2) analyse the influence of parental socio-economic status and maternal education on the efficacy of the questionnaire. A regional population of 703 very preterm infants (<35 weeks gestational age) born between 2003 and 2006 were evaluated at 2 years by their parents who completed the ASQ, by a pediatric clinical examination, and by the revised Brunet Lezine psychometric test with establishment of a DQ score. Detailed information regarding parental socio-economic status was available for 419 infants. At 2 years corrected age, 630 infants (89.6%) had an optimal neuromotor examination. Overall ASQ scores for predicting a DQ score ≤85 produced an area under the receiver operator curve value of 0.85 (95% Confidence Interval:0.82–0.87). An ASQ cut-off score of ≤220 had optimal discriminatory power for identifying a DQ score ≤85 with a sensitivity of 0.85 (95%CI:0.75–0.91), a specificity of 0.72 (95%CI:0.69–0.75), a positive likelihood ratio of 3, and a negative likelihood ratio of 0.21. The median value for ASQ was not significantly associated with socio-economic level or maternal education. ASQ is an easy and reliable tool regardless of the socio-economic status of the family to predict normal neurologic outcome in ex-premature infants at 2 years of age. ASQ may be beneficial with a low-cost impact to some follow-up programs, and helps to establish a genuine sense of parental involvement