Reliability and Validity of the KIPPPI: An Early Detection Tool for Psychosocial Problems in Toddlers

Background: The KIPPPI (Brief Instrument Psychological and Pedagogical Problem Inventory) is a Dutch questionnaire that measures psychosocial and pedagogical problems in 2-year olds and consists of a KIPPPI Total score, Wellbeing scale, Competence scale, and Autonomy scale. This study examined the reliability, validity, screening accuracy and clinical application of the KIPPPI. Methods: Parents of 5959 2-year-old children in the Rotterdam area, the Netherlands, were invited to participate in the study. Parents of 3164 children (53.1% of all invited parents) completed the questionnaire. The internal consistency was evaluated and in subsamples the test-retest reliability and concurrent validity with regard to the Child Behavioral Checklist (CBCL). Discriminative validity was evaluated by comparing scores of parents who worried about their child's upbringing and parent's that did not. Screening accuracy of the KIPPPI was evaluated against the CBCL by calculating the Receiver Operating Characteristic (ROC) curves. The clinical application was evaluated by the relation between KIPPPI scores and the clinical decision made by the child health professionals. Results: Psychometric properties of the KIPPPI Total score, Wellbeing scale, Competence scale and Autonomy scale were respectively: Cronbach's alphas: 0.88, 0.86, 0.83, 0.58. Test-rete

Use of the Pediatric Symptom Checklist for the detection of psychosocial problems in preventive child healthcare

BACKGROUND: Early detection and treatment of psychosocial problems by preventive child healthcare may lead to considerable health benefits, and a short questionnaire could support this aim. The aim of this study was to assess whether the Dutch version of the US Pediatric Symptom checklist (PSC) is valid and suitable for the early detection of psychosocial problems among children. METHODS: We included 687 children (response 84.3%) aged 7–12 undergoing routine health assessments in nine Preventive Child Health Services across the Netherlands. Child health professionals interviewed and examined children and parents. Before the interview, parents completed an authorised Dutch translation of the PSC and the Child Behavior Checklist (CBCL). The CBCL and data on the child's current treatment status were used as criteria for the validity of the PSC. RESULTS: The consistency of the Dutch PSC was good (Cronbach alpha 0.89). The area under the ROC curve using the CBCL as a criterion was 0.94 (95% confidence interval 0.92 to 0.96). At the US cut-off (28 and above), the prevalence rate of an increased score and sensitivity were lower than in the USA. At a lower cut-off (22 and above), sensitivity and specificity were similar to that of the US version (71.7% and 93.0% respectively). Information on the PSC also helped in the identification of children with elevated CBCL Total Problems Scores, above solely clinical judgment. CONCLUSION: The PSC is also useful for the early detection of psychosocial problems in preventive child healthcare outside the USA, especially with an adjusted cut-off

Comparing three short questionnaires to detect psychosocial dysfunction among primary school children: a randomized method

BACKGROUND: Good questionnaires are essential to support the early identification of children with psychosocial dysfunction in community based settings. Our aim was to assess which of three short questionnaires was most suitable for this identification among school-aged children METHODS: A community-based sample of 2,066 parents of children aged 7-12 years (85% of those eligible) filled out the Child Behavior Checklist (CBCL) and - randomly determined - one of three questionnaires to be compared: the Strengths and Difficulties Questionnaire with Impact Supplement (SDQ), the Pediatric Symptom Checklist (PSC) and the PSYBOBA, a Dutch-origin questionnaire. Preventive Child Healthcare professionals assessed children's psychosocial functioning during routine health examinations. We assessed the scale structure (by means of Structural Equation Modelling), validity (correlation coefficients, sensitivity and specificity) and usability (ratings by parents and professionals) of each questionnaire and the degree to which they could improve the identification based only on clinical assessment (logistic regression). RESULTS: For the three questionnaires, Cronbach's alphas varied between 0.80 and 0.89. Sensitivities for a clinical CBCL at a cut off point with specificity = 0.90 varied between 0.78 and 0.86 for the three questionnaires. Areas under the Receiver Operating Curve, using the CBCL as criterion, varied between 0.93 and 0.96. No differences were statistically significant. All three questionnaires added information to the clinical assessment. Odds ratios (95% confidence intervals) for added information were PSC: 29.3 (14.4-59.8), SDQ: 55.0 (23.1-131.2) and PSYBOBA: 68.5 (28.3-165.6). Parents preferred the SDQ and PSYBOBA. Preventive Child Health Care professionals preferred the SDQ. CONCLUSIONS: This randomized comparison of three questionnaires shows that each of the three questionnaires can improve the detection of psychosocial dysfunction among children substantially

An accurate and efficient identification of children with psychosocial problems by means of computerized adaptive testing

Background: Questionnaires used by health services to identify children with psychosocial problems are often rather short. The psychometric properties of such short questionnaires are mostly less than needed for an accurate distinction between children with and without problems. We aimed to assess whether a short Computerized Adaptive Test (CAT) can overcome the weaknesses of short written questionnaires when identifying children with psychosocial problems. Method: We used a Dutch national data set obtained from parents of children invited for a routine health examination by Preventive Child Healthcare with 205 items on behavioral and emotional problems (n = 2,041, response 84%). In a random subsample we determined which items met the requirements of an Item Response Theory (IRT) model to a sufficient degree. Using those items, item parameters necessary for a CAT were calculated and a cut-off point was defined. In the remaining subsample we determined the validity and efficiency of a Computerized Adaptive Test using simulation techniques, with current treatment status and a clinical score on the Total Problem Scale (TPS) of the Child Behavior Checklist as criteria. Results: Out of 205 items available 190 sufficiently met the criteria of the underlying IRT model. For 90% of the children a score above or below cut-off point could be determined with 95% accuracy. The mean number of items needed to achieve this was 12. Sensitivity and specificity with the TPS as a criterion were 0.89 and 0.91, respectively. Conclusion: An IRT-based CAT is a very promising option for the identification of psychosocial problems in children, as it can lead to an efficient, yet high-quality identification. The results of our simulation study need to be replicated in a real-life administration of this CAT

The effectiveness of Stepping stones Triple P: the design of a randomised controlled trial on a parenting programme regarding children with mild intellectual disability and psychosocial problems versus care as usual

<p>Abstract</p> <p>Background</p> <p>Children with an intellectual disability are at increased risk of psychosocial problems. This leads to serious restrictions in the daily functioning of the children and to parental stress. Stepping Stones Triple P aims to prevent severe behavioural, emotional and developmental problems in children with a (intellectual) disability by enhancing parenting knowledge and skills, and the self-confidence of parents. This paper aims to describe the design of a study of the effectiveness of parenting counselling using Stepping Stones Triple P compared to Care as Usual.</p> <p>Methods/Design</p> <p>The effects of Stepping Stones Triple P will be studied in a Randomised Controlled Trial. Parents of children aged 5-12 years with an IQ of 50-85 will be recruited from schools. Prior to randomisation, parents complete a screening questionnaire about their child's psychosocial problems and their parenting skills. Subsequently, parents of children with increased levels of psychosocial problems (score on Strengths and Difficulties Questionnaire ≥ 14) will be invited to participate in the intervention study. After obtaining consent, parents will be randomised either to the experimental group (Stepping Stones Triple P) or to Care as Usual. The primary outcome is a change in the child's psychosocial problems according to parents and teachers. The secondary outcome is a change in parenting skills. Data will be collected before the start of the intervention, immediately after the intervention, and six months after.</p> <p>Discussion</p> <p>This paper presents an outline of the background and design of a randomised controlled trial to investigate the effectiveness of Stepping Stones Triple P, which aims to decrease psychosocial problems in children with a mild intellectual disability. Stepping Stones Triple P seems promising, but evidence on its effectiveness for this population is still lacking. This study provides evidence about the effects of this intervention in a community-based population of children with a mild intellectual disability.</p> <p>Trial registration</p> <p>Netherlands Trial Register (NTR): <a href="http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=NTR2624">NTR2624</a></p

Effectiveness of a family-centered method for the early identification of social-emotional and behavioral problems in children: a quasi experimental study

Background: Social-emotional and behavioral problems are common in childhood. Early identification of these is important as it can lead to interventions which may improve the child's prognosis. In Dutch Preventive Child Healthcare (PCH), a new family-centered method has been implemented to identify these problems in early childhood. Its main features are consideration of the child's developmental context and empowerment of parents to enhance the developmental context. Methods/design: In a quasi-experimental study, embedded in routine PCH in the Netherlands, regions in which the family-centered method has been implemented (intervention condition) will be compared to "care as usual" regions (control condition). These regions are comparable in regard to socio-demographic characteristics. From more than 3,500 newborn babies, 18-month follow-up data on social-emotional and behavioral development will be obtained. PCH professionals will assess development during each routine well-child visit; participating parents will fill in standardized questionnaires. Primary outcomes in the study are the proportion of social-emotional and behavioral problems identified by PCH professionals in children aged 2-14 and 18 months in both conditions, and the proportion of agreement between the assessment of PCH professionals and parents. In addition, the added value of the family-centered approach will be assessed by comparing PCH findings with standardized questionnaires. The secondary outcomes are the degree to which the needs of parents are met and the degree to which they are willing to disclose concerns. Discussion: The family-centered method seems promising for early identification of social-emotional and behavioral problems. The results of this study will contribute to evidence-based public health. Trial registration: NTR2681

A structured registration program can be validly used for quality assessment in general practice

ABSTRACT: BACKGROUND: Patient information, medical history, clinical outcomes and demographic information, can be registered in different ways in registration programs. For evaluation of diabetes care, data can easily be extracted from a structured registration program (SRP). The usability of data from this source depends on the agreement of this data with that of the usual data registration in the electronic medical record (EMR). Aim of the study was to determine the comparability of data from an EMR and from an SRP, to determine whether the use of SRP data for quality assessment is justified in general practice. METHODS: We obtained 196 records of diabetes mellitus patients in a sample of general practices in the Netherlands. We compared the agreement between the two programs in terms of laboratory and non-laboratory parameters. Agreement was determined by defining accordance between the programs in absent and present registrations, accordance between values of registrations, and whether the differences found in values were also a clinically relevant difference. RESULTS: No differences were found in the occurrence of registration (absent/present) in the SRP and EMR for all the laboratory parameters. Smoking behaviour, weight and eye examination were registered significantly more often in the SRP than in the EMR. In the EMR, blood pressure was registered significantly more often than in the SRP. Data registered in the EMR and in the SRP had a similar clinical meaning for all parameters (laboratory and non-laboratory). CONCLUSIONS: Laboratory parameters showed good agreement and non-laboratory acceptable agreement of the SRP with the EMR. Data from a structured registration program can be used validly for research purposes and quality assessment in general practice

Need-based resource allocation: different need indicators, different results?

<p>Abstract</p> <p>Background</p> <p>A key policy objective in most publicly financed health care systems is to allocate resources according to need. Many jurisdictions implement this policy objective through need-based allocation models. To date, no gold standard exists for selecting need indicators. In the absence of a gold standard, sensitivity of the choice of need indicators is of concern. The primary objective of this study was to assess the consistency and plausibility of estimates of per capita relative need for health services across Canadian provinces based on different need indicators.</p> <p>Methods</p> <p>Using the 2000/2001 Canadian Community Health Survey, we estimated relative per capita need for general practitioner, specialist, and hospital services by province using two approaches that incorporated a different set of need indicators: (1) demographics (age and sex), and (2) demographics, socioeconomic status, and health status. For both approaches, we first fitted regression models to estimate standard utilization of each of three types of health services by indicators of need. We defined the standard as average levels of utilization by needs indicators in the national sample. Subsequently, we estimated expected per capita utilization of each type of health services in each province. We compared these estimates of per capita relative need with premature mortality in each province to check their face validity.</p> <p>Results</p> <p>Both approaches suggested that expected relative per capita need for three services vary across provinces. Different approaches, however, yielded different and inconsistent results. Moreover, provincial per capita relative need for the three health services did not always indicate the same direction of need suggested by premature mortality in each province. In particular, the two approaches suggested Newfoundland had less need than the Canadian average for all three services, but it had the highest premature mortality in Canada.</p> <p>Conclusion</p> <p>Substantial differences in need for health care may exist across Canadian provinces, but the direction and magnitude of differences depend on the need indicators used. Allocations from models using survey data lacked face validity for some provinces. These results call for the need to better understand the biases that may result from the use of survey data for resource allocation.</p

Evaluation of an early detection tool for social-emotional and behavioral problems in toddlers: The Brief Infant Toddler Social and Emotional Assessment - A cluster randomized trial

<p>Abstract</p> <p>Background</p> <p>The prevalence of social-emotional and behavioral problems is estimated to be 8 to 9% among preschool children. Effective early detection tools are needed to promote the provision of adequate care at an early stage. The Brief Infant-Toddler Social and Emotional Assessment (BITSEA) was developed for this purpose. This study evaluates the effectiveness of the BITSEA to enhance social-emotional and behavioral health of preschool children.</p> <p>Methods and Design</p> <p>A cluster randomized controlled trial is set up in youth health care centers in the larger Rotterdam area in the Netherlands, to evaluate the BITSEA. The 31 youth health care centers are randomly allocated to either the control group or the intervention group. The intervention group uses the scores on the BITSEA and cut-off points to evaluate a child's social-emotional and behavioral health and to decide whether or not the child should be referred. The control group provides care as usual, which involves administering a questionnaire that structures the conversation between child health professionals and parents. At a one year follow-up measurement the social-emotional and behavioral health of all children included in the study population will be evaluated.</p> <p>Discussion</p> <p>It is hypothesized that better results will be found, in terms of social-emotional and behavioral health in the intervention group, compared to the control group, due to more adequate early detection, referral and more appropriate and timely care.</p> <p>Trial registration</p> <p>Current Controlled Trials <a href="http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=2035">NTR2035</a></p

Uptake of health services for common mental disorders by first-generation Turkish and Moroccan migrants in the Netherlands

Abstract Background Migration and ethnic minority status have been associated with higher occurrence of common mental disorders (CMD), while mental health care utilisation by non-Western migrants has been reported to be low compared to the general population in Western host countries. Still, the evidence-base for this is poor. This study evaluates uptake of mental health services for CMD and psychological distress among first-generation non-Western migrants in Amsterdam, the Netherlands. Methods A population-based survey. First generation non-Western migrants and ethnic Dutch respondents (N = 580) participated in structured interviews in their own languages. The interview included the Composite International Diagnostic Interview (CIDI) and the Kessler psychological distress scale (K10). Uptake of services was measured by self-report. Data were analysed using weighting techniques and multivariate logistic regression. Results Of subjects with a CMD during six months preceding the interview, 50.9% reported care for mental problems in that period; 35.0% contacted specialised services. In relation to CMD, ethnic groups were equally likely to access specialised mental health services. In relation to psychological distress, however, Moroccan migrants reported less uptake of primary care services (OR = 0.37; 95% CI = 0.15 to 0.88). Conclusion About half of the ethnic Dutch, Turkish and Moroccan population in Amsterdam with CMD contact mental health services. Since the primary purpose of specialised mental health services is to treat "cases", this study provides strong indications for equal access to specialised care for these ethnic groups. The purpose of primary care services is however to treat psychological distress, so that access appears to be lower among Moroccan migrants