The agreement between parent-reported and directly measured child language and parenting behaviors

Parenting behaviors are commonly targeted in early interventions to improve children\u27s language development. Accurate measurement of both parenting behaviors and children\u27s language outcomes is thus crucial for sensitive assessment of intervention outcomes. To date, only a small number of studies have compared parent-reported and directly measured behaviors, and these have been hampered by small sample sizes and inaccurate statistical techniques, such as correlations. The Bland-Altman Method and Reduced Major Axis regression represent more reliable alternatives because they allow us to quantify fixed and proportional bias between measures. In this study, we draw on data from two Australian early childhood cohorts (N = 201 parents and slow-to-talk toddlers aged 24 months; and N = 218 parents and children aged 6-36 months experiencing social adversity) to (1) examine agreement and quantify bias between parent-reported and direct measures, and (2) to determine socio-demographic predictors of the differences between parent-reported and direct measures. Measures of child language and parenting behaviors were collected from parents and their children. Our findings support the utility of the Bland-Altman Method and Reduced Major Axis regression in comparing measurement methods. Results indicated stronger agreement between parent-reported and directly measured child language, and poorer agreement between measures of parenting behaviors. Child age was associated with difference scores for child language; however, the direction varied for each cohort. Parents who rated their child\u27s temperament as more difficult tended to report lower language scores on the parent questionnaire, compared to the directly measured scores. Older parents tended to report lower parenting responsiveness on the parent questionnaire, compared to directly measured scores. Finally, speaking a language other than English was associated with less responsive parenting behaviors on the videotaped observation compared to the parent questionnaire. Variation in patterns of agreement across the distribution of scores highlighted the importance of assessing agreement comprehensively, providing strong evidence that simple correlations are grossly insufficient for method comparisons. We discuss implications for researchers and clinicians, including guidance for measurement selection, and the potential to reduce financial and time-related expenses and improve data quality. Further research is required to determine whether findings described here are reflected in more representative populations

EHLS at school: school-age follow-up of the early home learning study cluster randomized controlled trial

BACKGROUND: Targeted interventions during early childhood can assist families in providing strong foundations that promote children\u27s health and wellbeing across the life course. There is growing recognition that longer follow-up times are necessary to assess intervention outcomes, as effects may change as children develop. The Early Home Learning Study, or \u27EHLS\u27, comprised two cluster randomized controlled superiority trials of a brief parenting intervention, smalltalk, aimed at supporting parents to strengthen the early childhood home learning environment of infants (6-12 months) or toddlers (12-36 months). Results showed sustained improvements in parent-child interactions and the home environment at the 32 week follow-up for the toddler but not the infant trial. The current study will therefore follow up the EHLS toddler cohort to primary school age, with the aim of addressing a gap in literature concerning long-term effects of early childhood interventions focused on improving school readiness and later developmental outcomes. METHODS: \u27EHLS at School\u27 is a school-aged follow-up study of the toddler cluster randomized controlled trial (n = 1226). Data will be collected by parent-, child- and teacher-report questionnaires, recorded observations of parent-child interactions, and direct child assessment when children are aged 7.5 years old. Data linkage will provide additional data on child health and academic functioning at ages 5, 8 and 10 years. Child outcomes will be compared for families allocated to standard/usual care (control) versus those allocated to the smalltalk program (group program only or group program with additional home coaching). DISCUSSION: Findings from The Early Home Learning Study provided evidence of the benefits of the smalltalk intervention delivered via facilitated playgroups for parents of toddlers. The EHLS at School Study aims to examine the long-term outcomes of this initiative to determine whether improvements in the quality of the parent-child relationship persist over time and translate into benefits for children\u27s social, academic and behavioral skills that last into the school years

What influences parental engagement in early intervention? Parent, program and community predictors of enrolment, retention and involvement

Poor participant engagement undermines individual and public health benefits of early intervention programs. This study assessed the extent to which three types of engagement (participant enrolment, retention and involvement) were influenced by individual, program and contextual factors. Data were from a cluster randomised controlled trial (N = 1447) of a community-based parenting program, delivered at two levels of intensity (group sessions with and without individualised home coaching) conducted in Victoria, Australia. Individual (parent and family) factors and program factors were assessed by parent report and administrative records, and contextual factors by area-level population statistics. Data were analysed using multilevel logistic or linear regression models. Individual and contextual factors predicted enrolment, while family and program factors were more influential on program retention and parents’ active involvement. Provision of individualised support was important to all forms of engagement, particularly for families experiencing the greatest barriers to participation. These findings indicate that different strategies are required to effectively support families in the processes of enrolling, continuing to attend and actively participating in early intervention program

The agreement between parent-reported and directly measured child language and parenting behaviors

Parenting behaviors are commonly targeted in early interventions to improve children’s language development. Accurate measurement of both parenting behaviors and children’s language outcomes is thus crucial for sensitive assessment of intervention outcomes. To date, only a small number of studies have compared parent-reported and directly measured behaviors, and these have been hampered by small sample sizes and inaccurate statistical techniques, such as correlations. The Bland-Altman Method and Reduced Major Axis regression represent more reliable alternatives because they allow us to quantify fixed and proportional bias between measures. In this study, we draw on data from two Australian early childhood cohorts (N= 201 parents and slow-to-talk toddlers aged 24 months; and N=218 parents and children aged 6-36 months experiencing social adversity) to (1) examine agreement and quantify bias between parent-reported and direct measures, and (2) to determine socio-demographic predictors of the differences between parent-reported and direct measures. Measures of child language and parenting behaviors were collected from parents and their children. Our findings support the utility of the Bland-Altman Method and Reduced Major Axis regression in comparing measurement methods. Results indicated stronger agreement between parent-reported and directly measured child language, and poorer agreement between measures of parenting behaviors. Child age was associated with difference scores for child language; however the direction varied for each cohort. Parents who rated their child’s temperament as more difficult tended to report lower language scores on the parent questionnaire, compared to the directly measured scores. Older parents tended to report lower parenting responsiveness on the parent questionnaire, compared to directly measured scores. Finally, speaking a language other than English was associated with less responsive parenting behaviors on the videotaped observation. Variation in patterns of agreement across the distribution of scores highlighted the importance of assessing agreement comprehensively, providing strong evidence that simple correlations are grossly insufficient for method comparisons. We discuss implications for researchers and clinicians, including guidance for measurement selection, and the potential to reduce financial and time-related expenses and improve data quality. Further research is required to determine whether findings described here are reflected in more representative populations

Mothers’ experiences of parent-reported and video-recorded observational assessments

Rigorous evaluation of early childhood interventions requires accurate and efficient measurement. Researchers commonly use parent-reported surveys or direct observations; both of which have inherent strengths and limitations. Existing attempts to understand the correspondence between these methods have been primarily quantitative in design. Little is known about parents’ unique, subjective experiences of parent-reported surveys and direct parent-child observations. In this paper, we describe the experiences of ten mothers of children aged 24 months, recruited from a randomised controlled trial of a nurse home visiting program for mothers at risk of experiencing social adversity. After completing both a survey and video-recorded parent-child observation, mothers participated in in-depth semi-structured interviews which were analysed thematically. Mothers voiced concerns about how researchers may view their parenting skills, and their child’s behaviour and development. Contrary to previous quantitative evidence, mothers reported parent and child behavioural change, which they attributed to the researcher’s presence. Mothers described how the structured requirements of the observation contributed to forced and unnatural interactions. The survey was viewed as a welcome opportunity to reflect on parenting skills, the parent-child relationship and the child’s development. Mothers identified practical strategies for minimising parent-child discomfort during video-recorded observations, such as the researcher averting their gaze or stepping out of the room. We highlight opportunities for enhanced data validity in research and clinical settings, strengthened participant engagement, and minimisation of participant discomfort. Given the exploratory nature of this study, we do not claim that results are necessarily generalisable to other parent or general populations. Further research is warranted to build the evidence regarding parent participation in early childhood research.No Full Tex

Establishing agreement between parent-reported and directly-measured behaviours

The quality and accuracy of research findings relies on the use of appropriate and sensitive research methods. To date, few studies have directly compared quantitative measurement methods in the early childhood field and the extent to which parent-reported and directly-measured behaviours agree is unclear. Existing studies are hampered by small sample sizes and the use of statistical techniques which quantify the magnitude of association between measures (e.g. correlations), but not agreement. Here we review the limitations of existing method comparisons and suggest how alternative statistical approaches such as the Bland-Altman Method and ordinary least products regression can be readily applied in the early childhood context. Understanding agreement (and disagreement) between measurement methods has potential to reduce research costs and improve data quality, with important implications for researchers, clinicians and policy-makers.Full Tex

Parent and child mental health during COVID-19 in Australia: The role of pet attachment

Restrictions, social isolation, and uncertainty related to the global COVID-19 pandemic have disrupted the ways that parents and children maintain family routines, health, and wellbeing. Companion animals (pets) can be a critical source of comfort during traumatic experiences, although changes to family routines, such as those caused by COVID-19, can also bring about challenges like managing undesirable pet behaviours or pet-human interactions. We aimed to examine the relationship between pet attachment and mental health for both parents and their children during the COVID-19 pandemic in Australia. A total of 1,034 parents living with a child under 18 years and a cat or dog completed an online cross-sectional survey between July and October 2020. Path analysis using multivariate linear regression was conducted to examine associations between objective COVID-19 impacts, subjective worry about COVID-19, human-pet attachment, and mental health. After adjusting for core demographic factors, stronger pet-child attachment was associated with greater child anxiety (parent-reported, p < .001). Parent-pet attachment was not associated with self-reported psychological distress (p = .42), however, parents who reported a strong emotional closeness with their pet reported greater psychological distress (p = .002). Findings highlight the role of pets during times of change and uncertainty. It is possible that families are turning to animals as a source of comfort, during a time when traditional social supports are less accessible. Alternatively, strong pet attachment is likely to reflect high levels of empathy, which might increase vulnerability to psychological distress. Longitudinal evidence is required to delineate the mechanisms underpinning pet attachment and mental health

Tablet-based adaptation and administration of the Castles and Coltheart Reading Test 2 for a large longitudinal study.

Tablet-adapted measures provide an efficient, accurate method of data collection for large-scale studies. The Castles and Coltheart Reading Test 2 (CC2) is a standardized paper-and-pencil measure of children's reading ability. In the current study, the CC2 was administered to 603 children aged 7-8 years via iPad using electronic data capture software. Results indicate the tablet-adapted measure could be reliably administered by non-clinical staff and showed quantitative equivalence, i.e., comparable score distributions, to CC2 normative data. Internal consistency was good for regular and non-word lists. Findings suggest that the tablet-adapted CC2 is a viable tool for large research studies

Selective attrition in longitudinal studies:Effective processes for Facebook tracing

Participant attrition is a significant challenge for longitudinal studies, particularly those involving disadvantaged populations. We attempted to re-engage n = 990 families in a five-year follow-up of a randomised controlled trial of an early childhood parenting intervention. Tracing was attempted for n = 90/990 (9.1%) uncontactable participants. Evidence for the identification of a matching Facebook profile was classified as strong, moderate or weak. A private message was sent to those with strong evidence (n = 63/90, 70.0%), of which 32 responded, 22 agreed to participate and 19 provided data. Compared to participants engaged using traditional methods, those re-engaged through Facebook were more likely at initial recruitment to have a younger child (p =.02), to be a single parent (p =.04), less educated (p <.001), lower income (p =.01) and in an unemployed household (p <.001). Findings suggest that social media can be an effective engagement tool, helping to minimise overall and selective attrition in longitudinal studies, particularly for hard-to-reach populations.</p

Ethical considerations in using social media to engage research participants: Perspectives of Australian researchers and ethics committee members

Researchers increasingly use social media (SM) to recruit, retain, and trace participants, yet empirical literature investigating the ethics of engaging participants via SM is lacking. We conducted a survey of 401 Australian researchers and human research ethics committee (HREC) members to examine their experience, attitudes, and ethical concerns toward engaging participants via SM. Data revealed that researchers and HREC members share similar concerns and attitudes about using SM in general and in research. We identified a strong demand for additional support, training, and guidance on SM research ethics. This need reflects researchers’ and HREC members’ limited confidence and knowledge of ethical issues in this context and a lack of awareness of available SM-specific ethical guidelines