Reliability of team-based self-monitoring in critical events: A pilot study

Background: Teamwork is a critical component during critical events. Assessment is mandatory for remediation and to target training programmes for observed performance gaps. Methods: The primary purpose was to test the feasibility of team-based self-monitoring of crisis resource management with a validated teamwork assessment tool. A secondary purpose was to assess item-specific reliability and content validity in order to develop a modified context-optimised assessment tool.We conducted a prospective, single-centre study to assess team-based self-monitoring of teamwork after in-situ inter-professional simulated critical events by comparison with an assessment by observers. The Mayo High Performance Teamwork Scale (MHPTS) was used as the assessment tool with evaluation of internal consistency, item-specific consensus estimates for agreement between participating teams and observers, and content validity. Results: 105 participants and 58 observers completed the MHPTS after a total of 16 simulated critical events over 8 months. Summative internal consistency of the MHPTS calculated as Cronbachs alpha was acceptable with 0.712 for observers and 0.710 for participants. Overall consensus estimates for dichotomous data (agreement/non-agreement) was 0.62 (Cohens kappa; IQ-range 0.31-0.87). 6/16 items had excellent (kappa > 0.8) and 3/16 good reliability (kappa > 0.6). Short questions concerning easy to observe behaviours were more likely to be reliable. The MHPTS was modified using a threshold for good reliability of kappa > 0.6. The result is a 9 item self-assessment tool (TeamMonitor) with a calculated median kappa of 0.86 (IQ-range: 0.67-1.0) and good content validity.Conclusions: Team-based self-monitoring with the MHPTS to assess team performance during simulated critical events is feasible. A context-based modification of the tool is achievable with good internal consistency and content validity. Further studies are needed to investigate if team-based self-monitoring may be used as part of a programme of assessment to target training programmes for observed performance gaps. © 2013 Stocker et al.; licensee BioMed Central Ltd

Validation of the Brief Developmental Assessment in pre-school children with heart disease

INTRODUCTION: The objective of this study was to prospectively validate the “Brief Developmental Assessment”, which is a new early recognition tool for neurodevelopmental abnormalities in children with heart disease that was developed for use by cardiac teams. METHODS: This was a prospective validation study among a representative sample of 960 pre-school children with heart disease from three United Kingdom tertiary cardiac centres who were analysed grouped into five separate age bands. RESULTS: The “Brief Developmental Assessment” was successfully validated in the older four age bands, but not in the youngest representing infants under the age of 4 months, as pre-set validation thresholds were met – lower 95% confidence limit for the correlation coefficient above 0.75 – in terms of agreement of scores between two raters and with an external measure the “Mullen Scales of Early Learning”. On the basis of American Association of Pediatrics Guidelines, which state that the sensitivity and specificity of a developmental screening tool should fall between 70 and 80%, “Brief Developmental Assessment” outcome of Red meets this threshold for detection of Mullen scores >2 standard deviations below the mean. CONCLUSION: The “Brief Developmental Assessment” may be used to improve the quality of assessment of children with heart disease. This will require a training package for users and a guide to action for abnormal results. Further research is needed to determine how best to deploy the “Brief Developmental Assessment” at different time points in children with heart disease and to determine the management strategy in infants younger than 4 months old

Neurodevelopmental status and follow-up in preschool children with heart disease in London, UK

OBJECTIVE: To describe neurodevelopment and follow-up services in preschool children with heart disease (HD). DESIGN: Secondary analysis of a prospectively collected multicentre dataset. SETTING: Three London tertiary cardiac centres. PATIENTS: Preschool children<5 years of age: both inpatients and outpatients. METHODS: We analysed results of Mullen Scales of Early Learning (MSEL) and parental report of follow-up services in a representative convenience sample evaluated between January 2014 and July 2015 within a previous study. RESULTS: Of 971 preschool children: 577 (59.4%) had ≥1 heart operation, 236 (24.3%) had a known diagnosis linked to developmental delay (DD) ('known group') and 130 (13.4%) had history of clinical event linked to DD. On MSEL assessment, 643 (66.2%) had normal development, 181 (18.6%) had borderline scores and 147 (15.1%) had scores indicative of DD. Of 971 children, 609 (62.7%) were not receiving follow-up linked to child development and were more likely to be under these services with a known group diagnosis, history of clinical event linked to DD and DD (defined by MSEL). Of 236 in known group, parents of 77 (32.6%) and of 48 children not in a known group but with DD 29 (60.4%), reported no child development related follow-up. DD defined by MSEL assessment was more likely with a known group and older age at assessment. CONCLUSIONS: Our findings indicate that a 'structured neurodevelopmental follow-up pathway' in preschool children with HD should be considered for development and evaluation as children get older, with particular focus on those at higher risk

Early morbidities following paediatric cardiac surgery: a mixed-methods study

Background: Over 5000 paediatric cardiac surgeries are performed in the UK each year and early survival has improved to > 98%. Objectives: We aimed to identify the surgical morbidities that present the greatest burden for patients and health services and to develop and pilot routine monitoring and feedback. Design and setting: Our multidisciplinary mixed-methods study took place over 52 months across five UK paediatric cardiac surgery centres. Participants: The participants were children aged < 17 years. Methods: We reviewed existing literature, ran three focus groups and undertook a family online discussion forum moderated by the Children’s Heart Federation. A multidisciplinary group, with patient and carer involvement, then ranked and selected nine key morbidities informed by clinical views on definitions and feasibility of routine monitoring. We validated a new, nurse-administered early warning tool for assessing preoperative and postoperative child development, called the brief developmental assessment, by testing this among 1200 children. We measured morbidity incidence in 3090 consecutive surgical admissions over 21 months and explored risk factors for morbidity. We measured the impact of morbidities on quality of life, clinical burden and costs to the NHS and families over 6 months in 666 children, 340 (51%) of whom had at least one morbidity. We developed and piloted methods suitable for routine monitoring of morbidity by centres and co-developed new patient information about morbidities with parents and user groups. Results: Families and clinicians prioritised overlapping but also different morbidities, leading to a final list of acute neurological event, unplanned reoperation, feeding problems, renal replacement therapy, major adverse events, extracorporeal life support, necrotising enterocolitis, surgical infection and prolonged pleural effusion. The brief developmental assessment was valid in children aged between 4 months and 5 years, but not in the youngest babies or 5- to 17-year-olds. A total of 2415 (78.2%) procedures had no measured morbidity. There was a higher risk of morbidity in neonates, complex congenital heart disease, increased preoperative severity of illness and with prolonged bypass. Patients with any morbidity had a 6-month survival of 81.5% compared with 99.1% with no morbidity. Patients with any morbidity scored 5.2 points lower on their total quality of life score at 6 weeks, but this difference had narrowed by 6 months. Morbidity led to fewer days at home by 6 months and higher costs. Extracorporeal life support patients had the lowest days at home (median: 43 days out of 183 days) and highest costs (£71,051 higher than no morbidity). Limitations: Monitoring of morbidity is more complex than mortality, and hence this requires resources and clinician buy-in. Conclusions: Evaluation of postoperative morbidity provides important information over and above 30-day survival and should become the focus of audit and quality improvement. Future work: National audit of morbidities has been initiated. Further research is needed to understand the implications of feeding problems and renal failure and to evaluate the brief developmental assessment. Funding: This project was funded by the NIHR Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 8, No. 30. See the NIHR Journals Library website for further project information

Effect of a Sedation and Ventilator Liberation Protocol vs Usual Care on Duration of Invasive Mechanical Ventilation in Pediatric Intensive Care Units

IMPORTANCE: There is limited evidence on the optimal strategy for liberating infants and children from invasive mechanical ventilation in the pediatric intensive care unit. OBJECTIVE: o determine if a sedation and ventilator liberation protocol intervention reduces the duration of invasive mechanical ventilation in infants and children anticipated to require prolonged mechanical ventilation. DESIGN, SETTING, AND PARTICIPANTS: A pragmatic multicenter, stepped-wedge, cluster randomized clinical trial was conducted that included 17 hospital sites (18 pediatric intensive care units) in the UK sequentially randomized from usual care to the protocol intervention. From February 2018 to October 2019, 8843 critically ill infants and children anticipated to require prolonged mechanical ventilation were recruited. The last date of follow-up was November 11, 2019. INTERVENTIONS: Pediatric intensive care units provided usual care (n = 4155 infants and children) or a sedation and ventilator liberation protocol intervention (n = 4688 infants and children) that consisted of assessment of sedation level, daily screening for readiness to undertake a spontaneous breathing trial, a spontaneous breathing trial to test ventilator liberation potential, and daily rounds to review sedation and readiness screening and set patient-relevant targets. MAIN OUTCOMES AND MEASURES: The primary outcome was the duration of invasive mechanical ventilation from initiation of ventilation until the first successful extubation. The primary estimate of the treatment effect was a hazard ratio (with a 95% CI) adjusted for calendar time and cluster (hospital site) for infants and children anticipated to require prolonged mechanical ventilation. RESULTS: There were a total of 8843 infants and children (median age, 8 months [interquartile range, 1 to 46 months]; 42% were female) who completed the trial. There was a significantly shorter median time to successful extubation for the protocol intervention compared with usual care (64.8 hours vs 66.2 hours, respectively; adjusted median difference, −6.1 hours [interquartile range, −8.2 to −5.3 hours]; adjusted hazard ratio, 1.11 [95% CI, 1.02 to 1.20], P = .02). The serious adverse event of hypoxia occurred in 9 (0.2%) infants and children for the protocol intervention vs 11 (0.3%) for usual care; nonvascular device dislodgement occurred in 2 (0.04%) vs 7 (0.1%), respectively. CONCLUSIONS AND RELEVANCE: Among infants and children anticipated to require prolonged mechanical ventilation, a sedation and ventilator liberation protocol intervention compared with usual care resulted in a statistically significant reduction in time to first successful extubation. However, the clinical importance of the effect size is uncertain. TRIAL REGISTRATION: isrctn.org Identifier: ISRCTN1699814