Recalibrating prognostic models to improve predictions of in-hospital child mortality in resource-limited settings

Background In an external validation study, model recalibration is suggested once there is evidence of poor model calibration but with acceptable discriminatory abilities. We identified four models, namely RISC-Malawi (Respiratory Index of Severity in Children) developed in Malawi, and three other predictive models developed in Uganda by Lowlaavar et al. (2016). These prognostic models exhibited poor calibration performance in the recent external validation study, hence the need for recalibration. Objective In this study, we aim to recalibrate these models using regression coefficients updating strategy and determine how much their performances improve. Methods We used data collected by the Clinical Information Network from paediatric wards of 20 public county referral hospitals. Missing data were multiply imputed using chained equations. Model updating entailed adjustment of the model's calibration performance while the discriminatory ability remained unaltered. We used two strategies to adjust the model: intercept-only and the logistic recalibration method. Results Eligibility criteria for the RISC-Malawi model were met in 50,669 patients, split into two sets: a model-recalibrating set (n = 30,343) and a test set (n = 20,326). For the Lowlaavar models, 10,782 patients met the eligibility criteria, of whom 6175 were used to recalibrate the models and 4607 were used to test the performance of the adjusted model. The intercept of the recalibrated RISC-Malawi model was 0.12 (95% CI 0.07, 0.17), while the slope of the same model was 1.08 (95% CI 1.03, 1.13). The performance of the recalibrated models on the test set suggested that no model met the threshold of a perfectly calibrated model, which includes a calibration slope of 1 and a calibration-in-the-large/intercept of 0. Conclusions Even after model adjustment, the calibration performances of the 4 models did not meet the recommended threshold for perfect calibration. This finding is suggestive of models over/underestimating the predicted risk of in-hospital mortality, potentially harmful clinically. Therefore, researchers may consider other alternatives, such as ensemble techniques to combine these models into a meta-model to improve out-of-sample predictive performance

Blood culture versus antibiotic use for neonatal inpatients in 61 hospitals implementing with the NEST360 Alliance in Kenya, Malawi, Nigeria, and Tanzania: a cross-sectional study

Background: Thirty million small and sick newborns worldwide require inpatient care each year. Many receive antibiotics for clinically diagnosed infections without blood cultures, the current ‘gold standard’ for neonatal infection detection. Low neonatal blood culture use hampers appropriate antibiotic use, fuelling antimicrobial resistance (AMR) which threatens newborn survival. This study analysed the gap between blood culture use and antibiotic prescribing in hospitals implementing with Newborn Essential Solutions and Technologies (NEST360) in Kenya, Malawi, Nigeria, and Tanzania. Methods: Inpatient data from every newborn admission record (July 2019–August 2022) were included to describe hospital-level blood culture use and antibiotic prescription. Health Facility Assessment data informed performance categorisation of hospitals into four tiers: (Tier 1) no laboratory, (Tier 2) laboratory but no microbiology, (Tier 3) neonatal blood culture use \u3c 50% of newborns receiving antibiotics, and (Tier 4) neonatal blood culture use \u3e 50%. Results: A total of 144,146 newborn records from 61 hospitals were analysed. Mean hospital antibiotic prescription was 70% (range = 25–100%), with 6% mean blood culture use (range = 0–56%). Of the 10,575 blood cultures performed, only 24% (95%CI 23–25) had results, with 10% (10–11) positivity. Overall, 40% (24/61) of hospitals performed no blood cultures for newborns. No hospitals were categorised as Tier 1 because all had laboratories. Of Tier 2 hospitals, 87% (20/23) were District hospitals. Most hospitals could do blood cultures (38/61), yet the majority were categorised as Tier 3 (36/61). Only two hospitals performed \u3e 50% blood cultures for newborns on antibiotics (Tier 4). Conclusions: The two Tier 4 hospitals, with higher use of blood cultures for newborns, underline potential for higher blood culture coverage in other similar hospitals. Understanding why these hospitals are positive outliers requires more research into local barriers and enablers to performing blood cultures. Tier 3 facilities are missing opportunities for infection detection, and quality improvement strategies in neonatal units could increase coverage rapidly. Tier 2 facilities could close coverage gaps, but further laboratory strengthening is required. Closing this culture gap is doable and a priority for advancing locally-driven antibiotic stewardship programmes, preventing AMR, and reducing infection-related newborn deaths

Evaluating the effects of supplementing ward nurses on quality of newborn care in Kenyan neonatal units: protocol for a prospective workforce intervention study

BACKGROUND: Data from High Income Countries have now linked low nurse staff to patient ratios to poor quality patient care. Adequately staffing hospitals is however still a challenge in resource-constrained Low-middle income countries (LMICs) and poor staff-to-patient ratios are largely taken as a norm. This in part relates to limited evidence on the relationship between staffing and quality of patient care in these settings and also an absence of research on benefits that might occur from improving hospital staff numbers in LMICs. This study will determine the effect on the quality of patient care of prospectively adding extra nursing staff to newborn units in a resource constrained LMIC setting and describe the relationship between staffing and quality of care. METHODS: This prospective workforce intervention study will involve a multi-method approach. We will conduct a before and after study in newborn units of 4 intervention hospitals and a single time-point comparison in 4 non-intervention hospitals to determine if there is a change in the level of missed nursing care, a process measure of the quality of patient care. We will also determine the effect of our intervention on routinely collected quality indicators using interrupted time series analysis. Using three nurse staffing metrics (Total nursing hours, nursing hours per patient day and nursing hours per patient per shift), we will describe the relationship between staffing and the quality of patient care. DISCUSSION: There is an urgent need for the implementation of staffing policies in resource constrained LMICs that are guided by relevant contextual data. To the best of our knowledge, this is the first study to evaluate the prospective addition of nursing staff in resource-constrained care settings. Our findings are likely to provide the much-needed evidence for better staffing in these settings. TRIAL REGISTRATION: This study was retrospectively registered in the Pan African Clinical Trial Registry ( https://pactr.samrc.ac.za/Default.aspx?Logout=True ) database on the 10th of June 2022 with a unique identification number-PACTR202206477083141

Risk factors for death among children aged 5-14 years hospitalised with pneumonia: a retrospective cohort study in Kenya.

INTRODUCTION: There were almost 1 million deaths in children aged between 5 and 14 years in 2017, and pneumonia accounted for 11%. However, there are no validated guidelines for pneumonia management in older children and data to support their development are limited. We sought to understand risk factors for mortality among children aged 5-14 years hospitalised with pneumonia in district-level health facilities in Kenya. METHODS: We did a retrospective cohort study using data collected from an established clinical information network of 13 hospitals. We reviewed records for children aged 5-14 years admitted with pneumonia between 1 March 2014 and 28 February 2018. Individual clinical signs were examined for association with inpatient mortality using logistic regression. We used existing WHO criteria (intended for under 5s) to define levels of severity and examined their performance in identifying those at increased risk of death. RESULTS: 1832 children were diagnosed with pneumonia and 145 (7.9%) died. Severe pallor was strongly associated with mortality (adjusted OR (aOR) 8.06, 95% CI 4.72 to 13.75) as were reduced consciousness, mild/moderate pallor, central cyanosis and older age (>9 years) (aOR >2). Comorbidities HIV and severe acute malnutrition were also associated with death (aOR 2.31, 95% CI 1.39 to 3.84 and aOR 1.89, 95% CI 1.12 to 3.21, respectively). The presence of clinical characteristics used by WHO to define severe pneumonia was associated with death in univariate analysis (OR 2.69). However, this combination of clinical characteristics was poor in discriminating those at risk of death (sensitivity: 0.56, specificity: 0.68, and area under the curve: 0.62). CONCLUSION: Children >5 years have high inpatient pneumonia mortality. These findings also suggest that the WHO criteria for classification of severity for children under 5 years do not appear to be a valid tool for risk assessment in this older age group, indicating the urgent need for evidence-based clinical guidelines for this neglected population

Missed nursing care in acute care hospital settings in low-middle income countries: a systematic review protocol

Background:  Missed nursing care (care left undone or task incompletion) is viewed as an important early predictor of adverse patient care outcomes and is a useful indicator to determine the quality of patient care. Available systematic reviews on missed nursing care are based mainly on primary studies from developed countries, and there is limited evidence on missed nursing care from low-middle income countries (LMICs). We propose conducting a systematic review to identify the magnitude of missed nursing care and document factors and reasons associated with this phenomenon in LMIC settings. Methods and analysis:  This protocol was developed using the Preferred Reporting Items for Systematic Reviews and Meta-analysis Protocols (PRISMA-P). We will conduct literature searching across the Ovid Medline, Embase and EBSCO Cumulative Index to Nursing and Allied Health Literature (CINAHL) databases, from inception to 2021. Two independent reviewers will conduct searches and data abstraction, and discordance will be handled by discussion between both parties. The risk of bias of the individual studies will be determined using the Newcastle-Ottawa Scale (NOS). Ethics and dissemination: Ethical permission is not required for this review as we will make use of already published data. We aim to publish the findings of our review in peer-reviewed journals PROSPERO registration number: CRD42021286897 (27th October 2021)</ns4:p

Identifying gaps in global evidence for nurse staffing and patient care outcomes research in low/middle-income countries: an umbrella review.

OBJECTIVE: To identify nurse staffing and patient care outcome literature in published systematic reviews and map out the evidence gaps for low/middle-income countries (LMICs). METHODS: We included quantitative systematic reviews on nurse staffing levels and patient care outcomes in regular ward settings published in English. We excluded qualitative reviews or reviews on nursing skill mix. We searched the Cochrane Register of Systematic Reviews, the Joanna Briggs Institute Database of Systematic Reviews and Implementation Reports, Medline, Embase and Cumulative Index to Nursing and Allied Health Literature from inception until July 2021. We used the A Measurement Tool to Assess Systematic Reviews -2 (AMSTAR-2) criteria for risk of bias assessment and conducted a narrative synthesis. RESULTS: From 843 papers, we included 14 in our final synthesis. There were overlaps in primary studies summarised across reviews, but overall, the reviews summarised 136 unique primary articles. Only 4 out of 14 reviews had data on LMIC publications and only 9 (6.6%) of 136 unique primary articles were conducted in LMICs. Only 8 of 23 patient care outcomes were reported from LMICs. Less research was conducted in contexts with staffing levels that are typical of many LMIC contexts. DISCUSSION: Our umbrella review identified very limited data for nurse staffing and patient care outcomes in LMICs. We also identified data from high-income countries might not be good proxies for LMICs as staffing levels where this research was conducted had comparatively better staffing levels than the few LMIC studies. This highlights a critical need for the conduct of nurse staffing research in LMIC contexts. LIMITATIONS: We included data on systematic reviews that scored low on our risk of bias assessment because we sought to provide a broad description of the research area. We only considered systematic reviews published in English and did not include any qualitative reviews in our synthesis. PROSPERO REGISTRATION NUMBER: CRD42021286908

A mixed-methods study to investigate feasibility and acceptability of an early warning score for preterm infants in neonatal units in Kenya: results of the NEWS-K study

Preterm birth (\u3c 37 weeks gestation) complications are the leading cause of neonatal mortality. Early-warning scores (EWS) are charts where vital signs (e.g., temperature, heart rate, respiratory rate) are recorded, triggering action. To evaluate whether a neonatal EWS improves clinical outcomes in low-middle income countries, a randomised trial is needed. Determining whether the use of a neonatal EWS is feasible and acceptable in newborn units, is a prerequisite to conducting a trial. We implemented a neonatal EWS in three newborn units in Kenya. Staff were asked to record infants’ vital signs on the EWS during the study, triggering additional interventions as per existing local guidelines. No other aspects of care were altered. Feasibility criteria were pre-specified. We also interviewed health professionals (n = 28) and parents/family members (n = 42) to hear their opinions of the EWS. Data were collected on 465 preterm and/or low birthweight (\u3c 2.5 kg) infants. In addition to qualitative study participants, 45 health professionals in participating hospitals also completed an online survey to share their views on the EWS. 94% of infants had the EWS completed at least once during their newborn unit admission. EWS completion was highest on the day of admission (93%). Completion rates were similar across shifts. 15% of vital signs triggered escalation to a more senior member of staff. Health professionals reported liking the EWS, though recognised the biggest barrier to implementation was poor staffing. Newborn unit infant to staff ratios varied between 10 and 53 staff per 1 infant, depending upon time of shift and staff type. A randomised trial of neonatal EWS in Kenya is possible and acceptable, though adaptations are required to the form before implementation

Nurse staffing and patient care outcomes: protocol for an umbrella review to identify evidence gaps for low and middle-income countries in global literature.

BACKGROUND: Adequate staffing is key to the delivery of nursing care and thus to improved inpatient and health service outcomes. Several systematic reviews have addressed the relationship between nurse staffing and these outcomes. Most primary studies within each systematic review are likely to be from high-income countries which have different practice contexts to low and middle-income countries (LMICs), although this has not been formally examined. We propose conducting an umbrella review to characterise the existing evidence linking nurse staffing to key outcomes and explicitly aim to identify evidence gaps in nurse staffing research in LMICs. METHODS AND ANALYSIS: This protocol was developed using the Preferred Reporting Items for Systematic Reviews and Meta-analysis Protocols (PRISMA-P). Literature searching will be conducted across Ovid Medline, Embase and EBSCO Cumulative Index to Nursing and Allied Health Literature (CINAHL) databases. Two independent reviewers will conduct searching and data abstraction and discordance will be handled by discussion between both parties. The risk of bias of the individual studies will be performed using the AMSTAR-2 . ETHICS AND DISSEMINATION Ethical permission is not required for this review as we will make use of already published data. We aim to publish the findings of our review in peer-reviewed journals. PROSPERO REGISTRATION NUMBER CRD42021286908

Prevalence and fluid management of dehydration in children without diarrhoea admitted to Kenyan hospitals: a multisite observational study

OBJECTIVES: To examine the prevalence of dehydration without diarrhoea among admitted children aged 1-59 months and to describe fluid management practices in such cases. DESIGN: A multisite observational study that used routine in-patient data collected prospectively between October 2013 and December 2018. SETTINGS: Study conducted in 13 county referral hospitals in Kenya. PARTICIPANTS: Children aged 1-59 months with admission or discharge diagnosis of dehydration but had no diarrhoea as a symptom or diagnosis. Children aged <28 days and those with severe acute malnutrition were excluded. RESULTS: The prevalence of dehydration in children without diarrhoea was 3.0% (2019/68 204) and comprised 15.9% (2019/12 702) of all dehydration cases. Only 55.8% (1127/2019) of affected children received either oral or intravenous fluid therapy. Where fluid treatment was given, the volumes, type of fluid, duration of fluid therapy and route of administration were similar to those used in the treatment of dehydration secondary to diarrhoea. Pneumonia (1021/2019, 50.6%) and malaria (715/2019, 35.4%) were the two most common comorbid diagnoses. Overall case fatality in the study population was 12.9% (260/2019). CONCLUSION: Sixteen per cent of children hospitalised with dehydration do not have diarrhoea but other common illnesses. Two-fifths do not receive fluid therapy; a regimen similar to that used in diarrhoeal cases is used in cases where fluid is administered. Efforts to promote compliance with guidance in routine clinical settings should recognise special circumstances where guidelines do not apply, and further studies on appropriate management for dehydration in the absence of diarrhoea are required

Effective coverage of essential inpatient care for small and sick newborns in a high mortality urban setting: a cross-sectional study in Nairobi City County, Kenya.

BACKGROUND: Effective coverage requires that those in need can access skilled care supported by adequate resources. There are, however, few studies of effective coverage of facility-based neonatal care in low-income settings, despite the recognition that improving newborn survival is a global priority. METHODS: We used a detailed retrospective review of medical records for neonatal admissions to public, private not-for-profit (mission) and private-for-profit (private) sector facilities providing 24×7 inpatient neonatal care in Nairobi City County to estimate the proportion of small and sick newborns receiving nationally recommended care across six process domains. We used our findings to explore the relationship between facility measures of structure and process and estimate effective coverage. RESULTS: Of 33 eligible facilities, 28 (four public, six mission and 18 private), providing an estimated 98.7% of inpatient neonatal care in the county, agreed to partake. Data from 1184 admission episodes were collected. Overall performance was lowest (weighted mean score 0.35 [95% confidence interval or CI: 0.22-0.48] out of 1) for correct prescription of fluid and feed volumes and best (0.86 [95% CI: 0.80-0.93]) for documentation of demographic characteristics. Doses of gentamicin, when prescribed, were at least 20% higher than recommended in 11.7% cases. Larger (often public) facilities tended to have higher process and structural quality scores compared with smaller, predominantly private, facilities. We estimate effective coverage to be 25% (estimate range: 21-31%). These newborns received high-quality inpatient care, while almost half (44.5%) of newborns needed care but did not receive it and a further 30.4% of newborns received an inadequate service. CONCLUSIONS: Failure to receive services and gaps in quality of care both contribute to a shortfall in effective coverage in Nairobi City County. Three-quarters of small and sick newborns do not have access to high-quality facility-based care. Substantial improvements in effective coverage will be required to tackle high neonatal mortality in this urban setting with high levels of poverty