External validation of the RISC, RISC-Malawi, and PERCH clinical prediction rules to identify risk of death in children hospitalized with pneumonia

BACKGROUND: Existing scores to identify children at risk of hospitalized pneumonia-related mortality lack broad external validation. Our objective was to externally validate three such risk scores. METHODS: We applied the Respiratory Index of Severity in Children (RISC) for HIV-negative children, the RISC-Malawi, and the Pneumonia Etiology Research for Child Health (PERCH) scores to hospitalized children in the Pneumonia REsearch Partnerships to Assess WHO REcommendations (PREPARE) data set. The PREPARE data set includes pooled data from 41 studies on pediatric pneumonia from across the world. We calculated test characteristics and the area under the curve (AUC) for each of these clinical prediction rules. RESULTS: The RISC score for HIV-negative children was applied to 3574 children 0-24 months and demonstrated poor discriminatory ability (AUC = 0.66, 95% confidence interval (CI) = 0.58-0.73) in the identification of children at risk of hospitalized pneumonia-related mortality. The RISC-Malawi score had fair discriminatory value (AUC = 0.75, 95% CI = 0.74-0.77) among 17 864 children 2-59 months. The PERCH score was applied to 732 children 1-59 months and also demonstrated poor discriminatory value (AUC = 0.55, 95% CI = 0.37-0.73). CONCLUSIONS: In a large external application of the RISC, RISC-Malawi, and PERCH scores, a substantial number of children were misclassified for their risk of hospitalized pneumonia-related mortality. Although pneumonia risk scores have performed well among the cohorts in which they were derived, their performance diminished when externally applied. A generalizable risk assessment tool with higher sensitivity and specificity to identify children at risk of hospitalized pneumonia-related mortality may be needed. Such a generalizable risk assessment tool would need context-specific validation prior to implementation in that setting

Assembling a global database of child pneumonia studies to inform WHO pneumonia management algorithm: methodology and applications

BACKGROUND: The existing World Health Organization (WHO) pneumonia case management guidelines rely on clinical symptoms and signs for identifying, classifying, and treating pneumonia in children up to 5 years old. We aimed to collate an individual patient-level data set from large, high-quality pre-existing studies on pneumonia in children to identify a set of signs and symptoms with greater validity in the diagnosis, prognosis, and possible treatment of childhood pneumonia for the improvement of current pneumonia case management guidelines. METHODS: Using data from a published systematic review and expert knowledge, we identified studies meeting our eligibility criteria and invited investigators to share individual-level patient data. We collected data on demographic information, general medical history, and current illness episode, including history, clinical presentation, chest radiograph findings when available, treatment, and outcome. Data were gathered separately from hospital-based and community-based cases. We performed a narrative synthesis to describe the final data set. RESULTS: Forty-one separate data sets were included in the Pneumonia Research Partnership to Assess WHO Recommendations (PREPARE) database, 26 of which were hospital-based and 15 were community-based. The PREPARE database includes 285 839 children with pneumonia (244 323 in the hospital and 41 516 in the community), with detailed descriptions of clinical presentation, clinical progression, and outcome. Of 9185 pneumonia-related deaths, 6836 (74%) occurred in children <1 year of age and 1317 (14%) in children aged 1-2 years. Of the 285 839 episodes, 280 998 occurred in children 0-59 months old, of which 129 584 (46%) were 2-11 months of age and 152 730 (54%) were males. CONCLUSIONS: This data set could identify an improved specific, sensitive set of criteria for diagnosing clinical pneumonia and help identify sick children in need of referral to a higher level of care or a change of therapy. Field studies could be designed based on insights from PREPARE analyses to validate a potential revised pneumonia algorithm. The PREPARE methodology can also act as a model for disease database assembly

Treating childhood pneumonia in hard-to-reach areas: A model-based comparison of mobile clinics and community-based care

BACKGROUND: Where hard-to-access populations (such as those living in insecure areas) lack access to basic health services, relief agencies, donors, and ministries of health face a dilemma in selecting the most effective intervention strategy. This paper uses a decision mathematical model to estimate the relative effectiveness of two alternative strategies, mobile clinics and fixed community-based health services, for antibiotic treatment of childhood pneumonia, the world's leading cause of child mortality. METHODS: A "Markov cycle tree" cohort model was developed in Excel with Visual Basic to compare the number of deaths from pneumonia in children aged 1 to 59 months expected under three scenarios: 1) No curative services available, 2) Curative services provided by a highly-skilled but intermittent mobile clinic, and 3) Curative services provided by a low-skilled community health post. Parameter values were informed by literature and expert interviews. Probabilistic sensitivity analyses were conducted for several plausible scenarios. RESULTS: We estimated median pneumonia-specific under-5 mortality rates of 0.51 (95% credible interval: 0.49 to 0.541) deaths per 10,000 child-days without treatment, 0.45 (95% CI: 0.43 to 0.48) with weekly mobile clinics, and 0.31 (95% CI: 0.29 to 0.32) with CHWs in fixed health posts. Sensitivity analyses found the fixed strategy superior, except when mobile clinics visited communities daily, where rates of care-seeking were substantially higher at mobile clinics than fixed posts, or where several variables simultaneously differed substantially from our baseline assumptions. CONCLUSIONS: Current evidence does not support the hypothesis that mobile clinics are more effective than CHWs. A CHW strategy therefore warrants consideration in high-mortality, hard-to-access areas. Uncertainty remains, and parameter values may vary across contexts, but the model allows preliminary findings to be updated as new or context-specific evidence becomes available. Decision analytic modelling can guide needed field-based research efforts in hard-to-access areas and offer evidence-based insights for decision-makers

External validation of the RISC, RISC-Malawi, and PERCH clinical prediction rules to identify risk of death in children hospitalized with pneumonia

From Crossref journal articles via Jisc Publications RouterBackground Existing scores to identify children at risk of hospitalized pneumonia-related mortality lack broad external validation. Our objective was to externally validate three such risk scores. Methods We applied the Respiratory Index of Severity in Children (RISC) for HIV-negative children, the RISC-Malawi, and the Pneumonia Etiology Research for Child Health (PERCH) scores to hospitalized children in the Pneumonia REsearch Partnerships to Assess WHO REcommendations (PREPARE) data set. The PREPARE data set includes pooled data from 41 studies on pediatric pneumonia from across the world. We calculated test characteristics and the area under the curve (AUC) for each of these clinical prediction rules. Results The RISC score for HIV-negative children was applied to 3574 children 0-24 months and demonstrated poor discriminatory ability (AUC = 0.66, 95% confidence interval (CI) = 0.58-0.73) in the identification of children at risk of hospitalized pneumonia-related mortality. The RISC-Malawi score had fair discriminatory value (AUC = 0.75, 95% CI = 0.74-0.77) among 17 864 children 2-59 months. The PERCH score was applied to 732 children 1-59 months and also demonstrated poor discriminatory value (AUC = 0.55, 95% CI = 0.37-0.73). Conclusions In a large external application of the RISC, RISC-Malawi, and PERCH scores, a substantial number of children were misclassified for their risk of hospitalized pneumonia-related mortality. Although pneumonia risk scores have performed well among the cohorts in which they were derived, their performance diminished when externally applied. A generalizable risk assessment tool with higher sensitivity and specificity to identify children at risk of hospitalized pneumonia-related mortality may be needed. Such a generalizable risk assessment tool would need context-specific validation prior to implementation in that setting.11pubpub

A literature review and survey of childhood pneumonia etiology studies: 2000-2010.

The Pneumonia Etiology Research for Child Health (PERCH) project is the largest multicountry etiology study of childhood pneumonia since the Board on Science and Technology in International Development studies of the 1980s. However, it is not the only recent or ongoing pneumonia etiology study, and even with seven sites, it cannot capture all epidemiologic settings in the developing world. Funding providers, researchers and policymakers rely on the best available evidence to strategically plan programs, new research directions and interventions. We aimed to describe the current landscape of recent pneumonia etiology studies in children under 5 years of age in the developed and developing world, as ascertained by a literature review of relevant studies with data since the year 2000 and a survey of researchers in the field of childhood pneumonia. We collected information on the study population, study design, case definitions, laboratory samples and methods and identified pathogens. A literature review identified 88 studies with child pneumonia etiology results. As of June 2010, our survey of researchers identified an additional 65 ongoing and recently completed child pneumonia etiology studies. This demonstrates the broad existing context into which the PERCH study must be placed. However, the landscape analysis also reveals a multiplicity of case definitions, levels of clinician involvement, facility types, specimen collection, and laboratory techniques. It reinforces the need for the standardization of methods and analyses for present and future pneumonia etiology studies in order to optimize their cumulative potential to accurately describe the microbial causes of childhood pneumonia

Derivation and validation of a novel risk assessment tool to identify children aged 2-59 months at risk of hospitalised pneumonia-related mortality in 20 countries

INTRODUCTION: Existing risk assessment tools to identify children at risk of hospitalised pneumonia-related mortality have shown suboptimal discriminatory value during external validation. Our objective was to derive and validate a novel risk assessment tool to identify children aged 2-59 months at risk of hospitalised pneumonia-related mortality across various settings. METHODS: We used primary, baseline, patient-level data from 11 studies, including children evaluated for pneumonia in 20 low-income and middle-income countries. Patients with complete data were included in a logistic regression model to assess the association of candidate variables with the outcome hospitalised pneumonia-related mortality. Adjusted log coefficients were calculated for each candidate variable and assigned weighted points to derive the Pneumonia Research Partnership to Assess WHO Recommendations (PREPARE) risk assessment tool. We used bootstrapped selection with 200 repetitions to internally validate the PREPARE risk assessment tool. RESULTS: A total of 27 388 children were included in the analysis (mean age 14.0 months, pneumonia-related case fatality ratio 3.1%). The PREPARE risk assessment tool included patient age, sex, weight-for-age z-score, body temperature, respiratory rate, unconsciousness or decreased level of consciousness, convulsions, cyanosis and hypoxaemia at baseline. The PREPARE risk assessment tool had good discriminatory value when internally validated (area under the curve 0.83, 95% CI 0.81 to 0.84). CONCLUSIONS: The PREPARE risk assessment tool had good discriminatory ability for identifying children at risk of hospitalised pneumonia-related mortality in a large, geographically diverse dataset. After external validation, this tool may be implemented in various settings to identify children at risk of hospitalised pneumonia-related mortality

Respiratory syncytial virus and human metapneumovirus in children with acute respiratory infections in Yemen

A survey of 604 Yemeni children younger than 2 years with acute respiratory infections identified respiratory syncytial virus (RSV) in 244 (40%), human metapneumovirus (HMPV) in 41 (7%) and RSV/HMPV coinfection in 25 (4%) children. RSV infections occurred in younger children and were associated with more severe hypoxia than observed with HMPV. Both viruses are important causes of severe acute respiratory infection in Yemen