Wanted: studies on mortality estimation methods for humanitarian emergencies, suggestions for future research.

Measuring rates and circumstances of population mortality (in particular crude and under-5 year mortality rates) is essential to evidence-based humanitarian relief interventions. Because prospective vital event registration is absent or deteriorates in nearly all crisis-affected populations, retrospective household surveys are often used to estimate and describe patterns of mortality. Originally designed for measuring vaccination coverage, the two-stage cluster survey methodology is frequently employed to measure mortality retrospectively due to limited time and resources during humanitarian emergencies. The method tends to be followed without considering alternatives, and there is a need for expert advice to guide health workers measuring mortality in the field. In a workshop in France in June 2006, we deliberated the problems inherent in this method when applied to measure outcomes other than vaccine coverage and acute malnutrition (specifically, mortality), and considered recommendations for improvement. Here we describe these recommendations and outline outstanding issues in three main problem areas in emergency mortality assessment discussed during the workshop: sampling, household data collection issues, and cause of death ascertainment. We urge greater research on these issues. As humanitarian emergencies become ever more complex, all agencies should benefit from the most recently tried and tested survey tools

A new method to estimate mortality in crisis-affected and resource-poor settings: validation study

Background Data on mortality rates are crucial to guide health interventions in crisis-affected and resource-poor settings. The methods currently available to collect mortality data in such settings feature important methodological limitations. We developed and validated a new method to provide near real-time mortality estimates in such settings

Performance of Small Cluster Surveys and the Clustered LQAS Design to estimate Local-level Vaccination Coverage in Mali

<p>Abstract</p> <p>Background</p> <p>Estimation of vaccination coverage at the local level is essential to identify communities that may require additional support. Cluster surveys can be used in resource-poor settings, when population figures are inaccurate. To be feasible, cluster samples need to be small, without losing robustness of results. The clustered LQAS (CLQAS) approach has been proposed as an alternative, as smaller sample sizes are required.</p> <p>Methods</p> <p>We explored (i) the efficiency of cluster surveys of decreasing sample size through bootstrapping analysis and (ii) the performance of CLQAS under three alternative sampling plans to classify local VC, using data from a survey carried out in Mali after mass vaccination against meningococcal meningitis group A.</p> <p>Results</p> <p>VC estimates provided by a 10 × 15 cluster survey design were reasonably robust. We used them to classify health areas in three categories and guide mop-up activities: i) health areas not requiring supplemental activities; ii) health areas requiring additional vaccination; iii) health areas requiring further evaluation. As sample size decreased (from 10 × 15 to 10 × 3), standard error of VC and ICC estimates were increasingly unstable. Results of CLQAS simulations were not accurate for most health areas, with an overall risk of misclassification greater than 0.25 in one health area out of three. It was greater than 0.50 in one health area out of two under two of the three sampling plans.</p> <p>Conclusions</p> <p>Small sample cluster surveys (10 × 15) are acceptably robust for classification of VC at local level. We do not recommend the CLQAS method as currently formulated for evaluating vaccination programmes.</p

Precision, time, and cost: a comparison of three sampling designs in an emergency setting

The conventional method to collect data on the health, nutrition, and food security status of a population affected by an emergency is a 30 × 30 cluster survey. This sampling method can be time and resource intensive and, accordingly, may not be the most appropriate one when data are needed rapidly for decision making. In this study, we compare the precision, time and cost of the 30 × 30 cluster survey with two alternative sampling designs: a 33 × 6 cluster design (33 clusters, 6 observations per cluster) and a 67 × 3 cluster design (67 clusters, 3 observations per cluster). Data for each sampling design were collected concurrently in West Darfur, Sudan in September-October 2005 in an emergency setting. Results of the study show the 30 × 30 design to provide more precise results (i.e. narrower 95% confidence intervals) than the 33 × 6 and 67 × 3 design for most child-level indicators. Exceptions are indicators of immunization and vitamin A capsule supplementation coverage which show a high intra-cluster correlation. Although the 33 × 6 and 67 × 3 designs provide wider confidence intervals than the 30 × 30 design for child anthropometric indicators, the 33 × 6 and 67 × 3 designs provide the opportunity to conduct a LQAS hypothesis test to detect whether or not a critical threshold of global acute malnutrition prevalence has been exceeded, whereas the 30 × 30 design does not. For the household-level indicators tested in this study, the 67 × 3 design provides the most precise results. However, our results show that neither the 33 × 6 nor the 67 × 3 design are appropriate for assessing indicators of mortality. In this field application, data collection for the 33 × 6 and 67 × 3 designs required substantially less time and cost than that required for the 30 × 30 design. The findings of this study suggest the 33 × 6 and 67 × 3 designs can provide useful time- and resource-saving alternatives to the 30 × 30 method of data collection in emergency settings