What is meant by validity in maternal and newborn health measurement? A conceptual framework for understanding indicator validation.

BACKGROUND: Rigorous monitoring supports progress in achieving maternal and newborn mortality and morbidity reductions. Recent work to strengthen measurement for maternal and newborn health highlights the existence of a large number of indicators being used for this purpose. The definitions and data sources used to produce indicator estimates vary and challenges exist with completeness, accuracy, transparency, and timeliness of data. The objective of this study is to create a conceptual overview of how indicator validity is defined and understood by those who develop and use maternal and newborn health indicators. METHODS: A conceptual framework of validity was developed using mixed methods. We were guided by principles for conceptual frameworks and by a review of the literature and key maternal and newborn health indicator guidance documents. We also conducted qualitative semi-structured interviews with 32 key informants chosen through purposive sampling. RESULTS: We categorised indicator validity into three main types: criterion, convergent, and construct. Criterion or diagnostic validity, comparing a measure with a gold standard, has predominantly been used to assess indicators of care coverage and content. Studies assessing convergent validity quantify the extent to which two or more indicator measurement approaches, none of which is a gold-standard, relate. Key informants considered construct validity, or the accuracy of the operationalisation of a concept or phenomenon, a critical part of the overall assessment of indicator validity. CONCLUSION: Given concerns about the large number of maternal and newborn health indicators currently in use, a more consistent understanding of validity can help guide prioritization of key indicators and inform development of new indicators. All three types of validity are relevant for evaluating the performance of maternal and newborn health indicators. We highlight the need to establish a common language and understanding of indicator validity among the various global and local stakeholders working within maternal and newborn health

Advances in the measurement of coverage for RMNCH and nutrition: from contact to effective coverage.

Current methods for measuring intervention coverage for reproductive, maternal, newborn, and child health and nutrition (RMNCH+N) do not adequately capture the quality of services delivered. Without information on the quality of care, it is difficult to assess whether services provided will result in expected health improvements. We propose a six-step coverage framework, starting from a target population to (1) service contact, (2) likelihood of services, (3) crude coverage, (4) quality-adjusted coverage, (5) user-adherence-adjusted coverage and (6) outcome-adjusted coverage. We support our framework with a comprehensive review of published literature on effective coverage for RMNCH+N interventions since 2000. We screened 8103 articles and selected 36 from which we summarised current methods for measuring effective coverage and computed the gaps between 'crude' coverage measures and quality-adjusted measures. Our review showed considerable variability in data sources, indicator definitions and analytical approaches for effective coverage measurement. Large gaps between crude coverage and quality-adjusted coverage levels were evident, ranging from an average of 10 to 38 percentage points across the RMNCH+N interventions assessed. We define effective coverage as the proportion of individuals experiencing health gains from a service among those who need the service, and distinguish this from other indicators along a coverage cascade that make quality adjustments. We propose a systematic approach for analysis along six steps in the cascade. Research to date shows substantial drops in effective delivery of care across these steps, but variation in methods limits comparability of the results. Advancement in coverage measurement will require standardisation of effective coverage terminology and improvements in data collection and methodological approaches

Count every newborn; a measurement improvement roadmap for coverage data.

BACKGROUND: The Every Newborn Action Plan (ENAP), launched in 2014, aims to end preventable newborn deaths and stillbirths, with national targets of ≤12 neonatal deaths per 1000 live births and ≤12 stillbirths per 1000 total births by 2030. This requires ambitious improvement of the data on care at birth and of small and sick newborns, particularly to track coverage, quality and equity. METHODS: In a multistage process, a matrix of 70 indicators were assessed by the Every Newborn steering group. Indicators were graded based on their availability and importance to ENAP, resulting in 10 core and 10 additional indicators. A consultation process was undertaken to assess the status of each ENAP core indicator definition, data availability and measurement feasibility. Coverage indicators for the specific ENAP treatment interventions were assigned task teams and given priority as they were identified as requiring the most technical work. Consultations were held throughout. RESULTS: ENAP published 10 core indicators plus 10 additional indicators. Three core impact indicators (neonatal mortality rate, maternal mortality ratio, stillbirth rate) are well defined, with future efforts needed to focus on improving data quantity and quality. Three core indicators on coverage of care for all mothers and newborns (intrapartum/skilled birth attendance, early postnatal care, essential newborn care) have defined contact points, but gaps exist in measuring content and quality of the interventions. Four core (antenatal corticosteroids, neonatal resuscitation, treatment of serious neonatal infections, kangaroo mother care) and one additional coverage indicator for newborns at risk or with complications (chlorhexidine cord cleansing) lack indicator definitions or data, especially for denominators (population in need). To address these gaps, feasible coverage indicator definitions are presented for validity testing. Measurable process indicators to help monitor health service readiness are also presented. A major measurement gap exists to monitor care of small and sick babies, yet signal functions could be tracked similarly to emergency obstetric care. CONCLUSIONS: The ENAP Measurement Improvement Roadmap (2015-2020) outlines tools to be developed (e.g., improved birth and death registration, audit, and minimum perinatal dataset) and actions to test, validate and institutionalise proposed coverage indicators. The roadmap presents a unique opportunity to strengthen routine health information systems, crosslinking these data with civil registration and vital statistics and population-based surveys. Real measurement change requires intentional transfer of leadership to countries with the greatest disease burden and will be achieved by working with centres of excellence and existing networks

Countdown to 2030 : tracking progress towards universal coverage for reproductive, maternal, newborn, and child health

Building upon the successes of Countdown to 2015, Countdown to 2030 aims to support the monitoring and measurement of women's, children's, and adolescents' health in the 81 countries that account for 95% of maternal and 90% of all child deaths worldwide. To achieve the Sustainable Development Goals by 2030, the rate of decline in prevalence of maternal and child mortality, stillbirths, and stunting among children younger than 5 years of age needs to accelerate considerably compared with progress since 2000. Such accelerations are only possible with a rapid scale-up of effective interventions to all population groups within countries (particularly in countries with the highest mortality and in those affected by conflict), supported by improvements in underlying socioeconomic conditions, including women's empowerment. Three main conclusions emerge from our analysis of intervention coverage, equity, and drivers of reproductive, maternal, newborn, and child health (RMNCH) in the 81 Countdown countries. First, even though strong progress was made in the coverage of many essential RMNCH interventions during the past decade, many countries are still a long way from universal coverage for most essential interventions. Furthermore, a growing body of evidence suggests that available services in many countries are of poor quality, limiting the potential effect on RMNCH outcomes. Second, within-country inequalities in intervention coverage are reducing in most countries (and are now almost non-existent in a few countries), but the pace is too slow. Third, health-sector (eg, weak country health systems) and non-health-sector drivers (eg, conflict settings) are major impediments to delivering high-quality services to all populations. Although more data for RMNCH interventions are available now, major data gaps still preclude the use of evidence to drive decision making and accountability. Countdown to 2030 is investing in improvements in measurement in several areas, such as quality of care and effective coverage, nutrition programmes, adolescent health, early childhood development, and evidence for conflict settings, and is prioritising its regional networks to enhance local analytic capacity and evidence for RMNCH

A call for standardised age-disaggregated health data.

The 2030 Sustainable Development Goals agenda calls for health data to be disaggregated by age. However, age groupings used to record and report health data vary greatly, hindering the harmonisation, comparability, and usefulness of these data, within and across countries. This variability has become especially evident during the COVID-19 pandemic, when there was an urgent need for rapid cross-country analyses of epidemiological patterns by age to direct public health action, but such analyses were limited by the lack of standard age categories. In this Personal View, we propose a recommended set of age groupings to address this issue. These groupings are informed by age-specific patterns of morbidity, mortality, and health risks, and by opportunities for prevention and disease intervention. We recommend age groupings of 5 years for all health data, except for those younger than 5 years, during which time there are rapid biological and physiological changes that justify a finer disaggregation. Although the focus of this Personal View is on the standardisation of the analysis and display of age groups, we also outline the challenges faced in collecting data on exact age, especially for health facilities and surveillance data. The proposed age disaggregation should facilitate targeted, age-specific policies and actions for health care and disease management

Improving the health of the global poor.

We analyzed the technical basis for a major global program to reduce disease among the poor. Effective interventions exist against the few diseases which most account for excess mortality among the poor. Achieving high coverage of effective interventions requires a well-functioning health system, as well as overcoming a set of financial and nonfinancial constraints. The annual incremental cost would be between $40 billion and$52 billion by 2015 in 83 low-income and sub-Saharan African countries. Such a program is feasible and would avoid millions of child, maternal, and adult deaths annually in poor countries

Preventing vertical transmission of HIV in Kinshasa, Democratic Republic of the Congo: a baseline survey of 18 antenatal clinics.

OBJECTIVE: To assess the content and delivery of essential antenatal services before implementation of programmes for prevention of mother-to-child transmission (PMTCT) of human immunodeficiency virus (HIV). METHODS: We assessed 18 antenatal care centres (eight public units and ten managed by nongovernmental organizations) in Kinshasa, Democratic Republic of the Congo. We used a survey to capture information about the number and type of antenatal health workers, infrastructure capacity and the delivery of basic antenatal care services such as: nutritional counselling; tetanus toxoid vaccination; prevention and management of anaemia, malaria, sexually transmitted infections, and tuberculosis; and counselling for postpartum contraception. FINDINGS: Antenatal care units differed with respect to size, capacity, cost, service delivery systems and content. For instance, 17 of the 18 sites offered anaemia screening but only two sites included the cost in the card that gives access to antenatal care. Nine of the clinics (50%) reported providing the malaria prophyalxis sulfadoxine pyrimethamine as per national policy. Four (22%) of the sites offered syphilis screening. CONCLUSION: Scaling up PMTCT programmes in under-resourced settings requires evaluation and strengthening of existing basic antenatal care service delivery