Using health worker opinions to assess changes in structural components of quality in a Cluster Randomized Trial.

BACKGROUND: The 'resource readiness' of health facilities to provide effective services is captured in the structure component of the classical Donabedian paradigm often used for assessment of the quality of care in the health sector. Periodic inventories are commonly used to confirm the presence (or absence) of equipment or drugs by physical observation or by asking those in charge to indicate whether an item is present or not. It is then assumed that this point observation is representative of the everyday status. However the availability of an item (consumables) may vary. Arguably therefore a more useful assessment for resources would be one that captures this fluctuation in time. Here we report an approach that may circumvent these difficulties. METHODS: We used self-administered questionnaires (SAQ) to seek health worker views of availability of key resources supporting paediatric care linked to a cluster randomized trial of a multifaceted intervention aimed at improving this care conducted in eight rural Kenyan district hospitals. Four hospitals received a full intervention and four a partial intervention. Data were collected pre-intervention and after 6 and 18 months from health workers in three clinical areas asked to score item availability using an 11-point scale. Mean scores for items common to all 3 areas and mean scores for items allocated to domains identified using exploratory factor analysis (EFA) were used to describe availability and explore changes over time. RESULTS: SAQ were collected from 1,156 health workers. EFA identified 11 item domains across the three departments. Mean availability scores for these domains were often <5/10 at baseline reflecting lack of basic resources such as oxygen, nutrition and second line drugs. An improvement in mean scores occurred in 8 out of 11 domains in both control and intervention groups. A calculation of difference in difference of means for intervention vs. control suggested an intervention effect resulting in greater changes in 5 out of 11 domains. CONCLUSION: Using SAQ data to assess resource availability experienced by health workers provides an alternative to direct observations that provide point prevalence estimates. Further the approach was able to demonstrate poor access to resources, change over time and variability across place

A cross sectional comparison of postnatal care quality in facilities participating in a maternal health voucher program versus non-voucher facilities in Kenya

Background: Health service fees constitute substantial barriers for women seeking childbirth and postnatal care. In an effort to reduce health inequities, the government of Kenya in 2006 introduced the output-based approach (OBA), or voucher programme, to increase poor women’s access to quality Safe Motherhood services including postnatal care. To help improve service quality, OBA programmes purchase services on behalf of the poor and marginalised, with provider reimbursements for verified services. Kenya’s programme accredited health facilities in three districts as well as in two informal Nairobi settlements. Methods: Postnatal care quality in voucher health facilities (n = 21) accredited in 2006 and in similar non-voucher health facilities (n = 20) are compared with cross sectional data collected in 2010. Summary scores for quality were calculated as additive sums of specific aspects of each attribute (structure, process, outcome). Measures of effect were assessed in a linear regression model accounting for clustering at facility level. Data were analysed using Stata 11.0. Results: The overall quality of postnatal care is poor in voucher and non-voucher facilities, but many facilities demonstrated ‘readiness’ for postnatal care (structural attributes: infrastructure, equipment, supplies, staffing, training) indicated by high scores (83/111), with public voucher facilities scoring higher than public non-voucher facilities. The two groups of facilities evinced no significant differences in postnatal care mean process scores: 14.2/ 55 in voucher facilities versus 16.4/55 in non-voucher facilities; coefficient: -1.70 (-4.9, 1.5), p = 0.294. Significantly more newborns were seen within 48 hours (83.5 % versus 72.1 %: p = 0.001) and received Bacillus Calmette-Guerin (BCG) (82.5 % versus 76.5 %: p \u3c 0.001) at voucher facilities than at non-voucher facilities. Conclusions: Four years after facility accreditation in Kenya, scores for postnatal care quality are low in all facilities, even those with Safe Motherhood vouchers. We recommend the Kenya OBA programme review its Safe Motherhood reimbursement package and draw lessons from supply side results-based financing initiatives, to improve postnatal care quality

Prenatal surgery for myelomeningocele and the need for cerebrospinal fluid shunt placement.

ObjectThe Management of Myelomeningocele Study (MOMS) was a multicenter randomized trial comparing the safety and efficacy of prenatal and postnatal closure of myelomeningocele. The trial was stopped early because of the demonstrated efficacy of prenatal surgery, and outcomes on 158 of 183 pregnancies were reported. Here, the authors update the 1-year outcomes for the complete trial, analyze the primary and related outcomes, and evaluate whether specific prerandomization risk factors are associated with prenatal surgery benefit.MethodsThe primary outcome was a composite of fetal loss or any of the following: infant death, CSF shunt placement, or meeting the prespecified criteria for shunt placement. Primary outcome, actual shunt placement, and shunt revision rates for prenatal versus postnatal repair were compared. The shunt criteria were reassessed to determine which were most concordant with practice, and a new composite outcome was created from the primary outcome by replacing the original criteria for CSF shunt placement with the revised criteria. The authors used logistic regression to estimate whether there were interactions between the type of surgery and known prenatal risk factors (lesion level, gestational age, degree of hindbrain herniation, and ventricle size) for shunt placement, and to determine which factors were associated with shunting among those infants who underwent prenatal surgery.ResultsNinety-one women were randomized to prenatal surgery and 92 to postnatal repair. The primary outcome occurred in 73% of infants in the prenatal surgery group and in 98% in the postnatal group (p &lt; 0.0001). Actual rates of shunt placement were only 44% and 84% in the 2 groups, respectively (p &lt; 0.0001). The authors revised the most commonly met criterion to require overt clinical signs of increased intracranial pressure, defined as split sutures, bulging fontanelle, or sunsetting eyes, in addition to increasing head circumference or hydrocephalus. Using these modified criteria, only 3 patients in each group met criteria but did not receive a shunt. For the revised composite outcome, there was a difference between the prenatal and postnatal surgery groups: 49.5% versus 87.0% (p &lt; 0.0001). There was also a significant reduction in the number of children who had a shunt placed and then required a revision by 1 year of age in the prenatal group (15.4% vs 40.2%, relative risk 0.38 [95% CI 0.22-0.66]). In the prenatal surgery group, 20% of those with ventricle size &lt; 10 mm at initial screening, 45.2% with ventricle size of 10 up to 15 mm, and 79.0% with ventricle size ≥ 15 mm received a shunt, whereas in the postnatal group, 79.4%, 86.0%, and 87.5%, respectively, received a shunt (p = 0.02). Lesion level and degree of hindbrain herniation appeared to have no effect on the eventual need for shunting (p = 0.19 and p = 0.13, respectively). Similar results were obtained for the revised outcome.ConclusionsLarger ventricles at initial screening are associated with an increased need for shunting among those undergoing fetal surgery for myelomeningocele. During prenatal counseling, care should be exercised in recommending prenatal surgery when the ventricles are 15 mm or larger because prenatal surgery does not appear to improve outcome in this group. The revised criteria may be useful as guidelines for treating hydrocephalus in this group

Prenatal surgery for myelomeningocele and the need for cerebrospinal fluid shunt placement

OBJECT: The Management of Myelomeningocele Study (MOMS) was a multicenter randomized trial comparing the safety and efficacy of prenatal and postnatal closure of myelomeningocele. The trial was stopped early because of the demonstrated efficacy of prenatal surgery, and outcomes on 158 of 183 pregnancies were reported. Here, the authors update the 1-year outcomes for the complete trial, analyze the primary and related outcomes, and evaluate whether specific prerandomization risk factors are associated with prenatal surgery benefit. METHODS: The primary outcome was a composite of fetal loss or any of the following: infant death, CSF shunt placement, or meeting the prespecified criteria for shunt placement. Primary outcome, actual shunt placement, and shunt revision rates for prenatal versus postnatal repair were compared. The shunt criteria were reassessed to determine which were most concordant with practice, and a new composite outcome was created from the primary outcome by replacing the original criteria for CSF shunt placement with the revised criteria. The authors used logistic regression to estimate whether there were interactions between the type of surgery and known prenatal risk factors (lesion level, gestational age, degree of hindbrain herniation, and ventricle size) for shunt placement, and to determine which factors were associated with shunting among those infants who underwent prenatal surgery. RESULTS: Ninety-one women were randomized to prenatal surgery and 92 to postnatal repair. The primary outcome occurred in 73% of infants in the prenatal surgery group and in 98% in the postnatal group (p < 0.0001). Actual rates of shunt placement were only 44% and 84% in the 2 groups, respectively (p < 0.0001). The authors revised the most commonly met criterion to require overt clinical signs of increased intracranial pressure, defined as split sutures, bulging fontanelle, or sunsetting eyes, in addition to increasing head circumference or hydrocephalus. Using these modified criteria, only 3 patients in each group met criteria but did not receive a shunt. For the revised composite outcome, there was a difference between the prenatal and postnatal surgery groups: 49.5% versus 87.0% (p < 0.0001). There was also a significant reduction in the number of children who had a shunt placed and then required a revision by 1 year of age in the prenatal group (15.4% vs 40.2%, relative risk 0.38 [95% CI 0.22–0.66]). In the prenatal surgery group, 20% of those with ventricle size < 10 mm at initial screening, 45.2% with ventricle size of 10 up to 15 mm, and 79.0% with ventricle size ≥ 15 mm received a shunt, whereas in the postnatal group, 79.4%, 86.0%, and 87.5%, respectively, received a shunt (p = 0.02). Lesion level and degree of hindbrain herniation appeared to have no effect on the eventual need for shunting (p = 0.19 and p = 0.13, respectively). Similar results were obtained for the revised outcome. CONCLUSIONS: Larger ventricles at initial screening are associated with an increased need for shunting among those undergoing fetal surgery for myelomeningocele. During prenatal counseling, care should be exercised in recommending prenatal surgery when the ventricles are 15 mm or larger because prenatal surgery does not appear to improve outcome in this group. The revised criteria may be useful as guidelines for treating hydrocephalus in this group