Rasch scaling procedures for informing development of a valid Fetal Surveillance Education Program multiple-choice assessment

<p>Abstract</p> <p>Background</p> <p>It is widely recognised that deficiencies in fetal surveillance practice continue to contribute significantly to the burden of adverse outcomes. This has prompted the development of evidence-based clinical practice guidelines by the Royal Australian and New Zealand College of Obstetricians and Gynaecologists and an associated Fetal Surveillance Education Program to deliver the associated learning. This article describes initial steps in the validation of a corresponding multiple-choice assessment of the relevant educational outcomes through a combination of item response modelling and expert judgement.</p> <p>Methods</p> <p>The Rasch item response model was employed for item and test analysis and to empirically derive the substantive interpretation of the assessment variable. This interpretation was then compared to the hierarchy of competencies specified a priori by a team of eight subject-matter experts. Classical Test Theory analyses were also conducted.</p> <p>Results</p> <p>A high level of agreement between the hypothesised and derived variable provided evidence of construct validity. Item and test indices from Rasch analysis and Classical Test Theory analysis suggested that the current test form was of moderate quality. However, the analyses made clear the required steps for establishing a valid assessment of sufficient psychometric quality. These steps included: increasing the number of items from 40 to 50 in the first instance, reviewing ineffective items, targeting new items to specific content and difficulty gaps, and formalising the assessment blueprint in light of empirical information relating item structure to item difficulty.</p> <p>Conclusion</p> <p>The application of the Rasch model for criterion-referenced assessment validation with an expert stakeholder group is herein described. Recommendations for subsequent item and test construction are also outlined in this article.</p

Beyond maternal death: improving the quality of maternal care through national studies of ‘near-miss’ maternal morbidity

Knight M, Acosta C, Brocklehurst P, Cheshire A, Fitzpatrick K, Hinton L, Jokinen M, Kemp B, Kurinczuk JJ, Lewis G, Lindquist A, Locock L, Nair M, Patel N, Quigley M, Ridge D, Rivero-Arias O, Sellers S, Shah A on behalf of the UKNeS coapplicant group. Background Studies of maternal mortality have been shown to result in important improvements to women’s health. It is now recognised that in countries such as the UK, where maternal deaths are rare, the study of near-miss severe maternal morbidity provides additional information to aid disease prevention, treatment and service provision. Objectives To (1) estimate the incidence of specific near-miss morbidities; (2) assess the contribution of existing risk factors to incidence; (3) describe different interventions and their impact on outcomes and costs; (4) identify any groups in which outcomes differ; (5) investigate factors associated with maternal death; (6) compare an external confidential enquiry or a local review approach for investigating quality of care for affected women; and (7) assess the longer-term impacts. Methods Mixed quantitative and qualitative methods including primary national observational studies, database analyses, surveys and case studies overseen by a user advisory group. Setting Maternity units in all four countries of the UK. Participants Women with near-miss maternal morbidities, their partners and comparison women without severe morbidity. Main outcome measures The incidence, risk factors, management and outcomes of uterine rupture, placenta accreta, haemolysis, elevated liver enzymes and low platelets (HELLP) syndrome, severe sepsis, amniotic fluid embolism and pregnancy at advanced maternal age (≥ 48 years at completion of pregnancy); factors associated with progression from severe morbidity to death; associations between severe maternal morbidity and ethnicity and socioeconomic status; lessons for care identified by local and external review; economic evaluation of interventions for management of postpartum haemorrhage (PPH); women’s experiences of near-miss maternal morbidity; long-term outcomes; and models of maternity care commissioned through experience-led and standard approaches. Results Women and their partners reported long-term impacts of near-miss maternal morbidities on their physical and mental health. Older maternal age and caesarean delivery are associated with severe maternal morbidity in both current and future pregnancies. Antibiotic prescription for pregnant or postpartum women with suspected infection does not necessarily prevent progression to severe sepsis, which may be rapidly progressive. Delay in delivery, of up to 48 hours, may be safely undertaken in women with HELLP syndrome in whom there is no fetal compromise. Uterine compression sutures are a cost-effective second-line therapy for PPH. Medical comorbidities are associated with a fivefold increase in the odds of maternal death from direct pregnancy complications. External reviews identified more specific clinical messages for care than local reviews. Experience-led commissioning may be used as a way to commission maternity services. Limitations This programme used observational studies, some with limited sample size, and the possibility of uncontrolled confounding cannot be excluded. Conclusions Implementation of the findings of this research could prevent both future severe pregnancy complications as well as improving the outcome of pregnancy for women. One of the clearest findings relates to the population of women with other medical and mental health problems in pregnancy and their risk of severe morbidity. Further research into models of pre-pregnancy, pregnancy and postnatal care is clearly needed

How common is substandard obstetric care in adverse events of birth asphyxia, shoulder dystocia and postpartum hemorrhage? Findings from an external inspection of Norwegian maternity units

Introduction - The Norwegian Board of Health Supervision inspects healthcare institutions to ensure safety and quality of health and welfare services. A planned inspection of 12 maternity units aimed to investigate the practice of obstetric care in the case of birth asphyxia, shoulder dystocia and severe postpartum hemorrhage. Material and methods - The inspection was carried out at two large, four medium and six small maternity units in Norway in 2016 to investigate adverse events that occurred between 1 January and 31 December 2014. Six of them were selected as control units. The Norwegian Board of Health Supervision searched the Medical Birth Registry of Norway to identify adverse events in each of the categories and then requested access to the medical records for all patients identified. Information about guidelines, formal teaching and simulation training at each unit was obtained by sending a questionnaire to the obstetrician in charge of each maternity unit. Results - The obstetric units inspected had 553 serious adverse events of birth asphyxia, shoulder dystocia or severe postpartum hemorrhage among 17 323 deliveries. Twenty-nine events were excluded from further analysis due to erroneous coding or missing data in the patients’ medical records. We included 524 cases (3.0% of all deliveries) of adverse events in the final analysis. Medical errors caused by substandard care were present in 295 (56.2%) cases. There was no difference in the prevalence of substandard care among the maternity units according to their size. Surprisingly, we found significantly fewer cases with substandard care in the units which the supervisory authorities considered particularly risky before the inspection, compared with the control units. Seven of the 12 units had regular formal teaching and training arrangements for obstetric healthcare personnel as outlined in the national guidelines. Conclusions - Prevalence of adverse events was 3% and similar in all maternity units irrespective of their size. A breach in the standard of care was observed in 56.2% of cases and almost half of the maternity units did not follow national recommendations regarding teaching and practical training of obstetric personnel, suggesting that they should focus on implementing guidelines and training their staff