External validation of prognostic models to predict stillbirth using the International Prediction of Pregnancy Complications (IPPIC) Network database: an individual participant data meta-analysis

Objective Stillbirth is a potentially preventable complication of pregnancy. Identifying women at high risk of stillbirth can guide decisions on the need for closer surveillance and timing of delivery in order to prevent fetal death. Prognostic models have been developed to predict the risk of stillbirth, but none has yet been validated externally. In this study, we externally validated published prediction models for stillbirth using individual participant data (IPD) meta-analysis to assess their predictive performance. Methods MEDLINE, EMBASE, DH-DATA and AMED databases were searched from inception to December 2020 to identify studies reporting stillbirth prediction models. Studies that developed or updated prediction models for stillbirth for use at any time during pregnancy were included. IPD from cohorts within the International Prediction of Pregnancy Complications (IPPIC) Network were used to validate externally the identified prediction models whose individual variables were available in the IPD. The risk of bias of the models and cohorts was assessed using the Prediction study Risk Of Bias ASsessment Tool (PROBAST). The discriminative performance of the models was evaluated using the C-statistic, and calibration was assessed using calibration plots, calibration slope and calibration-in-the-large. Performance measures were estimated separately in each cohort, as well as summarized across cohorts using random-effects meta-analysis. Clinical utility was assessed using net benefit. Results Seventeen studies reporting the development of 40 prognostic models for stillbirth were identified. None of the models had been previously validated externally, and the full model equation was reported for only one-fifth (20%, 8/40) of the models. External validation was possible for three of these models, using IPD from 19 cohorts (491 201 pregnant women) within the IPPIC Network database. Based on evaluation of the model development studies, all three models had an overall high risk of bias, according to PROBAST. In the IPD meta-analysis, the models had summary C-statistics ranging from 0.53 to 0.65 and summary calibration slopes ranging from 0.40 to 0.88, with risk predictions that were generally too extreme compared with the observed risks. The models had little to no clinical utility, as assessed by net benefit. However, there remained uncertainty in the performance of some models due to small available sample sizes. Conclusions The three validated stillbirth prediction models showed generally poor and uncertain predictive performance in new data, with limited evidence to support their clinical application. The findings suggest methodological shortcomings in their development, including overfitting. Further research is needed to further validate these and other models, identify stronger prognostic factors and develop more robust prediction models. (c) 2021 The Authors. Ultrasound in Obstetrics & Gynecology published by John Wiley & Sons Ltd on behalf of International Society of Ultrasound in Obstetrics and Gynecology.Peer reviewe

EuReCa ONE—27 Nations, ONE Europe, ONE Registry A prospective one month analysis of out-of-hospital cardiac arrest outcomes in 27 countries in Europe

AbstractIntroductionThe aim of the EuReCa ONE study was to determine the incidence, process, and outcome for out of hospital cardiac arrest (OHCA) throughout Europe.MethodsThis was an international, prospective, multi-centre one-month study. Patients who suffered an OHCA during October 2014 who were attended and/or treated by an Emergency Medical Service (EMS) were eligible for inclusion in the study. Data were extracted from national, regional or local registries.ResultsData on 10,682 confirmed OHCAs from 248 regions in 27 countries, covering an estimated population of 174 million. In 7146 (66%) cases, CPR was started by a bystander or by the EMS. The incidence of CPR attempts ranged from 19.0 to 104.0 per 100,000 population per year. 1735 had ROSC on arrival at hospital (25.2%), Overall, 662/6414 (10.3%) in all cases with CPR attempted survived for at least 30 days or to hospital discharge.ConclusionThe results of EuReCa ONE highlight that OHCA is still a major public health problem accounting for a substantial number of deaths in Europe.EuReCa ONE very clearly demonstrates marked differences in the processes for data collection and reported outcomes following OHCA all over Europe. Using these data and analyses, different countries, regions, systems, and concepts can benchmark themselves and may learn from each other to further improve survival following one of our major health care events

External validation of prognostic models predicting pre-eclampsia : individual participant data meta-analysis

Abstract Background Pre-eclampsia is a leading cause of maternal and perinatal mortality and morbidity. Early identification of women at risk during pregnancy is required to plan management. Although there are many published prediction models for pre-eclampsia, few have been validated in external data. Our objective was to externally validate published prediction models for pre-eclampsia using individual participant data (IPD) from UK studies, to evaluate whether any of the models can accurately predict the condition when used within the UK healthcare setting. Methods IPD from 11 UK cohort studies (217,415 pregnant women) within the International Prediction of Pregnancy Complications (IPPIC) pre-eclampsia network contributed to external validation of published prediction models, identified by systematic review. Cohorts that measured all predictor variables in at least one of the identified models and reported pre-eclampsia as an outcome were included for validation. We reported the model predictive performance as discrimination (C-statistic), calibration (calibration plots, calibration slope, calibration-in-the-large), and net benefit. Performance measures were estimated separately in each available study and then, where possible, combined across studies in a random-effects meta-analysis. Results Of 131 published models, 67 provided the full model equation and 24 could be validated in 11 UK cohorts. Most of the models showed modest discrimination with summary C-statistics between 0.6 and 0.7. The calibration of the predicted compared to observed risk was generally poor for most models with observed calibration slopes less than 1, indicating that predictions were generally too extreme, although confidence intervals were wide. There was large between-study heterogeneity in each model’s calibration-in-the-large, suggesting poor calibration of the predicted overall risk across populations. In a subset of models, the net benefit of using the models to inform clinical decisions appeared small and limited to probability thresholds between 5 and 7%. Conclusions The evaluated models had modest predictive performance, with key limitations such as poor calibration (likely due to overfitting in the original development datasets), substantial heterogeneity, and small net benefit across settings. The evidence to support the use of these prediction models for pre-eclampsia in clinical decision-making is limited. Any models that we could not validate should be examined in terms of their predictive performance, net benefit, and heterogeneity across multiple UK settings before consideration for use in practice. Trial registration PROSPERO ID: CRD42015029349

A core outcome set for pre‐eclampsia research: an international consensus development study

Objective To develop a core outcome set for pre‐eclampsia. Design Consensus development study. Setting International. Population Two hundred and eight‐one healthcare professionals, 41 researchers and 110 patients, representing 56 countries, participated. Methods Modified Delphi method and Modified Nominal Group Technique. Results A long‐list of 116 potential core outcomes was developed by combining the outcomes reported in 79 pre‐eclampsia trials with those derived from thematic analysis of 30 in‐depth interviews of women with lived experience of pre‐eclampsia. Forty‐seven consensus outcomes were identified from the Delphi process following which 14 maternal and eight offspring core outcomes were agreed at the consensus development meeting. Maternal core outcomes: death, eclampsia, stroke, cortical blindness, retinal detachment, pulmonary oedema, acute kidney injury, liver haematoma or rupture, abruption, postpartum haemorrhage, raised liver enzymes, low platelets, admission to intensive care required, and intubation and ventilation. Offspring core outcomes: stillbirth, gestational age at delivery, birthweight, small‐for‐gestational‐age, neonatal mortality, seizures, admission to neonatal unit required and respiratory support. Conclusions The core outcome set for pre‐eclampsia should underpin future randomised trials and systematic reviews. Such implementation should ensure that future research holds the necessary reach and relevance to inform clinical practice, enhance women's care and improve the outcomes of pregnant women and their babies