Inter- and Intra-Observer Variability and the Effect of Experience in Cine-MRI for Adhesion Detection

Cine-MRI for adhesion detection is a promising novel modality that can help the large group of patients developing pain after abdominal surgery. Few studies into its diagnostic accuracy are available, and none address observer variability. This retrospective study explores the inter- and intra-observer variability, diagnostic accuracy, and the effect of experience. A total of 15 observers with a variety of experience reviewed 61 sagittal cine-MRI slices, placing box annotations with a confidence score at locations suspect for adhesions. Five observers reviewed the slices again one year later. Inter- and intra-observer variability are quantified using Fleiss’ (inter) and Cohen’s (intra) κ and percentage agreement. Diagnostic accuracy is quantified with receiver operating characteristic (ROC) analysis based on a consensus standard. Inter-observer Fleiss’ κ values range from 0.04 to 0.34, showing poor to fair agreement. High general and cine-MRI experience led to significantly (p &lt; 0.001) better agreement among observers. The intra-observer results show Cohen’s κ values between 0.37 and 0.53 for all observers, except one with a low κ of −0.11. Group AUC scores lie between 0.66 and 0.72, with individual observers reaching 0.78. This study confirms that cine-MRI can diagnose adhesions, with respect to a radiologist consensus panel and shows that experience improves reading cine-MRI. Observers without specific experience adapt to this modality quickly after a short online tutorial. Observer agreement is fair at best and area under the receiver operating characteristic curve (AUC) scores leave room for improvement. Consistently interpreting this novel modality needs further research, for instance, by developing reporting guidelines or artificial intelligence-based methods.</p

Inter- and Intra-Observer Variability and the Effect of Experience in Cine-MRI for Adhesion Detection

Cine-MRI for adhesion detection is a promising novel modality that can help the large group of patients developing pain after abdominal surgery. Few studies into its diagnostic accuracy are available, and none address observer variability. This retrospective study explores the inter- and intra-observer variability, diagnostic accuracy, and the effect of experience. A total of 15 observers with a variety of experience reviewed 61 sagittal cine-MRI slices, placing box annotations with a confidence score at locations suspect for adhesions. Five observers reviewed the slices again one year later. Inter- and intra-observer variability are quantified using Fleiss’ (inter) and Cohen’s (intra) κ and percentage agreement. Diagnostic accuracy is quantified with receiver operating characteristic (ROC) analysis based on a consensus standard. Inter-observer Fleiss’ κ values range from 0.04 to 0.34, showing poor to fair agreement. High general and cine-MRI experience led to significantly (p < 0.001) better agreement among observers. The intra-observer results show Cohen’s κ values between 0.37 and 0.53 for all observers, except one with a low κ of −0.11. Group AUC scores lie between 0.66 and 0.72, with individual observers reaching 0.78. This study confirms that cine-MRI can diagnose adhesions, with respect to a radiologist consensus panel and shows that experience improves reading cine-MRI. Observers without specific experience adapt to this modality quickly after a short online tutorial. Observer agreement is fair at best and area under the receiver operating characteristic curve (AUC) scores leave room for improvement. Consistently interpreting this novel modality needs further research, for instance, by developing reporting guidelines or artificial intelligence-based methods

Multidisciplinary consensus on screening for, diagnosis and management of fetal growth restriction in the Netherlands

Background: Screening for, diagnosis and management of intrauterine growth restriction (IUGR) is often performed in multidisciplinary collaboration. However, variation in screening methods, diagnosis and management of IUGR may lead to confusion. In the Netherlands two monodisciplinary guidelines on IUGR do not fully align. To facilitate effective collaboration between different professionals in perinatal care, we undertook a Delphi study with uniform recommendations as our primary result, focusing on issues that are not aligned or for which specifications are lacking in the current guidelines.  Methods: We conducted a Delphi study in three rounds. A purposively sampled selection of 56 panellists participated: 27 representing midwife-led care and 29 obstetrician-led care. Consensus was defined as agreement between the professional groups on the same answer and among at least 70% of the panellists within groups.  Results: Per round 51 or 52 (91% - 93%) panellists responded. This has led to consensus on 27 issues, leading to four consensus based recommendations on screening for IUGR in midwife-led care and eight consensus based recommendations on diagnosis and eight on management in obstetrician-led care. The multidisciplinary project group decided on four additional recommendations as no consensus was reached by the panel. No recommendations could be made about induction of labour versus expectant monitoring, nor about the choice for a primary caesarean section.  Conclusions: We reached consensus on recommendations for care for IUGR within a multidisciplinary panel. These will be implemented in a study on the effectiveness and cost-effectiveness of routine third trimester ultrasound for monitoring fetal growth. Research is needed to evaluate the effects of implementation of these recommendations on perinatal outcomes. Trial registration:NTR4367

Multidisciplinary consensus on screening for, diagnosis and management of fetal growth restriction in the Netherlands

Background: Screening for, diagnosis and management of intrauterine growth restriction (IUGR) is often performed in multidisciplinary collaboration. However, variation in screening methods, diagnosis and management of IUGR may lead to confusion. In the Netherlands two monodisciplinary guidelines on IUGR do not fully align. To facilitate effective collaboration between different professionals in perinatal care, we undertook a Delphi study with uniform recommendations as our primary result, focusing on issues that are not aligned or for which specifications are lacking in the current guidelines.  Methods: We conducted a Delphi study in three rounds. A purposively sampled selection of 56 panellists participated: 27 representing midwife-led care and 29 obstetrician-led care. Consensus was defined as agreement between the professional groups on the same answer and among at least 70% of the panellists within groups.  Results: Per round 51 or 52 (91% - 93%) panellists responded. This has led to consensus on 27 issues, leading to four consensus based recommendations on screening for IUGR in midwife-led care and eight consensus based recommendations on diagnosis and eight on management in obstetrician-led care. The multidisciplinary project group decided on four additional recommendations as no consensus was reached by the panel. No recommendations could be made about induction of labour versus expectant monitoring, nor about the choice for a primary caesarean section.  Conclusions: We reached consensus on recommendations for care for IUGR within a multidisciplinary panel. These will be implemented in a study on the effectiveness and cost-effectiveness of routine third trimester ultrasound for monitoring fetal growth. Research is needed to evaluate the effects of implementation of these recommendations on perinatal outcomes. Trial registration:NTR4367

Effectiveness and cost-effectiveness of routine third trimester ultrasound screening for intrauterine growth restriction : Study protocol of a nationwide stepped wedge cluster-randomized trial in The Netherlands (The IRIS Study)

Background Intrauterine growth retardation (IUGR) is a major risk factor for perinatal mortality and morbidity. Thus, there is a compelling need to introduce sensitive measures to detect IUGR fetuses. Routine third trimester ultrasonography is increasingly used to detect IUGR. However, we lack evidence for its clinical effectiveness and cost-effectiveness and information on ethical considerations of additional third trimester ultrasonography. This nationwide stepped wedge cluster-randomized trial examines the (cost-)effectiveness of routine third trimester ultrasonography in reducing severe adverse perinatal outcome through subsequent protocolized management. Methods For this trial, 15,000 women with a singleton pregnancy receiving care in 60 participating primary care midwifery practices will be included at 22 weeks of gestation. In the intervention (n = 7,500) and control group (n = 7,500) fetal growth will be monitored by serial fundal height assessments. All practices will start offering the control condition (ultrasonography based on medical indication). Every three months, 20 practices will be randomized to the intervention condition, i.e. apart from ultrasonography if indicated, two routine ultrasound examinations will be performed (at 28–30 weeks and 34–36 weeks). If IUGR is suspected, both groups will receive subsequent clinical management as described in the IRIS study protocol that will be developed before the start of the trial. The primary dichotomous clinical composite outcome is ‘severe adverse perinatal outcome’ up to 7 days after birth, including: perinatal death; Apgar score <4 at 5 minutes after birth; impaired consciousness; need for assisted ventilation for more than 24 h; asphyxia; septicemia; meningitis; bronchopulmonary dysplasia; intraventricular hemorrhage; cystic periventricular leukomalacia; neonatal seizures or necrotizing enterocolitis. For the economic evaluation, costs will be measured from a societal perspective. Quality of life will be measured using the EQ-5D-5 L to enable calculation of QALYs. Cost-effectiveness and cost-utility analyses will be performed. In a qualitative sub-study (using diary notes from 32 women for 9 months, at least 10 individual interviews and 2 focus group studies) we will explore ethical considerations of additional ultrasonography and how to deal with them. Discussion The results of this trial will assist healthcare providers and policymakers in making an evidence-based decision about whether or not introducing routine third trimester ultrasonography. Trial registration NTR4367, 21 March 2014

Effectiveness and cost-effectiveness of routine third trimester ultrasound screening for intrauterine growth restriction : study protocol of a nationwide stepped wedge cluster-randomized trial in The Netherlands (The IRIS Study)

Background: Intrauterine growth retardation (IUGR) is a major risk factor for perinatal mortality and morbidity. Thus, there is a compelling need to introduce sensitive measures to detect IUGR fetuses. Routine third trimester ultrasonography is increasingly used to detect IUGR. However, we lack evidence for its clinical effectiveness and cost-effectiveness and information on ethical considerations of additional third trimester ultrasonography. This nationwide stepped wedge cluster-randomized trial examines the (cost-)effectiveness of routine third trimester ultrasonography in reducing severe adverse perinatal outcome through subsequent protocolized management. Methods: For this trial, 15,000 women with a singleton pregnancy receiving care in 60 participating primary care midwifery practices will be included at 22 weeks of gestation. In the intervention (n = 7,500) and control group (n = 7,500) fetal growth will be monitored by serial fundal height assessments. All practices will start offering the control condition (ultrasonography based on medical indication). Every three months, 20 practices will be randomized to the intervention condition, i.e. apart from ultrasonography if indicated, two routine ultrasound examinations will be performed (at 28-30 weeks and 34-36 weeks). If IUGR is suspected, both groups will receive subsequent clinical management as described in the IRIS study protocol that will be developed before the start of the trial. The primary dichotomous clinical composite outcome is 'severe adverse perinatal outcome' up to 7 days after birth, including: perinatal death; Apgar score <4 at 5 minutes after birth; impaired consciousness; need for assisted ventilation for more than 24 h; asphyxia; septicemia; meningitis; bronchopulmonary dysplasia; intraventricular hemorrhage cystic periventricular leukomalacia; neonatal seizures or necrotizing enterocolitis. For the economic evaluation, costs will be measured from a societal perspective. Quality of life will be measured using the EQ-5D-5 L to enable calculation of QALYs. Cost-effectiveness and cost-utility analyses will be performed. In a qualitative sub-study (using diary notes from 32 women for 9 months, at least 10 individual interviews and 2 focus group studies) we will explore ethical considerations of additional ultrasonography and how to deal with them. Discussion: The results of this trial will assist healthcare providers and policymakers in making an evidence-based decision about whether or not introducing routine third trimester ultrasonography. Trial registration: NTR4367, 21 March 2014