Development and Evaluation of Machine Learning in Whole-Body Magnetic Resonance Imaging for Detecting Metastases in Patients With Lung or Colon Cancer: A Diagnostic Test Accuracy Study

OBJECTIVES: Whole-body magnetic resonance imaging (WB-MRI) has been demonstrated to be efficient and cost-effective for cancer staging. The study aim was to develop a machine learning (ML) algorithm to improve radiologists' sensitivity and specificity for metastasis detection and reduce reading times. MATERIALS AND METHODS: A retrospective analysis of 438 prospectively collected WB-MRI scans from multicenter Streamline studies (February 2013-September 2016) was undertaken. Disease sites were manually labeled using Streamline reference standard. Whole-body MRI scans were randomly allocated to training and testing sets. A model for malignant lesion detection was developed based on convolutional neural networks and a 2-stage training strategy. The final algorithm generated lesion probability heat maps. Using a concurrent reader paradigm, 25 radiologists (18 experienced, 7 inexperienced in WB-/MRI) were randomly allocated WB-MRI scans with or without ML support to detect malignant lesions over 2 or 3 reading rounds. Reads were undertaken in the setting of a diagnostic radiology reading room between November 2019 and March 2020. Reading times were recorded by a scribe. Prespecified analysis included sensitivity, specificity, interobserver agreement, and reading time of radiology readers to detect metastases with or without ML support. Reader performance for detection of the primary tumor was also evaluated. RESULTS: Four hundred thirty-three evaluable WB-MRI scans were allocated to algorithm training (245) or radiology testing (50 patients with metastases, from primary 117 colon [n = 117] or lung [n = 71] cancer). Among a total 562 reads by experienced radiologists over 2 reading rounds, per-patient specificity was 86.2% (ML) and 87.7% (non-ML) (-1.5% difference; 95% confidence interval [CI], -6.4%, 3.5%; P = 0.39). Sensitivity was 66.0% (ML) and 70.0% (non-ML) (-4.0% difference; 95% CI, -13.5%, 5.5%; P = 0.344). Among 161 reads by inexperienced readers, per-patient specificity in both groups was 76.3% (0% difference; 95% CI, -15.0%, 15.0%; P = 0.613), with sensitivity of 73.3% (ML) and 60.0% (non-ML) (13.3% difference; 95% CI, -7.9%, 34.5%; P = 0.313). Per-site specificity was high (>90%) for all metastatic sites and experience levels. There was high sensitivity for the detection of primary tumors (lung cancer detection rate of 98.6% with and without ML [0.0% difference; 95% CI, -2.0%, 2.0%; P = 1.00], colon cancer detection rate of 89.0% with and 90.6% without ML [-1.7% difference; 95% CI, -5.6%, 2.2%; P = 0.65]). When combining all reads from rounds 1 and 2, reading times fell by 6.2% (95% CI, -22.8%, 10.0%) when using ML. Round 2 read-times fell by 32% (95% CI, 20.8%, 42.8%) compared with round 1. Within round 2, there was a significant decrease in read-time when using ML support, estimated as 286 seconds (or 11%) quicker (P = 0.0281), using regression analysis to account for reader experience, read round, and tumor type. Interobserver variance suggests moderate agreement, Cohen κ = 0.64; 95% CI, 0.47, 0.81 (with ML), and Cohen κ = 0.66; 95% CI, 0.47, 0.81 (without ML). CONCLUSIONS: There was no evidence of a significant difference in per-patient sensitivity and specificity for detecting metastases or the primary tumor using concurrent ML compared with standard WB-MRI. Radiology read-times with or without ML support fell for round 2 reads compared with round 1, suggesting that readers familiarized themselves with the study reading method. During the second reading round, there was a significant reduction in reading time when using ML support

Evaluating Fallopian Tube Patency: What the Radiologist Needs to Know

Impaired tubal patency accounts for up to 35% of cases of subfer-tility and infertility. Hysterosalpingography (HSG) or hysterosal-pingo-contrast sonography (HyCoSy) represents a first-line test in evaluating fallopian tube patency. Despite the association of HSG with ionizing radiation, HSG is a reference standard in assessing fallopian tube patency and tubal conditions such as tubal occlusion, salpingitis isthmica nodosa, and hydrosalpinx. HSG is widely available and utilizes either a water-soluble contrast medium (WSCM) or an oil-soluble contrast medium (OSCM). Compared with WSCM, HSG with OSCM results in a higher incidence of non–in vitro fertilization pregnancies and, therefore, may be pre-ferred in women younger than 38 years with unexplained subfer-tility. HSG may also be helpful in assessment after sterilization or before fallopian tube recanalization. US-based tubal tests are free of ionizing radiation and include HyCoSy, with either air-saline or microbubble US contrast material, and hysterosalpingo-foam sonography (HyFoSy), a tubal patency test that utilizes a gel foam. A comprehensive US infertility evaluation of the pelvis and fallopian tubes can be achieved in one setting by adding coronal three-dimensional imaging of the uterus, saline infusion sonohysterogra-phy, and HyCoSy or HyFoSy to routine pelvic US. MR HSG and virtual CT HSG also depict tubal patency and uterine and adnexal pathologic conditions and may be considered in select patients. While laparoscopic chromopertubation remains the standard for tubal patency evaluation, its disadvantages are its invasiveness and cost. Knowledge of the different fallopian tube tests and radiologic appearance of normal and abnormal fallopian tubes results in fewer pitfalls, accurate interpretation, and optimal patient care

MRI reporting standard for chronic pelvic pain:Consensus development

AIM: To identify radiological parameters that should be reported on gynaecological MRI in order to create a standardized assessment pro forma for reporting CPP, which may be used in clinical practice. METHODS: Chronic pelvic pain (CPP) in females is a common problem presenting a major challenge to healthcare providers. The complex multifactorial aetiology requires a multidisciplinary approach and often necessitates diagnostic laparoscopy for assessment. MRI is emerging as a potential non-invasive alternative for evaluation of CPP; however, standardization of reporting is required for it to be used in routine clinical practice. A two-generational Delphi survey with an expert panel of 28 radiologists specializing in gynaecological MRI from across the UK was used to refine a proposed reporting template for CPP. RESULTS: 75% response rate for the first round and 79% for the second. Following the second round, agreement was reached on the structure of the pro forma and the way in which information was sought, with overall consistency of agreement between experts deemed as fair (intraclass correlation coefficient = 0.394). This was accepted as the final version by consensus. CONCLUSION: The standardized pro forma developed in this study will form the basis for future prospective evaluation of MRI in CPP. This template could be modified for the assessment of other benign gynaecological conditions. ADVANCES IN KNOWLEDGE: Female CPP is a significant problem presenting challenges for clinicians. MRI is often used for evaluation and standardization of techniques, and reporting is required. The pro forma developed in this study will form the basis for future prospective MRI evaluation

MRI reporting standard for chronic pelvic pain: consensus development

AIM: To identify radiological parameters that should be reported on gynaecological MRI in order to create a standardized assessment pro forma for reporting CPP, which may be used in clinical practice. METHODS: Chronic pelvic pain (CPP) in females is a common problem presenting a major challenge to healthcare providers. The complex multifactorial aetiology requires a multidisciplinary approach and often necessitates diagnostic laparoscopy for assessment. MRI is emerging as a potential non-invasive alternative for evaluation of CPP; however, standardization of reporting is required for it to be used in routine clinical practice. A two-generational Delphi survey with an expert panel of 28 radiologists specializing in gynaecological MRI from across the UK was used to refine a proposed reporting template for CPP. RESULTS: 75% response rate for the first round and 79% for the second. Following the second round, agreement was reached on the structure of the pro forma and the way in which information was sought, with overall consistency of agreement between experts deemed as fair (intraclass correlation coefficient = 0.394). This was accepted as the final version by consensus. CONCLUSION: The standardized pro forma developed in this study will form the basis for future prospective evaluation of MRI in CPP. This template could be modified for the assessment of other benign gynaecological conditions. ADVANCES IN KNOWLEDGE: Female CPP is a significant problem presenting challenges for clinicians. MRI is often used for evaluation and standardization of techniques, and reporting is required. The pro forma developed in this study will form the basis for future prospective MRI evaluation

Recommandations de la Société européenne d'imagerie génito-urinaire : IRM de l'endométriose pelvienne

Endometriosis is a common gynaecological condition of unknown aetiology that primarily affects women of reproductive age. The accepted first-line imaging modality is pelvic ultrasound. However, magnetic resonance imaging (MRI) is increasingly performed as an additional investigation in complex cases and for surgical planning. There is currently no international consensus regarding patient preparation, MRI protocols or reporting criteria. Our aim was to develop clinical guidelines for MRI evaluation of pelvic endometriosis based on literature evidence and consensus expert opinion. This work was performed by a group of radiologists from the European Society of Urogenital Radiology (ESUR), experts in gynaecological imaging, and a gynaecologist expert in methodology. The group discussed indications for MRI, technical requirements, patient preparation, MRI protocols and criteria for the diagnosis of pelvic endometriosis on MRI. The expert panel proposed a final recommendation for each criterion using Oxford Centre for Evidence Based Medicine (OCEBM) 2011 levels of evidence

Weibull parametric model for survival analysis in women with endometrial cancer using clinical and T2-weighted MRI radiomic features

Abstract Background Semiparametric survival analysis such as the Cox proportional hazards (CPH) regression model is commonly employed in endometrial cancer (EC) study. Although this method does not need to know the baseline hazard function, it cannot estimate event time ratio (ETR) which measures relative increase or decrease in survival time. To estimate ETR, the Weibull parametric model needs to be applied. The objective of this study is to develop and evaluate the Weibull parametric model for EC patients’ survival analysis. Methods Training (n = 411) and testing (n = 80) datasets from EC patients were retrospectively collected to investigate this problem. To determine the optimal CPH model from the training dataset, a bi-level model selection with minimax concave penalty was applied to select clinical and radiomic features which were obtained from T2-weighted MRI images. After the CPH model was built, model diagnostic was carried out to evaluate the proportional hazard assumption with Schoenfeld test. Survival data were fitted into a Weibull model and hazard ratio (HR) and ETR were calculated from the model. Brier score and time-dependent area under the receiver operating characteristic curve (AUC) were compared between CPH and Weibull models. Goodness of the fit was measured with Kolmogorov-Smirnov (KS) statistic. Results Although the proportional hazard assumption holds for fitting EC survival data, the linearity of the model assumption is suspicious as there are trends in the age and cancer grade predictors. The result also showed that there was a significant relation between the EC survival data and the Weibull distribution. Finally, it showed that Weibull model has a larger AUC value than CPH model in general, and it also has smaller Brier score value for EC survival prediction using both training and testing datasets, suggesting that it is more accurate to use the Weibull model for EC survival analysis. Conclusions The Weibull parametric model for EC survival analysis allows simultaneous characterization of the treatment effect in terms of the hazard ratio and the event time ratio (ETR), which is likely to be better understood. This method can be extended to study progression free survival and disease specific survival. Trial registration ClinicalTrials.gov NCT03543215, https://clinicaltrials.gov/ , date of registration: 30th June 2017

Staging, recurrence and follow-up of uterine cervical cancer using MRI: updated guidelines of the European Society of Urogenital Radiology after revised FIGO staging 2018

Objectives: The recommendations cover indications for MRI examination including acquisition planes, patient preparation, imaging protocol including multi-parametric approaches such as diffusion-weighted imaging (DWI-MR), dynamic contrast-enhanced imaging (DCE-MR) and standardised reporting. The document also underscores the value of whole-body 18-Fluorodeoxyglucose Positron Emission Tomography/Computed Tomography (FDG-PET/CT) and highlights potential future methods. Methods: In 2019, the ESUR female pelvic imaging working group reviewed the revised 2018 FIGO staging system, the up-to-date clinical management guidelines, and the recent imaging literature. The RAND-UCLA Appropriateness Method (RAM) was followed to develop the current ESUR consensus guidelines following methodological steps: literature research, questionnaire developments, panel selection, survey, data extraction and analysis. Results: The updated ESUR guidelines are recommendations based on ≥ 80% consensus among experts. If ≥ 80% agreement was not reached, the action was indicated as optional. Conclusions: The present ESUR guidelines focus on the main role of MRI in the initial staging, response monitoring and evaluation of disease recurrence. Whole-body FDG-PET plays an important role in the detection of lymph nodes (LNs) and distant metastases. Key points: • T2WI and DWI-MR are now recommended for initial staging, monitoring of response and evaluation of recurrence. • DCE-MR is optional; its primary role remains in the research setting. • T2WI, DWI-MRI and whole-body FDG-PET/CT enable comprehensive assessment of treatment response and recurrenc

Society of Abdominal Radiology (SAR) and European Society of Urogenital Radiology (ESUR) joint consensus statement for MR imaging of placenta accreta spectrum disorders

This study was conducted in order to establish the joint Society of Abdominal Radiology (SAR) and European Society of Urogenital Radiology (ESUR) guidelines on placenta accreta spectrum (PAS) disorders and propose strategies to standardize image acquisition, interpretation, and reporting for this condition with MRI. The published evidence-based data and the opinion of experts were combined using the RAND-UCLA Appropriateness Method and formed the basis for these consensus guidelines. The responses of the experts to questions regarding the details of patient preparation, MRI protocol, image interpretation, and reporting were collected, analyzed, and classified as "recommended" versus "not recommended" (if at least 80% consensus among experts) or uncertain (if less than 80% consensus among experts). Consensus regarding image acquisition, interpretation, and reporting was determined using the RAND-UCLA Appropriateness Method. The use of a tailored MRI protocol and standardized report was recommended. A standardized imaging protocol and reporting system ensures recognition of the salient features of PAS disorders. These consensus recommendations should be used as a guide for the evaluation of PAS disorders with MRI. • MRI is a powerful adjunct to ultrasound and provides valuable information on the topography and depth of placental invasion. • Consensus statement proposed a common lexicon to allow for uniformity in MRI acquisition, interpretation, and reporting of PAS disorders. • Seven MRI features, namely intraplacental dark T2 bands, uterine/placental bulge, loss of low T2 retroplacental line, myometrial thinning/disruption, bladder wall interruption, focal exophytic placental mass, and abnormal vasculature of the placental bed, reached consensus and are categorized as "recommended" for diagnosing PAS disorders