Outcomes and potential impact of a virtual hands-on training program on MRI staging confidence and performance in rectal cancer

Objectives: To explore the potential impact of a dedicated virtual training course on MRI staging confidence and performance in rectal cancer. // Methods: Forty-two radiologists completed a stepwise virtual training course on rectal cancer MRI staging composed of a pre-course (baseline) test with 7 test cases (5 staging, 2 restaging), a 1-day online workshop, 1 month of individual case readings (n = 70 cases with online feedback), a live online feedback session supervised by two expert faculty members, and a post-course test. The ESGAR structured reporting templates for (re)staging were used throughout the course. Results of the pre-course and post-course test were compared in terms of group interobserver agreement (Krippendorf’s alpha), staging confidence (perceived staging difficulty), and diagnostic accuracy (using an expert reference standard). // Results: Though results were largely not statistically significant, the majority of staging variables showed a mild increase in diagnostic accuracy after the course, ranging between + 2% and + 17%. A similar trend was observed for IOA which improved for nearly all variables when comparing the pre- and post-course. There was a significant decrease in the perceived difficulty level (p = 0.03), indicating an improved diagnostic confidence after completion of the course. // Conclusions: Though exploratory in nature, our study results suggest that use of a dedicated virtual training course and web platform has potential to enhance staging performance, confidence, and interobserver agreement to assess rectal cancer on MRI virtual training and could thus be a good alternative (or addition) to in-person training. // Clinical relevance statement: Rectal cancer MRI reporting quality is highly dependent on radiologists’ expertise, stressing the need for dedicated training/teaching. This study shows promising results for a virtual web-based training program, which could be a good alternative (or addition) to in-person training. // Key Points: • Rectal cancer MRI reporting quality is highly dependent on radiologists’ expertise, stressing the need for dedicated training and teaching. • Using a dedicated virtual training course and web-based platform, encouraging first results were achieved to improve staging accuracy, diagnostic confidence, and interobserver agreement. • These exploratory results suggest that virtual training could thus be a good alternative (or addition) to in-person training

Outcomes and potential impact of a virtual hands-on training program on MRI staging confidence and performance in rectal cancer

Objectives: To explore the potential impact of a dedicated virtual training course on MRI staging confidence and performance in rectal cancer. Methods: Forty-two radiologists completed a stepwise virtual training course on rectal cancer MRI staging composed of a pre-course (baseline) test with 7 test cases (5 staging, 2 restaging), a 1-day online workshop, 1 month of individual case readings (n = 70 cases with online feedback), a live online feedback session supervised by two expert faculty members, and a post-course test. The ESGAR structured reporting templates for (re)staging were used throughout the course. Results of the pre-course and post-course test were compared in terms of group interobserver agreement (Krippendorf’s alpha), staging confidence (perceived staging difficulty), and diagnostic accuracy (using an expert reference standard). Results: Though results were largely not statistically significant, the majority of staging variables showed a mild increase in diagnostic accuracy after the course, ranging between + 2% and + 17%. A similar trend was observed for IOA which improved for nearly all variables when comparing the pre- and post-course. There was a significant decrease in the perceived difficulty level (p = 0.03), indicating an improved diagnostic confidence after completion of the course. Conclusions: Though exploratory in nature, our study results suggest that use of a dedicated virtual training course and web platform has potential to enhance staging performance, confidence, and interobserver agreement to assess rectal cancer on MRI virtual training and could thus be a good alternative (or addition) to in-person training. Clinical relevance statement: Rectal cancer MRI reporting quality is highly dependent on radiologists’ expertise, stressing the need for dedicated training/teaching. This study shows promising results for a virtual web-based training program, which could be a good alternative (or addition) to in-person training. Key Points: • Rectal cancer MRI reporting quality is highly dependent on radiologists’ expertise, stressing the need for dedicated training and teaching. • Using a dedicated virtual training course and web-based platform, encouraging first results were achieved to improve staging accuracy, diagnostic confidence, and interobserver agreement. • These exploratory results suggest that virtual training could thus be a good alternative (or addition) to in-person training

Development and multicenter validation of a multiparametric imaging model to predict treatment response in rectal cancer

Funding Information: This study has received funding from the Dutch Cancer Society (project number 10138). Publisher Copyright: © 2023, The Author(s).Objectives: To develop and validate a multiparametric model to predict neoadjuvant treatment response in rectal cancer at baseline using a heterogeneous multicenter MRI dataset. Methods: Baseline staging MRIs (T2W (T2-weighted)-MRI, diffusion-weighted imaging (DWI) / apparent diffusion coefficient (ADC)) of 509 patients (9 centres) treated with neoadjuvant chemoradiotherapy (CRT) were collected. Response was defined as (1) complete versus incomplete response, or (2) good (Mandard tumor regression grade (TRG) 1–2) versus poor response (TRG3-5). Prediction models were developed using combinations of the following variable groups: (1) Non-imaging: age/sex/tumor-location/tumor-morphology/CRT-surgery interval (2) Basic staging: cT-stage/cN-stage/mesorectal fascia involvement, derived from (2a) original staging reports, or (2b) expert re-evaluation (3) Advanced staging: variables from 2b combined with cTN-substaging/invasion depth/extramural vascular invasion/tumor length (4) Quantitative imaging: tumour volume + first-order histogram features (from T2W-MRI and DWI/ADC) Models were developed with data from 6 centers (n = 412) using logistic regression with the Least Absolute Shrinkage and Selector Operator (LASSO) feature selection, internally validated using repeated (n = 100) random hold-out validation, and externally validated using data from 3 centers (n = 97). Results: After external validation, the best model (including non-imaging and advanced staging variables) achieved an area under the curve of 0.60 (95%CI=0.48–0.72) to predict complete response and 0.65 (95%CI=0.53–0.76) to predict a good response. Quantitative variables did not improve model performance. Basic staging variables consistently achieved lower performance compared to advanced staging variables. Conclusions: Overall model performance was moderate. Best results were obtained using advanced staging variables, highlighting the importance of good-quality staging according to current guidelines. Quantitative imaging features had no added value (in this heterogeneous dataset). Clinical relevance statement: Predicting tumour response at baseline could aid in tailoring neoadjuvant therapies for rectal cancer. This study shows that image-based prediction models are promising, though are negatively affected by variations in staging quality and MRI acquisition, urging the need for harmonization. Key Points: This multicenter study combining clinical information and features derived from MRI rendered disappointing performance to predict response to neoadjuvant treatment in rectal cancer. Best results were obtained with the combination of clinical baseline information and state-of-the-art image-based staging variables, highlighting the importance of good quality staging according to current guidelines and staging templates. No added value was found for quantitative imaging features in this multicenter retrospective study. This is likely related to acquisition variations, which is a major problem for feature reproducibility and thus model generalizability.Peer reviewe

The sigmoid take-off as a landmark to distinguish rectal from sigmoid tumours on MRI:Reproducibility, pitfalls and potential impact on treatment stratification

PURPOSE: The sigmoid take-off (STO) was recently introduced as a preferred landmark, agreed upon by expert consensus recommendation, to discern rectal from sigmoid cancer on imaging. Aim of this study was to assess the reproducibility of the STO, explore its potential treatment impact and identify its main interpretation pitfalls. METHODS: Eleven international radiologists (with varying expertise) retrospectively assessed n = 155 patients with previously clinically staged upper rectal/rectosigmoid tumours and re-classified them using the STO as completely below (rectum), straddling the STO (rectosigmoid) or completely above (sigmoid), after which scores were dichotomized as rectum (below/straddling STO) and sigmoid (above STO), being the clinically most relevant distinction. A random subset of n = 48 was assessed likewise by 6 colorectal surgeons. . RESULTS: Interobserver agreement (IOA) for the 3-category score ranged from κ0.19-0.82 (radiologists) and κ0.32-0.72 (surgeons), with highest scores for the most experienced radiologists (κ0.69-0.76). Of the 155 cases, 44 (28%) were re-classified by ≥ 80% of radiologists as sigmoid cancers; 36 of these originally received neoadjuvant treatment which in retrospect might have been omitted if the STO had been applied. Main interpretation pitfalls were related to anatomical variations, borderline cases near the STO and angulation of axial imaging planes. CONCLUSIONS: Good agreement was reached for experienced radiologists. Despite considerable variation among less-expert readers, use of the STO could have changed treatment in ±1/4 of patients in our cohort. Identified interpretation pitfalls may serve as a basis for teaching and to further optimize MR protocols

The sigmoid take-off as a landmark to distinguish rectal from sigmoid tumours on MRI:Reproducibility, pitfalls and potential impact on treatment stratification

Purpose: The sigmoid take-off (STO) was recently introduced as a preferred landmark, agreed upon by expert consensus recommendation, to discern rectal from sigmoid cancer on imaging. Aim of this study was to assess the reproducibility of the STO, explore its potential treatment impact and identify its main interpretation pitfalls. Methods: Eleven international radiologists (with varying expertise) retrospectively assessed n = 155 patients with previously clinically staged upper rectal/rectosigmoid tumours and re-classified them using the STO as completely below (rectum), straddling the STO (rectosigmoid) or completely above (sigmoid), after which scores were dichotomized as rectum (below/straddling STO) and sigmoid (above STO), being the clinically most relevant distinction. A random subset of n = 48 was assessed likewise by 6 colorectal surgeons. Results: Interobserver agreement (IOA) for the 3-category score ranged from κ0.19–0.82 (radiologists) and κ0.32–0.72 (surgeons), with highest scores for the most experienced radiologists (κ0.69–0.76). Of the 155 cases, 44 (28%) were re-classified by ≥ 80% of radiologists as sigmoid cancers; 36 of these originally received neoadjuvant treatment which in retrospect might have been omitted if the STO had been applied. Main interpretation pitfalls were related to anatomical variations, borderline cases near the STO and angulation of axial imaging planes. Conclusions: Good agreement was reached for experienced radiologists. Despite considerable variation among less-expert readers, use of the STO could have changed treatment in ±1/4 of patients in our cohort. Identified interpretation pitfalls may serve as a basis for teaching and to further optimize MR protocols.</p

Comparison of MRI response evaluation methods in rectal cancer: a multicentre and multireader validation study

OBJECTIVES: To compare four previously published methods for rectal tumor response evaluation after chemoradiotherapy on MRI. METHODS: Twenty-two radiologists (5 rectal MRI experts, 17 general/abdominal radiologists) retrospectively reviewed the post-chemoradiotherapy MRIs of 90 patients, scanned at 10 centers (with non-standardized protocols). They applied four response methods; two based on T2W-MRI only (MRI tumor regression grade (mrTRG); split-scar sign), and two based on T2W-MRI+DWI (modified-mrTRG; DWI-patterns). Image quality was graded using a 0-6-point score (including slice thickness and in-plane resolution; sequence angulation; DWI b-values, signal-to-noise, and artefacts); scores < 4 were classified below average. Mixed model linear regression was used to calculate average sensitivity/specificity/accuracy to predict a complete response (versus residual tumor) and assess the impact of reader experience and image quality. Group interobserver agreement (IOA) was calculated using Krippendorff's alpha. Readers were asked to indicate their preferred scoring method(s). RESULTS: Average sensitivity/specificity/accuracy was 57%/64%/62% (mrTRG), 36%/79%/66% (split-scar), 40%/79%/67% (modified-mrTRG), and 37%/82%/68% (DWI-patterns); mrTRG showed higher sensitivity but lower specificity and accuracy (p < 0.001) compared to the other methods. IOA was lower for the split scar method (0.18 vs. 0.39-0.43). Higher reader experience had a significant positive effect on diagnostic performance and IOA (except for the split scar sign); below-average imaging quality had a significant negative effect on diagnostic performance. DWI pattern was selected as the preferred method by 73% of readers. CONCLUSIONS: Methods incorporating DWI showed the most favorable results when combining diagnostic performance, IOA, and reader preference. Reader experience and image quality clearly impacted diagnostic performance emphasizing the need for state-of-the-art imaging and dedicated radiologist training. KEY POINTS: • In a multireader study comparing 4 MRI methods for rectal tumor response evaluation, those incorporating DWI showed the best results when combining diagnostic performance, IOA, and reader preference. • The most preferred method (by 73% of readers) was the "DWI patterns" approach with an accuracy of 68%, high specificity of 82%, and group IOA of 0.43. • Reader experience level and MRI quality had an evident effect on diagnostic performance and IOA

Predicting response to chemoradiotherapy in rectal cancer via visual morphologic assessment and staging on baseline MRI:a multicenter and multireader study

Purpose Pre-treatment knowledge of the anticipated response of rectal tumors to neoadjuvant chemoradiotherapy (CRT) could help to further optimize the treatment. Van Griethuysen et al. proposed a visual 5-point confidence score to predict the likelihood of response on baseline MRI. Aim was to evaluate this score in a multicenter and multireader study setting and compare it to two simplified (4-point and 2-point) adaptations in terms of diagnostic performance, interobserver agreement (IOA), and reader preference. Methods Twenty-two radiologists from 14 countries (5 MRI-experts,17 general/abdominal radiologists) retrospectively reviewed 90 baseline MRIs to estimate if patients would likely achieve a (near-)complete response (nCR); first using the 5-point score by van Griethuysen (1=highly unlikely to 5=highly likely to achieve nCR), second using a 4-point adaptation (with 1-point each for high-risk T-stage, obvious mesorectal fascia invasion, nodal involvement, and extramural vascular invasion), and third using a 2-point score (unlikely/likely to achieve nCR). Diagnostic performance was calculated using ROC curves and IOA using Krippendorf’s alpha (α). Results Areas under the ROC curve to predict the likelihood of a nCR were similar for the three methods (0.71–0.74). IOA was higher for the 5- and 4-point scores (α=0.55 and 0.57 versus 0.46 for the 2-point score) with best results for the MRIexperts (α=0.64-0.65). Most readers (55%) favored the 4-point score

Pelvic CT in addition to MRI to differentiate between rectal and sigmoid cancer on imaging using the sigmoid take-off as a landmark

Background:The sigmoid take-off (STO) is a recently established landmark to discern rectal from sigmoid cancer on imaging. STO-assessment can be challenging on magnetic resonance imaging (MRI) due to varying axial planes. Purpose: To establish the benefit of using computed tomography (CT; with consistent axial planes), in addition to MRI, to anatomically classify rectal versus sigmoid cancer using the STO. Material and Methods:A senior and junior radiologist retrospectively classified 40 patients with rectal/rectosigmoid cancers using the STO, first on MRI-only (sagittal and oblique-axial views) and then using a combination of MRI and axial CT. Tumors were classified as rectal/rectosigmoid/sigmoid (according to published STO definitions) and then dichotomized into rectal versus sigmoid. Diagnostic confidence was documented using a 5-point scale. Results:Adding CT resulted in a change in anatomical tumor classification in 4/40 cases (10%) for the junior reader and in 6/40 cases (15%) for the senior reader. Diagnostic confidence increased significantly after adding CT for the junior reader (mean score 3.85 vs. 4.27; P &lt; 0.001); confidence of the senior reader was not affected (4.28 vs. 4.25; P = 0.80). Inter-observer agreement was similarly good for MRI only (kappa=0.77) and MRI + CT (kappa=0.76). Readers reached consensus on the classification of rectal versus sigmoid cancer in 78%-85% of cases. Conclusion:Availability of a consistent axial imaging plane - in the case of this study provided by CT - in addition to a standard MRI protocol with sagittal and oblique-axial imaging views can be helpful to more confidently localize tumors using the STO as a landmark, especially for more junior readers

Outcomes and potential impact of a virtual hands-on training program on MRI staging confidence and performance in rectal cancer

Objectives: To explore the potential impact of a dedicated virtual training course on MRI staging confidence and performance in rectal cancer. Methods: Forty-two radiologists completed a stepwise virtual training course on rectal cancer MRI staging composed of a pre-course (baseline) test with 7 test cases (5 staging, 2 restaging), a 1-day online workshop, 1 month of individual case readings (n = 70 cases with online feedback), a live online feedback session supervised by two expert faculty members, and a post-course test. The ESGAR structured reporting templates for (re)staging were used throughout the course. Results of the pre-course and post-course test were compared in terms of group interobserver agreement (Krippendorf’s alpha), staging confidence (perceived staging difficulty), and diagnostic accuracy (using an expert reference standard). Results: Though results were largely not statistically significant, the majority of staging variables showed a mild increase in diagnostic accuracy after the course, ranging between + 2% and + 17%. A similar trend was observed for IOA which improved for nearly all variables when comparing the pre- and post-course. There was a significant decrease in the perceived difficulty level (p = 0.03), indicating an improved diagnostic confidence after completion of the course. Conclusions: Though exploratory in nature, our study results suggest that use of a dedicated virtual training course and web platform has potential to enhance staging performance, confidence, and interobserver agreement to assess rectal cancer on MRI virtual training and could thus be a good alternative (or addition) to in-person training. Clinical relevance statement: Rectal cancer MRI reporting quality is highly dependent on radiologists’ expertise, stressing the need for dedicated training/teaching. This study shows promising results for a virtual web-based training program, which could be a good alternative (or addition) to in-person training. Key Points: • Rectal cancer MRI reporting quality is highly dependent on radiologists’ expertise, stressing the need for dedicated training and teaching. • Using a dedicated virtual training course and web-based platform, encouraging first results were achieved to improve staging accuracy, diagnostic confidence, and interobserver agreement. • These exploratory results suggest that virtual training could thus be a good alternative (or addition) to in-person training