Intra- and interreader reproducibility of PI-RADSv2: A multireader study

Background: The Prostate Imaging Reporting and Data System version 2 (PI-RADSv2) has been in use since 2015; while interreader reproducibility has been studied, there has been a paucity of studies investigating the intrareader reproducibility of PI-RADSv2. Purpose: To evaluate both intra- and interreader reproducibility of PI-RADSv2 in the assessment of intraprostatic lesions using multiparametric magnetic resonance imaging (mpMRI). Study Type: Retrospective. Population/Subjects: In all, 102 consecutive biopsy-naïve patients who underwent prostate MRI and subsequent MR/transrectal ultrasonography (MR/TRUS)-guided biopsy. Field Strength/Sequences: Prostate mpMRI at 3T using endorectal with phased array surface coils (TW MRI, DW MRI with ADC maps and b2000 DW MRI, DCE MRI). Assessment: Previously detected and biopsied lesions were scored by four readers from four different institutions using PI-RADSv2. Readers scored lesions during two readout rounds with a 4-week washout period. Statistical Tests: Kappa (κ) statistics and specific agreement (Po) were calculated to quantify intra- and interreader reproducibility of PI-RADSv2 scoring. Lesion measurement agreement was calculated using the intraclass correlation coefficient (ICC). Results: Overall intrareader reproducibility was moderate to substantial (κ = 0.43–0.67, Po = 0.60–0.77), while overall interreader reproducibility was poor to moderate (κ = 0.24, Po = 46). Readers with more experience showed greater interreader reproducibility than readers with intermediate experience in the whole prostate (P = 0.026) and peripheral zone (P = 0.002). Sequence-specific interreader agreement for all readers was similar to the overall PI-RADSv2 score, with κ = 0.24, 0.24, and 0.23 and Po = 0.47, 0.44, and 0.54 in T2-weighted, diffusion-weighted imaging (DWI), and dynamic contrast-enhanced (DCE), respectively. Overall intrareader and interreader ICC for lesion measurement was 0.82 and 0.71, respectively. Data Conclusion: PI-RADSv2 provides moderate intrareader reproducibility, poor interreader reproducibility, and moderate interreader lesion measurement reproducibility. These findings suggest a need for more standardized reader training in prostate MRI. Level of Evidence: 2. Technical Efficacy: Stage 2

Multiparametric MRI for the detection of local recurrence of prostate cancer in the setting of biochemical recurrence after low dose rate brachytherapy

PURPOSE Prostate multiparametric magnetic resonance imaging (mpMRI) has utility in detecting post-ra-diotherapy local recurrence. We conducted a multireader study to evaluate the diagnostic performance of mpMRI for local recurrence after low dose rate (LDR) brachytherapy. METHODS A total of 19 patients with biochemical recurrence after LDR brachytherapy underwent 3T en-dorectal coil mpMRI with T2-weighted imaging, dynamic contrast-enhanced imaging (DCE) and diffusion-weighted imaging (DWI) with pathologic confirmation. Prospective reads by an experienced prostate radiologist were compared with reads from 4 radiologists of varying experience. Readers identified suspicious lesions and rated each MRI detection parameter. MRI-detected lesions were considered true-positive with ipsilateral pathologic confirmation. Inferences for sensitivity, specificity, positive predictive value (PPV), kappa, and index of specific agreement were made with the use of bootstrap resampling. RESULTS Pathologically confirmed recurrence was found in 15 of 19 patients. True positive recurrences identified by mpMRI were frequently located in the transition zone (46.7%) and seminal vesicles (30%). On patient-based analysis, average sensitivity of mpMRI was 88% (standard error [SE], 3.5%). For highly suspicious lesions, specificity of mpMRI was 75% (SE, 16.5%). On lesion-based analysis, the average PPV was 62% (SE, 6.7%) for all lesions and 78.7% (SE, 10.3%) for highly suspicious lesions. The average PPV for lesions invading the seminal vesicles was 88.8% (n=13). The average PPV was 66.6% (SE, 5.8%) for lesions identified with T2-weighted imaging, 64.9% (SE, 7.3%) for DCE, and 70% (SE, 7.3%) for DWI. CONCLUSION This series provides evidence that mpMRI after LDR brachytherapy is feasible with a high patient-based cancer detection rate. Radiologists of varying experience demonstrated moderate agreement in detecting recurrence.This research was supported in part by the Intramural Research Program of the National Institutes of Health, National Cancer Institute, Center for Cancer Research (ZIA BC 011552). This research was also made possible in part through the NIH Medical Research Scholars Program, a public-private partnership supported jointly by the NIH and generous contributions to the Foundation for the NIH from the Doris Duke Charitable Foundation, the Howard Hughes Medical Institute, the American Association for Dental Research, the Colgate-Palmolive Company, and other private donors

Can computer-aided diagnosis assist in the identification of prostate cancer on prostate MRI? a multi-center, multi-reader investigation.

For prostate cancer detection on prostate multiparametric MRI (mpMRI), the Prostate Imaging-Reporting and Data System version 2 (PI-RADSv2) and computer-aided diagnosis (CAD) systems aim to widely improve standardization across radiologists and centers. Our goal was to evaluate CAD assistance in prostate cancer detection compared with conventional mpMRI interpretation in a diverse dataset acquired from five institutions tested by nine readers of varying experience levels, in total representing 14 globally spread institutions. Index lesion sensitivities of mpMRI-alone were 79% (whole prostate (WP)), 84% (peripheral zone (PZ)), 71% (transition zone (TZ)), similar to CAD at 76% (WP, p=0.39), 77% (PZ, p=0.07), 79% (TZ, p=0.15). Greatest CAD benefit was in TZ for moderately-experienced readers at PI-RADSv2 <3 (84% vs mpMRI-alone 67%, p=0.055). Detection agreement was unchanged but CAD-assisted read times improved (4.6 vs 3.4 minutes, p<0.001). At PI-RADSv2 ≥ 3, CAD improved patient-level specificity (72%) compared to mpMRI-alone (45%, p<0.001). PI-RADSv2 and CAD-assisted mpMRI interpretations have similar sensitivities across multiple sites and readers while CAD has potential to improve specificity and moderately-experienced radiologists' detection of more difficult tumors in the center of the gland. The multi-institutional evidence provided is essential to future prostate MRI and CAD development

All over the map: An interobserver agreement study of tumor location based on the PI-RADSv2 sector map

© 2018 International Society for Magnetic Resonance in Medicine Background: Prostate imaging reporting and data system version 2 (PI-RADSv2) recommends a sector map for reporting findings of prostate cancer mulitparametric MRI (mpMRI). Anecdotally, radiologists may demonstrate inconsistent reproducibility with this map. Purpose: To evaluate interobserver agreement in defining prostate tumor location on mpMRI using the PI-RADSv2 sector map. Study Type: Retrospective. Population: Thirty consecutive patients who underwent mpMRI between October, 2013 and March, 2015 and who subsequently underwent prostatectomy with whole-mount processing. Field Strength: 3T mpMRI with T 2 W, diffusion-weighted imaging (DWI) (apparent diffusion coefficient [ADC] and b-2000), dynamic contrast-enhanced (DCE). Assessment: Six radiologists (two high, two intermediate, and two low experience) from six institutions participated. Readers were blinded to lesion location and detected up to four lesions as per PI-RADSv2 guidelines. Readers marked the long-axis of lesions, saved screen-shots of each lesion, and then marked the lesion location on the PI-RADSv2 sector map. Whole-mount prostatectomy specimens registered to the MRI served as ground truth. Index lesions were defined as the highest grade lesion or largest lesion if grades were equivalent. Statistical Test: Agreement was calculated for the exact, overlap, and proportion of agreement. Results: Readers detected an average of 1.9 lesions per patient (range 1.6–2.3). 96.3% (335/348) of all lesions for all readers were scored PI-RADS ≥3. Readers defined a median of 2 (range 1–18) sectors per lesion. Agreement for detecting index lesions by screen shots was 83.7% (76.1%–89.9%) vs. 71.0% (63.1–78.3%) overlap agreement on the PI-RADS sector map (P \u3c 0.001). Exact agreement for defining sectors of detected index lesions was only 21.2% (95% confidence interval [CI]: 14.4–27.7%) and rose to 49.0% (42.4–55.3%) when overlap was considered. Agreement on defining the same level of disease (ie, apex, mid, base) was 61.4% (95% CI 50.2–71.8%). Data Conclusion: Readers are highly likely to detect the same index lesion on mpMRI, but exhibit poor reproducibility when attempting to define tumor location on the PI-RADSv2 sector map. The poor agreement of the PI-RADSv2 sector map raises concerns its utility in clinical practice. Level of Evidence: 3. Technical Efficacy: Stage 2. J. MAGN. RESON. IMAGING 2018;48:482–490

Intra- and interreader reproducibility of PI-RADSv2: A multireader study

© 2018 International Society for Magnetic Resonance in Medicine Background: The Prostate Imaging Reporting and Data System version 2 (PI-RADSv2) has been in use since 2015; while interreader reproducibility has been studied, there has been a paucity of studies investigating the intrareader reproducibility of PI-RADSv2. Purpose: To evaluate both intra- and interreader reproducibility of PI-RADSv2 in the assessment of intraprostatic lesions using multiparametric magnetic resonance imaging (mpMRI). Study Type: Retrospective. Population/Subjects: In all, 102 consecutive biopsy-naïve patients who underwent prostate MRI and subsequent MR/transrectal ultrasonography (MR/TRUS)-guided biopsy. Field Strength/Sequences: Prostate mpMRI at 3T using endorectal with phased array surface coils (TW MRI, DW MRI with ADC maps and b2000 DW MRI, DCE MRI). Assessment: Previously detected and biopsied lesions were scored by four readers from four different institutions using PI-RADSv2. Readers scored lesions during two readout rounds with a 4-week washout period. Statistical Tests: Kappa (κ) statistics and specific agreement (P o ) were calculated to quantify intra- and interreader reproducibility of PI-RADSv2 scoring. Lesion measurement agreement was calculated using the intraclass correlation coefficient (ICC). Results: Overall intrareader reproducibility was moderate to substantial (κ = 0.43–0.67, P o = 0.60–0.77), while overall interreader reproducibility was poor to moderate (κ = 0.24, P o = 46). Readers with more experience showed greater interreader reproducibility than readers with intermediate experience in the whole prostate (P = 0.026) and peripheral zone (P = 0.002). Sequence-specific interreader agreement for all readers was similar to the overall PI-RADSv2 score, with κ = 0.24, 0.24, and 0.23 and P o = 0.47, 0.44, and 0.54 in T 2 -weighted, diffusion-weighted imaging (DWI), and dynamic contrast-enhanced (DCE), respectively. Overall intrareader and interreader ICC for lesion measurement was 0.82 and 0.71, respectively. Data Conclusion: PI-RADSv2 provides moderate intrareader reproducibility, poor interreader reproducibility, and moderate interreader lesion measurement reproducibility. These findings suggest a need for more standardized reader training in prostate MRI. Level of Evidence: 2. Technical Efficacy: Stage 2

Interreader variability of prostate imaging reporting and data system version 2 in detecting and assessing prostate cancer lesions at prostate MRI

© American Roentgen Ray Society. OBJECTIVE. The purpose of this study was to evaluate agreement among radiologists in detecting and assessing prostate cancer at multiparametric MRI using Prostate Imaging Reporting and Data System version 2 (PI-RADSv2). MATERIALS AND METHODS. Treatment-na ve patients underwent 3-T multiparametric MRI between April 2012 and June 2015. Among the 163 patients evaluated, 110 underwent prostatectomy after MRI and 53 had normal MRI findings and transrectal ultrasound- guided biopsy results. Nine radiologists participated (three each with high, intermediate, and low levels of experience). Readers interpreted images of 58 patients on average (range, 56-60) using PI-RADSv2. Prostatectomy specimens registered to MRI were ground truth. Interobserver agreement was evaluated with the index of specific agreement for lesion detection and kappa and proportion of agreement for PI-RADS category assignment. RESULTS. The radiologists detected 336 lesions. Sensitivity for index lesions was 80.9% (95% CI, 75.1-85.9%), comparable across reader experience (p = 0.392). Patient-level specificity was experience dependent; highly experienced readers had 84.0% specificity versus 55.2% for all others (p \u3c 0.001). Interobserver agreement was excellent for detecting index lesions (index of specific agreement, 0.871; 95% CI, 0.798-0.923). Agreement on PI-RADSv2 category assignment of index lesions was moderate (= 0.419; 95% CI, 0.238-0.595). For individual category assignments, proportion of agreement was slight for PI-RADS category 3 (0.208; 95% CI, 0.086-0.284) but substantial for PI-RADS category 4 (0.674; 95% CI, 0.540-0.776). However, proportion of agreement for T2-weighted PI-RADS 4 in the transition zone was 0.250 (95% CI, 0.108-0.372). Proportion of agreement for category assignment of index lesions on dynamic contrast-enhanced MR images was 0.822 (95% CI, 0.728-0.903), on T2-weighted MR images was 0.515 (95% CI, 0.430-0623), and on DW images was 0.586 (95% CI, 0.495-0.682). Proportion of agreement for dominant lesion was excellent (0.828; 95% CI, 0.742-0.913). CONCLUSION. Radiologists across experience levels had excellent agreement for detecting index lesions and moderate agreement for category assignment of lesions using PI-RADS. Future iterations of PI-RADS should clarify PI-RADS 3 and PI-RADS 4 in the transition zone

Intra- and interreader reproducibility of PI-RADSv2: A multireader study

© 2018 International Society for Magnetic Resonance in Medicine Background: The Prostate Imaging Reporting and Data System version 2 (PI-RADSv2) has been in use since 2015; while interreader reproducibility has been studied, there has been a paucity of studies investigating the intrareader reproducibility of PI-RADSv2. Purpose: To evaluate both intra- and interreader reproducibility of PI-RADSv2 in the assessment of intraprostatic lesions using multiparametric magnetic resonance imaging (mpMRI). Study Type: Retrospective. Population/Subjects: In all, 102 consecutive biopsy-naïve patients who underwent prostate MRI and subsequent MR/transrectal ultrasonography (MR/TRUS)-guided biopsy. Field Strength/Sequences: Prostate mpMRI at 3T using endorectal with phased array surface coils (TW MRI, DW MRI with ADC maps and b2000 DW MRI, DCE MRI). Assessment: Previously detected and biopsied lesions were scored by four readers from four different institutions using PI-RADSv2. Readers scored lesions during two readout rounds with a 4-week washout period. Statistical Tests: Kappa (κ) statistics and specific agreement (P o ) were calculated to quantify intra- and interreader reproducibility of PI-RADSv2 scoring. Lesion measurement agreement was calculated using the intraclass correlation coefficient (ICC). Results: Overall intrareader reproducibility was moderate to substantial (κ = 0.43–0.67, P o = 0.60–0.77), while overall interreader reproducibility was poor to moderate (κ = 0.24, P o = 46). Readers with more experience showed greater interreader reproducibility than readers with intermediate experience in the whole prostate (P = 0.026) and peripheral zone (P = 0.002). Sequence-specific interreader agreement for all readers was similar to the overall PI-RADSv2 score, with κ = 0.24, 0.24, and 0.23 and P o = 0.47, 0.44, and 0.54 in T 2 -weighted, diffusion-weighted imaging (DWI), and dynamic contrast-enhanced (DCE), respectively. Overall intrareader and interreader ICC for lesion measurement was 0.82 and 0.71, respectively. Data Conclusion: PI-RADSv2 provides moderate intrareader reproducibility, poor interreader reproducibility, and moderate interreader lesion measurement reproducibility. These findings suggest a need for more standardized reader training in prostate MRI. Level of Evidence: 2. Technical Efficacy: Stage 2

Interreader Variability of Prostate Imaging Reporting and Data System Version 2 in Detecting and Assessing Prostate Cancer Lesions at Prostate MRI.

OBJECTIVE. The purpose of this study was to evaluate agreement among radiologists in detecting and assessing prostate cancer at multiparametric MRI using Prostate Imaging Reporting and Data System version 2 (PI-RADSv2). MATERIALS AND METHODS. Treatment-naïve patients underwent 3-T multipara-metric MRI between April 2012 and June 2015. Among the 163 patients evaluated, 110 underwent prostatectomy after MRI and 53 had normal MRI findings and transrectal ultrasound-guided biopsy results. Nine radiologists participated (three each with high, intermediate, and low levels of experience). Readers interpreted images of 58 patients on average (range, 56-60) using PI-RADSv2. Prostatectomy specimens registered to MRI were ground truth. Interob-server agreement was evaluated with the index of specific agreement for lesion detection and kappa and proportion of agreement for PI-RADS category assignment. RESULTS. The radiologists detected 336 lesions. Sensitivity for index lesions was 80.9% (95% CI, 75.1-85.9%), comparable across reader experience (p = 0.392). Patient-level specificity was experience dependent; highly experienced readers had 84.0% specificity versus 55.2% for all others (p < 0.001). Interobserver agreement was excellent for detecting index lesions (index of specific agreement, 0.871; 95% CI, 0.798-0.923). Agreement on PI-RADSv2 category assignment of index lesions was moderate (κ = 0.419; 95% CI, 0.238-0.595). For individual category assignments, proportion of agreement was slight for PI-RADS category 3 (0.208; 95% CI, 0.086-0.284) but substantial for PI-RADS category 4 (0.674; 95% CI, 0.540-0.776). However, proportion of agreement for T2-weighted PI-RADS 4 in the transition zone was 0.250 (95% CI, 0.108-0.372). Proportion of agreement for category assignment of index lesions on dynamic contrast-enhanced MR images was 0.822 (95% CI, 0.728-0.903), on T2-weighted MR images was 0.515 (95% CI, 0.430-0623), and on DW images was 0.586 (95% CI, 0.495-0.682). Proportion of agreement for dominant lesion was excellent (0.828; 95% CI, 0.742-0.913). CONCLUSION. Radiologists across experience levels had excellent agreement for detecting index lesions and moderate agreement for category assignment of lesions using PI-RADS. Future iterations of PI-RADS should clarify PI-RADS 3 and PI-RADS 4 in the transition zone