The impact of a pathologist's personality on the interobserver variability and diagnostic accuracy of predictive PD-L1 immunohistochemistry in lung cancer

OBJECTIVES: Programmed death-ligand 1 (PD-L1) is the only approved predictive biomarker for immunotherapy in non-small cell lung cancer (NSCLC). However, predictive PD-L1 immunohistochemistry is subject to interobserver variability. We hypothesized that a pathologist's personality influences the interobserver variability and diagnostic accuracy of PD-L1 immunoscoring. MATERIALS AND METHODS: Seventeen pathologists performed PD-L1 immunoscoring on 50 resected NSCLC tumors in three categories (<1%;1-49%;≥50%). Also, the pathologists completed a certified personality test (NEO-PI-r), assessing five personality traits: neuroticism, extraversion, openness, altruism and conscientiousness. RESULTS: The overall agreement among pathologists for a series of 47 tumors was substantial (kappa = 0.63). Of these, 23/47 (49%) tumors were entirely negative or largely positive, resulting in a kappa value of 0.93. The remaining 24/47 (51%) tumors had a PD-L1 score around the cutoff value, generating a kappa value of 0.32. Pathologists with high scores for conscientiousness (careful, diligent) had the least interobserver variability (r = 0.6, p = 0.009). Also, they showed a trend towards higher sensitivity (74% vs. 68%, p = 0.4), specificity (86% vs. 82%, p = 0.3) and percent agreement (83% vs. 79%, p = 0.3), although not significant. In contrast, pathologists with high scores for neuroticism (sensitive, anxious) had significantly lower specificity (80% vs. 87%, p = 0.03) and percent agreement (78% vs. 85%, p = 0.03). Also, a trend towards high interobserver variability (r = -0.3, p = 0.2) and lower sensitivity (68% vs. 74%, p = 0.3) was observed, although not significant. Pathologists with relatively high scores for conscientiousness scored fewer tumors PD-L1 positive at the ≥ 1% cut-off (r = -0.5, p = 0.03). In contrast, pathologists with relatively high scores for neuroticism score more tumors PD-L1 positive at ≥ 1% (r = 0.6, p = 0.017) and ≥ 50% cut-offs (r = 0.6, p = 0.009). CONCLUSIONS: This study is the first to demonstrate the impact of a pathologist's personality on the interobserver variability and diagnostic accuracy of immunostaining, in the context of PD-L1 in NSCLC. Larger studies are needed for validation of these findings

Improved cytodiagnostics and quality of patient care through double reading of selected cases by an expert cytopathologist

Double reading may be a valuable tool for improving the quality of patient care by restoring diagnostic errors before final sign-out, but standard double reading would significantly increase costs of pathology. The aim of this study was to assess the added value of routine double reading of defined categories of clinical cytology specimens by specialized cytopathologists. Specialized cytopathologists routinely re-diagnosed blinded defined categories of clinical cytology specimens that had been signed out by routine pathologists from January 2012 up to December 2013. Major and minor discordance rates between initial and expert diagnoses were determined, and both diagnoses were validated by comparison with same-site histological follow-up. Initial and expert diagnoses were concordant in 131/218 specimens (60.1 %). Major and minor discordances were present in 28 (12.8 %) and 59 (27.1 %) specimens, respectively. Pleural fluid, thyroid and urine specimens showed the highest major discordance rates (19.4, 19.2 and 16.7 %, respectively). Histological follow-up (where possible) supported the expert diagnosis in 95.5 % of specimens. Our implemented double reading strategy of defined categories of cytology specimens showed major discordance in 12.8 % of specimens. The expert diagnosis was supported in 95.5 % of discordant cases where histological follow-up was available. This indicates that this double reading strategy is worthwhile and contributes to better cytodiagnostics and quality of patient care, especially for suspicious pleural fluid, thyroid and urine specimens. Our results emphasize that cytopathology is a subspecialization of pathology and requires specialized cytopathologists

The impact of a pathologist's personality on the interobserver variability and diagnostic accuracy of predictive PD-L1 immunohistochemistry in lung cancer

Objectives: Programmed death-ligand 1 (PD-L1) is the only approved predictive biomarker for immunotherapy in non-small cell lung cancer (NSCLC). However, predictive PD-L1 immunohistochemistry is subject to interobserver variability. We hypothesized that a pathologist's personality influences the interobserver variability and diagnostic accuracy of PD-L1 immunoscoring. Materials and Methods: Seventeen pathologists performed PD-L1 immunoscoring on 50 resected NSCLC tumors in three categories (<1%;1–49%;≥50%). Also, the pathologists completed a certified personality test (NEO-PI-r), assessing five personality traits: neuroticism, extraversion, openness, altruism and conscientiousness. Results: The overall agreement among pathologists for a series of 47 tumors was substantial (kappa = 0.63). Of these, 23/47 (49%) tumors were entirely negative or largely positive, resulting in a kappa value of 0.93. The remaining 24/47 (51%) tumors had a PD-L1 score around the cutoff value, generating a kappa value of 0.32. Pathologists with high scores for conscientiousness (careful, diligent) had the least interobserver variability (r = 0.6, p = 0.009). Also, they showed a trend towards higher sensitivity (74% vs. 68%, p = 0.4), specificity (86% vs. 82%, p = 0.3) and percent agreement (83% vs. 79%, p = 0.3), although not significant. In contrast, pathologists with high scores for neuroticism (sensitive, anxious) had significantly lower specificity (80% vs. 87%, p = 0.03) and percent agreement (78% vs. 85%, p = 0.03). Also, a trend towards high interobserver variability (r = -0.3, p = 0.2) and lower sensitivity (68% vs. 74%, p = 0.3) was observed, although not significant. Pathologists with relatively high scores for conscientiousness scored fewer tumors PD-L1 positive at the ≥ 1% cut-off (r = −0.5, p = 0.03). In contrast, pathologists with relatively high scores for neuroticism score more tumors PD-L1 positive at ≥ 1% (r = 0.6, p = 0.017) and ≥ 50% cut-offs (r = 0.6, p = 0.009). Conclusions: This study is the first to demonstrate the impact of a pathologist's personality on the interobserver variability and diagnostic accuracy of immunostaining, in the context of PD-L1 in NSCLC. Larger studies are needed for validation of these findings

Prognostic value of histopathological DCIS features in a large-scale international interrater reliability study

PURPOSE: For optimal management of ductal carcinoma in situ (DCIS), reproducible histopathological assessment is essential to distinguish low-risk from high-risk DCIS. Therefore, we analyzed interrater reliability of histopathological DCIS features and assessed their associations with subsequent ipsilateral invasive breast cancer (iIBC) risk. METHODS: Using a case-cohort design, reliability was assessed in a population-based, nationwide cohort of 2767 women with screen-detected DCIS diagnosed between 1993 and 2004, treated by breast-conserving surgery with/without radiotherapy (BCS ± RT) using Krippendorff's alpha (KA) and Gwet's AC2 (GAC2). Thirty-eight raters scored histopathological DCIS features including grade (2-tiered and 3-tiered), growth pattern, mitotic activity, periductal fibrosis, and lymphocytic infiltrate in 342 women. Using majority opinion-based scores for each feature, their association with subsequent iIBC risk was assessed using Cox regression. RESULTS: Interrater reliability of grade using various classifications was fair to moderate, and only substantial for grade 1 versus 2 + 3 when using GAC2 (0.78). Reliability for growth pattern (KA 0.44, GAC2 0.78), calcifications (KA 0.49, GAC2 0.70) and necrosis (KA 0.47, GAC2 0.70) was moderate using KA and substantial using GAC2; for (type of) periductal fibrosis and lymphocytic infiltrate fair to moderate estimates were found and for mitotic activity reliability was substantial using GAC2 (0.70). Only in patients treated with BCS-RT, high mitotic activity was associated with a higher iIBC risk in univariable analysis (Hazard Ratio (HR) 2.53, 95% Confidence Interval (95% CI) 1.05-6.11); grade 3 versus 1 + 2 (HR 2.64, 95% CI 1.35-5.14) and a cribriform/solid versus flat epithelial atypia/clinging/(micro)papillary growth pattern (HR 3.70, 95% CI 1.34-10.23) were independently associated with a higher iIBC risk. CONCLUSIONS: Using majority opinion-based scores, DCIS grade, growth pattern, and mitotic activity are associated with iIBC risk in patients treated with BCS-RT, but interrater variability is substantial. Semi-quantitative grading, incorporating and separately evaluating nuclear pleomorphism, growth pattern, and mitotic activity, may improve the reliability and prognostic value of these features.status: publishe

Prognostic value of histopathological DCIS features in a large-scale international interrater reliability study

Purpose: For optimal management of ductal carcinoma in situ (DCIS), reproducible histopathological assessment is essential to distinguish low-risk from high-risk DCIS. Therefore, we analyzed interrater reliability of histopathological DCIS features and assessed their associations with subsequent ipsilateral invasive breast cancer (iIBC) risk. Methods: Using a case-cohort design, reliability was assessed in a population-based, nationwide cohort of 2767 women with screen-detected DCIS diagnosed between 1993 and 2004, treated by breast-conserving surgery with/without radiotherapy (BCS ± RT) using Krippendorff’s alpha (KA) and Gwet’s AC2 (GAC2). Thirty-eight raters scored histopathological DCIS features including grade (2-tiered and 3-tiered), growth pattern, mitotic activity, periductal fibrosis, and lymphocytic infiltrate in 342 women. Using majority opinion-based scores for each feature, their association with subsequent iIBC risk was assessed using Cox regression. Results: Interrater reliability of grade using various classifications was fair to moderate, and only substantial for grade 1 versus 2 + 3 when using GAC2 (0.78). Reliability for growth pattern (KA 0.44, GAC2 0.78), calcifications (KA 0.49, GAC2 0.70) and necrosis (KA 0.47, GAC2 0.70) was moderate using KA and substantial using GAC2; for (type of) periductal fibrosis and lymphocytic infiltrate fair to moderate estimates were found and for mitotic activity reliability was substantial using GAC2 (0.70). Only in patients treated with BCS-RT, high mitotic activity was associated with a higher iIBC risk in univariable analysis (Hazard Ratio (HR) 2.53, 95% Confidence Interval (95% CI) 1.05–6.11); grade 3 versus 1 + 2 (HR 2.64, 95% CI 1.35–5.14) and a cribriform/solid versus flat epithelial atypia/clinging/(micro)papillary growth pattern (HR 3.70, 95% CI 1.34–10.23) were independently associated with a higher iIBC risk. Conclusions: Using majority opinion-based scores, DCIS grade, growth pattern, and mitotic activity are associated with iIBC risk in patients treated with BCS-RT, but interrater variability is substantial. Semi-quantitative grading, incorporating and separately evaluating nuclear pleomorphism, growth pattern, and mitotic activity, may improve the reliability and prognostic value of these features