Standardisation and optimisation of radiomic techniques for the identification of robust imaging biomarkers in oncology

Radiomics is a rapidly evolving field within oncology. It explores the extraction of quantitative features from medical scans to aid in diagnosis, prognosis and monitoring of disease. In effect, these features may act as imaging biomarkers. Radiomics is a potential piece of a multifaceted data puzzle, powering precision medicine approaches, where treatment strategies could be tailored more to the individual than relying on a one-size-fits-all strategy. However, there are crucial challenges within the field regarding reproducibility and reliability of many common radiomic features. This thesis explored the hypothesis that varying but valid approaches to engineered feature extraction can cause discrepancy that harms identification and validation of potential radiomic biomarkers. As a research community, we require guidelines, standards and references to see forward progression and to avoid a replication crisis. Through development of radiomics software, results from this work significantly contributed to a large collaborative consensus benchmarking effort to address this standardisation need. This work investigated the effect of implementation choices on compliance to this new standard. Alongside this, the role of interpolation in radiomics became a key focus through the lens of robustness. Optimal feature extraction should avoid redundancy and utilise robust features. Finally, benchmarking methodology and tools were developed in an effort to standardise the application of filters in image processing steps prior to feature extraction. Discrepancies between radiomics software were identified and evaluated using these tools. The uncertainties in developing optimal and robust radiomic imaging biomarkers that result in clinically useful models are discussed

Sensitivity of standardised radiomics algorithms to mask generation across different software platforms

The field of radiomics continues to converge on a standardised approach to image processing and feature extraction. Conventional radiomics requires a segmentation. Certain features can be sensitive to small contour variations. The industry standard for medical image communication stores contours as coordinate points that must be converted to a binary mask before image processing can take place. This study investigates the impact that the process of converting contours to mask can have on radiomic features calculation. To this end we used a popular open dataset for radiomics standardisation and we compared the impact of masks generated by importing the dataset into 4 medical imaging software. We interfaced our previously standardised radiomics platform with these software using their published application programming interface to access image volume, masks and other data needed to calculate features. Additionally, we used super-sampling strategies to systematically evaluate the impact of contour data pre processing methods on radiomic features calculation. Finally, we evaluated the effect that using different mask generation approaches could have on patient clustering in a multi-center radiomics study. The study shows that even when working on the same dataset, mask and feature discrepancy occurs depending on the contour to mask conversion technique implemented in various medical imaging software. We show that this also affects patient clustering and potentially radiomic-based modelling in multi-centre studies where a mix of mask generation software is used. We provide recommendations to negate this issue and facilitate reproducible and reliable radiomics

Standardised convolutional filtering for radiomics

The Image Biomarker Standardisation Initiative (IBSI) aims to improve reproducibility of radiomics studies by standardising the computational process of extracting image biomarkers (features) from images. We have previously established reference values for 169 commonly used features, created a standard radiomics image processing scheme, and developed reporting guidelines for radiomic studies. However, several aspects are not standardised. Here we present a preliminary version of a reference manual on the use of convolutional image filters in radiomics. Filters, such as wavelets or Laplacian of Gaussian filters, play an important part in emphasising specific image characteristics such as edges and blobs. Features derived from filter response maps have been found to be poorly reproducible. This reference manual forms the basis of ongoing work on standardising convolutional filters in radiomics, and will be updated as this work progresses.Comment: 62 pages. For additional information see https://theibsi.github.io

Assessing radiomic feature robustness to interpolation in 18F-FDG PET imaging

Radiomic studies link quantitative imaging features to patient outcomes in an effort to personalise treatment in oncology. To be clinically useful, a radiomic feature must be robust to image processing steps, which has made robustness testing a necessity for many technical aspects of feature extraction. We assessed the stability of radiomic features to interpolation processing and categorised features based on stable, systematic, or unstable responses. Here, 18F-fluorodeoxyglucose (18F-FDG) PET images for 441 oesophageal cancer patients (split: testing = 353, validation = 88) were resampled to 6 isotropic voxel sizes (1.5 mm, 1.8 mm, 2.0 mm, 2.2 mm, 2.5 mm, 2.7 mm) and 141 features were extracted from each volume of interest (VOI). Features were categorised into four groups with two statistical tests. Feature reliability was analysed using an intraclass correlation coefficient (ICC) and patient ranking consistency was assessed using a Spearman’s rank correlation coefficient (ρ). We categorised 93 features robust and 6 limited robustness (stable responses), 34 potentially correctable (systematic responses), and 8 not robust (unstable responses). We developed a correction technique for features with potential systematic variation that used surface fits to link voxel size and percentage change in feature value. Twenty-nine potentially correctable features were re-categorised to robust for the validation dataset, after applying corrections defined by surface fits generated on the testing dataset. Furthermore, we found the choice of interpolation algorithm alone (spline vs trilinear) resulted in large variation in values for a number of features but the response categorisations remained constant. This study attempted to quantify the diverse response of radiomics features commonly found in 18F-FDG PET clinical modelling to isotropic voxel size interpolation

Discovery of stable and prognostic CT-based radiomic features independent of contrast administration and dimensionality in oesophageal cancer

The aim of this work was to investigate radiomic analysis of contrast and non-contrast enhanced planning CT images of oesophageal cancer (OC) patients in terms of stability, dimensionality and contrast agent dependency. The prognostic significance of CT-based radiomic features was also evaluated. Different 2D and 3D radiomic features were extracted from contrast and non-contrast enhanced CT images of 213 patients from the multi-centre SCOPE1 randomised controlled trial (RCT) in OC. Feature stability was evaluated by randomly dividing patients into three groups and identifying textures with similar distributions among groups with a Kruskal-Wallis analysis. A paired two-sided Wilcoxon signed rank test was used to assess for significant differences in the remaining corresponding 2D and 3D stable features. A prognostic model was constructed using clinical characteristics and remaining filtered features. The discriminative ability of significant variables was tested using Kaplan-Meier analysis. A total of 238 2D and 3D radiomic features were computed from oesophageal CT images. More than 75 features were stable if extracted from homogeneous cohort (contrast or non-contrast enhanced CT images) and inhomogeneous cohort (contrast and non-contrast enhanced CT images). Among the remaining corresponding stable features computed from both cohorts, only 4 features did not show a statistically significant difference if obtained in 2D or in 3D (p-value < 0.05). A Cox regression model constructed using 5 clinical variables (age, sex, tumour, node and metastasis (TNM) stage, WHO performance status and contrast administration) and 4 radiomic variables (inverse varianceGLCM, large distance emphasisGLDZM, zone distance non uniformity normGLDZM, zone distance varianceGLDZM), identified one radiomic feature (zone distance varianceGLDZM) that was significantly associated with overall survival (p-value = 0.032, HR = 1.25, 95% CI = 1.02–1.52). A significant difference in overall survival between groups was found when considering a threshold of zone distance varianceGLDZM equals to 1.70 (X2 = 7.692, df = 1, p-value = 0.006). Zone distance varianceGLDZM was identified as the only stable CT radiomic feature statistically correlated with overall survival, independent of dimensionality and contrast administration. This feature was able to identify high-risk patients and if validated, could be the subject of a future clinical trial aiming to improve clinical decision making and personalise OC treatment

External validation of a prognostic model incorporating quantitative PET image features in esophageal cancer

Aim Enhanced prognostic models are required to improve risk stratification of patients with oesophageal cancer so treatment decisions can be optimised. The primary aim was to externally validate a published prognostic model incorporating PET image features. Transferability of the model was compared using only clinical variables. Methods This was a Transparent Reporting of a multivariate prediction model for Individual Prognosis Or Diagnosis (TRIPOD) type 3 study. The model was validated against patients treated with neoadjuvant chemoradiotherapy according to the Neoadjuvant chemoradiotherapy plus surgery versus surgery alone for oesophageal or junctional cancer (CROSS) trial regimen using pre- and post-harmonised image features. The Kaplan–Meier method with log-rank significance tests assessed risk strata discrimination. A Cox proportional hazards model assessed model calibration. Primary outcome was overall survival (OS). Results Between 2010 and 2015, 449 patients were included in the development (n = 302), internal validation (n = 101) and external validation (n = 46) cohorts. No statistically significant difference in OS between patient quartiles was demonstrated in prognostic models incorporating PET image features (X2 = 1.42, df = 3, p = 0.70) or exclusively clinical variables (age, disease stage and treatment; X2 = 1.19, df = 3, p = 0.75). The calibration slope β of both models was not significantly different from unity (p = 0.29 and 0.29, respectively). Risk groups defined using only clinical variables suggested differences in OS, although these were not statistically significant (X2 = 0.71, df = 2, p = 0.70). Conclusion The prognostic model did not enable significant discrimination between the validation risk groups, but a second model with exclusively clinical variables suggested some transferable prognostic ability. PET harmonisation did not significantly change the results of model validation

The image biomarker standardization initiative: Standardized convolutional filters for reproducible radiomics and enhanced clinical insights

Standardizing convolutional filters that enhance specific structures and patterns in medical imaging enables reproducible radiomics analyses, improving consistency and reliability for enhanced clinical insights. Filters are commonly used to enhance specific structures and patterns in images, such as vessels or peritumoral regions, to enable clinical insights beyond the visible image using radiomics. However, their lack of standardization restricts reproducibility and clinical translation of radiomics decision support tools. In this special report, teams of researchers who developed radiomics software participated in a three-phase study (September 2020 to December 2022) to establish a standardized set of filters. The first two phases focused on finding reference filtered images and reference feature values for commonly used convolutional filters: mean, Laplacian of Gaussian, Laws and Gabor kernels, separable and nonseparable wavelets (including decomposed forms), and Riesz transformations. In the first phase, 15 teams used digital phantoms to establish 33 reference filtered images of 36 filter configurations. In phase 2, 11 teams used a chest CT image to derive reference values for 323 of 396 features computed from filtered images using 22 filter and image processing configurations. Reference filtered images and feature values for Riesz transformations were not established. Reproducibility of standardized convolutional filters was validated on a public data set of multimodal imaging (CT, fluorodeoxyglucose PET, and T1-weighted MRI) in 51 patients with soft-tissue sarcoma. At validation, reproducibility of 486 features computed from filtered images using nine configurations × three imaging modalities was assessed using the lower bounds of 95% CIs of intraclass correlation coefficients. Out of 486 features, 458 were found to be reproducible across nine teams with lower bounds of 95% CIs of intraclass correlation coefficients greater than 0.75. In conclusion, eight filter types were standardized with reference filtered images and reference feature values for verifying and calibrating radiomics software packages. A web-based tool is available for compliance checking