Kernelized Supervised Dictionary Learning

The representation of a signal using a learned dictionary instead of predefined operators, such as wavelets, has led to state-of-the-art results in various applications such as denoising, texture analysis, and face recognition. The area of dictionary learning is closely associated with sparse representation, which means that the signal is represented using few atoms in the dictionary. Despite recent advances in the computation of a dictionary using fast algorithms such as K-SVD, online learning, and cyclic coordinate descent, which make the computation of a dictionary from millions of data samples computationally feasible, the dictionary is mainly computed using unsupervised approaches such as k-means. These approaches learn the dictionary by minimizing the reconstruction error without taking into account the category information, which is not optimal in classification tasks. In this thesis, we propose a supervised dictionary learning (SDL) approach by incorporating information on class labels into the learning of the dictionary. To this end, we propose to learn the dictionary in a space where the dependency between the signals and their corresponding labels is maximized. To maximize this dependency, the recently-introduced Hilbert Schmidt independence criterion (HSIC) is used. The learned dictionary is compact and has closed form; the proposed approach is fast. We show that it outperforms other unsupervised and supervised dictionary learning approaches in the literature on real-world data. Moreover, the proposed SDL approach has as its main advantage that it can be easily kernelized, particularly by incorporating a data-driven kernel such as a compression-based kernel, into the formulation. In this thesis, we propose a novel compression-based (dis)similarity measure. The proposed measure utilizes a 2D MPEG-1 encoder, which takes into consideration the spatial locality and connectivity of pixels in the images. The proposed formulation has been carefully designed based on MPEG encoder functionality. To this end, by design, it solely uses P-frame coding to find the (dis)similarity among patches/images. We show that the proposed measure works properly on both small and large patch sizes on textures. Experimental results show that by incorporating the proposed measure as a kernel into our SDL, it significantly improves the performance of a supervised pixel-based texture classification on Brodatz and outdoor images compared to other compression-based dissimilarity measures, as well as state-of-the-art SDL methods. It also improves the computation speed by about 40% compared to its closest rival. Eventually, we have extended the proposed SDL to multiview learning, where more than one representation is available on a dataset. We propose two different multiview approaches: one fusing the feature sets in the original space and then learning the dictionary and sparse coefficients on the fused set; and the other by learning one dictionary and the corresponding coefficients in each view separately, and then fusing the representations in the space of the dictionaries learned. We will show that the proposed multiview approaches benefit from the complementary information in multiple views, and investigate the relative performance of these approaches in the application of emotion recognition

Predictive quantitative ultrasound radiomic markers associated with treatment response in head and neck cancer

Aim: We aimed to identify quantitative ultrasound (QUS)-radiomic markers to predict radiotherapy response in metastatic lymph nodes of head and neck cancer. Materials & methods: Node-positive head and neck cancer patients underwent pretreatment QUS imaging of their metastatic lymph nodes. Imaging features were extracted using the QUS spectral form, and second-order texture parameters. Machine-learning classifiers were used for predictive modeling, which included a logistic regression, naive Bayes, and k-nearest neighbor classifiers. Results: There was a statistically significant difference in the pretreatment QUS-radiomic parameters between radiological complete responders versus partial responders (p < 0.05). The univariable model that demonstrated the greatest classification accuracy included: spectral intercept (SI)-contrast (area under the curve = 0.741). Multivariable models were also computed and showed that the SI-contrast + SI-homogeneity demonstrated an area under the curve = 0.870. The three-feature model demonstrated that the spectral slope-correlation + SI-contrast + SI-homogeneity-predicted response with accuracy of 87.5%. Conclusion: Multivariable QUS-radiomic features of metastatic lymph nodes can predict treatment response a priori

Quantitative ultrasound delta-radiomics during radiotherapy for monitoring treatment responses in head and neck malignancies

Aim: We investigated quantitative ultrasound (QUS) in patients with node-positive head and neck malignancies for monitoring responses to radical radiotherapy (RT). Materials & methods: QUS spectral and texture parameters were acquired from metastatic lymph nodes 24 h, 1 and 4 weeks after starting RT. K-nearest neighbor and naive-Bayes machine-learning classifiers were used to build prediction models for each time point. Response was detected after 3 months of RT, and patients were classified into complete and partial responders. Results: Single-feature naive-Bayes classification performed best with a prediction accuracy of 80, 86 and 85% at 24 h, week 1 and 4, respectively. Conclusion: QUS-radiomics can predict RT response at 3 months as early as 24 h with reasonable accuracy, which further improves into 1 week of treatment

Predicting Breast Cancer Response to Neoadjuvant Chemotherapy Using Pretreatment Diffuse Optical Spectroscopic-Texture Analysis

Purpose: Diffuse optical spectroscopy (DOS) has been demonstrated capable of monitoring response to neoadjuvant chemotherapy (NAC) in locally advanced breast cancer (LABC) patients. In this study, we evaluate texture features of pre-treatment DOS functional maps for predicting LABC response to NAC. Methods: LABC patients (n = 37) underwent DOS-breast imaging before starting neoadjuvant chemotherapy. Breast-tissue parametric maps were constructed and texture analyses were performed based on grey level co-occurrence matrices (GLCM) for feature extraction. Ground-truth labels as responders (R) or non-responders (NR) were assigned to patients based on Miller-Payne pathological response criteria. The capability of DOS-textural features computed on volumetric tumour data before the start of treatment (i.e. “pre-treatment”) to predict patient responses to NAC was evaluated using a leave-one-out validation scheme at subject level. Data were analysed using a logistic regression, naïve Bayes, and k-nearest neighbour (k-NN) classifiers. Results: Data indicated that textural characteristics of pre-treatment DOS parametric maps can differentiate between treatment response outcomes. The HbO2-homogeneity resulted in the highest accuracy amongst univariate parameters in predicting response to chemotherapy: sensitivity (%Sn) and specificity (%Sp) were 86.5 and 89.0%, respectively and accuracy was 87.8%. The highest predictors using multivariate (binary) combination features were the Hb-Contrast + HbO2-Homogeneity which resulted in a %Sn/%Sp = 78.0/81.0% and an accuracy of 79.5%. Conclusions: This study demonstrated that pre-treatment tumour DOS-texture features can predict breast cancer response to NAC and potentially guide treatments