Apriori prediction of chemotherapy response in locally advanced breast cancer patients using CT imaging and deep learning: transformer versus transfer learning

ObjectiveNeoadjuvant chemotherapy (NAC) is a key element of treatment for locally advanced breast cancer (LABC). Predicting the response to NAC for patients with Locally Advanced Breast Cancer (LABC) before treatment initiation could be beneficial to optimize therapy, ensuring the administration of effective treatments. The objective of the work here was to develop a predictive model to predict tumor response to NAC for LABC using deep learning networks and computed tomography (CT).Materials and methodsSeveral deep learning approaches were investigated including ViT transformer and VGG16, VGG19, ResNet-50, Res-Net-101, Res-Net-152, InceptionV3 and Xception transfer learning networks. These deep learning networks were applied on CT images to assess the response to NAC. Performance was evaluated based on balanced_accuracy, accuracy, sensitivity and specificity classification metrics. A ViT transformer was applied to utilize the attention mechanism in order to increase the weight of important part image which leads to better discrimination between classes.ResultsAmongst the 117 LABC patients studied, 82 (70%) had clinical-pathological response and 35 (30%) had no response to NAC. The ViT transformer obtained the best performance range (accuracy = 71 ± 3% to accuracy = 77 ± 4%, specificity = 86 ± 6% to specificity = 76 ± 3%, sensitivity = 56 ± 4% to sensitivity = 52 ± 4%, and balanced_accuracy=69 ± 3% to balanced_accuracy=69 ± 3%) depending on the split ratio of train-data and test-data. Xception network obtained the second best results (accuracy = 72 ± 4% to accuracy = 65 ± 4, specificity = 81 ± 6% to specificity = 73 ± 3%, sensitivity = 55 ± 4% to sensitivity = 52 ± 5%, and balanced_accuracy = 66 ± 5% to balanced_accuracy = 60 ± 4%). The worst results were obtained using VGG-16 transfer learning network.ConclusionDeep learning networks in conjunction with CT imaging are able to predict the tumor response to NAC for patients with LABC prior to start. A ViT transformer could obtain the best performance, which demonstrated the importance of attention mechanism

Implementation of Non-Invasive Quantitative Ultrasound in Clinical Cancer Imaging

Quantitative ultrasound (QUS) is a non-invasive novel technique that allows treatment response monitoring. Studies have shown that QUS backscatter variables strongly correlate with changes observed microscopically. Increases in cell death result in significant alterations in ultrasound backscatter parameters. In particular, the parameters related to scatterer size and scatterer concentration tend to increase in relation to cell death. The use of QUS in monitoring tumor response has been discussed in several preclinical and clinical studies. Most of the preclinical studies have utilized QUS for evaluating cell death response by differentiating between viable cells and dead cells. In addition, clinical studies have incorporated QUS mostly for tissue characterization, including classifying benign versus malignant breast lesions, as well as responder versus non-responder patients. In this review, we highlight some of the important findings of previous preclinical and clinical studies and expand the applicability and therapeutic benefits of QUS in clinical settings. We summarized some recent clinical research advances in ultrasound-based radiomics analysis for monitoring and predicting treatment response and characterizing benign and malignant breast lesions. We also discuss current challenges, limitations, and future prospects of QUS-radiomics

Quantitative corneal elastography using high-frequency ultrasound

Thesis (Ph. D.)--University of Rochester. Department of Physics and Astronomy, 2018.Measurement of corneal biomechanical properties can aid in predicting corneal responses to diseases and surgeries. Different biomechanical characteristics of the cornea have been studied primarily through ex vivo destructive testing. However, destructive methods are not suitable for in vivo applications and do not preserve the natural environment of the cornea. These motivate development of nondestructive means to measure corneal biomechanical properties. Currently, there is no clinically available in vivo instrumentation that can provide spatially-resolved distribution of corneal biomechanical properties. In this dissertation, we demonstrate a high-resolution ultrasound elastography system using high-frequency ultrasound for ex vivo measurement of strain-dependent corneal wave speed. Corneal wave speed was found to be a linear function of IOP. We also observed depth-dependent variations of wave speed in the cornea, decreasing from anterior toward posterior. This depth dependence is more pronounced at higher IOP values. This work demonstrates the potential of high-frequency ultrasound elastography in the characterization of corneal biomechanical properties

Table_1_Apriori prediction of chemotherapy response in locally advanced breast cancer patients using CT imaging and deep learning: transformer versus transfer learning.docx

ObjectiveNeoadjuvant chemotherapy (NAC) is a key element of treatment for locally advanced breast cancer (LABC). Predicting the response to NAC for patients with Locally Advanced Breast Cancer (LABC) before treatment initiation could be beneficial to optimize therapy, ensuring the administration of effective treatments. The objective of the work here was to develop a predictive model to predict tumor response to NAC for LABC using deep learning networks and computed tomography (CT).Materials and methodsSeveral deep learning approaches were investigated including ViT transformer and VGG16, VGG19, ResNet-50, Res-Net-101, Res-Net-152, InceptionV3 and Xception transfer learning networks. These deep learning networks were applied on CT images to assess the response to NAC. Performance was evaluated based on balanced_accuracy, accuracy, sensitivity and specificity classification metrics. A ViT transformer was applied to utilize the attention mechanism in order to increase the weight of important part image which leads to better discrimination between classes.ResultsAmongst the 117 LABC patients studied, 82 (70%) had clinical-pathological response and 35 (30%) had no response to NAC. The ViT transformer obtained the best performance range (accuracy = 71 ± 3% to accuracy = 77 ± 4%, specificity = 86 ± 6% to specificity = 76 ± 3%, sensitivity = 56 ± 4% to sensitivity = 52 ± 4%, and balanced_accuracy=69 ± 3% to balanced_accuracy=69 ± 3%) depending on the split ratio of train-data and test-data. Xception network obtained the second best results (accuracy = 72 ± 4% to accuracy = 65 ± 4, specificity = 81 ± 6% to specificity = 73 ± 3%, sensitivity = 55 ± 4% to sensitivity = 52 ± 5%, and balanced_accuracy = 66 ± 5% to balanced_accuracy = 60 ± 4%). The worst results were obtained using VGG-16 transfer learning network.ConclusionDeep learning networks in conjunction with CT imaging are able to predict the tumor response to NAC for patients with LABC prior to start. A ViT transformer could obtain the best performance, which demonstrated the importance of attention mechanism.</p