19 research outputs found
Capsule Network-based Radiomics: From Diagnosis to Treatment
Recent advancements in signal processing and machine learning coupled with developments of electronic medical record keeping in hospitals have resulted in a surge of significant interest in ``radiomics". Radiomics is an emerging and relatively new research field, which refers to semi-quantitative and/or quantitative features extracted from medical images with the goal of developing predictive and/or prognostic models. Radiomics is expected to become a critical component for integration of image-derived information for personalized treatment in the near future. The conventional radiomics workflow is, typically, based on extracting pre-designed features (also referred to as hand-crafted or engineered features) from a segmented region of interest. Clinical application of hand-crafted radiomics is, however, limited by the fact that features are pre-defined and extracted without taking the desired outcome into account. The aforementioned drawback has motivated trends towards development of deep learning-based radiomics (also referred to as discovery radiomics). Discovery radiomics has the advantage of learning the desired features on its own in an end-to-end fashion. Discovery radiomics has several applications in disease prediction/ diagnosis. Through this Ph.D. thesis, we develop deep learning-based architectures to address the following critical challenges identified within the radiomics domain. First, we cover the tumor type classification problem, which is of high importance for treatment selection. We address this problem, by designing a Capsule network-based architecture that has several advantages over existing solutions such as eliminating the need for access to a huge amount of training data, and its capability to learn input transformations on its own. We apply different modifications to the Capsule network architecture to make it more suitable for radiomics. At one hand, we equip the proposed architecture with access to the tumor boundary box, and on the other hand, a multi-scale Capsule network architecture is designed. Furthermore, capitalizing on the advantages of ensemble learning paradigms, we design a boosting and also a mixture of experts capsule network. A Bayesian capsule network is also developed to capture the uncertainty of the tumor classification. Beside knowing the tumor type (through classification), predicting the patient's response to treatment plays an important role in treatment design. Predicting patient's response, including survival and tumor recurrence, is another goal of this thesis, which we address by designing a deep learning-based model that takes not only the medical images, but also different clinical factors (such as age and gender) as inputs. Finally, COVID-19 diagnosis, another challenging and crucial problem within the radiomics domain, is dealt with using both X-ray and Computed Tomography (CT) images (in particular low-dose ones), where two in-house datasets are collected for the latter and different capsule network-based models are developed for COVID-19 diagnosis
Improving the Accuracy of Beauty Product Recommendations by Assessing Face Illumination Quality
We focus on addressing the challenges in responsible beauty product
recommendation, particularly when it involves comparing the product's color
with a person's skin tone, such as for foundation and concealer products. To
make accurate recommendations, it is crucial to infer both the product
attributes and the product specific facial features such as skin conditions or
tone. However, while many product photos are taken under good light conditions,
face photos are taken from a wide range of conditions. The features extracted
using the photos from ill-illuminated environment can be highly misleading or
even be incompatible to be compared with the product attributes. Hence bad
illumination condition can severely degrade quality of the recommendation.
We introduce a machine learning framework for illumination assessment which
classifies images into having either good or bad illumination condition. We
then build an automatic user guidance tool which informs a user holding their
camera if their illumination condition is good or bad. This way, the user is
provided with rapid feedback and can interactively control how the photo is
taken for their recommendation. Only a few studies are dedicated to this
problem, mostly due to the lack of dataset that is large, labeled, and diverse
both in terms of skin tones and light patterns. Lack of such dataset leads to
neglecting skin tone diversity. Therefore, We begin by constructing a diverse
synthetic dataset that simulates various skin tones and light patterns in
addition to an existing facial image dataset. Next, we train a Convolutional
Neural Network (CNN) for illumination assessment that outperforms the existing
solutions using the synthetic dataset. Finally, we analyze how the our work
improves the shade recommendation for various foundation products.Comment: 7 pages, 5 figures. Presented in FAccTRec202
MERCAT: Mediated, Encrypted, Reversible, SeCure Asset Transfers
For security token adoption by financial institutions and industry players on the blockchain, there is a
need for a secure asset management protocol that enables condential asset issuance and transfers by concealing
from the public the transfer amounts and asset types, while on a public blockchain. Flexibly supporting arbitrary
restrictions on financial transactions, only some of which need to be supported by zero-knowledge proofs. This paper
proposes leveraging a hybrid design approach, by using zero-knowledge proofs, supported by restrictions enforced
by trusted mediators. As part of our protocol, we also describe a novel transaction ordering mechanism that can
support a flexible transaction workflow without putting any timing constraints on when the transactions should
be generated by the users or processed by the network validators. This technique is likely to be of independent
interest
Spatio-Temporal Hybrid Fusion of CAE and SWIn Transformers for Lung Cancer Malignancy Prediction
The paper proposes a novel hybrid discovery Radiomics framework that
simultaneously integrates temporal and spatial features extracted from non-thin
chest Computed Tomography (CT) slices to predict Lung Adenocarcinoma (LUAC)
malignancy with minimum expert involvement. Lung cancer is the leading cause of
mortality from cancer worldwide and has various histologic types, among which
LUAC has recently been the most prevalent. LUACs are classified as
pre-invasive, minimally invasive, and invasive adenocarcinomas. Timely and
accurate knowledge of the lung nodules malignancy leads to a proper treatment
plan and reduces the risk of unnecessary or late surgeries. Currently, chest CT
scan is the primary imaging modality to assess and predict the invasiveness of
LUACs. However, the radiologists' analysis based on CT images is subjective and
suffers from a low accuracy compared to the ground truth pathological reviews
provided after surgical resections. The proposed hybrid framework, referred to
as the CAET-SWin, consists of two parallel paths: (i) The Convolutional
Auto-Encoder (CAE) Transformer path that extracts and captures informative
features related to inter-slice relations via a modified Transformer
architecture, and; (ii) The Shifted Window (SWin) Transformer path, which is a
hierarchical vision transformer that extracts nodules' related spatial features
from a volumetric CT scan. Extracted temporal (from the CAET-path) and spatial
(from the Swin path) are then fused through a fusion path to classify LUACs.
Experimental results on our in-house dataset of 114 pathologically proven
Sub-Solid Nodules (SSNs) demonstrate that the CAET-SWin significantly improves
reliability of the invasiveness prediction task while achieving an accuracy of
82.65%, sensitivity of 83.66%, and specificity of 81.66% using 10-fold
cross-validation.Comment: arXiv admin note: substantial text overlap with arXiv:2110.0872