Semi-Supervised Deep Learning for Multi-Tissue Segmentation from Multi-Contrast MRI

Segmentation of thigh tissues (muscle, fat, inter-muscular adipose tissue (IMAT), bone, and bone marrow) from magnetic resonance imaging (MRI) scans is useful for clinical and research investigations in various conditions such as aging, diabetes mellitus, obesity, metabolic syndrome, and their associated comorbidities. Towards a fully automated, robust, and precise quantification of thigh tissues, herein we designed a novel semi-supervised segmentation algorithm based on deep network architectures. Built upon Tiramisu segmentation engine, our proposed deep networks use variational and specially designed targeted dropouts for faster and robust convergence, and utilize multi-contrast MRI scans as input data. In our experiments, we have used 150 scans from 50 distinct subjects from the Baltimore Longitudinal Study of Aging (BLSA). The proposed system made use of both labeled and unlabeled data with high efficacy for training, and outperformed the current state-of-the-art methods with dice scores of 97.52%, 94.61%, 80.14%, 95.93%, and 96.83% for muscle, fat, IMAT, bone, and bone marrow tissues, respectively. Our results indicate that the proposed system can be useful for clinical research studies where volumetric and distributional tissue quantification is pivotal and labeling is a significant issue. To the best of our knowledge, the proposed system is the first attempt at multi-tissue segmentation using a single end-to-end semi-supervised deep learning framework for multi-contrast thigh MRI scans.Comment: 20 pages, 9 figures, Journal of Signal Processing System

Automatic signal and image-based assessments of spinal cord injury and treatments.

Spinal cord injury (SCI) is one of the most common sources of motor disabilities in humans that often deeply impact the quality of life in individuals with severe and chronic SCI. In this dissertation, we have developed advanced engineering tools to address three distinct problems that researchers, clinicians and patients are facing in SCI research. Particularly, we have proposed a fully automated stochastic framework to quantify the effects of SCI on muscle size and adipose tissue distribution in skeletal muscles by volumetric segmentation of 3-D MRI scans in individuals with chronic SCI as well as non-disabled individuals. We also developed a novel framework for robust and automatic activation detection, feature extraction and visualization of the spinal cord epidural stimulation (scES) effects across a high number of scES parameters to build individualized-maps of muscle recruitment patterns of scES. Finally, in the last part of this dissertation, we introduced an EMG time-frequency analysis framework that implements EMG spectral analysis and machine learning tools to characterize EMG patterns resulting in independent or assisted standing enabled by scES, and identify the stimulation parameters that promote muscle activation patterns more effective for standing. The neurotechnological advancements proposed in this dissertation have greatly benefited SCI research by accelerating the efforts to quantify the effects of SCI on muscle size and functionality, expanding the knowledge regarding the neurophysiological mechanisms involved in re-enabling motor function with epidural stimulation and the selection of stimulation parameters and helping the patients with complete paralysis to achieve faster motor recovery

Diffusion-tensor MRI methods to study and evaluate muscle architecture

The thesis describes the development of various approaches for measuring muscle architectural parameters using Diffusion Tensor MR Imaging (DTI). It also illustrates how to apply them to study changes in muscle architecture after an injury prevention program.In Chapter 2, because manual segmentation of muscles is cumbersome, we validated a semi-automatic framework for estimating DTI indices in upper leg muscles. This method reduced segmentation time by a factor of three in a cross-sectional study design and can be used fully automatically in a longitudinal assessment of changes in DTI indices.Chapter 3 was a feasibility study measuring fiber orientation changes with DTI in calf muscles and sub-compartments of the Soleus and Tibialis Anterior during plantarflexion and dorsiflexion. Differences in fiber orientations corresponded to the known agonist-antagonist function of the muscles. This shows that DTI can be utilized to assess changes in muscle orientation due to posture or training.In Chapter 4, we compared DTI fiber tractography for Vastus Lateralis fiber architecture assessment with 3D ultrasonography (3D-US). We discovered that both methods have their advantages and disadvantages, with the agreement between the two techniques being moderate.Finally, in Chapter 5, we examined the effects of a hamstring injury prevention exercise on the muscle architectural parameters of basketball players. DTI was employed to quantify changes in fiber orientation and length using tractography and fiber orientation maps. It was observed that the Semitendinosus fascicle length increased after the Nordics exercise, while the Biceps Femoris long head fiber orientation decreased following the Divers intervention

A Geometric Flow Approach for Segmentation of Images with Inhomongeneous Intensity and Missing Boundaries

Image segmentation is a complex mathematical problem, especially for images that contain intensity inhomogeneity and tightly packed objects with missing boundaries in between. For instance, Magnetic Resonance (MR) muscle images often contain both of these issues, making muscle segmentation especially difficult. In this paper we propose a novel intensity correction and a semi-automatic active contour based segmentation approach. The approach uses a geometric flow that incorporates a reproducing kernel Hilbert space (RKHS) edge detector and a geodesic distance penalty term from a set of markers and anti-markers. We test the proposed scheme on MR muscle segmentation and compare with some state of the art methods. To help deal with the intensity inhomogeneity in this particular kind of image, a new approach to estimate the bias field using a fat fraction image, called Prior Bias-Corrected Fuzzy C-means (PBCFCM), is introduced. Numerical experiments show that the proposed scheme leads to significantly better results than compared ones. The average dice values of the proposed method are 92.5%, 85.3%, 85.3% for quadriceps, hamstrings and other muscle groups while other approaches are at least 10% worse.Comment: Presented at CVIT 2023 Conference. Accepted to Journal of Image and Graphic

Artificial Intelligence, Mathematical Modeling and Magnetic Resonance Imaging for Precision Medicine in Neurology and Neuroradiology

La tesi affronta la possibilità di utilizzare metodi matematici, tecniche di simulazione, teorie fisiche riadattate e algoritmi di intelligenza artificiale per soddisfare le esigenze cliniche in neuroradiologia e neurologia al fine di descrivere e prevedere i patterns e l’evoluzione temporale di una malattia, nonché di supportare il processo decisionale clinico. La tesi è suddivisa in tre parti. La prima parte riguarda lo sviluppo di un workflow radiomico combinato con algoritmi di Machine Learning al fine di prevedere parametri che favoriscono la descrizione quantitativa dei cambiamenti anatomici e del coinvolgimento muscolare nei disordini neuromuscolari, con particolare attenzione alla distrofia facioscapolo-omerale. Il workflow proposto si basa su sequenze di risonanza magnetica convenzionali disponibili nella maggior parte dei centri neuromuscolari e, dunque, può essere utilizzato come strumento non invasivo per monitorare anche i più piccoli cambiamenti nei disturbi neuromuscolari oltre che per la valutazione della progressione della malattia nel tempo. La seconda parte riguarda l’utilizzo di un modello cinetico per descrivere la crescita tumorale basato sugli strumenti della meccanica statistica per sistemi multi-agente e che tiene in considerazione gli effetti delle incertezze cliniche legate alla variabilità della progressione tumorale nei diversi pazienti. L'azione dei protocolli terapeutici è modellata come controllo che agisce a livello microscopico modificando la natura della distribuzione risultante. Viene mostrato come lo scenario controllato permetta di smorzare le incertezze associate alla variabilità della dinamica tumorale. Inoltre, sono stati introdotti metodi di simulazione numerica basati sulla formulazione stochastic Galerkin del modello cinetico sviluppato. La terza parte si riferisce ad un progetto ancora in corso che tenta di descrivere una porzione di cervello attraverso la teoria quantistica dei campi e di simularne il comportamento attraverso l'implementazione di una rete neurale con una funzione di attivazione costruita ad hoc e che simula la funzione di risposta del modello biologico neuronale. E’ stato ottenuto che, nelle condizioni studiate, l'attività della porzione di cervello può essere descritta fino a O(6), i.e, considerando l’interazione fino a sei campi, come un processo gaussiano. Il framework quantistico definito può essere esteso anche al caso di un processo non gaussiano, ovvero al caso di una teoria di campo quantistico interagente utilizzando l’approccio della teoria wilsoniana di campo efficace.The thesis addresses the possibility of using mathematical methods, simulation techniques, repurposed physical theories and artificial intelligence algorithms to fulfill clinical needs in neuroradiology and neurology. The aim is to describe and to predict disease patterns and its evolution over time as well as to support clinical decision-making processes. The thesis is divided into three parts. Part 1 is related to the development of a Radiomic workflow combined with Machine Learning algorithms in order to predict parameters that quantify muscular anatomical involvement in neuromuscular diseases, with special focus on Facioscapulohumeral dystrophy. The proposed workflow relies on conventional Magnetic Resonance Imaging sequences available in most neuromuscular centers and it can be used as a non-invasive tool to monitor even fine change in neuromuscular disorders and to evaluate longitudinal diseases’ progression over time. Part 2 is about the description of a kinetic model for tumor growth by means of classical tools of statistical mechanics for many-agent systems also taking into account the effects of clinical uncertainties related to patients’ variability in tumor progression. The action of therapeutic protocols is modeled as feedback control at the microscopic level. The controlled scenario allows the dumping of uncertainties associated with the variability in tumors’ dynamics. Suitable numerical methods, based on Stochastic Galerkin formulation of the derived kinetic model, are introduced. Part 3 refers to a still-on going project that attempts to describe a brain portion through a quantum field theory and to simulate its behavior through the implementation of a neural network with an ad-hoc activation function mimicking the biological neuron model response function. Under considered conditions, the brain portion activity can be expressed up to O(6), i.e., up to six fields interaction, as a Gaussian Process. The defined quantum field framework may also be extended to the case of a Non-Gaussian Process behavior, or rather to an interacting quantum field theory in a Wilsonian Effective Field theory approach

Evaluation of an automated thresholding algorithm for the quantification of paraspinal muscle composition from MRI images

Abstract Background The imaging assessment of paraspinal muscle morphology and fatty infiltration has gained considerable attention in the past decades, with reports suggesting an association between muscle degenerative changes and low back pain (LBP). To date, qualitative and quantitative approaches have been used to assess paraspinal muscle composition. Though highly reliable, manual thresholding techniques are time consuming and not always feasible in a clinical setting. The tedious and rater-dependent nature of such manual thresholding techniques provides the impetus for the development of automated or semi-automated segmentation methods. The purpose of the present study was to develop and evaluate an automated thresholding algorithm for the assessment of paraspinal muscle composition. The reliability and validity of the muscle measurements using the new automated thresholding algorithm were investigated through repeated measurements and comparison with measurements from an established, highly reliable manual thresholding technique. Methods Magnetic resonance images of 30 patients with LBP were randomly selected cohort of patients participating in a project on commonly diagnosed lumbar pathologies in patients attending spine surgeon clinics. A series of T2-weighted MR images were used to train the algorithm; preprocessing techniques including adaptive histogram equalization method image adjustment scheme were used to enhance the quality and contrast of the images. All muscle measurements were repeated twice using a manual thresholding technique and the novel automated thresholding algorithm, from axial T2-weigthed images, at least 5 days apart. The rater was blinded to all earlier measurements. Inter-method agreement and intra-rater reliability for each measurement method were assessed. The study did not received external funding and the authors have no disclosures. Results There was excellent agreement between the two methods with inter-method reliability coefficients (intraclass correlation coefficients) varying from 0.79 to 0.99. Bland and Altman plots further confirmed the agreement between the two methods. Intra-rater reliability and standard error of measurements were comparable between methods, with reliability coefficient varying between 0.95 and 0.99 for the manual thresholding and 0.97–0.99 for the automated algorithm. Conclusion The proposed automated thresholding algorithm to assess paraspinal muscle size and composition measurements was highly reliable, with excellent agreement with the reference manual thresholding method

Automating the multimodal analysis of musculoskeletal imaging in the presence of hip implants

In patients treated with hip arthroplasty, the muscular condition and presence of inflammatory reactions are assessed using magnetic resonance imaging (MRI). As MRI lacks contrast for bony structures, computed tomography (CT) is preferred for clinical evaluation of bone tissue and orthopaedic surgical planning. Combining the complementary information of MRI and CT could improve current clinical practice for diagnosis, monitoring and treatment planning. In particular, the different contrast of these modalities could help better quantify the presence of fatty infiltration to characterise muscular condition after hip replacement. In this thesis, I developed automated processing tools for the joint analysis of CT and MR images of patients with hip implants. In order to combine the multimodal information, a novel nonlinear registration algorithm was introduced, which imposes rigidity constraints on bony structures to ensure realistic deformation. I implemented and thoroughly validated a fully automated framework for the multimodal segmentation of healthy and pathological musculoskeletal structures, as well as implants. This framework combines the proposed registration algorithm with tailored image quality enhancement techniques and a multi-atlas-based segmentation approach, providing robustness against the large population anatomical variability and the presence of noise and artefacts in the images. The automation of muscle segmentation enabled the derivation of a measure of fatty infiltration, the Intramuscular Fat Fraction, useful to characterise the presence of muscle atrophy. The proposed imaging biomarker was shown to strongly correlate with the atrophy radiological score currently used in clinical practice. Finally, a preliminary work on multimodal metal artefact reduction, using an unsupervised deep learning strategy, showed promise for improving the postprocessing of CT and MR images heavily corrupted by metal artefact. This work represents a step forward towards the automation of image analysis in hip arthroplasty, supporting and quantitatively informing the decision-making process about patient’s management