Automating the multimodal analysis of musculoskeletal imaging in the presence of hip implants

In patients treated with hip arthroplasty, the muscular condition and presence of inflammatory reactions are assessed using magnetic resonance imaging (MRI). As MRI lacks contrast for bony structures, computed tomography (CT) is preferred for clinical evaluation of bone tissue and orthopaedic surgical planning. Combining the complementary information of MRI and CT could improve current clinical practice for diagnosis, monitoring and treatment planning. In particular, the different contrast of these modalities could help better quantify the presence of fatty infiltration to characterise muscular condition after hip replacement. In this thesis, I developed automated processing tools for the joint analysis of CT and MR images of patients with hip implants. In order to combine the multimodal information, a novel nonlinear registration algorithm was introduced, which imposes rigidity constraints on bony structures to ensure realistic deformation. I implemented and thoroughly validated a fully automated framework for the multimodal segmentation of healthy and pathological musculoskeletal structures, as well as implants. This framework combines the proposed registration algorithm with tailored image quality enhancement techniques and a multi-atlas-based segmentation approach, providing robustness against the large population anatomical variability and the presence of noise and artefacts in the images. The automation of muscle segmentation enabled the derivation of a measure of fatty infiltration, the Intramuscular Fat Fraction, useful to characterise the presence of muscle atrophy. The proposed imaging biomarker was shown to strongly correlate with the atrophy radiological score currently used in clinical practice. Finally, a preliminary work on multimodal metal artefact reduction, using an unsupervised deep learning strategy, showed promise for improving the postprocessing of CT and MR images heavily corrupted by metal artefact. This work represents a step forward towards the automation of image analysis in hip arthroplasty, supporting and quantitatively informing the decision-making process about patient’s management

Volumetric Segmentation of Cell Cycle Markers in Confocal Images Using Machine Learning and Deep Learning

© Copyright © 2020 Khan, Voß, Pound and French. Understanding plant growth processes is important for many aspects of biology and food security. Automating the observations of plant development—a process referred to as plant phenotyping—is increasingly important in the plant sciences, and is often a bottleneck. Automated tools are required to analyze the data in microscopy images depicting plant growth, either locating or counting regions of cellular features in images. In this paper, we present to the plant community an introduction to and exploration of two machine learning approaches to address the problem of marker localization in confocal microscopy. First, a comparative study is conducted on the classification accuracy of common conventional machine learning algorithms, as a means to highlight challenges with these methods. Second, a 3D (volumetric) deep learning approach is developed and presented, including consideration of appropriate loss functions and training data. A qualitative and quantitative analysis of all the results produced is performed. Evaluation of all approaches is performed on an unseen time-series sequence comprising several individual 3D volumes, capturing plant growth. The comparative analysis shows that the deep learning approach produces more accurate and robust results than traditional machine learning. To accompany the paper, we are releasing the 4D point annotation tool used to generate the annotations, in the form of a plugin for the popular ImageJ (FIJI) software. Network models and example datasets will also be available online

Hydrogel-Tissue Chemistry: Principles and Applications

Over the past five years, a rapidly developing experimental approach has enabled high-resolution and high-content information retrieval from intact multicellular animal (metazoan) systems. New chemical and physical forms are created in the hydrogel-tissue chemistry process, and the retention and retrieval of crucial phenotypic information regarding constituent cells and molecules (and their joint interrelationships) are thereby enabled. For example, rich data sets defining both single-cell-resolution gene expression and single-cell-resolution activity during behavior can now be collected while still preserving information on three-dimensional positioning and/or brain-wide wiring of those very same neurons—even within vertebrate brains. This new approach and its variants, as applied to neuroscience, are beginning to illuminate the fundamental cellular and chemical representations of sensation, cognition, and action. More generally, reimagining metazoans as metareactants—or positionally defined three-dimensional graphs of constituent chemicals made available for ongoing functionalization, transformation, and readout—is stimulating innovation across biology and medicine

Advanced Sensing and Image Processing Techniques for Healthcare Applications

This Special Issue aims to attract the latest research and findings in the design, development and experimentation of healthcare-related technologies. This includes, but is not limited to, using novel sensing, imaging, data processing, machine learning, and artificially intelligent devices and algorithms to assist/monitor the elderly, patients, and the disabled population

Diffusion-tensor MRI methods to study and evaluate muscle architecture

The thesis describes the development of various approaches for measuring muscle architectural parameters using Diffusion Tensor MR Imaging (DTI). It also illustrates how to apply them to study changes in muscle architecture after an injury prevention program.In Chapter 2, because manual segmentation of muscles is cumbersome, we validated a semi-automatic framework for estimating DTI indices in upper leg muscles. This method reduced segmentation time by a factor of three in a cross-sectional study design and can be used fully automatically in a longitudinal assessment of changes in DTI indices.Chapter 3 was a feasibility study measuring fiber orientation changes with DTI in calf muscles and sub-compartments of the Soleus and Tibialis Anterior during plantarflexion and dorsiflexion. Differences in fiber orientations corresponded to the known agonist-antagonist function of the muscles. This shows that DTI can be utilized to assess changes in muscle orientation due to posture or training.In Chapter 4, we compared DTI fiber tractography for Vastus Lateralis fiber architecture assessment with 3D ultrasonography (3D-US). We discovered that both methods have their advantages and disadvantages, with the agreement between the two techniques being moderate.Finally, in Chapter 5, we examined the effects of a hamstring injury prevention exercise on the muscle architectural parameters of basketball players. DTI was employed to quantify changes in fiber orientation and length using tractography and fiber orientation maps. It was observed that the Semitendinosus fascicle length increased after the Nordics exercise, while the Biceps Femoris long head fiber orientation decreased following the Divers intervention

OCM 2021 - Optical Characterization of Materials

The state of the art in the optical characterization of materials is advancing rapidly. New insights have been gained into the theoretical foundations of this research and exciting developments have been made in practice, driven by new applications and innovative sensor technologies that are constantly evolving. The great success of past conferences proves the necessity of a platform for presentation, discussion and evaluation of the latest research results in this interdisciplinary field

OCM 2021 - Optical Characterization of Materials : Conference Proceedings

The state of the art in the optical characterization of materials is advancing rapidly. New insights have been gained into the theoretical foundations of this research and exciting developments have been made in practice, driven by new applications and innovative sensor technologies that are constantly evolving. The great success of past conferences proves the necessity of a platform for presentation, discussion and evaluation of the latest research results in this interdisciplinary field