Deep learning-based fully automatic segmentation of wrist cartilage in MR images

The study objective was to investigate the performance of a dedicated convolutional neural network (CNN) optimized for wrist cartilage segmentation from 2D MR images. CNN utilized a planar architecture and patch-based (PB) training approach that ensured optimal performance in the presence of a limited amount of training data. The CNN was trained and validated in twenty multi-slice MRI datasets acquired with two different coils in eleven subjects (healthy volunteers and patients). The validation included a comparison with the alternative state-of-the-art CNN methods for the segmentation of joints from MR images and the ground-truth manual segmentation. When trained on the limited training data, the CNN outperformed significantly image-based and patch-based U-Net networks. Our PB-CNN also demonstrated a good agreement with manual segmentation (Sorensen-Dice similarity coefficient (DSC) = 0.81) in the representative (central coronal) slices with large amount of cartilage tissue. Reduced performance of the network for slices with a very limited amount of cartilage tissue suggests the need for fully 3D convolutional networks to provide uniform performance across the joint. The study also assessed inter- and intra-observer variability of the manual wrist cartilage segmentation (DSC=0.78-0.88 and 0.9, respectively). The proposed deep-learning-based segmentation of the wrist cartilage from MRI could facilitate research of novel imaging markers of wrist osteoarthritis to characterize its progression and response to therapy

Segmentation of bones in magnetic resonance images of the wrist

PURPOSE:   Rheumatoid arthritis (RA) is a disease characterized by progressive and irreversible destruction of bones and joints. According to current recommendations, magnetic resonance imaging (MRI) is used to asses three main signs of RA based on manual evaluation of MR images: synovitis, bone edema and bone erosions. The key feature of a future computer-assisted diagnostic system for evaluation RA lesions is accurate segmentation of 15 wrist bones. In the present paper, we focus on developing a wrist bones segmentation framework. METHOD:    The segmentation procedure consisted of three stages: segmentation of the distal parts of ulna and radius, segmentation of the proximal parts of metacarpal bones and segmentation of carpal bones. At every stage, markers of bones were determined first, using an atlas-based approach. Then, given markers of bones and a marker of background, a watershed from markers algorithm was applied to find the final segmentation. RESULTS:   The MR data for 37 cases were analyzed. The automated segmentation results were compared with gold-standard manual segmentations using a few well-established metrics: area under ROC curve AUC, mean similarity MS and mean absolute distance MAD. The mean (standard deviation) values of AUC, MS and MAD were 0.97 (0.04), 0.93 (0.09) and 1.23 (0.28), respectively. CONCLUSION:   The results of the present study demonstrate that automated segmentation of wrist bones is feasible. The proposed algorithm can be the first stage for the detection of early lesions like bone edema or synovitis

On the segmentation and classification of hand radiographs

This research is part of a wider project to build predictive models of bone age using hand radiograph images. We examine ways of finding the outline of a hand from an X-ray as the first stage in segmenting the image into constituent bones. We assess a variety of algorithms including contouring, which has not previously been used in this context. We introduce a novel ensemble algorithm for combining outlines using two voting schemes, a likelihood ratio test and dynamic time warping (DTW). Our goal is to minimize the human intervention required, hence we investigate alternative ways of training a classifier to determine whether an outline is in fact correct or not. We evaluate outlining and classification on a set of 1370 images. We conclude that ensembling with DTW improves performance of all outlining algorithms, that the contouring algorithm used with the DTW ensemble performs the best of those assessed, and that the most effective classifier of hand outlines assessed is a random forest applied to outlines transformed into principal components

Deep learning-based post-processing of real-time MRI to assess and quantify dynamic wrist movement in health and disease

While morphologic magnetic resonance imaging (MRI) is the imaging modality of choice for the evaluation of ligamentous wrist injuries, it is merely static and incapable of diagnosing dynamic wrist instability. Based on real-time MRI and algorithm-based image post-processing in terms of convolutional neural networks (CNNs), this study aims to develop and validate an automatic technique to quantify wrist movement. A total of 56 bilateral wrists (28 healthy volunteers) were imaged during continuous and alternating maximum ulnar and radial abduction. Following CNN-based automatic segmentations of carpal bone contours, scapholunate and lunotriquetral gap widths were quantified based on dedicated algorithms and as a function of wrist position. Automatic segmentations were in excellent agreement with manual reference segmentations performed by two radiologists as indicated by Dice similarity coefficients of 0.96 ± 0.02 and consistent and unskewed Bland–Altman plots. Clinical applicability of the framework was assessed in a patient with diagnosed scapholunate ligament injury. Considerable increases in scapholunate gap widths across the range-of-motion were found. In conclusion, the combination of real-time wrist MRI and the present framework provides a powerful diagnostic tool for dynamic assessment of wrist function and, if confirmed in clinical trials, dynamic carpal instability that may elude static assessment using clinical-standard imaging modalities

Novel Approaches to the Representation and Analysis of 3D Segmented Anatomical Districts

Nowadays, image processing and 3D shape analysis are an integral part of clinical practice and have the potentiality to support clinicians with advanced analysis and visualization techniques. Both approaches provide visual and quantitative information to medical practitioners, even if from different points of view. Indeed, shape analysis is aimed at studying the morphology of anatomical structures, while image processing is focused more on the tissue or functional information provided by the pixels/voxels intensities levels. Despite the progress obtained by research in both fields, a junction between these two complementary worlds is missing. When working with 3D models analyzing shape features, the information of the volume surrounding the structure is lost, since a segmentation process is needed to obtain the 3D shape model; however, the 3D nature of the anatomical structure is represented explicitly. With volume images, instead, the tissue information related to the imaged volume is the core of the analysis, while the shape and morphology of the structure are just implicitly represented, thus not clear enough. The aim of this Thesis work is the integration of these two approaches in order to increase the amount of information available for physicians, allowing a more accurate analysis of each patient. An augmented visualization tool able to provide information on both the anatomical structure shape and the surrounding volume through a hybrid representation, could reduce the gap between the two approaches and provide a more complete anatomical rendering of the subject. To this end, given a segmented anatomical district, we propose a novel mapping of volumetric data onto the segmented surface. The grey-levels of the image voxels are mapped through a volume-surface correspondence map, which defines a grey-level texture on the segmented surface. The resulting texture mapping is coherent to the local morphology of the segmented anatomical structure and provides an enhanced visual representation of the anatomical district. The integration of volume-based and surface-based information in a unique 3D representation also supports the identification and characterization of morphological landmarks and pathology evaluations. The main research contributions of the Ph.D. activities and Thesis are: \u2022 the development of a novel integration algorithm that combines surface-based (segmented 3D anatomical structure meshes) and volume-based (MRI volumes) information. The integration supports different criteria for the grey-levels mapping onto the segmented surface; \u2022 the development of methodological approaches for using the grey-levels mapping together with morphological analysis. The final goal is to solve problems in real clinical tasks, such as the identification of (patient-specific) ligament insertion sites on bones from segmented MR images, the characterization of the local morphology of bones/tissues, the early diagnosis, classification, and monitoring of muscle-skeletal pathologies; \u2022 the analysis of segmentation procedures, with a focus on the tissue classification process, in order to reduce operator dependency and to overcome the absence of a real gold standard for the evaluation of automatic segmentations; \u2022 the evaluation and comparison of (unsupervised) segmentation methods, finalized to define a novel segmentation method for low-field MR images, and for the local correction/improvement of a given segmentation. The proposed method is simple but effectively integrates information derived from medical image analysis and 3D shape analysis. Moreover, the algorithm is general enough to be applied to different anatomical districts independently of the segmentation method, imaging techniques (such as CT), or image resolution. The volume information can be integrated easily in different shape analysis applications, taking into consideration not only the morphology of the input shape but also the real context in which it is inserted, to solve clinical tasks. The results obtained by this combined analysis have been evaluated through statistical analysis

Computer-aided techniques for assessment of MRI-detected inflammation for early identification of inflammatory arthritis

Inflammatory arthritis comprises a group of diseases in which the immune system attacks the body’s own tissues. Two prevalent types of inflammatory arthritis are rheumatoid arthritis (RA) and spondyloarthritis (SpA). Clinical research points to the importance of early diagnosis, as treatment in early disease stages increases chances of better outcome and improved quality of life for patients. To this end, the diagnostic potential of imaging modalities sensitive to local inflammation, such as magnetic resonance imaging (MRI), is of great interest. The goal of this thesis was to develop computer-aided methods for assessment of MRI-detected inflammation with the aim of aiding early diagnosis of inflammatory arthritis. In particular, we focused on the tasks of comparative visualization, automatic quantification, and feature selection. The presented studies showcase the potential of comparative visualization and automatic quantification to overcome the limitations of visual scoring and lay out a fertile ground for future improvements. Additionally, the understanding of the diagnostic role of individual inflammatory features in prediction of RA development is further advanced. Collectively, these findings can help facilitate the use of MRI for early diagnosis of inflammatory arthritis and potentially increase chances of better outcome and quality of life for patients.This research was supported by the Dutch Technology Foundation STW, under grant number 13329. STW (currently TTW) is part of the Netherlands Organization for Scientific Research (NWO), which is partly funded by the Dutch Ministry of Economic Affairs.LUMC / Geneeskunde Repositoriu

Non-contact measures to monitor hand movement of people with rheumatoid arthritis using a monocular RGB camera

Hand movements play an essential role in a person’s ability to interact with the environment. In hand biomechanics, the range of joint motion is a crucial metric to quantify changes due to degenerative pathologies, such as rheumatoid arthritis (RA). RA is a chronic condition where the immune system mistakenly attacks the joints, particularly those in the hands. Optoelectronic motion capture systems are gold-standard tools to quantify changes but are challenging to adopt outside laboratory settings. Deep learning executed on standard video data can capture RA participants in their natural environments, potentially supporting objectivity in remote consultation. The three main research aims in this thesis were 1) to assess the extent to which current deep learning architectures, which have been validated for quantifying motion of other body segments, can be applied to hand kinematics using monocular RGB cameras, 2) to localise where in videos the hand motions of interest are to be found, 3) to assess the validity of 1) and 2) to determine disease status in RA. First, hand kinematics for twelve healthy participants, captured with OpenPose were benchmarked against those captured using an optoelectronic system, showing acceptable instrument errors below 10°. Then, a gesture classifier was tested to segment video recordings of twenty-two healthy participants, achieving an accuracy of 93.5%. Finally, OpenPose and the classifier were applied to videos of RA participants performing hand exercises to determine disease status. The inferred disease activity exhibited agreement with the in-person ground truth in nine out of ten instances, outperforming virtual consultations, which agreed only six times out of ten. These results demonstrate that this approach is more effective than estimated disease activity performed by human experts during video consultations. The end goal sets the foundation for a tool that RA participants can use to observe their disease activity from their home.Open Acces