69 research outputs found
Artificial Intelligence Applications in Cardiovascular Magnetic Resonance Imaging: Are We on the Path to Avoiding the Administration of Contrast Media?
In recent years, cardiovascular imaging examinations have experienced exponential growth due to technological innovation, and this trend is consistent with the most recent chest pain guidelines. Contrast media have a crucial role in cardiovascular magnetic resonance (CMR) imaging, allowing for more precise characterization of different cardiovascular diseases. However, contrast media have contraindications and side effects that limit their clinical application in determinant patients. The application of artificial intelligence (AI)-based techniques to CMR imaging has led to the development of non-contrast models. These AI models utilize non-contrast imaging data, either independently or in combination with clinical and demographic data, as input to generate diagnostic or prognostic algorithms. In this review, we provide an overview of the main concepts pertaining to AI, review the existing literature on non-contrast AI models in CMR, and finally, discuss the strengths and limitations of these AI models and their possible future development
Multi-Modality Pathology Segmentation Framework: Application to Cardiac Magnetic Resonance Images
Multi-sequence of cardiac magnetic resonance (CMR) images can provide
complementary information for myocardial pathology (scar and edema). However,
it is still challenging to fuse these underlying information for pathology
segmentation effectively. This work presents an automatic cascade pathology
segmentation framework based on multi-modality CMR images. It mainly consists
of two neural networks: an anatomical structure segmentation network (ASSN) and
a pathological region segmentation network (PRSN). Specifically, the ASSN aims
to segment the anatomical structure where the pathology may exist, and it can
provide a spatial prior for the pathological region segmentation. In addition,
we integrate a denoising auto-encoder (DAE) into the ASSN to generate
segmentation results with plausible shapes. The PRSN is designed to segment
pathological region based on the result of ASSN, in which a fusion block based
on channel attention is proposed to better aggregate multi-modality information
from multi-modality CMR images. Experiments from the MyoPS2020 challenge
dataset show that our framework can achieve promising performance for
myocardial scar and edema segmentation.Comment: 12 pages,MyoPS 202
Evaluation of state-of-the-art segmentation algorithms for left ventricle infarct from late Gadolinium enhancement MR images
Studies have demonstrated the feasibility of late Gadolinium enhancement (LGE) cardiovascular magnetic
resonance (CMR) imaging for guiding the management of patients with sequelae to myocardial infarction,
such as ventricular tachycardia and heart failure. Clinical implementation of these developments necessitates
a reproducible and reliable segmentation of the infarcted regions. It is challenging to compare
new algorithms for infarct segmentation in the left ventricle (LV) with existing algorithms. Benchmarking
datasets with evaluation strategies are much needed to facilitate comparison. This manuscript presents
a benchmarking evaluation framework for future algorithms that segment infarct from LGE CMR of the
LV. The image database consists of 30 LGE CMR images of both humans and pigs that were acquired
from two separate imaging centres. A consensus ground truth was obtained for all data using maximum
likelihood estimation.
Six widely-used fixed-thresholding methods and five recently developed algorithms are tested on the
benchmarking framework. Results demonstrate that the algorithms have better overlap with the consensus
ground truth than most of the n-SD fixed-thresholding methods, with the exception of the FullWidth-at-Half-Maximum
(FWHM) fixed-thresholding method. Some of the pitfalls of fixed thresholding
methods are demonstrated in this work. The benchmarking evaluation framework, which is a contribution
of this work, can be used to test and benchmark future algorithms that detect and quantify infarct
in LGE CMR images of the LV. The datasets, ground truth and evaluation code have been made publicly
available through the website: https://www.cardiacatlas.org/web/guest/challenges
Semi-Supervised Medical Image Segmentation with Co-Distribution Alignment
Medical image segmentation has made significant progress when a large amount
of labeled data are available. However, annotating medical image segmentation
datasets is expensive due to the requirement of professional skills.
Additionally, classes are often unevenly distributed in medical images, which
severely affects the classification performance on minority classes. To address
these problems, this paper proposes Co-Distribution Alignment (Co-DA) for
semi-supervised medical image segmentation. Specifically, Co-DA aligns marginal
predictions on unlabeled data to marginal predictions on labeled data in a
class-wise manner with two differently initialized models before using the
pseudo-labels generated by one model to supervise the other. Besides, we design
an over-expectation cross-entropy loss for filtering the unlabeled pixels to
reduce noise in their pseudo-labels. Quantitative and qualitative experiments
on three public datasets demonstrate that the proposed approach outperforms
existing state-of-the-art semi-supervised medical image segmentation methods on
both the 2D CaDIS dataset and the 3D LGE-MRI and ACDC datasets, achieving an
mIoU of 0.8515 with only 24% labeled data on CaDIS, and a Dice score of 0.8824
and 0.8773 with only 20% data on LGE-MRI and ACDC, respectively.Comment: Paper appears in Bioengineering 2023, 10(7), 86
Doctor of Philosophy
dissertationImage segmentation entails the partitioning of an image domain, usually two or three dimensions, so that each partition or segment has some meaning that is relevant to the application at hand. Accurate image segmentation is a crucial challenge in many disciplines, including medicine, computer vision, and geology. In some applications, heterogeneous pixel intensities; noisy, ill-defined, or diffusive boundaries; and irregular shapes with high variability can make it challenging to meet accuracy requirements. Various segmentation approaches tackle such challenges by casting the segmentation problem as an energy-minimization problem, and solving it using efficient optimization algorithms. These approaches are broadly classified as either region-based or edge (surface)-based depending on the features on which they operate. The focus of this dissertation is on the development of a surface-based energy model, the design of efficient formulations of optimization frameworks to incorporate such energy, and the solution of the energy-minimization problem using graph cuts. This dissertation utilizes a set of four papers whose motivation is the efficient extraction of the left atrium wall from the late gadolinium enhancement magnetic resonance imaging (LGE-MRI) image volume. This dissertation utilizes these energy formulations for other applications, including contact lens segmentation in the optical coherence tomography (OCT) data and the extraction of geologic features in seismic data. Chapters 2 through 5 (papers 1 through 4) explore building a surface-based image segmentation model by progressively adding components to improve its accuracy and robustness. The first paper defines a parametric search space and its discrete formulation in the form of a multilayer three-dimensional mesh model within which the segmentation takes place. It includes a generative intensity model, and we optimize using a graph formulation of the surface net problem. The second paper proposes a Bayesian framework with a Markov random field (MRF) prior that gives rise to another class of surface nets, which provides better segmentation with smooth boundaries. The third paper presents a maximum a posteriori (MAP)-based surface estimation framework that relies on a generative image model by incorporating global shape priors, in addition to the MRF, within the Bayesian formulation. Thus, the resulting surface not only depends on the learned model of shapes,but also accommodates the test data irregularities through smooth deviations from these priors. Further, the paper proposes a new shape parameter estimation scheme, in closed form, for segmentation as a part of the optimization process. Finally, the fourth paper (under review at the time of this document) presents an extensive analysis of the MAP framework and presents improved mesh generation and generative intensity models. It also performs a thorough analysis of the segmentation results that demonstrates the effectiveness of the proposed method qualitatively, quantitatively, and clinically. Chapter 6, consisting of unpublished work, demonstrates the application of an MRF-based Bayesian framework to segment coupled surfaces of contact lenses in optical coherence tomography images. This chapter also shows an application related to the extraction of geological structures in seismic volumes. Due to the large sizes of seismic volume datasets, we also present fast, approximate surface-based energy minimization strategies that achieve better speed-ups and memory consumption
Deep learning for unsupervised domain adaptation in medical imaging: Recent advancements and future perspectives
Deep learning has demonstrated remarkable performance across various tasks in
medical imaging. However, these approaches primarily focus on supervised
learning, assuming that the training and testing data are drawn from the same
distribution. Unfortunately, this assumption may not always hold true in
practice. To address these issues, unsupervised domain adaptation (UDA)
techniques have been developed to transfer knowledge from a labeled domain to a
related but unlabeled domain. In recent years, significant advancements have
been made in UDA, resulting in a wide range of methodologies, including feature
alignment, image translation, self-supervision, and disentangled representation
methods, among others. In this paper, we provide a comprehensive literature
review of recent deep UDA approaches in medical imaging from a technical
perspective. Specifically, we categorize current UDA research in medical
imaging into six groups and further divide them into finer subcategories based
on the different tasks they perform. We also discuss the respective datasets
used in the studies to assess the divergence between the different domains.
Finally, we discuss emerging areas and provide insights and discussions on
future research directions to conclude this survey.Comment: Under Revie
Data efficient deep learning for medical image analysis: A survey
The rapid evolution of deep learning has significantly advanced the field of
medical image analysis. However, despite these achievements, the further
enhancement of deep learning models for medical image analysis faces a
significant challenge due to the scarcity of large, well-annotated datasets. To
address this issue, recent years have witnessed a growing emphasis on the
development of data-efficient deep learning methods. This paper conducts a
thorough review of data-efficient deep learning methods for medical image
analysis. To this end, we categorize these methods based on the level of
supervision they rely on, encompassing categories such as no supervision,
inexact supervision, incomplete supervision, inaccurate supervision, and only
limited supervision. We further divide these categories into finer
subcategories. For example, we categorize inexact supervision into multiple
instance learning and learning with weak annotations. Similarly, we categorize
incomplete supervision into semi-supervised learning, active learning, and
domain-adaptive learning and so on. Furthermore, we systematically summarize
commonly used datasets for data efficient deep learning in medical image
analysis and investigate future research directions to conclude this survey.Comment: Under Revie
- …