373 research outputs found
A Survey on Deep Learning in Medical Image Analysis
Deep learning algorithms, in particular convolutional networks, have rapidly
become a methodology of choice for analyzing medical images. This paper reviews
the major deep learning concepts pertinent to medical image analysis and
summarizes over 300 contributions to the field, most of which appeared in the
last year. We survey the use of deep learning for image classification, object
detection, segmentation, registration, and other tasks and provide concise
overviews of studies per application area. Open challenges and directions for
future research are discussed.Comment: Revised survey includes expanded discussion section and reworked
introductory section on common deep architectures. Added missed papers from
before Feb 1st 201
Human treelike tubular structure segmentation: A comprehensive review and future perspectives
Various structures in human physiology follow a treelike morphology, which often expresses complexity at very fine scales. Examples of such structures are intrathoracic airways, retinal blood vessels, and hepatic blood vessels. Large collections of 2D and 3D images have been made available by medical imaging modalities such as magnetic resonance imaging (MRI), computed tomography (CT), Optical coherence tomography (OCT) and ultrasound in which the spatial arrangement can be observed. Segmentation of these structures in medical imaging is of great importance since the analysis of the structure provides insights into disease diagnosis, treatment planning, and prognosis. Manually labelling extensive data by radiologists is often time-consuming and error-prone. As a result, automated or semi-automated computational models have become a popular research field of medical imaging in the past two decades, and many have been developed to date. In this survey, we aim to provide a comprehensive review of currently publicly available datasets, segmentation algorithms, and evaluation metrics. In addition, current challenges and future research directions are discussed
Human Treelike Tubular Structure Segmentation: A Comprehensive Review and Future Perspectives
Various structures in human physiology follow a treelike morphology, which
often expresses complexity at very fine scales. Examples of such structures are
intrathoracic airways, retinal blood vessels, and hepatic blood vessels. Large
collections of 2D and 3D images have been made available by medical imaging
modalities such as magnetic resonance imaging (MRI), computed tomography (CT),
Optical coherence tomography (OCT) and ultrasound in which the spatial
arrangement can be observed. Segmentation of these structures in medical
imaging is of great importance since the analysis of the structure provides
insights into disease diagnosis, treatment planning, and prognosis. Manually
labelling extensive data by radiologists is often time-consuming and
error-prone. As a result, automated or semi-automated computational models have
become a popular research field of medical imaging in the past two decades, and
many have been developed to date. In this survey, we aim to provide a
comprehensive review of currently publicly available datasets, segmentation
algorithms, and evaluation metrics. In addition, current challenges and future
research directions are discussed.Comment: 30 pages, 19 figures, submitted to CBM journa
AeroPath: An airway segmentation benchmark dataset with challenging pathology
To improve the prognosis of patients suffering from pulmonary diseases, such
as lung cancer, early diagnosis and treatment are crucial. The analysis of CT
images is invaluable for diagnosis, whereas high quality segmentation of the
airway tree are required for intervention planning and live guidance during
bronchoscopy. Recently, the Multi-domain Airway Tree Modeling (ATM'22)
challenge released a large dataset, both enabling training of deep-learning
based models and bringing substantial improvement of the state-of-the-art for
the airway segmentation task. However, the ATM'22 dataset includes few patients
with severe pathologies affecting the airway tree anatomy. In this study, we
introduce a new public benchmark dataset (AeroPath), consisting of 27 CT images
from patients with pathologies ranging from emphysema to large tumors, with
corresponding trachea and bronchi annotations. Second, we present a multiscale
fusion design for automatic airway segmentation. Models were trained on the
ATM'22 dataset, tested on the AeroPath dataset, and further evaluated against
competitive open-source methods. The same performance metrics as used in the
ATM'22 challenge were used to benchmark the different considered approaches.
Lastly, an open web application is developed, to easily test the proposed model
on new data. The results demonstrated that our proposed architecture predicted
topologically correct segmentations for all the patients included in the
AeroPath dataset. The proposed method is robust and able to handle various
anomalies, down to at least the fifth airway generation. In addition, the
AeroPath dataset, featuring patients with challenging pathologies, will
contribute to development of new state-of-the-art methods. The AeroPath dataset
and the web application are made openly available.Comment: 13 pages, 5 figures, submitted to Scientific Report
Deep Learning in Cardiology
The medical field is creating large amount of data that physicians are unable
to decipher and use efficiently. Moreover, rule-based expert systems are
inefficient in solving complicated medical tasks or for creating insights using
big data. Deep learning has emerged as a more accurate and effective technology
in a wide range of medical problems such as diagnosis, prediction and
intervention. Deep learning is a representation learning method that consists
of layers that transform the data non-linearly, thus, revealing hierarchical
relationships and structures. In this review we survey deep learning
application papers that use structured data, signal and imaging modalities from
cardiology. We discuss the advantages and limitations of applying deep learning
in cardiology that also apply in medicine in general, while proposing certain
directions as the most viable for clinical use.Comment: 27 pages, 2 figures, 10 table
U-Net and its variants for medical image segmentation: theory and applications
U-net is an image segmentation technique developed primarily for medical
image analysis that can precisely segment images using a scarce amount of
training data. These traits provide U-net with a very high utility within the
medical imaging community and have resulted in extensive adoption of U-net as
the primary tool for segmentation tasks in medical imaging. The success of
U-net is evident in its widespread use in all major image modalities from CT
scans and MRI to X-rays and microscopy. Furthermore, while U-net is largely a
segmentation tool, there have been instances of the use of U-net in other
applications. As the potential of U-net is still increasing, in this review we
look at the various developments that have been made in the U-net architecture
and provide observations on recent trends. We examine the various innovations
that have been made in deep learning and discuss how these tools facilitate
U-net. Furthermore, we look at image modalities and application areas where
U-net has been applied.Comment: 42 pages, in IEEE Acces
Is attention all you need in medical image analysis? A review
Medical imaging is a key component in clinical diagnosis, treatment planning
and clinical trial design, accounting for almost 90% of all healthcare data.
CNNs achieved performance gains in medical image analysis (MIA) over the last
years. CNNs can efficiently model local pixel interactions and be trained on
small-scale MI data. The main disadvantage of typical CNN models is that they
ignore global pixel relationships within images, which limits their
generalisation ability to understand out-of-distribution data with different
'global' information. The recent progress of Artificial Intelligence gave rise
to Transformers, which can learn global relationships from data. However, full
Transformer models need to be trained on large-scale data and involve
tremendous computational complexity. Attention and Transformer compartments
(Transf/Attention) which can well maintain properties for modelling global
relationships, have been proposed as lighter alternatives of full Transformers.
Recently, there is an increasing trend to co-pollinate complementary
local-global properties from CNN and Transf/Attention architectures, which led
to a new era of hybrid models. The past years have witnessed substantial growth
in hybrid CNN-Transf/Attention models across diverse MIA problems. In this
systematic review, we survey existing hybrid CNN-Transf/Attention models,
review and unravel key architectural designs, analyse breakthroughs, and
evaluate current and future opportunities as well as challenges. We also
introduced a comprehensive analysis framework on generalisation opportunities
of scientific and clinical impact, based on which new data-driven domain
generalisation and adaptation methods can be stimulated
- …