2,432 research outputs found
Extraction of Airways using Graph Neural Networks
We present extraction of tree structures, such as airways, from image data as
a graph refinement task. To this end, we propose a graph auto-encoder model
that uses an encoder based on graph neural networks (GNNs) to learn embeddings
from input node features and a decoder to predict connections between nodes.
Performance of the GNN model is compared with mean-field networks in their
ability to extract airways from 3D chest CT scans.Comment: Extended Abstract submitted to MIDL, 2018. 3 page
Graph Refinement based Airway Extraction using Mean-Field Networks and Graph Neural Networks
Graph refinement, or the task of obtaining subgraphs of interest from
over-complete graphs, can have many varied applications. In this work, we
extract trees or collection of sub-trees from image data by, first deriving a
graph-based representation of the volumetric data and then, posing the tree
extraction as a graph refinement task. We present two methods to perform graph
refinement. First, we use mean-field approximation (MFA) to approximate the
posterior density over the subgraphs from which the optimal subgraph of
interest can be estimated. Mean field networks (MFNs) are used for inference
based on the interpretation that iterations of MFA can be seen as feed-forward
operations in a neural network. This allows us to learn the model parameters
using gradient descent. Second, we present a supervised learning approach using
graph neural networks (GNNs) which can be seen as generalisations of MFNs.
Subgraphs are obtained by training a GNN-based graph refinement model to
directly predict edge probabilities. We discuss connections between the two
classes of methods and compare them for the task of extracting airways from 3D,
low-dose, chest CT data. We show that both the MFN and GNN models show
significant improvement when compared to one baseline method, that is similar
to a top performing method in the EXACT'09 Challenge, and a 3D U-Net based
airway segmentation model, in detecting more branches with fewer false
positives.Comment: Accepted for publication at Medical Image Analysis. 14 page
Mean Field Network based Graph Refinement with application to Airway Tree Extraction
We present tree extraction in 3D images as a graph refinement task, of
obtaining a subgraph from an over-complete input graph. To this end, we
formulate an approximate Bayesian inference framework on undirected graphs
using mean field approximation (MFA). Mean field networks are used for
inference based on the interpretation that iterations of MFA can be seen as
feed-forward operations in a neural network. This allows us to learn the model
parameters from training data using back-propagation algorithm. We demonstrate
usefulness of the model to extract airway trees from 3D chest CT data. We first
obtain probability images using a voxel classifier that distinguishes airways
from background and use Bayesian smoothing to model individual airway branches.
This yields us joint Gaussian density estimates of position, orientation and
scale as node features of the input graph. Performance of the method is
compared with two methods: the first uses probability images from a trained
voxel classifier with region growing, which is similar to one of the best
performing methods at EXACT'09 airway challenge, and the second method is based
on Bayesian smoothing on these probability images. Using centerline distance as
error measure the presented method shows significant improvement compared to
these two methods.Comment: 10 pages. Preprin
Multi-site, Multi-domain Airway Tree Modeling (ATM'22): A Public Benchmark for Pulmonary Airway Segmentation
Open international challenges are becoming the de facto standard for
assessing computer vision and image analysis algorithms. In recent years, new
methods have extended the reach of pulmonary airway segmentation that is closer
to the limit of image resolution. Since EXACT'09 pulmonary airway segmentation,
limited effort has been directed to quantitative comparison of newly emerged
algorithms driven by the maturity of deep learning based approaches and
clinical drive for resolving finer details of distal airways for early
intervention of pulmonary diseases. Thus far, public annotated datasets are
extremely limited, hindering the development of data-driven methods and
detailed performance evaluation of new algorithms. To provide a benchmark for
the medical imaging community, we organized the Multi-site, Multi-domain Airway
Tree Modeling (ATM'22), which was held as an official challenge event during
the MICCAI 2022 conference. ATM'22 provides large-scale CT scans with detailed
pulmonary airway annotation, including 500 CT scans (300 for training, 50 for
validation, and 150 for testing). The dataset was collected from different
sites and it further included a portion of noisy COVID-19 CTs with ground-glass
opacity and consolidation. Twenty-three teams participated in the entire phase
of the challenge and the algorithms for the top ten teams are reviewed in this
paper. Quantitative and qualitative results revealed that deep learning models
embedded with the topological continuity enhancement achieved superior
performance in general. ATM'22 challenge holds as an open-call design, the
training data and the gold standard evaluation are available upon successful
registration via its homepage.Comment: 32 pages, 16 figures. Homepage: https://atm22.grand-challenge.org/.
Submitte
Human treelike tubular structure segmentation: A comprehensive review and future perspectives
Various structures in human physiology follow a treelike morphology, which often expresses complexity at very fine scales. Examples of such structures are intrathoracic airways, retinal blood vessels, and hepatic blood vessels. Large collections of 2D and 3D images have been made available by medical imaging modalities such as magnetic resonance imaging (MRI), computed tomography (CT), Optical coherence tomography (OCT) and ultrasound in which the spatial arrangement can be observed. Segmentation of these structures in medical imaging is of great importance since the analysis of the structure provides insights into disease diagnosis, treatment planning, and prognosis. Manually labelling extensive data by radiologists is often time-consuming and error-prone. As a result, automated or semi-automated computational models have become a popular research field of medical imaging in the past two decades, and many have been developed to date. In this survey, we aim to provide a comprehensive review of currently publicly available datasets, segmentation algorithms, and evaluation metrics. In addition, current challenges and future research directions are discussed
- …