International audienceSegmentation and analysis of blood vessels is an important issue in medical imaging. In 3D cerebral angiographic data, the vascular signal is however hard to accurately detect and can, in particular, be disconnected. In this article, we present a procedure utilising both linear, Hessian-based and morphological methods for blood vessel edge enhancement and reconnection. More specifically, multi-scale second-order derivative analysis is performed to detect candidate vessels as well as their orientation. This information is then fed to a spatially-variant morphological filter for reconnection and reconstruction. The result is a fast and effective vessel-reconnecting method

Dokládal, Petr

Passat, Nicolas

Talbot, Hugues

Tankyevych, Olena

English

HAL-Ecole des Ponts ParisTech

Direction-adaptive grey-level morphology. Application to 3D vascular brain imaging

HAL - UPEC / UPEM

HAL-MINES ParisTech

Archive Ouverte en Sciences de l'Information et de la Communication

HAL Id: hal-00622439
https://hal-upec-upem.archives-ouvertes.fr/hal-00622439
Submitted on 3 Mar 2018
HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.
L’archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d’enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.
Direction-adaptive grey-level morphology. Application
to 3D vascular brain imaging
Olena Tankyevych, Hugues Talbot, Petr Dokládal, Nicolas Passat
To cite this version:
Olena Tankyevych, Hugues Talbot, Petr Dokládal, Nicolas Passat. Direction-adaptive grey-level mor-
phology. Application to 3D vascular brain imaging. International Conference on Image Processing
(ICIP), 2009, Cairo, Egypt. pp.2261-2264, ￿10.1109/ICIP.2009.5414356￿. ￿hal-00622439￿
DIRECTION-ADAPTIVE GREY-LEVEL MORPHOLOGY.
APPLICATION TO 3D VASCULAR BRAIN IMAGING
Olena Tankyevych1, Hugues Talbot1, Petr Doklada´l2, Nicolas Passat3
1Universite´ Paris-Est, Laboratoire informatique Institut Gaspard-Monge,
Unite´ mixte de recherche ESIEE/UMLV/CNRS, Noisy-le-Grand, France
2Centre de Morphologie Mathe´matique
Ecole Nationale Supe´rieure des Mines de Paris, Fontainebleau, France
3Universite´ de Strasbourg, LSIIT UMR 7005, Strasbourg, France
ABSTRACT
Segmentation and analysis of blood vessels is an important
issue in medical imaging. In 3D cerebral angiographic data,
the vascular signal is however hard to accurately detect and
can, in particular, be disconnected. In this article, we present
a procedure utilising both linear and morphological methods
for blood vessel edge enhancement and reconnection. More
specifically, multi-scale second-order derivative analysis is
performed to detect candidate vessels as well as their ori-
entation. This information is then fed to a spatially-variant
morphological filter for reconnection and reconstruction. The
result is a fast and effective method.
Index Terms— Adaptive morphology, spatially-variant
morphology, vascular imaging, vesselness, Hessian-based fil-
tering, directional filtering.
1. INTRODUCTION
Vascular network detection from angiographic data is an im-
portant issue, justified by various applications (pathology de-
tection, surgical planning, etc.). In this context, 3D Computed
Tomography Angiography (CTA) provides a well-detailed vi-
sualisation of vascular networks until the resolution of the
generated images (i.e. 0.5mm). However, the small size and
the complexity of the vascular structures, coupled to noise, ac-
quisition artifacts, and blood signal heterogenity (especially
signal discontinuity) make the analysis of such data a chal-
lenging task, thus justifying intensive efforts devoted to seg-
mentation purpose.
There exist a multitude of works on vessel segmentation
(see [1] for a survey), but only very few are capable of
segmenting the smallest tubular objects. Among them, the
second-order derivative based methods that rely on vessel
geometrical models [2, 3, 4] can perform in a multiscale
fashion, thus detecting different sized objects. However, in
practice, such vesselness filters can segment large objects and
are more likely to ignore the smallest ones.
Consequently, specifically-designed filters must be con-
sidered to filter thin elongated objects. For such structures, it
is assumed that one dimension is still long, everywhere tan-
gent to the object. Filtering can thus be applied along this
direction without necessarily altering the object structure. In
morphology, one can use families of segments as structuring
elements, selecting the one that best matches the objects ev-
erywhere [5]. This, however, requires directional sampling,
which may be prohibitive in 3D.
Recently, two similar 2D approaches were proposed com-
bining the analysis of orientation from either the Hessian or
the structure tensor, and using spatially-variant morphology
to bridge the disconnection gaps [6, 7]. Spatially-variant mor-
phology has also been used for adaptive filtering on grey-level
and colour images in [8]. This is a productive approach, as
long as the resulting filter is indeed a morphological filter,
and directions are well estimated.
This article is a 3D extension of our previous work [7] on a
2D morpho-Hessian filter. Here, we especially focus on cere-
bral angiographic image segmentation. Our final purpose is
in particular to segment vessels to further perform vein/artery
classification. As a primary step, we aim at filtering and seg-
menting vessels, while detecting the smaller ones and cor-
rectly reconnecting them to larger vessels.
The procedure begins with a vesselness-based multiscale
segmentation similar to the one proposed in [2]. Then, based
on the detected principal vessel directions, a morphological
closure is carried out on the considered image. In the last step,
the vascular network is reconstructed based on the vesselness-
detected objects propagating into the morphologically filtered
image. The results of the filtering are compared to the vessel
enhancing diffusion filter by Manniesing [9]; they emphasise
the detection and reconnection of the smaller vessels.
2. METHODS
The proposed procedure consists of the following three steps:
1) detection of vessel-like objects and of their directions by
using a multi-scale vesselness method, 2) propagation of in-
tensities inside the vessel and reconnection using a morpho-
logical closing by a spatially-variant structuring element ac-
cording to the detected directions, and 3) reconstruction of
vascular tree from the vesselness detected objects into the
morphologically closed image. These steps are detailed be-
low.
2.1. Tubular object detection
The first step of the vascular image filtering is the segmenta-
tion of the tubular structures. This is done with the Hessian-
based filtering measure. The Hessian matrix is obtained from
the Gaussian second derivative analysis of the 3D image F at
each voxel in its six principal directions:
H =
 Fxx Fxy FxzFyx Fyy Fyz
Fzx Fzy Fzz
 . (1)
By the principal value analysis, the Hessian matrix H can
be decomposed into three principal values, λ1, λ2 and λ3
( |λ1| ≤ |λ2| ≤ |λ3| ) and e1, e2 and e3 their correspond-
ing eigenvectors, respectively. When λ1 is close to zero and
much smaller than λ2 and λ3, the principal direction of the
(bright) vessel is given by e1. Among the most popular defini-
tions of vessel-like object measures [2, 4, 3], we have chosen
the vesselness function provided in [2]. Indeed, this function,
formulated as follows, seems to be advantageous due to its
multiscale representation:
ν(x, σ) =
{
0 if λ2 > 0 or λ3 > 0,
(1− e
−R2A
2α2 ) · e−
R2B
2β2 · (1− e−S
2
2γ2 ) otherwise,
(2)
with
RA =
|λ2|
|λ3| ,
RB =
|λ1|√
|λ2λ3|
,
S = ‖Hσ‖ =
√∑
j λ
2
j ,
(3)
in whichRA differentiates between plate and line like objects,
RB describes blob-like ones, and S accounts for the intensity
difference between objects (vessels) and background. Param-
eters α, β and γ influence the weight of the according objects.
The final vesselness result is produced by its best response at
different scales σ for each voxel x.
2.2. Direction-adaptive morphological filter
Let L be a family of functions, or images, defined as a map-
ping from the support D to the set of values V .
Let δ, ε: L → L be a dilation and an erosion of f ∈ L
given by
[δB(f)](x) = [
∨
b∈B(x)
fb](x) (4)
[εB(f)](x) = [
∧
b∈B̂(x)
fb](x) (5)
where fb denotes the translation of f by b computed as fb(x)
= f(x− b). The set B is the structuring element. Usually, B
is translation invariant, defined as B ⊂ D.
However, in the context of spatially variant morphology,
B is no longer a set but a family of sets (we then say that B
is a structuring function). This structuring function B is then
defined as B : D → P(D) (where P(D) = {X | X ⊆
D}). Hence, B(x) denotes the structuring element B used at
location x.
The set B̂, used in Eq. 5, called transpose of B, is defined
by
B̂(x) = {y | x ∈ B(y)}. (6)
Notice that, contrary to the invariant transposition B̂ = {x |
−x ∈ B}, which is a set reflection, the spatially-variant trans-
position Eq. 6 is non local and requires an exhaustive search.
Such a search is prohibitive for composing filters based on
series of dilation and erosion, to form a closing or an opening
ϕBf = εB(δB(f)); γBf = δB(εB(f)) (7)
These operations, implemented by using the definitions
Eqs. 4, 5, both reauire B and B̂. Nevertheless, the trans-
position of B rapidly becomes costly for larger structuring
elements, and particularly in 3D.
2.2.1. Implementation
To compute a spatially variant closing ϕBf(x) using Eq. 7,
one needs to compute the erosion of dilation of f(x). The
inf/sup-of-functions based definitions Eqs. 4, 5 are usually
computed sequentially in the raster scan order according to
the following scheme.
[δB(f)](x) = max
b∈B(x)
f(x− b) (8)
[εB(f)](x) = min
b∈B̂(x)
f(x− b) = min
{y|x∈B(y)}
f(x− y) (9)
The erosion (Eq. 8) is computed inO(|B(x)|.|D|). In the fol-
lowing erosion (Eq. 9) given some x, the set {y | x ∈ B(y)}
is unknown and is then computed by exhaustive search in
O(|D|2). However, relaxing the sequential order of comput-
ing, the erosion can be computed more efficiently. Instead of
computing εB(f) sequentially for all x, one can sequentially
read the input f and update εB(f) at all locations of B(x),
where x contributes.
2.3. Algorithm
The Hessian matrix in its eigen form is produced for each
voxel on multiple scales of the image. The choice and number
of scales is chosen in order to detect vessels with different
radii. The vesselness value is calculated across these scales
according to Eq. 2, where the maximum response is chosen at
the end for each voxel bringing along the principal direction
obtained with the Hessian matrix.
In the second step of the filtering, the morphological clos-
ing operation is performed over the image with the aim of re-
connecting vessels. In order to propagate objects in the space,
it is necessary to have a dense direction field. In other diffu-
sion methods [9, 6], a directional tensor was computed using
an average squared gradient, then expanded using gradient
vector flow, in order to propagate the direction field every-
where. In our case, this is not necessary since we only need
the directional information as far as the dilation can reach. As
the image is processed with a spatially varying structuring el-
ement whose direction is obtained according to the principal
voxel direction according to the vesselness filter, we perform
the dilation first. At first, only the directional information is
propagated in the direction indicated by the Hessian. Then,
with the second dilation operation, the actual intensity image
is dilated according to the directions obtained at the previous
dilation. After follows the adjunct erosion operation as de-
scribed in section 2.2.1. This ensures an idempotent result,
which guarantees that the resulting filter obeys all morpho-
logical rules.
2.4. Morphological reconstruction
Following the morpho-Hessian closing - which performs
like an edge-enhancing inverse diffusion filter in some ways -
noise levels are generally increased. As our aim is mostly ves-
sel reconnection, we perform grey-level reconstruction [10]
using the initial vesselness image as marker, and the result of
the morphological closing as mask. This readily eliminates
all non-connected noise.
3. RESULTS AND DISCUSSION
The filters were written with the ITK library using the avail-
able implementations of vesselness and vessel enhancement
diffusion functions.
For experiments of the filtering method, the considered
vesselness parameters have been set similarly to [9]: α = β
= 0.5 and γ = 100, in order to avoid any bias when compar-
ing the proposed method with the vesselness diffusion method
proposed by Manniesing et al. [9].
In general, the lower scales are more sensitive to noise.
Moreover, in [11] it has been reported that the vessel-
ness response curve differs not more than 3 percent be-
tween σ = 1 and σ = 2
√
2 using a set of discrete values
(a) (b)
(c) (d)
Fig. 1. Filtering example on a low-dose CT angiography
image. (a) Original image maximal intensity projection, (b)
original image volume rendering, (c) morpho-hessian surface
rendering, (d) vesselness surface rendering. Plain arrows in-
dicate areas of reconnection. Dashed arrows point to missed
out vessels.
σi ∈ 1,
√
2, 2, 2
√
2, which is applicable for most applica-
tions. Therefore, for our filtering method, we used the scales
between σ = 1 and σ = 2
√
2, but with three logarithmic nat-
ural incrementation steps, as noted in [12] to be valid mainly
for coarse scales.
Segmentation excerpt of a CTA data is illustrated in Fig-
ure 1. The original and filtered images are surface-rendered
with the same threshold. The surface-rendered image (Fig-
ure 1a) and its projection (Figure 1b), show that it is densely
disrupted by noise. In Figure 1d, it can be observed that the
vesselness diffusion filters out the noise while smoothing the
surface of vessels. However, doing so, it also removes the
smaller tubular objects. In the contrast, morpho-Hessian filter
(Figure 1c) keeps the same rough vessel surface as the origi-
nal surface rendering, but it also preserves and reconnects the
smaller objects and eliminates the noise (the plain arrows in
the images indicate the places where the filter has managed to
reconstruct or/and reconnect vessels; the dashed arrows indi-
cate the places that should have been reconstructed in a better
fashion). It can be noticed that some reconnections are much
thinner than the vessel parts. This is due to the size of our
structuring element, which is a path of one pixel thickness.
Even though the minimal used scale (σ = 1) should not
be sufficient to detect the smallest vessel in the CT image
(0.5mm), the fact that the final morpho-Hessian image is re-
constructed from the vesselness result provides us with re-
connections of smaller arteries with larger vessels by propa-
gating intensities in the direction of the later.
4. CONCLUSION
In this article, we have presented a combined linear-morpholo-
gical filter for detecting, edge-enhancing and reconnecting
blood vessels. The results obtained by applying this filter
on real 3D CTA data, compared to those obtained from a
vessel enhancing diffusion filter [9], emphasise the ability of
the proposed approach to reconnect the smaller parts of the
vessel network with the larger ones.
It has to be noticed that some parts of the approach could
however be improved. First, the filter is based on the direc-
tions computed from the Hessian matrix, and then strongly re-
lies on the quality of these computed directions. The direction
computation could actually be improved by also considering
the first-order derivative of the image (as in [6]).
Second, instead of choosing only one scale (namely the
one for which the response is maximal), it could be interesting
to consider several potentially relevant scales and to combine
the results obtained at each of them in order to increase the
robustness of the process. The handling of scales w.r.t. to
the topology of the vascular tree could also be considered in
further works.
Third, the thin reconnections could be improved using
rectangular spatially-variant structuring elements, as pro-
posed in [13], using the eigenvalues of the Hessian matrix to
determine their size.
As a result, we have come up with an efficient reconstruc-
tion filter that can be of help in segmentation and filtering of
thin objects. The main perspective of this work is now to be
able to efficiently segment the whole vascular tree and to dis-
criminate arteries from veins.
5. ACKNOWLEDGMENTS
We wish to thank the following medical personnel from Col-
mar Hospital: A. Tournade, M. Musacchio, H. Oesterle´, M.
Lagneau, who provided medical expertise and data.
6. REFERENCES
[1] C. Kirbas and F. Quek, “A review of vessel extraction
techniques and algorithms,” ACM Computing Surveys,
vol. 36, no. 2, pp. 81–121, 2004.
[2] A.F. Frangi, W.J. Niessen, K.L. Vincken, and M.A.
Viergever, “Multiscale vessel enhancement filtering,” in
MICCAI, 1998, vol. 1496 of LNCS, pp. 130–137.
[3] K. Krissian, G. Malandain, N. Ayache, and Y. Vail-
lant, R. andTrousset, “Model-based detection of tubular
structures in 3D images,” Computer Vision and Image
Understanding, vol. 80, no. 2, pp. 130–171, 2000.
[4] Y. Sato, S. Nakajima, N. Shiraga, H. Atsumi, S. Yoshida,
T. Koller, G. Gerig, and R. Kikinis, “Three-dimensional
multi-scale line filter for segmentation and visualization
of curvilinear structures in medical images,” Medical
Image Analysis, vol. 2, no. 2, pp. 143–168, 1998.
[5] P. Soille and H. Talbot, “Directional morphological fil-
tering,” IEEE Transactions on Pattern Analysis and Ma-
chine Intelligence, vol. 23, no. 11, pp. 1313–1329, 2001.
[6] R. Verdu´-Monedero and J. Angulo, “Spatially-variant
directional mathematical morphology operators based
on a diffused average squared gradient field,” in ACIVS.
2008, vol. 5259 of LNCS, pp. 542–553, Springer.
[7] O. Tankyevych, H. Talbot, and P. Dokladal, “Curvilinear
morpho-Hessian filter,” in IEEE ISBI, 2008, pp. 1011–
1014.
[8] R. Lerallut, E. Decencie`re, and F. Meyer, “Image filter-
ing using morphological amoebas,” Image and Vision
Computing, vol. 25, no. 4, pp. 395–404, 2007.
[9] R. Manniesing, M.A. Viergever, and W.J. Niessen,
“Vessel enhancing diffusion: A scale space representa-
tion of vessel structures,” Medical Image Analysis, vol.
10, no. 6, pp. 815–825, 2006.
[10] L. Vincent, “Morphological grayscale reconstruction in
image analysis: Applications and efficient algorithms,”
IEEE Transactions on Image Processing, vol. 2, no. 2,
pp. 176–201, 1993.
[11] Y. Sato, C.-F. Westin, A. Bhalerao, S. Nakajima, S. Shi-
raga, S. Tamura, and R. Kikinis, “Tissue classification
based on 3D local intensity structures for volume ren-
dering,” IEEE Transactions on Visualization and Com-
puter Graphics, vol. 6, no. 2, pp. 160–180, 2000.
[12] J. J. Koenderink, “The structure of images,” Biological
Cybernetics, vol. 50, no. 5, pp. 363–370, 1984.
[13] P. Dokladal and E. Dokladalova, “Grey-scale morphol-
ogy with spatially-variant rectangles in linear time,” in
ACIVS, 2008, vol. 5259 of LNCS, pp. 674–685.


https://hal-upec-upem.archives-ouvertes.fr/hal-00622439

Direction-adaptive grey-level morphology. Application to 3D vascular brain imaging

Abstract

Similar works

Full text

Available Versions

HAL-Ecole des Ponts ParisTech

HAL - UPEC / UPEM

HAL-MINES ParisTech

Archive Ouverte en Sciences de l'Information et de la Communication