176,326 research outputs found
Deformable appearance pyramids for anatomy representation, landmark detection and pathology classification
Purpose
Representation of anatomy appearance is one of the key problems in medical image analysis. An appearance model represents the anatomies with parametric forms, which are then vectorised for prior learning, segmentation and classification tasks.
Methods
We propose a part-based parametric appearance model we refer to as a deformable appearance pyramid (DAP). The parts are delineated by multi-scale local feature pyramids extracted from an image pyramid. Each anatomy is represented by an appearance pyramid, with the variability within a population approximated by local translations of the multi-scale parts and linear appearance variations in the assembly of the parts. We introduce DAPs built on two types of image pyramids, namely Gaussian and wavelet pyramids, and present two approaches to model the prior and fit the model, one explicitly using a subspace Lucas–Kanade algorithm and the other implicitly using the supervised descent method (SDM).
Results
We validate the performance of the DAP instances with difference configurations on the problem of lumbar spinal stenosis for localising the landmarks and classifying the pathologies. We also compare them with classic methods such as active shape models, active appearance models and constrained local models. Experimental results show that the DAP built on wavelet pyramids and fitted with SDM gives the best results in both landmark localisation and classification.
Conclusion
A new appearance model is introduced with several configurations presented and evaluated. The DAPs can be readily applied for other clinical problems for the tasks of prior learning, landmark detection and pathology classification
Active appearance pyramids for object parametrisation and fitting
Object class representation is one of the key problems in various medical image analysis tasks. We propose a part-based parametric appearance model we refer to as an Active Appearance Pyramid (AAP). The parts are delineated by multi-scale Local Feature Pyramids (LFPs) for superior spatial specificity and distinctiveness. An AAP models the variability within a population with local translations of multi-scale parts and linear appearance variations of the assembly of the parts. It can fit and represent new instances by adjusting the shape and appearance parameters. The fitting process uses a two-step iterative strategy: local landmark searching followed by shape regularisation. We present a simultaneous local feature searching and appearance fitting algorithm based on the weighted Lucas and Kanade method. A shape regulariser is derived to calculate the maximum likelihood shape with respect to the prior and multiple landmark candidates from multi-scale LFPs, with a compact closed-form solution. We apply the 2D AAP on the modelling of variability in patients with lumbar spinal stenosis (LSS) and validate its performance on 200 studies consisting of routine axial and sagittal MRI scans. Intervertebral sagittal and parasagittal cross-sections are typically used for the diagnosis of LSS, we therefore build three AAPs on L3/4, L4/5 and L5/S1 axial cross-sections and three on parasagittal slices. Experiments show significant improvement in convergence range, robustness to local minima and segmentation precision compared with Constrained Local Models (CLMs), Active Shape Models (ASMs) and Active Appearance Models (AAMs), as well as superior performance in appearance reconstruction compared with AAMs. We also validate the performance on 3D CT volumes of hip joints from 38 studies. Compared to AAMs, AAPs achieve a higher segmentation and reconstruction precision. Moreover, AAPs have a significant improvement in efficiency, consuming about half the memory and less than 10% of the training time and 15% of the testing time
Improving Facial Analysis and Performance Driven Animation through Disentangling Identity and Expression
We present techniques for improving performance driven facial animation,
emotion recognition, and facial key-point or landmark prediction using learned
identity invariant representations. Established approaches to these problems
can work well if sufficient examples and labels for a particular identity are
available and factors of variation are highly controlled. However, labeled
examples of facial expressions, emotions and key-points for new individuals are
difficult and costly to obtain. In this paper we improve the ability of
techniques to generalize to new and unseen individuals by explicitly modeling
previously seen variations related to identity and expression. We use a
weakly-supervised approach in which identity labels are used to learn the
different factors of variation linked to identity separately from factors
related to expression. We show how probabilistic modeling of these sources of
variation allows one to learn identity-invariant representations for
expressions which can then be used to identity-normalize various procedures for
facial expression analysis and animation control. We also show how to extend
the widely used techniques of active appearance models and constrained local
models through replacing the underlying point distribution models which are
typically constructed using principal component analysis with
identity-expression factorized representations. We present a wide variety of
experiments in which we consistently improve performance on emotion
recognition, markerless performance-driven facial animation and facial
key-point tracking.Comment: to appear in Image and Vision Computing Journal (IMAVIS
The Relation between Solar Eruption Topologies and Observed Flare Features I: Flare Ribbons
In this paper we present a topological magnetic field investigation of seven
two-ribbon flares in sigmoidal active regions observed with Hinode, STEREO, and
SDO. We first derive the 3D coronal magnetic field structure of all regions
using marginally unstable 3D coronal magnetic field models created with the
flux rope insertion method. The unstable models have been shown to be a good
model of the flaring magnetic field configurations. Regions are selected based
on their pre-flare configurations along with the appearance and observational
coverage of flare ribbons, and the model is constrained using pre-flare
features observed in extreme ultraviolet and X-ray passbands. We perform a
topology analysis of the models by computing the squashing factor, Q, in order
to determine the locations of prominent quasi-separatrix layers (QSLs). QSLs
from these maps are compared to flare ribbons at their full extents. We show
that in all cases the straight segments of the two J-shaped ribbons are matched
very well by the flux-rope-related QSLs, and the matches to the hooked segments
are less consistent but still good for most cases. In addition, we show that
these QSLs overlay ridges in the electric current density maps. This study is
the largest sample of regions with QSLs derived from 3D coronal magnetic field
models, and it shows that the magnetofrictional modeling technique that we
employ gives a very good representation of flaring regions, with the power to
predict flare ribbon locations in the event of a flare following the time of
the model
Constrained Joint Cascade Regression Framework for Simultaneous Facial Action Unit Recognition and Facial Landmark Detection
Cascade regression framework has been shown to be effective for facial
landmark detection. It starts from an initial face shape and gradually predicts
the face shape update from the local appearance features to generate the facial
landmark locations in the next iteration until convergence. In this paper, we
improve upon the cascade regression framework and propose the Constrained Joint
Cascade Regression Framework (CJCRF) for simultaneous facial action unit
recognition and facial landmark detection, which are two related face analysis
tasks, but are seldomly exploited together. In particular, we first learn the
relationships among facial action units and face shapes as a constraint. Then,
in the proposed constrained joint cascade regression framework, with the help
from the constraint, we iteratively update the facial landmark locations and
the action unit activation probabilities until convergence. Experimental
results demonstrate that the intertwined relationships of facial action units
and face shapes boost the performances of both facial action unit recognition
and facial landmark detection. The experimental results also demonstrate the
effectiveness of the proposed method comparing to the state-of-the-art works.Comment: International Conference on Computer Vision and Pattern Recognition,
201
- …