3 research outputs found
A Novel Space-Time Representation on the Positive Semidefinite Con for Facial Expression Recognition
In this paper, we study the problem of facial expression recognition using a
novel space-time geometric representation. We describe the temporal evolution
of facial landmarks as parametrized trajectories on the Riemannian manifold of
positive semidefinite matrices of fixed-rank. Our representation has the
advantage to bring naturally a second desirable quantity when comparing shapes
-- the spatial covariance -- in addition to the conventional affine-shape
representation. We derive then geometric and computational tools for
rate-invariant analysis and adaptive re-sampling of trajectories, grounding on
the Riemannian geometry of the manifold. Specifically, our approach involves
three steps: 1) facial landmarks are first mapped into the Riemannian manifold
of positive semidefinite matrices of rank 2, to build time-parameterized
trajectories; 2) a temporal alignment is performed on the trajectories,
providing a geometry-aware (dis-)similarity measure between them; 3) finally,
pairwise proximity function SVM (ppfSVM) is used to classify them,
incorporating the latter (dis-)similarity measure into the kernel function. We
show the effectiveness of the proposed approach on four publicly available
benchmarks (CK+, MMI, Oulu-CASIA, and AFEW). The results of the proposed
approach are comparable to or better than the state-of-the-art methods when
involving only facial landmarks.Comment: To be appeared at ICCV 201
Detecting and Tracking Small Moving Objects in Wide Area Motion Imagery (WAMI) Using Convolutional Neural Networks (CNNs)
This paper proposes an approach to detect moving objects in Wide Area Motion
Imagery (WAMI), in which the objects are both small and well separated.
Identifying the objects only using foreground appearance is difficult since a
pixel vehicle is hard to distinguish from objects comprising the
background. Our approach is based on background subtraction as an efficient and
unsupervised method that is able to output the shape of objects. In order to
reliably detect low contrast and small objects, we configure the background
subtraction to extract foreground regions that might be objects of interest.
While this dramatically increases the number of false alarms, a Convolutional
Neural Network (CNN) considering both spatial and temporal information is then
trained to reject the false alarms. In areas with heavy traffic, the background
subtraction yields merged detections. To reduce the complexity of multi-target
tracker needed, we train another CNN to predict the positions of multiple
moving objects in an area. Our approach shows competitive detection performance
on smaller objects relative to the state-of-the-art. We adopt a GM-PHD filter
to associate detections over time and analyse the resulting performance.Comment: Accepted for publication in 22nd International Conference on
Information Fusion (FUSION 2019
A Review of Computational Approaches for Evaluation of Rehabilitation Exercises
Recent advances in data analytics and computer-aided diagnostics stimulate
the vision of patient-centric precision healthcare, where treatment plans are
customized based on the health records and needs of every patient. In physical
rehabilitation, the progress in machine learning and the advent of affordable
and reliable motion capture sensors have been conducive to the development of
approaches for automated assessment of patient performance and progress toward
functional recovery. The presented study reviews computational approaches for
evaluating patient performance in rehabilitation programs using motion capture
systems. Such approaches will play an important role in supplementing
traditional rehabilitation assessment performed by trained clinicians, and in
assisting patients participating in home-based rehabilitation. The reviewed
computational methods for exercise evaluation are grouped into three main
categories: discrete movement score, rule-based, and template-based approaches.
The review places an emphasis on the application of machine learning methods
for movement evaluation in rehabilitation. Related work in the literature on
data representation, feature engineering, movement segmentation, and scoring
functions is presented. The study also reviews existing sensors for capturing
rehabilitation movements and provides an informative listing of pertinent
benchmark datasets. The significance of this paper is in being the first to
provide a comprehensive review of computational methods for evaluation of
patient performance in rehabilitation programs.Comment: 29 pages, 1 figur