16 research outputs found
Robust gait recognition under variable covariate conditions
PhDGait is a weak biometric when compared to face, fingerprint or iris because it can be easily
affected by various conditions. These are known as the covariate conditions and include clothing,
carrying, speed, shoes and view among others. In the presence of variable covariate conditions
gait recognition is a hard problem yet to be solved with no working system reported.
In this thesis, a novel gait representation, the Gait Flow Image (GFI), is proposed to extract
more discriminative information from a gait sequence. GFI extracts the relative motion of body
parts in different directions in separate motion descriptors. Compared to the existing model-free
gait representations, GFI is more discriminative and robust to changes in covariate conditions.
In this thesis, gait recognition approaches are evaluated without the assumption on cooperative
subjects, i.e. both the gallery and the probe sets consist of gait sequences under different
and unknown covariate conditions. The results indicate that the performance of the existing approaches
drops drastically under this more realistic set-up. It is argued that selecting the gait
features which are invariant to changes in covariate conditions is the key to developing a gait
recognition system without subject cooperation. To this end, the Gait Entropy Image (GEnI) is
proposed to perform automatic feature selection on each pair of gallery and probe gait sequences.
Moreover, an Adaptive Component and Discriminant Analysis is formulated which seamlessly
integrates the feature selection method with subspace analysis for fast and robust recognition.
Among various factors that affect the performance of gait recognition, change in viewpoint
poses the biggest problem and is treated separately. A novel approach to address this problem is
proposed in this thesis by using Gait Flow Image in a cross view gait recognition framework with
the view angle of a probe gait sequence unknown. A Gaussian Process classification technique
is formulated to estimate the view angle of each probe gait sequence. To measure the similarity
of gait sequences across view angles, the correlation of gait sequences from different views is
modelled using Canonical Correlation Analysis and the correlation strength is used as a similarity
measure. This differs from existing approaches, which reconstruct gait features in different views
through 2D view transformation or 3D calibration. Without explicit reconstruction, the proposed
method can cope with feature mis-match across view and is more robust against feature noise
An Extensive Review on Spectral Imaging in Biometric Systems: Challenges and Advancements
Spectral imaging has recently gained traction for face recognition in
biometric systems. We investigate the merits of spectral imaging for face
recognition and the current challenges that hamper the widespread deployment of
spectral sensors for face recognition. The reliability of conventional face
recognition systems operating in the visible range is compromised by
illumination changes, pose variations and spoof attacks. Recent works have
reaped the benefits of spectral imaging to counter these limitations in
surveillance activities (defence, airport security checks, etc.). However, the
implementation of this technology for biometrics, is still in its infancy due
to multiple reasons. We present an overview of the existing work in the domain
of spectral imaging for face recognition, different types of modalities and
their assessment, availability of public databases for sake of reproducible
research as well as evaluation of algorithms, and recent advancements in the
field, such as, the use of deep learning-based methods for recognizing faces
from spectral images
Automatic Autism Spectrum Disorder Detection Using Artificial Intelligence Methods with MRI Neuroimaging: A Review
Autism spectrum disorder (ASD) is a brain condition characterized by diverse
signs and symptoms that appear in early childhood. ASD is also associated with
communication deficits and repetitive behavior in affected individuals. Various
ASD detection methods have been developed, including neuroimaging modalities
and psychological tests. Among these methods, magnetic resonance imaging (MRI)
imaging modalities are of paramount importance to physicians. Clinicians rely
on MRI modalities to diagnose ASD accurately. The MRI modalities are
non-invasive methods that include functional (fMRI) and structural (sMRI)
neuroimaging methods. However, the process of diagnosing ASD with fMRI and sMRI
for specialists is often laborious and time-consuming; therefore, several
computer-aided design systems (CADS) based on artificial intelligence (AI) have
been developed to assist the specialist physicians. Conventional machine
learning (ML) and deep learning (DL) are the most popular schemes of AI used
for diagnosing ASD. This study aims to review the automated detection of ASD
using AI. We review several CADS that have been developed using ML techniques
for the automated diagnosis of ASD using MRI modalities. There has been very
limited work on the use of DL techniques to develop automated diagnostic models
for ASD. A summary of the studies developed using DL is provided in the
appendix. Then, the challenges encountered during the automated diagnosis of
ASD using MRI and AI techniques are described in detail. Additionally, a
graphical comparison of studies using ML and DL to diagnose ASD automatically
is discussed. We conclude by suggesting future approaches to detecting ASDs
using AI techniques and MRI neuroimaging
Automatic autism spectrum disorder detection using artificial intelligence methods with MRI neuroimaging: A review
Autism spectrum disorder (ASD) is a brain condition characterized by
diverse signs and symptoms that appear in early childhood. ASD is also
associated with communication deficits and repetitive behavior in affected
individuals. Various ASD detection methods have been developed, including
neuroimaging modalities and psychological tests. Among these methods,
magnetic resonance imaging (MRI) imaging modalities are of paramount
importance to physicians. Clinicians rely on MRI modalities to diagnose
ASD accurately. The MRI modalities are non-invasive methods that include
functional (fMRI) and structural (sMRI) neuroimaging methods. However,
diagnosing ASD with fMRI and sMRI for specialists is often laborious and
time-consuming; therefore, several computer-aided design systems (CADS)
based on artificial intelligence (AI) have been developed to assist specialist
physicians. Conventional machine learning (ML) and deep learning (DL) are
the most popular schemes of AI used for diagnosing ASD. This study aims to
review the automated detection of ASD using AI. We review several CADS that
have been developed using ML techniques for the automated diagnosis of
ASD using MRI modalities. There has been very limited work on the use of DL techniques to develop automated diagnostic models for ASD. A summary of
the studies developed using DL is provided in the Supplementary Appendix.
Then, the challenges encountered during the automated diagnosis of ASD
using MRI and AI techniques are described in detail. Additionally, a graphical
comparison of studies using ML and DL to diagnose ASD automatically
is discussed. We suggest future approaches to detecting ASDs using AI
techniques and MRI neuroimaging.Qatar National
Librar
Automatic autism spectrum disorder detection using artificial intelligence methods with MRI neuroimaging: A review
Autism spectrum disorder (ASD) is a brain condition characterized by diverse signs and symptoms that appear in early childhood. ASD is also associated with communication deficits and repetitive behavior in affected individuals. Various ASD detection methods have been developed, including neuroimaging modalities and psychological tests. Among these methods, magnetic resonance imaging (MRI) imaging modalities are of paramount importance to physicians. Clinicians rely on MRI modalities to diagnose ASD accurately. The MRI modalities are non-invasive methods that include functional (fMRI) and structural (sMRI) neuroimaging methods. However, diagnosing ASD with fMRI and sMRI for specialists is often laborious and time-consuming; therefore, several computer-aided design systems (CADS) based on artificial intelligence (AI) have been developed to assist specialist physicians. Conventional machine learning (ML) and deep learning (DL) are the most popular schemes of AI used for diagnosing ASD. This study aims to review the automated detection of ASD using AI. We review several CADS that have been developed using ML techniques for the automated diagnosis of ASD using MRI modalities. There has been very limited work on the use of DL techniques to develop automated diagnostic models for ASD. A summary of the studies developed using DL is provided in the Supplementary Appendix. Then, the challenges encountered during the automated diagnosis of ASD using MRI and AI techniques are described in detail. Additionally, a graphical comparison of studies using ML and DL to diagnose ASD automatically is discussed. We suggest future approaches to detecting ASDs using AI techniques and MRI neuroimaging
Learning effective binary representation with deep hashing technique for large-scale multimedia similarity search
The explosive growth of multimedia data in modern times inspires the research of performing an efficient large-scale multimedia similarity search in the existing information retrieval systems. In the past decades, the hashing-based nearest neighbor search methods draw extensive attention in this research field. By representing the original data with compact hash code, it enables the efficient similarity retrieval by only conducting bitwise operation when computing the Hamming distance. Moreover, less memory space is required to process and store the massive amounts of features for the search engines owing to the nature of compact binary code. These advantages make hashing a competitive option in large-scale visual-related retrieval tasks. Motivated by the previous dedicated works, this thesis focuses on learning compact binary representation via hashing techniques for the large-scale multimedia similarity search tasks. Particularly, several novel frameworks are proposed for popular hashing-based applications like a local binary descriptor for patch-level matching (Chapter 3), video-to-video retrieval (Chapter 4) and cross-modality retrieval (Chapter 5). This thesis starts by addressing the problem of learning local binary descriptor for better patch/image matching performance. To this end, we propose a novel local descriptor termed Unsupervised Deep Binary Descriptor (UDBD) for the patch-level matching tasks, which learns the transformation invariant binary descriptor via embedding the original visual data and their transformed sets into a common Hamming space. By imposing a l2,1-norm regularizer on the objective function, the learned binary descriptor gains robustness against noises. Moreover, a weak bit scheme is applied to address the ambiguous matching in the local binary descriptor, where the best match is determined for each query by comparing a series of weak bits between the query instance and the candidates, thus improving the matching performance. Furthermore, Unsupervised Deep Video Hashing (UDVH) is proposed to facilitate large-scale video-to-video retrieval. To tackle the imbalanced distribution issue in the video feature, balanced rotation is developed to identify a proper projection matrix such that the information of each dimension can be balanced in the fixed-bit quantization, thus improving the retrieval performance dramatically with better code quality. To provide comprehensive insights on the proposed rotation, two different video feature learning structures: stacked LSTM units (UDVH-LSTM) and Temporal Segment Network (UDVH-TSN) are presented in Chapter 4. Lastly, we extend the research topic from single-modality to cross-modality retrieval, where Self-Supervised Deep Multimodal Hashing (SSDMH) based on matrix factorization is proposed to learn unified binary code for different modalities directly without the need for relaxation. By minimizing graph regularization loss, it is prone to produce discriminative hash code via preserving the original data structure. Moreover, Binary Gradient Descent (BGD) accelerates the discrete optimization against the bit-by-bit fashion. Besides, an unsupervised version termed Unsupervised Deep Cross-Modal Hashing (UDCMH) is proposed to tackle the large-scale cross-modality retrieval when prior knowledge is unavailable