A Review Of Multilevel Multibiometric Fusion System

Biometric systems allow automatic person recognition and authenticate based on the physical or behavioral characteristic. In recent years, researchers have paid close attention to the design of efficient multi-modal biometric systems due to their ability to withstand spoof attacks. Sometimes single biometric traits fail to extract relevant information for verifying the identity of a person. Therefore, combining multiple modalities, enhanced performance reliability could be achieved. If the security level increases then multi-level fusion techniques are used. This paper discusses the many fusion levels: algorithms, level of fusion, methods used for integrating the multiple verifiers and their applications

Machine Learning Methods for Human Identification from Dorsal Hand Images

Person identification is a process that uniquely identifies an individual based on physical or behavioural traits. This study investigates methods for the analysis of images of the human hand, focusing on their uniqueness and potential use for human identification. The human hand has significant and distinctive characteristics, and is highly complex and interesting, yet it has not been explored in much detail, particularly in the context of the contemporary high level of digitalisation and, more specifically, the advances in artificial intelligence (AI), machine learning (ML) and computer vision (CV). This research area is highly multi-disciplinary, involving anatomists, anthropologists, bioinformaticians, image analysts and, increasingly, computer scientists. A growing pool of advanced methods based on AI, ML and CV can benefit and relate directly to a better representation of the human hand in computer analysis. Historically, the research methods in this area relied on ‘handcrafted’ features such as the local binary pattern (LBP) and histogram of gradient (HOG) extraction, which necessitated human intervention. However, such approaches struggle to encode the human hand in variable conditions effectively, because of the change in camera viewpoint, hand pose, rotation, image quality, and self-occlusion. Thus, their performance is limited. Recently, there has been a surge of interest in deep learning neural network (DLNN) approaches, specifically convolutional neural networks (CNNs), due to the highly accurate results achieved in many applications and the wide availability of images. This work investigates advanced methods based on ML and DLNN for segmenting hand images with various rotation changes into different patches (e.g., knuckles and fingernails). The thesis focuses on developing ML methods like pre-trained CNN models on the 'ImageNet' dataset to learn the underlying structure of the human hand by extracting robust features from hand images with diverse conditions of rotation, and image quality. Also, this study investigates fine-tuning the pre-trained models of DLNN on subsets of hand images, as well as using various similarity metrics to find the best match of the individual’s hand. Furthermore, this work explores different types of ensemble learning or fusions, those of different region and similarity metrics to improve human identification results. This thesis also presents a study of a Siamese network on sub-images or segments of human dorsal hands for identification tasks. All presented approaches are compared with the state-of-the-art methods. This study advances the understanding of variations in and the uniqueness of humans using patches of their hands (e.g., different types of knuckles and fingernails). Lastly, it compares the matching performances of the left- and right-hand patches using various hand datasets and investigates whether the fingernail produces better identification results than the knuckles. This research shows that the proposed framework for person identification based on hand components led to better person identification results. The framework consists of vital feature extractions based on deep learning neural network (DLNN) and similarity metrics. These elements enhanced the performance. Also, the fingernails' shape performed better than other hand components, including the base, major, and minor knuckles. The left hand can be more distinguishable to individuals than the right hand. The fine-tuning of the hand components and ensemble learning improved the identification results

Fusion of face and iris biometrics in security verification systems.

Master of Science in Computer Science. University of KwaZulu-Natal, Durban, 2016.Abstract available in PDF file

Evaluation and analysis of hybrid intelligent pattern recognition techniques for speaker identification

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.The rapid momentum of the technology progress in the recent years has led to a tremendous rise in the use of biometric authentication systems. The objective of this research is to investigate the problem of identifying a speaker from its voice regardless of the content (i.e. text-independent), and to design efficient methods of combining face and voice in producing a robust authentication system. A novel approach towards speaker identification is developed using wavelet analysis, and multiple neural networks including Probabilistic Neural Network (PNN), General Regressive Neural Network (GRNN)and Radial Basis Function-Neural Network (RBF NN) with the AND voting scheme. This approach is tested on GRID and VidTIMIT cor-pora and comprehensive test results have been validated with state- of-the-art approaches. The system was found to be competitive and it improved the recognition rate by 15% as compared to the classical Mel-frequency Cepstral Coe±cients (MFCC), and reduced the recognition time by 40% compared to Back Propagation Neural Network (BPNN), Gaussian Mixture Models (GMM) and Principal Component Analysis (PCA). Another novel approach using vowel formant analysis is implemented using Linear Discriminant Analysis (LDA). Vowel formant based speaker identification is best suitable for real-time implementation and requires only a few bytes of information to be stored for each speaker, making it both storage and time efficient. Tested on GRID and Vid-TIMIT, the proposed scheme was found to be 85.05% accurate when Linear Predictive Coding (LPC) is used to extract the vowel formants, which is much higher than the accuracy of BPNN and GMM. Since the proposed scheme does not require any training time other than creating a small database of vowel formants, it is faster as well. Furthermore, an increasing number of speakers makes it di±cult for BPNN and GMM to sustain their accuracy, but the proposed score-based methodology stays almost linear. Finally, a novel audio-visual fusion based identification system is implemented using GMM and MFCC for speaker identi¯cation and PCA for face recognition. The results of speaker identification and face recognition are fused at different levels, namely the feature, score and decision levels. Both the score-level and decision-level (with OR voting) fusions were shown to outperform the feature-level fusion in terms of accuracy and error resilience. The result is in line with the distinct nature of the two modalities which lose themselves when combined at the feature-level. The GRID and VidTIMIT test results validate that the proposed scheme is one of the best candidates for the fusion of face and voice due to its low computational time and high recognition accuracy

Handbook of Vascular Biometrics

This open access handbook provides the first comprehensive overview of biometrics exploiting the shape of human blood vessels for biometric recognition, i.e. vascular biometrics, including finger vein recognition, hand/palm vein recognition, retina recognition, and sclera recognition. After an introductory chapter summarizing the state of the art in and availability of commercial systems and open datasets/open source software, individual chapters focus on specific aspects of one of the biometric modalities, including questions of usability, security, and privacy. The book features contributions from both academia and major industrial manufacturers

Advanced Biometrics with Deep Learning

Biometrics, such as fingerprint, iris, face, hand print, hand vein, speech and gait recognition, etc., as a means of identity management have become commonplace nowadays for various applications. Biometric systems follow a typical pipeline, that is composed of separate preprocessing, feature extraction and classification. Deep learning as a data-driven representation learning approach has been shown to be a promising alternative to conventional data-agnostic and handcrafted pre-processing and feature extraction for biometric systems. Furthermore, deep learning offers an end-to-end learning paradigm to unify preprocessing, feature extraction, and recognition, based solely on biometric data. This Special Issue has collected 12 high-quality, state-of-the-art research papers that deal with challenging issues in advanced biometric systems based on deep learning. The 12 papers can be divided into 4 categories according to biometric modality; namely, face biometrics, medical electronic signals (EEG and ECG), voice print, and others

Texture and Colour in Image Analysis

Research in colour and texture has experienced major changes in the last few years. This book presents some recent advances in the field, specifically in the theory and applications of colour texture analysis. This volume also features benchmarks, comparative evaluations and reviews