74 research outputs found
Deep Fingerprint Matching from Contactless to Contact Fingerprints for Increased Interoperability
Contactless fingerprint matching is a common form of biometric security today. Most smartphones and associated apps now let users opt into using this form of biometric security. However, it’s difficult to match a finger-photo to a fingerprint because of perspective distortion occurring at the edges of the finger-photo, so direct matching using conventional methods will not be as accurate due to a lack of sufficient matching minutiae points. To address this issue, we propose a deep model, Perspective Distortion Rectification Model (PDRM), to estimate the fingerprint correspondence for finger-photo images in order to recover more minutiae points. Not only do we determine the feasibility of matching synthesized fingerprints from finger-photos, but we also show that matching a finger-photo to a fingerprint directly is possible by using our proposed Coupled Generative Adversarial Network (CpGAN) verifier. The results from our PDRM show that our method for creating synthetic fingerprints from finger-photos provides a more accurate matching (AUC=96.4%, EER= 8.9%) than just using the same commercial matcher to match finger-photo and fingerprints directly (AUC=92.1%, EER=15.7%). Finally, our proposed CpGAN verifier provides the best matching accuracy with AUC=98.4% and EER=6.3%
FIGO: Enhanced Fingerprint Identification Approach Using GAN and One Shot Learning Techniques
Fingerprint evidence plays an important role in a criminal investigation for
the identification of individuals. Although various techniques have been
proposed for fingerprint classification and feature extraction, automated
fingerprint identification of fingerprints is still in its earliest stage. The
performance of traditional \textit{Automatic Fingerprint Identification System}
(AFIS) depends on the presence of valid minutiae points and still requires
human expert assistance in feature extraction and identification stages. Based
on this motivation, we propose a Fingerprint Identification approach based on
Generative adversarial network and One-shot learning techniques (FIGO). Our
solution contains two components: fingerprint enhancement tier and fingerprint
identification tier. First, we propose a Pix2Pix model to transform low-quality
fingerprint images to a higher level of fingerprint images pixel by pixel
directly in the fingerprint enhancement tier. With the proposed enhancement
algorithm, the fingerprint identification model's performance is significantly
improved. Furthermore, we develop another existing solution based on Gabor
filters as a benchmark to compare with the proposed model by observing the
fingerprint device's recognition accuracy. Experimental results show that our
proposed Pix2pix model has better support than the baseline approach for
fingerprint identification. Second, we construct a fully automated fingerprint
feature extraction model using a one-shot learning approach to differentiate
each fingerprint from the others in the fingerprint identification process. Two
twin convolutional neural networks (CNNs) with shared weights and parameters
are used to obtain the feature vectors in this process. Using the proposed
method, we demonstrate that it is possible to learn necessary information from
only one training sample with high accuracy
An Analysis on Adversarial Machine Learning: Methods and Applications
Deep learning has witnessed astonishing advancement in the last decade and revolutionized many fields ranging from computer vision to natural language processing. A prominent field of research that enabled such achievements is adversarial learning, investigating the behavior and functionality of a learning model in presence of an adversary. Adversarial learning consists of two major trends. The first trend analyzes the susceptibility of machine learning models to manipulation in the decision-making process and aims to improve the robustness to such manipulations. The second trend exploits adversarial games between components of the model to enhance the learning process. This dissertation aims to provide an analysis on these two sides of adversarial learning and harness their potential for improving the robustness and generalization of deep models.
In the first part of the dissertation, we study the adversarial susceptibility of deep learning models. We provide an empirical analysis on the extent of vulnerability by proposing two adversarial attacks that explore the geometric and frequency-domain characteristics of inputs to manipulate deep decisions. Afterward, we formalize the susceptibility of deep networks using the first-order approximation of the predictions and extend the theory to the ensemble classification scheme. Inspired by theoretical findings, we formalize a reliable and practical defense against adversarial examples to robustify ensembles. We extend this part by investigating the shortcomings of \gls{at} and highlight that the popular momentum stochastic gradient descent, developed essentially for natural training, is not proper for optimization in adversarial training since it is not designed to be robust against the chaotic behavior of gradients in this setup. Motivated by these observations, we develop an optimization method that is more suitable for adversarial training. In the second part of the dissertation, we harness adversarial learning to enhance the generalization and performance of deep networks in discriminative and generative tasks. We develop several models for biometric identification including fingerprint distortion rectification and latent fingerprint reconstruction. In particular, we develop a ridge reconstruction model based on generative adversarial networks that estimates the missing ridge information in latent fingerprints. We introduce a novel modification that enables the generator network to preserve the ID information during the reconstruction process. To address the scarcity of data, {\it e.g.}, in latent fingerprint analysis, we develop a supervised augmentation technique that combines input examples based on their salient regions. Our findings advocate that adversarial learning improves the performance and reliability of deep networks in a wide range of applications
Generative Fingerprint Augmentation against Membership Inference Attacks
openThis thesis aspires to provide a privacy protection mechanism for neural networks concerning fingerprints. Biometric identifiers, especially fingerprints, have become crucial in the last several years, from banking operations to daily smartphone usage. Using generative adversarial networks (GANs), we train models specialized in compressing and decompressing (Codecs) images in order to augment the data these models used during the learning process to provide additional privacy preservation over the identity of the fingerprints found in such datasets. We test and analyze our framework with custom membership inference attacks (MIA) to assess the quality of our defensive mechanism.This thesis aspires to provide a privacy protection mechanism for neural networks concerning fingerprints. Biometric identifiers, especially fingerprints, have become crucial in the last several years, from banking operations to daily smartphone usage. Using generative adversarial networks (GANs), we train models specialized in compressing and decompressing (Codecs) images in order to augment the data these models used during the learning process to provide additional privacy preservation over the identity of the fingerprints found in such datasets. We test and analyze our framework with custom membership inference attacks (MIA) to assess the quality of our defensive mechanism
Sensor-invariant Fingerprint ROI Segmentation Using Recurrent Adversarial Learning
A fingerprint region of interest (roi) segmentation algorithm is designed to
separate the foreground fingerprint from the background noise. All the learning
based state-of-the-art fingerprint roi segmentation algorithms proposed in the
literature are benchmarked on scenarios when both training and testing
databases consist of fingerprint images acquired from the same sensors.
However, when testing is conducted on a different sensor, the segmentation
performance obtained is often unsatisfactory. As a result, every time a new
fingerprint sensor is used for testing, the fingerprint roi segmentation model
needs to be re-trained with the fingerprint image acquired from the new sensor
and its corresponding manually marked ROI. Manually marking fingerprint ROI is
expensive because firstly, it is time consuming and more importantly, requires
domain expertise. In order to save the human effort in generating annotations
required by state-of-the-art, we propose a fingerprint roi segmentation model
which aligns the features of fingerprint images derived from the unseen sensor
such that they are similar to the ones obtained from the fingerprints whose
ground truth roi masks are available for training. Specifically, we propose a
recurrent adversarial learning based feature alignment network that helps the
fingerprint roi segmentation model to learn sensor-invariant features.
Consequently, sensor-invariant features learnt by the proposed roi segmentation
model help it to achieve improved segmentation performance on fingerprints
acquired from the new sensor. Experiments on publicly available FVC databases
demonstrate the efficacy of the proposed work.Comment: IJCNN 2021 (Accepted
- …