FaceQnet: Quality Assessment for Face Recognition based on Deep Learning

In this paper we develop a Quality Assessment approach for face recognition based on deep learning. The method consists of a Convolutional Neural Network, FaceQnet, that is used to predict the suitability of a specific input image for face recognition purposes. The training of FaceQnet is done using the VGGFace2 database. We employ the BioLab-ICAO framework for labeling the VGGFace2 images with quality information related to their ICAO compliance level. The groundtruth quality labels are obtained using FaceNet to generate comparison scores. We employ the groundtruth data to fine-tune a ResNet-based CNN, making it capable of returning a numerical quality measure for each input image. Finally, we verify if the FaceQnet scores are suitable to predict the expected performance when employing a specific image for face recognition with a COTS face recognition system. Several conclusions can be drawn from this work, most notably: 1) we managed to employ an existing ICAO compliance framework and a pretrained CNN to automatically label data with quality information, 2) we trained FaceQnet for quality estimation by fine-tuning a pre-trained face recognition network (ResNet-50), and 3) we have shown that the predictions from FaceQnet are highly correlated with the face recognition accuracy of a state-of-the-art commercial system not used during development. FaceQnet is publicly available in GitHub.Comment: Preprint version of a paper accepted at ICB 201

Likelihood ratio data to report the validation of a forensic fingerprint evaluation method

Data to which the authors refer to throughout this article are likelihood ratios (LR) computed from the comparison of 5–12 minutiae fingermarks with fingerprints. These LRs data are used for the validation of a likelihood ratio (LR) method in forensic evidence evaluation. These data present a necessary asset for conducting validation experiments when validating LR methods used in forensic evidence evaluation and set up validation reports. These data can be also used as a baseline for comparing the fingermark evidence in the same minutiae configuration as presented in (D. Meuwly, D. Ramos, R. Haraksim,) [1], although the reader should keep in mind that different feature extraction algorithms and different AFIS systems used may produce different LRs values. Moreover, these data may serve as a reproducibility exercise, in order to train the generation of validation reports of forensic methods, according to [1]. Alongside the data, a justification and motivation for the use of methods is given. These methods calculate LRs from the fingerprint/mark data and are subject to a validation procedure. The choice of using real forensic fingerprint in the validation and simulated data in the development is described and justified. Validation criteria are set for the purpose of validation of the LR methods, which are used to calculate the LR values from the data and the validation report. For privacy and data protection reasons, the original fingerprint/mark images cannot be shared. But these images do not constitute the core data for the validation, contrarily to the LRs that are shared.The research was conducted in scope of the BBfor2 – European Commission Marie Curie Initial Training Network (FP7-PEOPLE-ITN 2008 under Grant Agreement 238803) in cooperation with The Netherlands Forensic Institute and the ATVS Biometric Recognition Group at the Universidad Autonoma de Madrid

Measuring coherence of computer-assisted likelihood ratio methods

This is the author’s version of a work that was accepted for publication in Forensic Science International. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Forensic Science International, 249 (2015): 123 – 132 DOI:10.1016/j.forsciint.2015.01.033Measuring the performance of forensic evaluation methods that compute likelihood ratios (LRs) is relevant for both the development and the validation of such methods. A framework of performance characteristics categorized as primary and secondary is introduced in this study to help achieve such development and validation. Ground-truth labelled fingerprint data is used to assess the performance of an example likelihood ratio method in terms of those performance characteristics. Discrimination, calibration, and especially the coherence of this LR method are assessed as a function of the quantity and quality of the trace fingerprint data. Assessment of the coherence revealed a weakness of the comparison algorithm in the computer-assisted likelihood ratio method used.This research was conducted in the scope of the BBfor2 – European Commission Marie Curie Initial Training Network (FP7-PEOPLE-ITN-2008 under Grant Agreement 238803) at the Netherlands Forensic Institute, and in collaboration with the ATVS Biometric Recognition Group at the Universidad Autonoma de Madrid and the National Police Services Agency of the Netherlands

Assignment of the evidential value of a fingermark general pattern using a Bayesian network

Abstract: When visible on a fingermark, the general pattern maintains its importance in the fingerprint examination procedure, since the difference between the general pattern of a fingermark and a fingerprint is sufficient for exclusion. In the current work, the importance of the general pattern is extended by evaluating the strength of evidence of a match given corresponding general pattern. In current practice (due to the lack of statistical support for the general pattern evidence) the fingerprint examiners assign personal probabilities to the general pattern evidence based on their knowledge and experience, while in this work the probabilities are calculated using a Bayesian Network which is fed by empirical data. 1

Automatic fingerprint recognition: from children to elderly Ageing and age effects

By courtesy of the Portuguese Government, DG JRC has received a comprehensive set of fingerprint data from individuals aged 0-25 and 65-98. The main purpose of the proposed experiments is to deepen the understanding regarding the physiological development of the fingertip ridge structure over time and its impact on automated fingerprint recognition. The experiments explore three biometric processes in the light of age, ageing and growth effects. These effects are demonstrated and validated. A growth model is also developed and validated. The report concludes with a series of recommendations for enhanced implementation of automated fingerprint recognition system and suggestions for further researches.JRC.E.3-Cyber and Digital Citizens' Securit

Score based procedures for the calculation of forensic likelihood ratios - scores should take account of both similarity and typicality

Score based procedures for the calculation of forensic likelihood ratios are popular across different branches of forensic science. They have two stages, first a function or model which takes measured features from known-source and questioned-source pairs as input and calculates scores as output, then a subsequent model which converts scores to likelihood ratios. We demonstrate that scores which are purely measures of similarity are not appropriate for calculating forensically interpretable likelihood ratios. In addition to taking account of similarity between the questioned-origin specimen and the known-origin sample, scores must also take account of the typicality of the questioned-origin specimen with respect to a sample of the relevant population specified by the defence hypothesis. We use Monte Carlo simulations to compare the output of three score based procedures with reference likelihood ratio values calculated directly from the fully specified Monte Carlo distributions. The three types of scores compared are: 1. non-anchored similarity-only scores; 2. non-anchored similarity and typicality scores; and 3. known-source anchored same-origin scores and questioned-source anchored different-origin scores. We also make a comparison with the performance of a procedure using a dichotomous “match”/“non-match” similarity score, and compare the performance of 1 and 2 on real data

Validation of likelihood ratio methods used for forensic evidence evaluation: application in forensic fingerprints

In this chapter the Likelihood Ratio (LR) inference model will be introduced, the theoretical aspects of probabilities will be discussed and the validation framework for LR methods used for forensic evidence evaluation will be presented. Prior to introducing the validation framework, following questions will be addressed: “which aspects of a forensic evaluation scenario need to be validated?‿, “what is the role of the LR as part of a decision process?‿ and “how to deal with uncertainty in the LR calculation?‿ The answers to these questions are necessary to define the validation strategy based on the validation criteria. The questions: “what to validate?‿ focusing on defining validation criteria and methods, and “how to validate?‿ dealing with the implementation of a validation protocol, form the core of this chapter. The validation framework described can be used to provide assistance to the forensic practitioners, when determining the suitability and applicability of the LR method developed in the forensic practice by introducing performance characteristics, performance metrics, validation criteria and the decision thresholds. This chapter will start with the introduction of the LR inference model, followed by the validation framework proposed

Study on Fingermark and Palmmark Identification Technologies for its Implementation in the Schengen Information System

The report assesses the technology readiness and availability of new functionalities – based on automatic fingermark and palmmark recognition technologies – for their integration into the Schengen Information System (SIS). These functionalities have been introduced in the revised SIS Regulations adopted on 28th of November 2018, both in the context of police and judicial cooperation. The report is structured in two parts. In Part I, the automatic fingermark and palmmark recognition functionalities are introduced together with a review of the latest developments and state of the art, quality metrics and important biometric standards are provided; and it is concluded with a summary section entitled “lessons learnt”. In Part II, the functionalities are placed into the context of Schengen Information System. Use-cases for border control and police and judiciary cooperation in criminal matters are presented, and a list of recommendations for the successful implementation of fingermark and palmmark processing technologies into the Schengen Information System are provided.JRC.E.3-Cyber and Digital Citizens' Securit

A Study of Age and Ageing in Fingerprint Biometrics

Thanks to Mr James Bond we are aware that diamonds are forever but, are fingerprints? It is well known that biometrics brings to the security field a new paradigm: unlike traditional systems, individuals are not identified by something that they have or they know, but by what they are. While such an approach entails some clear advantages, an important question remains: Is what we are today the same as what we will be tomorrow? The present paper addresses such a key problem in the fingerprint modality based on a database of over 400K impressions coming from more than 250K different fingers. The database was acquired under real operational conditions and contains fingerprints from subjects aged between 0 and 98 years. Fingerprint pairs were collected with a time difference which ranges between 0 and 7 years. Such a unique set of data has allowed us to analyse both the age and ageing effects, shedding some new light into issues like fingerprint permanence and fingerprint quality.JRC.E.3-Cyber and Digital Citizens' Securit

A guideline for the validation of likelihood ratio methods used for forensic evidence evaluation

This Guideline proposes a protocol for the validation of forensic evaluation methods at the source level, using the Likelihood Ratio framework as defined within the Bayes’ inference model. In the context of the inference of identity of source, the Likelihood Ratio is used to evaluate the strength of the evidence for a trace specimen, e.g. a fingermark, and a reference specimen, e.g. a fingerprint, to originate from common or different sources. Some theoretical aspects of probabilities necessary for this Guideline were discussed prior to its elaboration, which started after a workshop of forensic researchers and practitioners involved in this topic. In the workshop, the following questions were addressed: ‘‘which aspects of a forensic evaluation scenario need to be validated?’’, ‘‘what is the role of the LR as part of a decision process?’’ and ‘‘how to deal with uncertainty in the LR calculation?’’. The questions: ‘‘what to validate?’’ focuses on the validation methods and criteria and ‘‘how to validate?’’ deals with the implementation of the validation protocol. Answers to these questions were deemed necessary with several objectives. First, concepts typical for validation standards [1], such as performance characteristics, performance metrics and validation criteria, will be adapted or applied by analogy to the LR framework. Second, a validation strategy will be defined. Third, validation methods will be described. Finally, a validation protocol and an example of validation report will be proposed, which can be applied to the forensic fields developing and validating LR methods for the evaluation of the strength of evidence at source level under the following propositions: H1/Hss: The trace and reference originate from the same source. H2/Hds: The trace and reference originate from different sources