Machine Learning Methods for Human Identification from Dorsal Hand Images

Person identification is a process that uniquely identifies an individual based on physical or behavioural traits. This study investigates methods for the analysis of images of the human hand, focusing on their uniqueness and potential use for human identification. The human hand has significant and distinctive characteristics, and is highly complex and interesting, yet it has not been explored in much detail, particularly in the context of the contemporary high level of digitalisation and, more specifically, the advances in artificial intelligence (AI), machine learning (ML) and computer vision (CV). This research area is highly multi-disciplinary, involving anatomists, anthropologists, bioinformaticians, image analysts and, increasingly, computer scientists. A growing pool of advanced methods based on AI, ML and CV can benefit and relate directly to a better representation of the human hand in computer analysis. Historically, the research methods in this area relied on ‘handcrafted’ features such as the local binary pattern (LBP) and histogram of gradient (HOG) extraction, which necessitated human intervention. However, such approaches struggle to encode the human hand in variable conditions effectively, because of the change in camera viewpoint, hand pose, rotation, image quality, and self-occlusion. Thus, their performance is limited. Recently, there has been a surge of interest in deep learning neural network (DLNN) approaches, specifically convolutional neural networks (CNNs), due to the highly accurate results achieved in many applications and the wide availability of images. This work investigates advanced methods based on ML and DLNN for segmenting hand images with various rotation changes into different patches (e.g., knuckles and fingernails). The thesis focuses on developing ML methods like pre-trained CNN models on the 'ImageNet' dataset to learn the underlying structure of the human hand by extracting robust features from hand images with diverse conditions of rotation, and image quality. Also, this study investigates fine-tuning the pre-trained models of DLNN on subsets of hand images, as well as using various similarity metrics to find the best match of the individual’s hand. Furthermore, this work explores different types of ensemble learning or fusions, those of different region and similarity metrics to improve human identification results. This thesis also presents a study of a Siamese network on sub-images or segments of human dorsal hands for identification tasks. All presented approaches are compared with the state-of-the-art methods. This study advances the understanding of variations in and the uniqueness of humans using patches of their hands (e.g., different types of knuckles and fingernails). Lastly, it compares the matching performances of the left- and right-hand patches using various hand datasets and investigates whether the fingernail produces better identification results than the knuckles. This research shows that the proposed framework for person identification based on hand components led to better person identification results. The framework consists of vital feature extractions based on deep learning neural network (DLNN) and similarity metrics. These elements enhanced the performance. Also, the fingernails' shape performed better than other hand components, including the base, major, and minor knuckles. The left hand can be more distinguishable to individuals than the right hand. The fine-tuning of the hand components and ensemble learning improved the identification results

Biometric Systems

Because of the accelerating progress in biometrics research and the latest nation-state threats to security, this book's publication is not only timely but also much needed. This volume contains seventeen peer-reviewed chapters reporting the state of the art in biometrics research: security issues, signature verification, fingerprint identification, wrist vascular biometrics, ear detection, face detection and identification (including a new survey of face recognition), person re-identification, electrocardiogram (ECT) recognition, and several multi-modal systems. This book will be a valuable resource for graduate students, engineers, and researchers interested in understanding and investigating this important field of study

Patterns Identification of Finger Outer Knuckles by Utilizing Local Directional Number

Finger Outer Knuckle (FOK) is a distinctive biometric that has grown in popularity recently. This results from its inborn qualities such as stability, protection, and specific anatomical patterns. Applications for the identification of FOK patterns include forensic investigations, access control systems, and personal identity. In this study, we suggest a method for identifying FOK patterns using Local Directional Number (LDN) codes produced from gradient-based compass masks. For the FOK pattern matching, the suggested method uses two asymmetric masks—Kirsch and Gaussian derivative—to compute the edge response and extract LDN codes. To calculate edge response on the pattern, an asymmetric compass mask made from the Gaussian derivative mask is created by rotating the Kirsch mask by 45 degrees to provide edge response in eight distinct directions. The edge response of each mask and the combination of dominating vector numbers are examined during the LDN code-generating process. A distance metric can be used to compare the LDN code\u27s condensed representation of the FOK pattern to the original for matching purposes. On the Indian Institute of Technology Delhi Finger Knuckle (IITDFK) database, the efficiency of the suggested procedure is assessed. The data show that the suggested strategy is effective, with an Equal Error Rate (EER) of 10.78%. This value performs better than other EER values when compared to different approaches

Signal processing and machine learning techniques for human verification based on finger textures

PhD ThesisIn recent years, Finger Textures (FTs) have attracted considerable attention as potential biometric characteristics. They can provide robust recognition performance as they have various human-speci c features, such as wrinkles and apparent lines distributed along the inner surface of all ngers. The main topic of this thesis is verifying people according to their unique FT patterns by exploiting signal processing and machine learning techniques. A Robust Finger Segmentation (RFS) method is rst proposed to isolate nger images from a hand area. It is able to detect the ngers as objects from a hand image. An e cient adaptive nger segmentation method is also suggested to address the problem of alignment variations in the hand image called the Adaptive and Robust Finger Segmentation (ARFS) method. A new Multi-scale Sobel Angles Local Binary Pattern (MSALBP) feature extraction method is proposed which combines the Sobel direction angles with the Multi-Scale Local Binary Pattern (MSLBP). Moreover, an enhanced method called the Enhanced Local Line Binary Pattern (ELLBP) is designed to e ciently analyse the FT patterns. As a result, a powerful human veri cation scheme based on nger Feature Level Fusion with a Probabilistic Neural Network (FLFPNN) is proposed. A multi-object fusion method, termed the Finger Contribution Fusion Neural Network (FCFNN), combines the contribution scores of the nger objects. The veri cation performances are examined in the case of missing FT areas. Consequently, to overcome nger regions which are poorly imaged a method is suggested to salvage missing FT elements by exploiting the information embedded within the trained Probabilistic Neural Network (PNN). Finally, a novel method to produce a Receiver Operating Characteristic (ROC) curve from a PNN is suggested. Furthermore, additional development to this method is applied to generate the ROC graph from the FCFNN. Three databases are employed for evaluation: The Hong Kong Polytechnic University Contact-free 3D/2D (PolyU3D2D), Indian Institute of Technology (IIT) Delhi and Spectral 460nm (S460) from the CASIA Multi-Spectral (CASIAMS) databases. Comparative simulation studies con rm the e ciency of the proposed methods for human veri cation. The main advantage of both segmentation approaches, the RFS and ARFS, is that they can collect all the FT features. The best results have been benchmarked for the ELLBP feature extraction with the FCFNN, where the best Equal Error Rate (EER) values for the three databases PolyU3D2D, IIT Delhi and CASIAMS (S460) have been achieved 0.11%, 1.35% and 0%, respectively. The proposed salvage approach for the missing feature elements has the capability to enhance the veri cation performance for the FLFPNN. Moreover, ROC graphs have been successively established from the PNN and FCFNN.the ministry of higher education and scientific research in Iraq (MOHESR); the Technical college of Mosul; the Iraqi Cultural Attach e; the active people in the MOHESR, who strongly supported Iraqi students

Advanced Biometrics with Deep Learning

Biometrics, such as fingerprint, iris, face, hand print, hand vein, speech and gait recognition, etc., as a means of identity management have become commonplace nowadays for various applications. Biometric systems follow a typical pipeline, that is composed of separate preprocessing, feature extraction and classification. Deep learning as a data-driven representation learning approach has been shown to be a promising alternative to conventional data-agnostic and handcrafted pre-processing and feature extraction for biometric systems. Furthermore, deep learning offers an end-to-end learning paradigm to unify preprocessing, feature extraction, and recognition, based solely on biometric data. This Special Issue has collected 12 high-quality, state-of-the-art research papers that deal with challenging issues in advanced biometric systems based on deep learning. The 12 papers can be divided into 4 categories according to biometric modality; namely, face biometrics, medical electronic signals (EEG and ECG), voice print, and others

Infrared Thermography for the Assessment of Lumbar Sympathetic Blocks in Patients with Complex Regional Pain Syndrome

[ES] El síndrome de dolor regional complejo (SDRC) es un trastorno de dolor crónico debilitante que suele afectar a una extremidad, y se caracteriza por su compleja e incomprendida fisiopatología subyacente, lo que supone un reto para su diagnóstico y tratamiento. Para evitar el deterioro de la calidad de vida de los pacientes, la consecución de un diagnóstico y tratamiento tempranos marca un punto de inflexión. Entre los diferentes tratamientos, los bloqueos simpáticos lumbares (BSLs) tienen como objetivo aliviar el dolor y reducir algunos signos simpáticos de la afección. Este procedimiento intervencionista se lleva a cabo inyectando anestesia local alrededor de los ganglios simpáticos y, hasta ahora, se realiza frecuentemente bajo el control de diferentes técnicas de imagen, como los ultrasonidos o la fluoroscopia. Dado que la termografía infrarroja (TIR) ha demostrado ser una herramienta eficaz para evaluar la temperatura de la piel, y teniendo en cuenta el efecto vasodilatador que presentan los anestésicos locales inyectados, se ha considerado el uso de la IRT para la evaluación de los BSLs. El objetivo de esta tesis es, estudiar la capacidad de la TIR como una técnica complementaria para la evaluación de la eficacia en la ejecución de los BSLs. Para cumplir este objetivo, se han realizado tres estudios implementando la TIR en pacientes diagnosticados de SDRC de miembros inferiores sometidos a BSLs. El primer estudio se centra en la viabilidad de la TIR como herramienta complementaria para la evaluación de la eficacia ejecución de los BSLs. Cuando se realizan los BSLs, la colocación correcta de la aguja es crítica para llevar realizar el procedimiento técnicamente correcto y, en consecuencia, para lograr los resultados clínicos deseados. Para verificar la posición de la aguja, tradicionalmente se han utilizado técnicas de imagen, sin embargo, los BSLs bajo control fluoroscópico no siempre aseguran su exacta ejecución. Por este motivo, se han aprovechado las alteraciones térmicas inducidas por los anestésicos locales y se han evaluado mediante la TIR. Así, cuando en las imágenes infrarrojas se observaron cambios térmicos en la planta del pie afectado tras la inyección de lidocaína, se consideró que el BSL era exitoso. El segundo estudio trata del análisis cuantitativo de los datos térmicos recogidos en el entorno clínico a partir de diferentes parámetros basados en las temperaturas extraídas de ambos pies. Según los resultados, para predecir adecuadamente los BSLs exitosos, se deberían analizar las temperaturas de las plantas de los pies durante los primeros cuatro minutos tras la inyección del anestésico local. Así, la aplicación de la TIR en el entorno clínico podría ser de gran ayuda para evaluar la eficacia de ejecución de los BSLs mediante la evaluación de las temperaturas de los pies en tiempo real. Por último, el tercer estudio aborda el análisis cuantitativo mediante la implementación de herramientas de machine learning (ML) para evaluar su capacidad de clasificar automáticamente los BSLs. En este estudio se han utilizado una serie de características térmicas extraídas de las imágenes infrarrojas para evaluar cuatro algoritmos de ML para tres momentos diferentes después del instante de referencia (inyección de lidocaína). Los resultados indican que los cuatro modelos evaluados presentan buenos rendimientos para clasificar automáticamente los BSLs entre exitosos y fallidos. Por lo tanto, la combinación de parámetros térmicos junto con de clasificación ML muestra ser eficaz para la clasificación automática de los procedimientos de BSLs. En conclusión, el uso de la TIR como técnica complementaria en la práctica clínica diaria para la evaluación de los BSLs ha demostrado ser totalmente eficaz. Dado que es un método objetivo y relativamente sencillo de implementar, puede permitir que los médicos especialistas en dolor identifiquen los bloqueos realizados fallidos y, en consecuencia, puedan revertir esta situación.[CA] La síndrome de dolor regional complex (SDRC) és un trastorn de dolor crònic debilitant que sol afectar una extremitat, i es caracteritza per la seua complexa i incompresa fisiopatologia subjacent, la qual cosa suposa un repte per al seu diagnòstic i tractament. Per a evitar la deterioració de la qualitat de vida dels pacients, la consecució d'un diagnòstic i tractament primerencs marca un punt d'inflexió. Entre els diferents tractaments , els bloquejos simpàtics lumbars (BSLs) tenen com a objectiu alleujar el dolor i reduir alguns signes simpàtics de l'afecció. Aquest procediment intervencionista es duu a terme injectant anestèsia local al voltant dels ganglis simpàtics i, fins ara, es realitza freqüentment sota el control de diferents tècniques d'imatge, com els ultrasons o la fluoroscopia. Atés que la termografia infraroja (TIR) ha demostrat ser una eina eficaç per a avaluar la temperatura de la pell, i tenint en compte l'efecte vasodilatador que presenten els anestèsics locals injectats, s'ha considerat l'ús de la TIR per a l'avaluació dels BSLs. L'objectiu d'aquesta tesi és, estudiar la capacitat de la TIR com una tècnica complementària per a l'avaluació de l'eficàcia en l'execució dels BSLs. Per a complir aquest objectiu, s'han realitzat tres estudis implementant la TIR en pacients diagnosticats de SDRC de membres inferiors sotmesos a BSLs. El primer estudi avalua la viabilitat de la TIR com a eina complementària per a l'analisi de l'eficàcia en l'execució dels BSLs. Quan es realitzen els BSLs, la col·locació correcta de l'agulla és crítica per a dur a terme el procediment tècnicament correcte i, en conseqüència, per a aconseguir els resultats clínics desitjats. Per a verificar la posició de l'agulla, tradicionalment s'han utilitzat tècniques d'imatge, no obstant això, els BSLs baix control fluoroscòpic no sempre asseguren la seua exacta execució. Per aquest motiu, s'han aprofitat les alteracions tèrmiques induïdes pels anestèsics locals i s'han avaluat mitjançant la TIR. Així, quan en les imatges infraroges es van observar canvis tèrmics en la planta del peu afectat després de la injecció de lidocaIna, es va considerar que el BSL era exitós. El segon estudi tracta de l'anàlisi quantitativa de les dades tèrmiques recollides en l'entorn clínic a partir de diferents paràmetres basats en les temperatures extretes d'ambdós peus. Segons els resultats, per a predir adequadament l'execució exitosa d'un BSL, s'haurien d'analitzar les temperatures de les plantes dels peus durant els primers quatre minuts després de la injecció de l'anestèsic local. Així, l'implementació de la TIR en l'entorn clínic podria ser de gran ajuda per a avaluar l'eficàcia d'execució dels BSLs mitjançant l'avaluació de les temperatures dels peus en temps real. El tercer estudi aborda l'anàlisi quantitativa mitjançant la implementació d'eines machine learning (ML) per a avaluar la seua capacitat de classificar automàticament els BSLs. En aquest estudi s'han utilitzat una sèrie de característiques tèrmiques extretes de les imatges infraroges per a avaluar quatre algorismes de ML per a tres moments diferents després de l'instant de referència (injecció de lidocaïna). Els resultats indiquen que els quatre models avaluats presenten bons rendiments per a classificar automàticament els BSLs en exitosos i fallits. Per tant, la combinació de paràmetres tèrmics juntament amb models de classificació ML mostra ser eficaç per a la classificació automàtica dels procediments de BSLs. En conclusió, l'ús de la TIR com a tècnica complementària en la pràctica clínica diària per a l'avaluació dels BSLs ha demostrat ser totalment eficaç. Atés que és un mètode objectiu i relativament senzill d'implementar, pot ajudar els metges especialistes en dolor a identificar els bloquejos realitzats fallits i, en conseqüència, puguen revertir aquesta situació.[EN] Complex regional pain syndrome (CRPS) is a debilitating chronic pain condition that usually affects one limb, and it is characterized by its misunderstood underlying pathophysiology, resulting in both challenging diagnosis and treatment. To avoid the patients' impairment quality of life, the achievement of both an early diagnosis and treatment marks a turning point. Among the different treatment approaches, lumbar sympathetic blocks (LSBs) are addressed to alleviate the pain and reduce some sympathetic signs of the condition. This interventional procedure is performed by injecting local anaesthetic around the sympathetic ganglia and, until now, it has been performed under different imaging techniques, including the ultrasound or the fluoroscopy approaches. Since infrared thermography (IRT) has proven to be a powerful tool to evaluate skin temperatures and taking into account the vasodilatory effects of the local anaesthetics injected in the LSB, the use of IRT has been considered for the LSBs assessment. Therefore, the purpose of this thesis is to evaluate the capability of IRT as a complementary assessment technique for the LSBs procedures performance. To fulfil this aim, three studies have been conducted implementing the IRT in patients diagnosed with lower limbs CRPS undergoing LSBs. The first study focuses on the feasibility of IRT as a complementary assessment tool for LSBs performance, that is, for the confirmation of the proper needle position. When LSBs are performed, the correct needle placement is critical to carry out the procedure technically correct and, consequently, to achieve the desired clinical outcomes. To verify the needle placement position, imaging techniques have traditionally been used, however, LSBs under radioscopic guidance do not always ensure an exact performance. For this reason, the thermal alterations induced by the local anaesthetics, have been exploited and assessed by means of IRT. Thus, the LSB procedure was considered successfully performed when thermal changes within the affected plantar foot were observed in the infrared images after the lidocaine injection. The second study deals with the quantitative analysis of the thermal data collected in the clinical setting through the evaluation of different temperature-based parameters extracted from both feet. According to the results, the proper LSB success prediction could be achieved in the first four minutes after the block through the evaluation of the feet skin temperatures. Therefore, the implementation of IRT in the clinical setting might be of great help in assessing the LSBs performance by evaluating the plantar feet temperatures in real time. Finally, the third study addresses the quantitative analysis by implementing machine learning (ML) tools to assess their capability to automatically classify LSBs. In this study, a set of thermal features retrieved from the infrared images have been used to evaluate four ML algorithms for three different moments after the baseline time (lidocaine injection). The results indicate that all four models evaluated present good performance metrics to automatically classify LSBs into successful and failed. Therefore, combining infrared features with ML classification models shows to be effective for the LSBs procedures automatic classification. In conclusion, the use of IRT as a complementary technique in daily clinical practice for LSBs assessment has been evidenced entirely effective. Since IRT is an objective method and it is not very demanding to perform, it is of great help for pain physicians to identify failed procedures, and consequently, it allow them to reverse this situation.Cañada Soriano, M. (2022). Infrared Thermography for the Assessment of Lumbar Sympathetic Blocks in Patients with Complex Regional Pain Syndrome [Tesis doctoral]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/181699TESI

Pattern Recognition

A wealth of advanced pattern recognition algorithms are emerging from the interdiscipline between technologies of effective visual features and the human-brain cognition process. Effective visual features are made possible through the rapid developments in appropriate sensor equipments, novel filter designs, and viable information processing architectures. While the understanding of human-brain cognition process broadens the way in which the computer can perform pattern recognition tasks. The present book is intended to collect representative researches around the globe focusing on low-level vision, filter design, features and image descriptors, data mining and analysis, and biologically inspired algorithms. The 27 chapters coved in this book disclose recent advances and new ideas in promoting the techniques, technology and applications of pattern recognition

Authentication technology methods for E-Commerce applications in Nigeria — a case for biometric digital security contactless palm vein authentication

E-Commerce has become one of the most interesting and beneficial Internet-enabled systems for humanity. E-Commerce has served as an economic enabler and driver for developed countries because of the total adoption by their citizens. However, in Nigeria citizens have rejected E-Commerce due to a lack of trust and inadequate security. This research identifies several factors that lead to distrust of E-Commerce systems in Nigeria. These factors: perceived fear, security, perceived risk, trust, usability, perceived advantage, and use of web assurance seal services are very important for intention to adopt E-Commerce as an online transaction technology. This thesis uses a novel Design Fiction and E-Commerce website simulation methodology to show citizens how new and improved security in E-Commerce could increase those citizens' trust and thus increase their intention to adopt E-Commerce. The research surveys a broad demographic sample of citizens from Nigeria who completed a set of tasks associated with the novel Design Fiction and E-Commerce website simulation followed by a detailed questionnaire. The questionnaire, with associated items, was designed to answer the research questions and hypothesis based on the E-Commerce Adoption Model proposed in the thesis. This new E-Commerce Adoption model is based on the Technology Acceptance Model and uses to comparatively test Digital Signature, Finger Print Identification, and Contactless Palm Vein Authentication technologies in E-Commerce transactions. Results from the survey show that Contactless Palm Vein Authentication leads to greater trust in E-Commerce in Nigeria. The thesis research findings also indicate that new improved security authentication techniques are overdue. The research indicates that poor E-Commerce adoption in Nigeria is mainly due to a key identified factor, which is security. The conceptual model and trust model are developed for E-Commerce adoption in Nigeria. Therefore, it shows that citizens are willing to accept Contactless Palm Vein Authentication as a solution. In particular, the research results also show that there are strong relationships between all the identified factors and citizens’ intention to adopt E-Commerce in Nigeria thus rejecting all null hypotheses

Anatomical and Functional Organization of Domain-General Brain Regions

How does complex brain activity organize thought and behaviour? Theoretical proposals have long emphasized that intelligent behaviour must be supported by a flexible control system. Numerous brain imaging studies identified a domain-general or “multiple-demand” (MD) brain system co-activated accompanying many tasks and is hypothesised to play a central role in cognitive control. However, the limited spatial localization provided by traditional imaging methods precluded a consensus regarding its anatomy and physiology. To address these limitations, the experiments in chapters 2 and 3 capitalize on novel multi-modal magnetic resonance imaging (MRI) methods developed by the Human Connectome Project. Chapter 2 delineated nine cortical MD patches per hemisphere and subdivided them into 10 regions forming a core of most strongly activated and functionally interconnected regions, surrounded by a penumbra of 17 additional regions. MD activations were also identified in specific subcortical and cerebellar regions. Chapter 3 investigated the relation between the newly defined MD regions and previously identified sensory-biased cortical regions. Contrasting auditory and visual low working memory demands revealed the strongest sensory-biases are localized just outside of MD regions. And additional working memory demands revealed MD activations showed no sensory biases. Chapter 4 used human electrophysiological recordings from the lateral frontal cortex to functionally map cognitive control regions during awake neurosurgeries. By contrasting a hard vs easy cognitive demand, spectral analysis revealed localized power increases in the gamma range (>30 Hz) that overlap with a canonical mask of the fronto-parietal control network. These findings contrast with spatially non-specific power decreases in the beta range (12-30 Hz). Thus, using similar task difficulty manipulations, electrophysiology and MRI functional signals converged on localizing lateral frontal regions related to cognitive control and support their clinical potential for intraoperative mapping of cognitive control. All together, the distributed anatomical organization, mosaic functional preferences, and strong functional interconnectivity of MD regions, suggest a skeleton for integrating and organizing the diverse components of cognitive operations. The precise anatomical delineation of MD regions provides the groundwork for refined analyses of their functions