Pose Invariant Palm Vein Identification System using Convolutional Neural Network

Palm vein recognition is a one of the most efficient biometric technologies, each individual can be identified through its veins unique characteristics, palm vein acquisition techniques is either contact based or contactless based, as the individual's hand contact or not the peg of the palm imaging device, the needs a contactless palm vein system in modern applications rise tow problems, the pose variations (rotation, scaling and translation transformations) since the imaging device cannot aligned correctly with the surface of the palm, and a delay of matching process especially for large systems, trying to solve these problems. This paper proposed a pose invariant identification system for contactless palm vein which include three main steps, at first data augmentation is done by making multiple copies of the input image then perform out-of-plane rotation on them around all the X,Y and Z axes. Then a new fast extract Region of Interest (ROI) algorithm is proposed for cropping palm region. Finally, features are extracted and classified by specific structure of Convolutional Neural Network (CNN). The system is tested on two public multispectral palm vein databases (PolyU and CASIA); furthermore, synthetic datasets are derived from these mentioned databases, to simulate the hand out-of-plane rotation in random angels within range from -20° to +20° degrees. To study several situations of pose invariant, twelve experiments are performed on all datasets, highest accuracy achieved is 99.73% ∓ 0.27 on PolyU datasets and 98 % ∓ 1 on CASIA datasets, with very fast identification process, about 0.01 second for identifying an individual, which proves system efficiency in contactless palm vein problems

Pilates Pose Classification Using MediaPipe and Convolutional Neural Networks with Transfer Learning

A sedentary lifestyle can lead to heart disease, cancer, and type 2 diabetes. An anaerobic exercise called pilates can address these problems. Although pilates training can provide health benefits, the heavy load of pilates poses may cause severe muscle injury if not done properly. Surveys have found that many teenagers are unaware of the movements in pilates poses. Therefore, a system is needed to help users classify pilates poses accurately. MediaPipe is a system that accurately extracts the real time human body skeleton. Convolutional Neural Network (CNN) with transfer learning is an accurate method for image classification. There have been several studies investigated pilates poses classification. However, there is still no research applies the MediaPipe as a skeleton feature extractor and CNN with a transfer learning to classify pilates poses. In addition, previous research still does not implement the pilates poses classification in real-time. Based on this problem, this study creates a system using MediaPipe as a feature extractor and CNN with transfer learning as a real-time pilates poses classifier. This system runs on a mobile device and gets information from a camera sensor. The results from MediaPipe then be classified by pre-trained CNN architectures with transfer learning: MobileNetV2, Xception, and ResNet50. The best model was obtained by MobileNetV2, which had an f1 score of 98%. Ten people who didn't know much about Pilates also tested the system. They all agreed that the app could accurately identify Pilates poses, make people more interested in Pilates, and help them learn more about Pilates

A pilot study on discriminative power of features of superficial venous pattern in the hand

The goal of the project is to develop an automatic way to identify, represent the superficial vasculature of the back hand and investigate its discriminative power as biometric feature. A prototype of a system that extracts the superficial venous pattern of infrared images of back hands will be described. Enhancement algorithms are used to solve the lack of contrast of the infrared images. To trace the veins, a vessel tracking technique is applied, obtaining binary masks of the superficial venous tree. Successively, a method to estimate the blood vessels calibre, length, the location and angles of vessel junctions, will be presented. The discriminative power of these features will be studied, independently and simultaneously, considering two features vector. Pattern matching of two vasculature maps will be performed, to investigate the uniqueness of the vessel network / L’obiettivo del progetto è di sviluppare un metodo automatico per identificare e rappresentare la rete vascolare superficiale presente nel dorso della mano ed investigare sul suo potere discriminativo come caratteristica biometrica. Un prototipo di sistema che estrae l’albero superficiale delle vene da immagini infrarosse del dorso della mano sarà descritto. Algoritmi per il miglioramento del contrasto delle immagini infrarosse saranno applicati. Per tracciare le vene, una tecnica di tracking verrà utilizzata per ottenere una maschera binaria della rete vascolare. Successivamente, un metodo per stimare il calibro e la lunghezza dei vasi sanguigni, la posizione e gli angoli delle giunzioni sarà trattato. Il potere discriminativo delle precedenti caratteristiche verrà studiato ed una tecnica di pattern matching di due modelli vascolari sarà presentata per verificare l’unicità di quest

FEATURE EXTRACTION AND MATCHING OF PALMPRINTS USING LEVEL I DETAIL

A thesis submitted in partial fulfilment of the requirements of the University of Wolverhampton for the degree of Doctor of PhilosophyCurrent Automatic Palmprint Identification Systems (APIS) closely follow the matching philosophy of Automatic Fingerprint Identification Systems (AFIS), in that they exclusively use a small subset of Level II palmar detail, when matching a latent to an exemplar palm print. However, due the increased size and the significantly more complex structure of the palm, it has long been recognised that there is much detail that remains underutilised. Forensic examiners routinely use this additional information when manually matching latents. The thesis develops novel automatic feature extraction and matching methods which exploit the underutilised Level I detail contained in the friction ridge flow. When applied to a data base of exemplars, the approach creates a ranked list of matches. It is shown that the matching success rate varied with latent size. For latents of diameter 38mm, 91:1% were ranked first and 95:6% of the matches were contained within the ranked top 10. The thesis presents improved orientation field extraction methods which are optimised for friction ridge flow and novel enhancement techniques, based upon the novel use of local circular statistics on palmar orientation fields. In combination, these techniques are shown to provide a more accurate orientation estimate than previous work. The novel feature extraction stages exploit the level sets of higher order local circular statistics, which naturally segment the palm into homogeneous regions representing Level I detail. These homogeneous regions, characterised by their spatial and circular features, are used to form a novel compact tree-like hierarchical representation of the Level I detail. Matching between the latent and an exemplar is performed between their respective tree-like hierarchical structures. The methods developed within the thesis are complementary to current APIS techniques

Level 3 Feature Based Fingerprint Identification

In this thesis, two novel schemes have been proposed: one scheme on dots and incipient ridges extraction and another scheme on matching using level 2 and level 3 features. Dots and incipient ridges are extracted by tracing valley. Starting points are found on the valley by analyzing the frequencies present in the fingerprint. Valleys are traced from the starting point using Fast Marching Method (FMM). An intensity based checking method is used for finding these feature points. Delaunay triangle has been constructed using level 2 feature. A novel algorithm of selecting compatible triangle pair from Delaunay triangle is proposed. A novel set of feature parameters are constructed by establishing spatial relation between minutiae and dots-and-incipient. Pore based matching has been performed using Robust Affine Iterative Closest Point algorithm. These extended features (dots, incipient ridges, and pores) are helpful for forensic experts. However, forensic experts deal with full-to-partial print matching of latent fingerprint. Hence, Full-to-partial fingerprint matching has been carried out. Partial print is constructed by cropping a window from a full fingerprint in two ways such as, non-overlapped cropping and random cropping. Form the experiment, it has been observed that random cropping based fingerprint has better accuracy than non-overlapped cropping. For performance evaluation of the proposed algorithm, two public databases have been used: NIST SD30 database and IIIT Delhi rural database. All images in SD30 are taken in constrained environment and images in IIIT database are taken in unconstrained environment. Feature level and score level fusion have been carried out for fusing different levels of feature. It has been observed that score level fusion shows better accuracy than feature level fusion

Pilates Pose Classification Using MediaPipe and Convolutional Neural Networks with Transfer Learning

A sedentary lifestyle can lead to heart disease, cancer, and type 2 diabetes. An anaerobic exercise called pilates can address these problems. Although pilates training can provide health benefits, the heavy load of pilates poses may cause severe muscle injury if not done properly. Surveys have found that many teenagers are unaware of the movements in pilates poses. Therefore, a system is needed to help users classify pilates poses accurately. MediaPipe is a system that accurately extracts the real time human body skeleton. Convolutional Neural Network (CNN) with transfer learning is an accurate method for image classification. There have been several studies investigated pilates poses classification. However, there is still no research applies the MediaPipe as a skeleton feature extractor and CNN with a transfer learning to classify pilates poses. In addition, previous research still does not implement the pilates poses classification in real-time. Based on this problem, this study creates a system using MediaPipe as a feature extractor and CNN with transfer learning as a real-time pilates poses classifier. This study utilized five types of Pilates poses: Warrior, Tree, Plank, Goddess, and Downward Dog.This system runs on a mobile device and gets information from a camera sensor. The results from MediaPipe then be classified by pre-trained CNN architectures with transfer learning: MobileNetV2, Xception, and ResNet50. The best model was obtained by MobileNetV2, which had an f1 score of 98%. Ten people who didn't know much about Pilates also tested the system. They all agreed that the app could accurately identify Pilates poses, make people more interested in Pilates, and help them learn more about Pilates