Anonymous subject identification and privacy information management in video surveillance

The widespread deployment of surveillance cameras has raised serious privacy concerns, and many privacy-enhancing schemes have been recently proposed to automatically redact images of selected individuals in the surveillance video for protection. Of equal importance are the privacy and efficiency of techniques to first, identify those individuals for privacy protection and second, provide access to original surveillance video contents for security analysis. In this paper, we propose an anonymous subject identification and privacy data management system to be used in privacy-aware video surveillance. The anonymous subject identification system uses iris patterns to identify individuals for privacy protection. Anonymity of the iris-matching process is guaranteed through the use of a garbled-circuit (GC)-based iris matching protocol. A novel GC complexity reduction scheme is proposed by simplifying the iris masking process in the protocol. A user-centric privacy information management system is also proposed that allows subjects to anonymously access their privacy information via their iris patterns. The system is composed of two encrypted-domain protocols: The privacy information encryption protocol encrypts the original video records using the iris pattern acquired during the subject identification phase; the privacy information retrieval protocol allows the video records to be anonymously retrieved through a GC-based iris pattern matching process. Experimental results on a public iris biometric database demonstrate the validity of our framework

Immersive video environments: Investigating the impact of “wraparound” media

Immersive technologies such as VR and binaural audio promise greater levels of audience engagement whereby one may lose oneself in an experience through a sense of presence or achieve higher levels of subject identification via an “empathy machine” – this project aims to devise how these claims may be tested while developing novel storytelling technique

Soft biometrics for subject identification using clothing attributes

Recently, soft biometrics has emerged as a novel attribute-based person description for identification. It is likely that soft biometrics can be deployed where other biometrics cannot, and have stronger invariance properties than vision-based biometrics, such as invariance to illumination and contrast. Previously, a variety of bodily soft biometrics has been used for identifying people. Describing a person by their clothing properties is a natural task performed by people. As yet, clothing descriptions have attracted little attention for identification purposes. There has been some usage of clothing attributes to augment biometric description, but a detailed description has yet to be used. We show here how clothing traits can be exploited for identification purposes. We explore the validity and usability of a set of proposed semantic attributes. Human identification is performed, evaluated and compared using different proposed forms of soft clothing traits in addition and in isolation

Towards Continuous Subject Identification Using Wearable Devices and Deep CNNs

© 2020 IEEE. Subject identification has several applications. In transportation companies, knowing who is driving their vehicles might prevent theft or other ill-intended actions. On the other hand, privacy concerns, and the respective legislation, hinder the applicability of several traditional recognition techniques based on invasive technologies, such as video cameras. Moreover, in order to keep the driver's distractions to a minimum, this technologies must be non-disruptive, that is, they must be able to identify the subject seamlessly without them taking any action. In this context, we propose using deep learning applied to smart watch data for recognizing the person driving a vehicle based on a training set. Our proposal relies on the possibility of using transfer learning to avoid long training sessions for new drivers and to deliver a solution which can be deployed in practice. In this paper, we describe the convolutional neural network used in the solution and present results according to a real data-set collected by us, achieving accuracies ranging from 75 to 94%

One-Class Subject Identification From Smartphone-Acquired Walking Data

In this work, a novel type of human identification system is proposed, which has the aim to recognize a user from his biometric traits of his way of walk. A smartphone is utilized to acquire motion data from the built-in sensors. Data from accelerometer and gyroscope are processed through a cycle extraction phase, a Convolutional Neural Network for feature extraction and a One-Class SVM classifier for identification. From quantitave results the system achieves an Equal Error Rate close to 1

Doppler Radar Techniques for Distinct Respiratory Pattern Recognition and Subject Identification.

Ph.D. Thesis. University of Hawaiʻi at Mānoa 2017

Design and implementation of a subject identification system based on Electroencephalogram

Biometrics are essential methods of identifying people nowadays. There are many types of biometrics, such as the classic methods for iris, face and fingerprint; but most of these are not robust or secure. Recently, biometrics based on electroencephalogram signals using machine learning algorithms have proven to be one of the highest quality and robust methods. Electroencephalograms have advantages over traditional modalities as they are extremely difficult to reproduce and cannot be captured stealthily from a distance. This work describes a system capable of acquiring real-time electroencephalogram signals, processing them using the PREP pipeline, to clean them and improve performance, and making subject identity predictions from electroencephalogram signals using different artificial intelligence algorithms. The system is portable, robust, low-cost and connected to the network to send the results to a server. It is composed of an acquisition system using an analog-to-digital converter and protection systems for electroencephalogram signals. The system is based on a Raspberry Pi Zero 2W as the computer in charge of performing all the computational work of the artificial intelligence algorithms and managing the different tasks. Several deep learning algorithms have been used and compared in terms of results and performance. The EEGNet model has provided the best results with an accuracy of 86.74% in its predictions. The data input to the model has been preprocessed with the PREP pipeline, which has proven to be effective in the results, as it improves the performance of all models that use it. The system provides a functional device with outstanding results that leads the way for future work and applications

UR-203 - Subject Identification from Off-Angle Iris Image Using Machine Learning

This research paper investigates the use of the Squeezenet Machine Learning Neural Network to identify a subject from off-angle iris images. Squeezenet is a convolutional neural network (CNNs) which contains 50x lesser parameters than Alexnet. It allows the model to be trained on the dataset on devices that have limited resources. The training dataset contains Iris images where the gaze angles are at 0 degrees, while the validation dataset uses off-angle images

GEFF: Graph Embedding for Functional Fingerprinting

It has been well established that Functional Connectomes (FCs), as estimated from functional MRI (fMRI) data, have an individual fingerprint that can be used to identify an individual from a population (subject-identification). Although identification rate is high when using resting-state FCs, other tasks show moderate to low values. Furthermore, identification rate is task-dependent, and is low when distinct cognitive states, as captured by different fMRI tasks, are compared. Here we propose an embedding framework, GEFF (Graph Embedding for Functional Fingerprinting), based on group-level decomposition of FCs into eigenvectors. GEFF creates an eigenspace representation of a group of subjects using one or more task FCs (Learning Stage). In the Identification Stage, we compare new instances of FCs from the Learning subjects within this eigenspace (validation dataset). The validation dataset contains FCs either from the same tasks as the Learning dataset or from the remaining tasks that were not included in Learning. Assessment of validation FCs within the eigenspace results in significantly increased subject-identification rates for all fMRI tasks tested and potentially task-independent fingerprinting process. It is noteworthy that combining resting-state with one fMRI task for GEFF Learning Stage covers most of the cognitive space for subject identification. In addition to subject-identification, GEFF was also used for identification of cognitive states, i.e. to identify the task associated to a given FC, regardless of the subject being already in the Learning dataset or not (subject-independent task-identification). In addition, we also show that eigenvectors from the Learning Stage can be characterized as task-dominant, subject dominant or neither, providing a deeper insight into the extent of variance in functional connectivity across individuals and cognitive states.Comment: 30 pages; 6 figures; 5 supplementary figure