27,106 research outputs found
Towards Egocentric Person Re-identification and Social Pattern Analysis
Wearable cameras capture a first-person view of the daily activities of the
camera wearer, offering a visual diary of the user behaviour. Detection of the
appearance of people the camera user interacts with for social interactions
analysis is of high interest. Generally speaking, social events, lifestyle and
health are highly correlated, but there is a lack of tools to monitor and
analyse them. We consider that egocentric vision provides a tool to obtain
information and understand users social interactions. We propose a model that
enables us to evaluate and visualize social traits obtained by analysing social
interactions appearance within egocentric photostreams. Given sets of
egocentric images, we detect the appearance of faces within the days of the
camera wearer, and rely on clustering algorithms to group their feature
descriptors in order to re-identify persons. Recurrence of detected faces
within photostreams allows us to shape an idea of the social pattern of
behaviour of the user. We validated our model over several weeks recorded by
different camera wearers. Our findings indicate that social profiles are
potentially useful for social behaviour interpretation
Polarimetric Thermal to Visible Face Verification via Self-Attention Guided Synthesis
Polarimetric thermal to visible face verification entails matching two images
that contain significant domain differences. Several recent approaches have
attempted to synthesize visible faces from thermal images for cross-modal
matching. In this paper, we take a different approach in which rather than
focusing only on synthesizing visible faces from thermal faces, we also propose
to synthesize thermal faces from visible faces. Our intuition is based on the
fact that thermal images also contain some discriminative information about the
person for verification. Deep features from a pre-trained Convolutional Neural
Network (CNN) are extracted from the original as well as the synthesized
images. These features are then fused to generate a template which is then used
for verification. The proposed synthesis network is based on the self-attention
generative adversarial network (SAGAN) which essentially allows efficient
attention-guided image synthesis. Extensive experiments on the ARL polarimetric
thermal face dataset demonstrate that the proposed method achieves
state-of-the-art performance.Comment: This work is accepted at the 12th IAPR International Conference On
Biometrics (ICB 2019
- …