2 research outputs found
A Personalized Affective Memory Neural Model for Improving Emotion Recognition
Recent models of emotion recognition strongly rely on supervised deep
learning solutions for the distinction of general emotion expressions. However,
they are not reliable when recognizing online and personalized facial
expressions, e.g., for person-specific affective understanding. In this paper,
we present a neural model based on a conditional adversarial autoencoder to
learn how to represent and edit general emotion expressions. We then propose
Grow-When-Required networks as personalized affective memories to learn
individualized aspects of emotion expressions. Our model achieves
state-of-the-art performance on emotion recognition when evaluated on
\textit{in-the-wild} datasets. Furthermore, our experiments include ablation
studies and neural visualizations in order to explain the behavior of our
model.Comment: Accepted by the International Conference on Machine Learning 2019
(ICML2019
Disambiguating Affective Stimulus Associations for Robot Perception and Dialogue
Effectively recognising and applying emotions to interactions is a highly
desirable trait for social robots. Implicitly understanding how subjects
experience different kinds of actions and objects in the world is crucial for
natural HRI interactions, with the possibility to perform positive actions and
avoid negative actions. In this paper, we utilize the NICO robot's appearance
and capabilities to give the NICO the ability to model a coherent affective
association between a perceived auditory stimulus and a temporally asynchronous
emotion expression. This is done by combining evaluations of emotional valence
from vision and language. NICO uses this information to make decisions about
when to extend conversations in order to accrue more affective information if
the representation of the association is not coherent. Our primary contribution
is providing a NICO robot with the ability to learn the affective associations
between a perceived auditory stimulus and an emotional expression. NICO is able
to do this for both individual subjects and specific stimuli, with the aid of
an emotion-driven dialogue system that rectifies emotional expression
incoherences. The robot is then able to use this information to determine a
subject's enjoyment of perceived auditory stimuli in a real HRI scenario