Group-level Emotion Recognition using Transfer Learning from Face Identification

In this paper, we describe our algorithmic approach, which was used for submissions in the fifth Emotion Recognition in the Wild (EmotiW 2017) group-level emotion recognition sub-challenge. We extracted feature vectors of detected faces using the Convolutional Neural Network trained for face identification task, rather than traditional pre-training on emotion recognition problems. In the final pipeline an ensemble of Random Forest classifiers was learned to predict emotion score using available training set. In case when the faces have not been detected, one member of our ensemble extracts features from the whole image. During our experimental study, the proposed approach showed the lowest error rate when compared to other explored techniques. In particular, we achieved 75.4% accuracy on the validation data, which is 20% higher than the handcrafted feature-based baseline. The source code using Keras framework is publicly available.Comment: 5 pages, 3 figures, accepted for publication at ICMI17 (EmotiW Grand Challenge

Emotion Recognition in the Wild using Deep Neural Networks and Bayesian Classifiers

Group emotion recognition in the wild is a challenging problem, due to the unstructured environments in which everyday life pictures are taken. Some of the obstacles for an effective classification are occlusions, variable lighting conditions, and image quality. In this work we present a solution based on a novel combination of deep neural networks and Bayesian classifiers. The neural network works on a bottom-up approach, analyzing emotions expressed by isolated faces. The Bayesian classifier estimates a global emotion integrating top-down features obtained through a scene descriptor. In order to validate the system we tested the framework on the dataset released for the Emotion Recognition in the Wild Challenge 2017. Our method achieved an accuracy of 64.68% on the test set, significantly outperforming the 53.62% competition baseline.Comment: accepted by the Fifth Emotion Recognition in the Wild (EmotiW) Challenge 201

Group Affect Prediction Using Multimodal Distributions

We describe our approach towards building an efficient predictive model to detect emotions for a group of people in an image. We have proposed that training a Convolutional Neural Network (CNN) model on the emotion heatmaps extracted from the image, outperforms a CNN model trained entirely on the raw images. The comparison of the models have been done on a recently published dataset of Emotion Recognition in the Wild (EmotiW) challenge, 2017. The proposed method achieved validation accuracy of 55.23% which is 2.44% above the baseline accuracy, provided by the EmotiW organizers.Comment: This research paper has been accepted at Workshop on Computer Vision for Active and Assisted Living, WACV 201

Depression Detection Using Stacked Autoencoder from Facial Features and NLP

Depression has become one of the most common mental illnesses in the past decade, affecting millions of patients and their families. However, the methods of diagnosing depression almost exclusively rely on questionnaire-based interviews and clinical judgments of symptom severity, which are highly dependent on doctors’ experience and makes it a labor-intensive work. This research work aims to develop an objective and convenient method to assist depression detection using facial features as well as textual features. Most of the people conceal their depression from everyone. So, an automated system is required that will pick out them who are dealing with depression. In this research, different research work focused for detecting depression are discussed and a hybrid approach is developed for detecting depression using facial as well as textual features. The main purpose of this research work is to design and propose a hybrid system of combining the effect of three effective models: Natural Language Processing, Stacked Deep Auto Encoder with Random forest (RF) classifier and fuzzy logic based on multi-feature depression detection system. According to literature several fingerprint as well as fingervein recognition system are designed that uses various techniques in order to reduce false detection rate and to enhance the performance of the system. A comparative study of different recognition technique along with their limitations is also summarized and optimum approach is proposed which may enhance the performance of the system. The result analysis shows that the developed technique significantly advantages over existing methods

Deep Learning Optimizers Comparison in Facial Expression Recognition

Artificial Intelligence is everywhere we go, whether it is programming an interactive cleaning robot or detecting a bank fraud. Its rise is inevitable. In the last few decades, many new architectures and approaches were brought up, so it becomes hard to know what is the best approach or architecture for a certain area. One of such areas is the detection of emotion in the human face, most commonly known by Facial Expression Recognition (or FER). In this work we started by doing an intensive collection of data concerning the theories that explain the existence of emotions, how they are distinguished from one another, and how they are recognized in a human face. After this, we started to develop deep learning models with different architectures as to compare their performances when used for Facial Expression Recognition. After developing the models, we took one of them and tested it with different deep learning optimizer algorithms, as to verify the difference among them, thus figuring out the best optimizing algorithm for this particular case.A Inteligência Artifical encontra-se presente em todo o lado, quer seja a programar um robô de limpeza interativo ou a detetar uma fraude bancária. A sua ascensão é inevitável. Nas últimas décadas, foram criadas inúmeras novas arquiteturas e abordagens e, por isso, torna-se difícil saber qual a melhor abordagem ou arquitetura para uma certa área. Uma dessas áreas é a deteção de emoção na cara humana, também conhecida como Reconhecimento de Expressão Facial. Neste trabalho começámos por realizar uma coleta intensiva de dados acerca das teorias que explicam a existência de emoções, como as mesmas são distinguidas umas das outras e como podem ser identificadas numa cara humana. Posteriormente, começámos a desenvolver modelos de deep learning com diferentes arquiteturas para comparar os respetivos desempenhos quando usadas em Reconhecimento de Expressão Facial. Após desenvolver os modelos, pegámos num dos mesmos e testámo-lo com diferentes algoritmos de otimização deep learning de forma a verificar quais as diferenças entre os mesmos, percebendo assim qual o mais indicado para uso neste caso em particular

Engineering affect: emotion regulation, the internet, and the techno-social niche

Philosophical work exploring the relation between cognition and the Internet is now an active area of research. Some adopt an externalist framework, arguing that the Internet should be seen as environmental scaffolding that drives and shapes cognition. However, despite growing interest in this topic, little attention has been paid to how the Internet influences our affective life — our moods, emotions, and our ability to regulate these and other feeling states. We argue that the Internet scaffolds not only cognition but also affect. Using various case studies, we consider some ways that we are increasingly dependent on our Internet-enabled “techno-social niches” to regulate the contours of our own affective life and participate in the affective lives of others. We argue further that, unlike many of the other environmental resources we use to regulate affect, the Internet has distinct properties that introduce new dimensions of complexity to these regulative processes. First, it is radically social in a way many of these other resources are not. Second, it is a radically distributed and decentralized resource; no one individual or agent is responsible for the Internet’s content or its affective impact on users. Accordingly, while the Internet can profoundly augment and enrich our affective life and deepen our connection with others, there is also a distinctive kind of affective precarity built into our online endeavors as well