Human emotion recognition in video using subtraction pre-processing

In this paper, we describe a new image pre-processing method, which can show features or important information clearly. Deep learning methods have grown rapidly in the last ten years and have better performance than the traditional machine learning methods in many domains. Deep learning shows its powerful ability particular in difficult multi-classes classification challenges. Video Facial expression recognition is one of the most popular classification topics and will become essential in robotics and auto-motion fields. The new system presented is a combination of new video pre-processing and Convolutional Neural Network (CNN). The new pre-processing method is proposed because we believe individual emotions are dynamic, which means the change of the face is the key feature. RAVDESS is the video set used, to train and test the neural network. From RAVDESS dataset the video songs without audio are taken for focusing on video frames differences. The chosen video set has six different classes of emotions. Each video presents a sentence in a melodious way. Based on the chosen video set, the new system with a new pre-processing method has been designed and trained. Later, the classification result of the new method has been compared with others in which the same dataset for video emotion recognition was used

ANN Models for Shoulder Pain Detection based on Human Facial Expression Covered by Mask

Facial expressions are a method to communicate if someone feels pain. Moreover, coding facial movements to assess pain requires extensive training and is time-consuming for clinical practice. In addition, in Covid 19 pandemic, it was difficult to determine this expression due to the mask on the face. There for, it needs to develop a system that can detect the pain from facial expressions when a person is wearing a mask. There are 41 points used to form 19 geometrical features. It used 20.000 frames of 24 respondents from the dataset as secondary data . From these data, training, and testing were carried out using the ANN (Artificial Neural Network) method with a variation of the number of neurons in the hidden layer, i.e., 5, 10, 15, and 20 neurons. The results obtained from testing these data are the highest accuracy of 86% with the number of 20 hidden layers