USING DEEP LEARNING-BASED FRAMEWORK FOR CHILD SPEECH EMOTION RECOGNITION

Biological languages of the body through which human emotion can be detected abound including heart rate, facial expressions, movement of the eyelids and dilation of the eyes, body postures, skin conductance, and even the speech we make. Speech emotion recognition research started some three decades ago, and the popular Interspeech Emotion Challenge has helped to propagate this research area. However, most speech recognition research is focused on adults and there is very little research on child speech. This dissertation is a description of the development and evaluation of a child speech emotion recognition framework. The higher-level components of the framework are designed to sort and separate speech based on the speaker’s age, ensuring that focus is only on speeches made by children. The framework uses Baddeley’s Theory of Working Memory to model a Working Memory Recurrent Network that can process and recognize emotions from speech. Baddeley’s Theory of Working Memory offers one of the best explanations on how the human brain holds and manipulates temporary information which is very crucial in the development of neural networks that learns effectively. Experiments were designed and performed to provide answers to the research questions, evaluate the proposed framework, and benchmark the performance of the framework with other methods. Satisfactory results were obtained from the experiments and in many cases, our framework was able to outperform other popular approaches. This study has implications for various applications of child speech emotion recognition such as child abuse detection and child learning robots

Affective Computing in the Area of Autism

The prevalence rate of Autism Spectrum Disorders (ASD) is increasing at an alarming rate (1 in 68 children). With this increase comes the need of early diagnosis of ASD, timely intervention, and understanding the conditions that could be comorbid to ASD. Understanding co-morbid anxiety and its interaction with emotion comprehension and production in ASD is a growing and multifaceted area of research. Recognizing and producing contingent emotional expressions is a complex task, which is even more difficult for individuals with ASD. First, I investigate the arousal experienced by adolescents with ASD in a group therapy setting. In this study I identify the instances in which the physiological arousal is experienced by adolescents with ASD ( have-it ), see if the facial expressions of these adolescents indicate their arousal ( show-it ), and determine if the adolescents are self-aware of this arousal or not ( know-it ). In order to establish a relationship across these three components of emotion expression and recognition, a multi-modal approach for data collection is utilized. Machine learning techniques are used to determine whether still video images of facial expressions could be used to predict Electrodermal Activity (EDA) data. Implications for the understanding of emotion and social communication difficulties in ASD, as well as future targets for intervention, are discussed. Second, it is hypothesized that a well-designed intervention technique helps in the overall development of children with ASD by improving their level of functioning. I designed and validated a mobile-based intervention designed for teaching social skills to children with ASD. I also evaluated the social skill intervention. Last, I present the research goals behind an mHealth-based screening tool for early diagnosis of ASD in toddlers. The design purpose of this tool is to help people from low-income group, who have limited access to resources. This goal is achieved without burdening the physicians, their staff, and the insurance companies

Humanization of robots: is it really such a good idea?

The aim of this review was to examine the pros and cons of humanizing social robots following a psychological perspective. As such, we had six goals. First, we defined what social robots are. Second, we clarified the meaning of humanizing social robots. Third, we presented the theoretical backgrounds for promoting humanization. Fourth, we conducted a review of empirical results of the positive effects and the negative effects of humanization on human–robot interaction (HRI). Fifth, we presented some of the political and ethical problems raised by the humanization of social robots. Lastly, we discussed the overall effects of the humanization of robots in HRI and suggested new avenues of research and development.info:eu-repo/semantics/publishedVersio

An-Pan Man: Language and culture in a Japanese children\u27s cartoon

This thesis examines a Japanese children\u27s fantasy story, An-Pan Man, an animated television cartoon. The cartoon employs stereotypical characterizations that are (a) defined by language use, especially politeness markers encoded in referents for self and other, and (b) exhibited through enacted nonverbal behavior. Since the episodic An-Pan Man story is directed toward a young audience, it can be considered as a presentation that models appropriate and inappropriate language and behavior to children through the media of popular culture. I present an interpretation of culturally specific identities established by language use through translation and interpretation of the cartoon assisted by native-speaker consultants

Boosting children's creativity through creative interactions with social robots

Creativity is an ability with psychological and developmental benefits. Creative levels are dynamic and oscillate throughout life, with a first major decline occurring at the age of 7 years old. However, creativity is an ability that can be nurtured if trained, with evidence suggesting an increase in this ability with the use of validated creativity training. Yet, creativity training for young children (aged between 6-9 years old) appears as scarce. Additionally, existing training interventions resemble test-like formats and lack of playful dynamics that could engage children in creative practices over time. This PhD project aimed at contributing to creativity stimulation in children by proposing to use social robots as intervention tools, thus adding playful and interactive dynamics to the training. Towards this goal, we conducted three studies in schools, summer camps, and museums for children, that contributed to the design, fabrication, and experimental testing of a robot whose purpose was to re-balance creative levels. Study 1 (n = 140) aimed at testing the effect of existing activities with robots in creativity and provided initial evidence of the positive potential of robots for creativity training. Study 2 (n = 134) aimed at including children as co-designers of the robot, ensuring the robot’s design meets children’s needs and requirements. Study 3 (n = 130) investigated the effectiveness of this robot as a tool for creativity training, showing the potential of robots as creativity intervention tools. In sum, this PhD showed that robots can have a positive effect on boosting the creativity of children. This places social robots as promising tools for psychological interventions.Criatividade é uma habilidade com benefícios no desenvolvimento saudável. Os níveis de criatividade são dinâmicos e oscilam durante a vida, sendo que o primeiro maior declínio acontece aos 7 anos de idade. No entanto, a criatividade é uma habilidade que pode ser nutrida se treinada e evidências sugerem um aumento desta habilidade com o uso de programas validados de criatividade. Ainda assim, os programas de criatividade para crianças pequenas (entre os 6-9 anos de idade) são escassos. Adicionalmente, estes programas adquirem o formato parecido ao de testes, faltando-lhes dinâmicas de brincadeira e interatividade que poderão motivar as crianças a envolverem-se em práticas criativas ao longo do tempo. O presente projeto de doutoramento procurou contribuir para a estimulação da criatividade em crianças propondo usar robôs sociais como ferramenta de intervenção, adicionando dinâmicas de brincadeira e interação ao treino. Assim, conduzimos três estudos em escolas, campos de férias, e museus para crianças que contribuíram para o desenho, fabricação, e teste experimental de um robô cujo objetivo é ser uma ferramenta que contribui para aumentar os níveis de criatividade. O Estudo 1 (n = 140) procurou testar o efeito de atividade já existentes com robôs na criatividade e mostrou o potencial positivo do uso de robôs para o treino criativo. O Estudo 2 (n = 134) incluiu crianças como co-designers do robô, assegurando que o desenho do robô correspondeu às necessidades das crianças. O Estudo 2 (n = 130) investigou a eficácia deste robô como ferramenta para a criatividade, demonstrando o seu potencial para o treino da criatividade. Em suma, o presente doutoramento mostrou que os robôs poderão ter um potencial criativo em atividades com crianças. Desta forma, os robôs sociais poderão ser ferramentas promissoras em intervenções na psicologia

Folk Theory of Mind: Conceptual Foundations of Social Cognition

The human ability to represent, conceptualize, and reason about mind and behavior is one of the greatest achievements of human evolution and is made possible by a “folk theory of mind” — a sophisticated conceptual framework that relates different mental states to each other and connects them to behavior. This chapter examines the nature and elements of this framework and its central functions for social cognition. As a conceptual framework, the folk theory of mind operates prior to any particular conscious or unconscious cognition and provides the “framing” or interpretation of that cognition. Central to this framing is the concept of intentionality, which distinguishes intentional action (caused by the agent’s intention and decision) from unintentional behavior (caused by internal or external events without the intervention of the agent’s decision). A second important distinction separates publicly observable from publicly unobservable (i.e., mental) events. Together, the two distinctions define the kinds of events in social interaction that people attend to, wonder about, and try to explain. A special focus of this chapter is the powerful tool of behavior explanation, which relies on the folk theory of mind but is also intimately tied to social demands and to the perceiver’s social goals. A full understanding of social cognition must consider the folk theory of mind as the conceptual underpinning of all (conscious and unconscious) perception and thinking about the social world