THE QUANTITATIVE CASE-BY-CASE ANALYSES OF THE SOCIO-EMOTIONAL OUTCOMES OF CHILDREN WITH ASD IN ROBOT-ASSISTED AUTISM THERAPY

With its focus on robot-assisted autism therapy, this paper presents case-by-case analyses of socio-emotional outcomes of 34 children aged 3–12 years old, with different cases of Autism Spectrum Disorder (ASD) and Attention Deficit Hyperactivity Disorder (ADHD).We grouped children by the following characteristics: ASD alone (n = 22), ASD+ADHD (n = 12), verbal (n = 11), non-verbal (n = 23), low-functioning autism (n = 24), and high-functioning autism (n = 10). This paper provides a series of separate quantitative analyses across the first and last sessions, adaptive and non-adaptive sessions, and parent and no-parent sessions, to present child experiences with the NAO robot, during play-based activities. The results suggest that robots are able to interact with children in social ways and influence their social behaviors over time. Each child with ASD is a unique case and needs an individualized approach to practice and learn social skills with the robot. We, finally, present specific child–robot intricacies that affect how children engage and learn over time as well as across different sessions

Robot NAO used in therapy: Advanced design and evaluation

Treball de Final de Màster Universitari en Sistemes Intel·ligents. Codi: SIE043. Curs acadèmic 2013-2014Following with the previous work which we have done in the Final Research Project, we introduced a therapeutic application with social robotics to improve the positive mood in patients with fibromyalgia. Different works about therapeutic robotics, positive psychology, emotional intelligence, social learning and mood induction procedures (MIPs) are reviewed. Hardware and software requirements and system development are explained with detail. Conclusions about the clinical utility of these robots are disputed. Nowadays, experiments with real fibromyalgia patients are running, the methodology and procedures which take place in them are described in the future lines section of this work

Role-Play-Based Guidance for Job Interviews Using an Android Robot for Individuals With Autism Spectrum Disorders

Interventions for job interviews targeting the impaired theory of mind observed in individuals with autism spectrum disorders (ASD) are limited. We developed a role-play-based guidance system for job interviews using an android robot resembling a real person. Individuals with ASD worked in pairs and played dual roles in mock job interviews. Specifically, one participant acted as the interviewee, while the other participant operated the android robot and acted as the interviewer. Eight individuals with high-functioning ASD participated in this study. After the training sessions, participants learned to understand the point of view of the interviewer, which may contribute to increased recognition of the importance of gestures and the motivation to learn how to behave in a job interview. In addition, participants reported improved self-confidence. These results provide preliminary support for the efficacy of playing dual roles using android robots

Investigating the Dynamics of Nonverbal Communication: Evidence from Neuroimaging in High-Functioning Autism and Typical Development

Being able to accurately decode nonverbal behaviors is essential for human communication. However, meaningful information is not only conveyed by static cues, which have already been extensively investigated in the past, but also by subtle movement dynamics. Investigating such subtle movement dynamics opens up new avenues for the investigation of social cognition in healthy and psychopathological contexts. Thus, this thesis investigated the correlates of perceiving and processing dynamic nonverbal social cues in the human brain using fMRI along with behavioral methods. First, we demonstrate the utility and validity of several digital simulation paradigms for nonverbal behavior research in a neuroimaging context. Further, we show for the first time that the observation of nonverbal communicative interactions is modulated by different spatiotemporal factors of perceived movement and that this is associated with both the AON and the SNN. In addition, we contribute to an ongoing debate by showing that in the context of the observation of complex human interactions, there is no biological bias of the AON. Furthermore, we demonstrate for the first time the domain-specificity of the two neural networks AON and SNN in the context of observing complex human interactions. Finally, we demonstrate that HFA is associated with deficits in social processing more so than social perception, but that social perception may rely on other cognitive strategies compared to typically developing individuals

Social Robots to enhance therapy and interaction for children: From the design to the implementation "in the wild"

En les últimes dues dècades els robots socials s'han convertit en un camp emergent en el qual encara hi ha molt per fer. Aquest camp requereix coneixements en mecànica, control, intel·ligència artificial, sistemes, etc., però també en psicologia, disseny, ètica, etc. El nostre grup de recerca de perfil interdisciplinari ha estat treballant en el disseny de robots socials en diferents aplicacions per a nens amb necessitats especials. L'objectiu d'aquesta tesi és investigar diferents escenaris en teràpia o educació on els robots socials podrien ser una eina útil per als nens. Es van realitzar 4 estudis amb diferents propòsits: (1) dissenyar activitats amb robòtica de LEGO per avaluar el comportament social dels nens amb trastorn de l'espectre autista (TEA) (entre companys i amb adults) i analitzar la seva efectivitat, (2) dissenyar un robot social per recuperar les funcionalitats més afectades a causa de traumatismes cranioencefàlics (TCE) en nens i veure l'eficàcia del tractament, (3) proporcionar un robot mascota per alleujar els sentiments d'ansietat, solitud i estrès en nens hospitalitzats, i (4) comprovar com un robot amb comportament social i amb una personalització versus robots sense aquestes característiques mostra diferències en termes d'interacció amb nens i, per tant, pot ajudar en l'efectivitat de diferents tractaments com hem esmentat anteriorment. Els resultats van revelar diferents resultats depenent de l'aplicació: (1) efectivitat amb la plataforma robòtica social que vam dissenyar en el tractament neuropsicològic per a aquells nens afectats per TCE, (2) eficàcia amb les activitats de robòtica de LEGO dissenyades per un grup de terapeutes en termes de millora d'habilitats socials (3) un efecte positiu entre els mediadors i facilitadors de la interacció i les relacions entre els diferents agents involucrats en el procés de la cura: pacients hospitalitzats, familiars, voluntaris i personal clínic, i (4) una interacció diferent, en termes de temps, entre els dos grups durant període de dues setmanes.En las últimas dos décadas los robots sociales se han convertido en un campo emergente en el que todavía hay mucho por hacer. Este campo requiere conocimientos en mecánica, control, inteligencia artificial, sistemas, etc., pero también en psicología, diseño, ética, etc. Nuestro grupo de investigación de perfil interdisciplinar ha estado trabajando en el diseño de robots sociales en diferentes aplicaciones para niños con necesidades especiales. El objetivo de esta tesis es investigar diferentes escenarios en terapia o educación donde los robots sociales podrían ser una herramienta útil para los niños. Se realizaron 4 estudios con diferentes propósitos: (1) diseñar actividades con robótica de LEGO para evaluar el comportamiento social de los niños con trastorno del espectro autista (TEA) (entre compañeros y con adultos) y analizar su efectividad, (2) diseñar un robot social para recuperar las funcionalidades más afectadas a causa de traumatismos craneoencefálicos (TCE) en niños y ver la eficacia del tratamiento, (3) proporcionar un robot mascota para aliviar los sentimientos de ansiedad, soledad y estrés en niños hospitalizados, y (4) comprobar como un robot con comportamiento social y con una personalización versus robots sin esas características muestra diferencias en términos de interacción con niños y, por tanto, puede ayudar en la efectividad de diferentes tratamientos como mencionamos anteriormente. Los resultados revelaron diferentes resultados dependiendo de la aplicación: (1) efectividad con la plataforma robótica social que diseñamos en el tratamiento neuropsicológico para aquellos niños afectadas por TCE, (2) eficacia con las actividades de robótica de LEGO diseñadas por un grupo de terapeutas en términos de mejora de habilidades sociales (3) un efecto positivo entre los mediadores y facilitadores de la interacción y las relaciones entre los diferentes agentes involucrados en el proceso del cuidado: pacientes hospitalizados, familiares, voluntarios y personal clínico, y (4) una interacción diferente, en términos de tiempo, entre ambos grupos en el promedio de un período de dos semanas.Over the past two decades social robots have become an emerging field where there are many things still to work on. This field not only requires knowledge in mechanics, control, artificial intelligence, systems, etc., but also in psychology, design, ethics, etc. Our multidisciplinary research group has been working on designing social robotic platforms in different applications for children with special needs. The aim of this thesis is to investigate different scenarios in therapy or education where social robots could be a useful tool for children. We ran 4 studies with different purposes: (1) to design activities with LEGO robotics to assess children with autism spectrum disorder (ASD) social behaviour (between peers and with adults) and to analyze the effectiveness, (2) to design a social robotic platform to recover the functionalities most affected by traumatic brain injuries (TBI) in children and see the effectiveness of the treatment, (3) to provide a pet robot to alleviate feelings of anxiety, loneliness and stress of long-term children inpatient and their bystanders, and (4) to verify how a robot with social behaviour and personalization verses those robots without, shows differences in terms of interaction with children and thus, helps the effectiveness of different treatments as we mention above. The results revealed different outcomes depending on the application: (1) effectiveness with the social robotic platform that we designed in neuropsychological treatment in those areas affected by TBI, (2) effectiveness with the LEGO robotics activities designed by a group of therapists in terms of improvement of the social skills and engagement, (3) a positive effect within mediators and facilitators of interaction and relationships between the different agents involved in the caring process: in-patients, relatives, volunteers and clinical staff (4) slight evidence towards a different interaction, in terms of time, between both groups in the average of a two-week period

by

th

Development of duplex eye contact framework for human-robot inter communication

Funding Information: This work was supported in part by the National Research Foundation of Korea-Grant funded by the Korean Government (Ministry of Science and ICT) under Grant NRF 2020R1A2B5B02002478, in part by the Sejong University through its Faculty Research Program, and in part by the Directorate of Research and Extension (DRE), Chittagong University of Engineering and Technology.Peer reviewedPublisher PD

UNOBTRUSIVE Technique Based On Infrared Thermal Imaging For Emotion Recognition In Children- With-asd- Robot Interaction

Emoções são relevantes para as relações sociais, e indivíduos com Transtorno do Espectro Autista (TEA) possuem compreensão e expressão de emoções prejudicadas. Esta tese consiste em estudos sobre a análise de emoções em crianças com desenvolvimento típico e crianças com TEA (idade entre 7 e 12 anos), por meio do imageamento térmico infravermelho (ITIV), uma técnica segura e não obtrusiva (isenta de contato), usada para registrar variações de temperatura em regiões de interesse (RIs) da face, tais como testa, nariz, bochechas, queixo e regiões periorbital e perinasal. Um robô social chamado N-MARIA (Novo-Robô Autônomo Móvel para Interação com Autistas) foi usado como estímulo emocional e mediador de tarefas sociais e pedagógicas. O primeiro estudo avaliou a variação térmica facial para cinco emoções (alegria, tristeza, medo, nojo e surpresa), desencadeadas por estímulos audiovisuais afetivos, em crianças com desenvolvimento típico. O segundo estudo avaliou a variação térmica facial para três emoções (alegria, surpresa e medo), desencadeadas pelo robô social N-MARIA, em crianças com desenvolvimento típico. No terceiro estudo, duas sessões foram realizadas com crianças com TEA, nas quais tarefas sociais e pedagógicas foram avaliadas tendo o robô N-MARIA como ferramenta e mediador da interação com as crianças. Uma análise emocional por variação térmica da face foi possível na segunda sessão, na qual o robô foi o estímulo para desencadear alegria, surpresa ou medo. Além disso, profissionais (professores, terapeuta ocupacional e psicóloga) avaliaram a usabilidade do robô social. Em geral, os resultados mostraram que o ITIV foi uma técnica eficiente para avaliar as emoções por meio de variações térmicas. No primeiro estudo, predominantes decréscimos térmicos foram observados na maioria das RIs, com as maiores variações de emissividade induzidas pelo nojo, felicidade e surpresa, e uma precisão maior que 85% para a classificação das cinco emoções. No segundo estudo, as maiores probabilidades de emoções detectadas pelo sistema de classificação foram para surpresa e alegria, e um aumento significativo de temperatura foi predominante no queixo e nariz. O terceiro estudo realizado com crianças com TEA encontrou aumentos térmicos significativos em todas as RIs e uma classificação com a maior probabilidade para surpresa. N-MARIA foi um estímulo promissor capaz de desencadear emoções positivas em crianças. A interação criança-com-TEA-e-robô foi positiva, com habilidades sociais e tarefas pedagógicas desempenhadas com sucesso pelas crianças. Além disso, a usabilidade do robô avaliada por profissionais alcançou pontuação satisfatória, indicando a N-MARIA como uma potencial ferramenta para terapias