Robot Assistive Therapy Strategies for Children with Autism

Background: Autism spectrum disorder (ASD) is a category of neurodevelopmental disorder characterized by persistent deficits in social communication and social interaction across multiple contexts as well as restricted, repetitive patterns of behaviour, interests, or activities. Social robots offer clinicians new ways to interact and work with people with ASD. Robot-Assisted Training (RAT) is a growing body of research in HRI, which studies how robots can assist and enhance human skills during a task-centred interaction. RAT systems have a wide range of application for children with ASD. Aims: In a pilot RCT with an experimental group and a control group, research aims will be: to assess group differences in repetitive and maladaptive behaviours (RMBs), affective states and performance tasks across sessions and within each group; to assess the perception of family relationships between two groups before and post robot interaction; to develop a robotic app capable to run Raven’s Progressive Matrices (RPM), a test typically used to measure general human intelligence and to compare the accuracy of the robot to capture the data with that run by psychologists. Material and Methods: Patients with mild or moderate level of ASD will be enrolled in the study which will last 3 years. The sample size is: 60 patients (30 patients will be located in the experimental group and 30 patients will be located in the control group) indicated by an evaluation of the estimated enrolment time. Inclusion criteria will be the following: eligibility of children confirmed using the Autism Diagnostic Observation Schedule −2; age ≥ 7 years; clinician judgment during a clinical psychology evaluation; written parental consent approved by the local ethical committee. The study will be conducted over 10 weeks for each participant, with the pretest and post test conducted during the first and last weeks of the study. The training will be provided over the intermediate eight weeks, with one session provided each week, for a total of 8 sessions. Baseline and follow-up evaluation include: socioeconomic status of families will be assessed using the Hollingshead scale; Social Communication Questionnaire (SCQ) will be used to screen the communication skills and social functioning in children with ASD; Vineland Adaptive Behavior Scale, 2nd edition (VABS) will be used to assess the capabilities of children in dealing with everyday life; severity and variety of children’s ripetitive behaviours will be also assessed using Repetitive Behavior Scale-Revised (RBS-R). Moreover, the perception of family relationships assessment will be run by Portfolio for the validation of parental acceptance and refusal (PARENTS). Expected Results: 1) improbe communication skills; 2) reduced repetitive and maladaptive behaviors; 3) more positive perception of family relationships; 4) improved performance. Conclusions: Robot-Assisted Training aims to train and enhance user (physical or cognitive) skills, through the interaction, and not assist users to complete a task thus a target is to enhance user performance by providing personalized and targeted assistance towards maximizing training and learning effects. Robotics systems can be used to manage therapy sessions, gather and analyse data and like interactions with the patient and generate useful information in the form of reports and graphs, thus are a powerful tool for the therapist to check patient’s progress and facilitate diagnosis

Lesson Plans from the Higher Education Course Curriculum for a Distance Learning Model Reinforced with Robotics for 3 to 7 Years Old Children

EARLY recognizes the importance of early childhood education and the potential of digital technologies in enhancing learning experiences. By providing teachers, parents, and children with effective strategies and resources, it aims to improve the quality of online education for young children. To ensure that all preschool children have access to a continuous learning process in different circumstances (e.g., pandemics, prolonged illness or other situations), teachers and parents benefit from being prepared for these different circumstances. The materials developed and offered in the Higher Education Course Curriculum for Distance Learning Model Reinforced with Robotics for 3-7 Years Old Children are, therefore, relevant. Besides the Curriculum itself, which can be used for structuring training or for self-learning, EARLY offers some examples of activities and lesson plans for online activities with educational value. The main target group of this curriculum is pre-service preschool educators (undergraduates in most countries), but the material is also suitable and recommended for experienced preschool educators who want to expand their competences and those who are in close contact with an early childhood learner.info:eu-repo/semantics/publishedVersio

Advancements in AI-driven multilingual comprehension for social robot interactions: An extensive review

In the digital era, human-robot interaction is rapidly expanding, emphasizing the need for social robots to fluently understand and communicate in multiple languages. It is not merely about decoding words but about establishing connections and building trust. However, many current social robots are limited to popular languages, serving in fields like language teaching, healthcare and companionship. This review examines the AI-driven language abilities in social robots, providing a detailed overview of their applications and the challenges faced, from nuanced linguistic understanding to data quality and cultural adaptability. Last, we discuss the future of integrating advanced language models in robots to move beyond basic interactions and towards deeper emotional connections. Through this endeavor, we hope to provide a beacon for researchers, steering them towards a path where linguistic adeptness in robots is seamlessly melded with their capacity for genuine emotional engagement

Superhero Media as a Potential Context for Investigating Children\u27s Understanding of Morally Relevant Events

Currently, superhero films are one of the more popular film genres, and the genre does not appear to be slowing down anytime soon. In addition, the lives and exploits of superheroes are told through other forms of media such as animated films and television series targeted towards children. However, these narratives are also violent. If older children (i.e., approximately 7-11) engage with superhero media, then it is important to understand the ways they attempt to make sense of this genre. To this end, the essay examines how superhero media may serve as a potential context for older children\u27s understanding of morally relevant events. This potential -- based on three broad areas of scholarship on children\u27s capacities for understanding others and their morally relevant acts -- is explored along two dimensions. The first is through common narrative features of the genre, and the second is through research implications. It is suggested that a research program utilizing the genre\u27s narrative features as a part of a methodology to investigate older children\u27s understanding of morally relevant acts affords unique opportunities to build upon existing scholarship on the relationship between media content and children\u27s moral understanding

Medijske pripovijedi o superherojima kao potencijalni kontekst za istraživanje dječjega razumijevanja moralno relevantnih događaja

Currently, superhero films are one of the more popular films genres, and the genre does not appear to be slowing down anytime soon. In addition, the lives and exploits of superheroes are told through other forms of media such as animated films and television series targeted towards children. However, these narratives are also violent. If older children (i.e., approximately 7–11) engage with superhero media, then it is important to understand the ways they attempt to make sense of this genre. To this end, the essay examines how superhero media may serve as a potential context for older children’s understanding of morally relevant events. This potential—based on three broad areas of scholarship on children’s capacities for understanding others and their morally relevant acts—is explored along two dimensions. The first is through common narrative features of the genre, and the second is through research implications. It is suggested that a research program utilizing the genre’s narrative features as a part of a methodology to investigate older children’s understanding of morally relevant acts affords unique opportunities to build upon existing scholarship on the relationship between media content and children’s moral understanding.Trenutačno su filmovi o superherojima jedan od popularnijih filmskih žanrova i čini se da se taj trend neće uskoro promijeniti. Osim toga, životi i pothvati superheroja prikazani su i putem drugih medija poput animiranih filmova i televizijskih serija namijenjenih djeci. Međutim, te su priče ujedno i nasilne. Ako se starija djeca (od 7 do 11 godina) susreću s medijskim sadržajem o superherojima, važno je razumjeti načine na koje oni pokušavaju shvatiti taj žanr. U tu svrhu, ovaj rad istražuje kako medijski sadržaj o superherojima može poslužiti kao potencijalni kontekst za razumijevanje moralno značajnih događaja kod starije djece. Taj potencijal – temeljen na tri šira područja istraživanja dječje sposobnosti razumijevanja drugih i njihovih moralno značajnih postupaka – istražuje se putem dviju dimenzija. Prvu predstavljaju zajednički pripovjedni elementi žanra, a drugu istraživačke implikacije. Predlaže se istraživački model koji se koristi pripovjednim obilježjima žanra kao dijelom metodologije za istraživanje razumijevanja moralno značajnih postupaka kod starije djece. Takav model također nudi mogućnost nadogradnje postojećih istraživanja o odnosu između medijskoga sadržaja i moralnoga razumijevanja djece

Psychophysiological analysis of a pedagogical agent and robotic peer for individuals with autism spectrum disorders.

Autism spectrum disorder (ASD) is a neurodevelopmental disorder characterized by ongoing problems in social interaction and communication, and engagement in repetitive behaviors. According to Centers for Disease Control and Prevention, an estimated 1 in 68 children in the United States has ASD. Mounting evidence shows that many of these individuals display an interest in social interaction with computers and robots and, in general, feel comfortable spending time in such environments. It is known that the subtlety and unpredictability of people’s social behavior are intimidating and confusing for many individuals with ASD. Computerized learning environments and robots, however, prepare a predictable, dependable, and less complicated environment, where the interaction complexity can be adjusted so as to account for these individuals’ needs. The first phase of this dissertation presents an artificial-intelligence-based tutoring system which uses an interactive computer character as a pedagogical agent (PA) that simulates a human tutor teaching sight word reading to individuals with ASD. This phase examines the efficacy of an instructional package comprised of an autonomous pedagogical agent, automatic speech recognition, and an evidence-based instructional procedure referred to as constant time delay (CTD). A concurrent multiple-baseline across-participants design is used to evaluate the efficacy of intervention. Additionally, post-treatment probes are conducted to assess maintenance and generalization. The results suggest that all three participants acquired and maintained new sight words and demonstrated generalized responding. The second phase of this dissertation describes the augmentation of the tutoring system developed in the first phase with an autonomous humanoid robot which serves the instructional role of a peer for the student. In this tutoring paradigm, the robot adopts a peer metaphor, where its function is to act as a peer. With the introduction of the robotic peer (RP), the traditional dyadic interaction in tutoring systems is augmented to a novel triadic interaction in order to enhance the social richness of the tutoring system, and to facilitate learning through peer observation. This phase evaluates the feasibility and effects of using PA-delivered sight word instruction, based on a CTD procedure, within a small-group arrangement including a student with ASD and the robotic peer. A multiple-probe design across word sets, replicated across three participants, is used to evaluate the efficacy of intervention. The findings illustrate that all three participants acquired, maintained, and generalized all the words targeted for instruction. Furthermore, they learned a high percentage (94.44% on average) of the non-target words exclusively instructed to the RP. The data show that not only did the participants learn nontargeted words by observing the instruction to the RP but they also acquired their target words more efficiently and with less errors by the addition of an observational component to the direct instruction. The third and fourth phases of this dissertation focus on physiology-based modeling of the participants’ affective experiences during naturalistic interaction with the developed tutoring system. While computers and robots have begun to co-exist with humans and cooperatively share various tasks; they are still deficient in interpreting and responding to humans as emotional beings. Wearable biosensors that can be used for computerized emotion recognition offer great potential for addressing this issue. The third phase presents a Bluetooth-enabled eyewear – EmotiGO – for unobtrusive acquisition of a set of physiological signals, i.e., skin conductivity, photoplethysmography, and skin temperature, which can be used as autonomic readouts of emotions. EmotiGO is unobtrusive and sufficiently lightweight to be worn comfortably without interfering with the users’ usual activities. This phase presents the architecture of the device and results from testing that verify its effectiveness against an FDA-approved system for physiological measurement. The fourth and final phase attempts to model the students’ engagement levels using their physiological signals collected with EmotiGO during naturalistic interaction with the tutoring system developed in the second phase. Several physiological indices are extracted from each of the signals. The students’ engagement levels during the interaction with the tutoring system are rated by two trained coders using the video recordings of the instructional sessions. Supervised pattern recognition algorithms are subsequently used to map the physiological indices to the engagement scores. The results indicate that the trained models are successful at classifying participants’ engagement levels with the mean classification accuracy of 86.50%. These models are an important step toward an intelligent tutoring system that can dynamically adapt its pedagogical strategies to the affective needs of learners with ASD

Designing for Autonomy, Competence and Relatedness in Robot-Assisted Language Learning

The current number of immigrants has risen quickly in recent years due to globalization. People move to another country for economic, educational, emotional, and other reasons. As a result, immigrants need to learn the host language to integrate into their new living environment. However, the process of learning the host language for adult immigrants faces many challenges. Among those challenges, maintaining intrinsic motivation is critical for a long-term language study process and the well-being of adult immigrants. Self-Determination Theory (SDT) is a popular theoretical framework that explains human motivation, especially intrinsic motivation, through a psychological approach to understand its nature. According to SDT, humans are intrinsically motivated through the satisfaction of the three basic needs of Autonomy, Competence, and Relatedness. Many researchers have applied the theory to different topics and directions, including language learning. On the other hand, social robots have been used extensively in the language learning context due to their physical embodiments and the application of artificial intelligence in robotics. Furthermore, research has proven that social robots can create a relaxed and engaging learning environment, thus motivating language learners. The thesis designs and implements a RALL application called SAMQ using QTrobot, a humanoid social robot capable of producing body gestures, displaying different facial expressions, and multilingual communication. The study aims to investigate SAMQ’s ability to evoke intrinsic motivations of adult immigrants in learning the Finnish language. While previous research focuses on English as the second language (L2) and targets children, this thesis’s L2 is Finnish, and the learners are adult immigrants. The thesis conducts semi-structured interviews during the Pre-study phase (N=6) to gather real insights from adult immigrants living in Finland, to understand demotivating factors in their language learning experience and the unsatisfied aspects of the three basic needs. The qualitative findings from the Pre-study contribute to the design and implementation of two versions of SAMQ, aiming at evoking intrinsic motivations through satisfying unmet needs. The first version is a Quiz-only program that tests several assumptions regarding human-robot interaction (HRI). The final version of SAMQ is a more comprehensive language learning application that supports two modes of study: Learning and Quizzes. It consists of multiple modifications that address all adult immigrants’ basic needs while additionally promoting intrinsic motivation through media. The final Evaluation of SAMQ (N=6) includes a questionnaire and a semi-structured interview. The quantitative results of the questionnaire validated the ability of using social robots to evoke adult learners’ intrinsic motivation in the RALL context. The qualitative findings from the research high-light the importance of social robots’ physical embodiments in eliciting intrinsic motivation for adult learners through satisfying Relatedness. In addition, the use of voice modality creates a genuine HRI for adult learners, fulfilling both Autonomy and Competence, resulting in an engaging and smooth learning experience. Besides that, the use of adult learners’ L1 plays a crucial role in facilitating a relaxed and familiar learning environment, supplying both Competence and Relatedness. Moreover, multimedia learning materials make the learning experience more vivid and attractive. Ultimately, the result shows that accessibility and flexibility are essential attributes for adult learners to maintain their motivation for long-term language study through the satisfaction of Autonomy. Finally, the thesis proposes a design guideline for the RALL context. It consists of five design implications for evoking intrinsic motivation in adult learners through satisfying the three basic psychological needs of Autonomy, Competence, and Relatedness. The design guideline acts as a proposal for future design and implementation of RALL programs for adults and contributes to developing the human-robot interaction field

Finding resilience through music for neurodivergent children

This research paper presents a collaborative effort to design a music-making tool that seamlessly blends enjoyment with accessibility, specifically tailored to meet the needs of children with diverse abilities including those who are neurodiverse and have varying musical abilities. The study's primary objective is to provide support to children who encounter challenges in learning traditional musical instruments or who have sensory processing issues and learn their experience of using this tool. Additionally, the research explores the potential role of music therapy in this context, with a focus on how the designed tool can serve as an ideal platform for fostering creativity and self-regulation among children. Qualitative research methods, namely participatory design and cooperative inquiry, were employed to develop and refine different aspects of the music-making tool iteratively. Active involvement and feedback from the primary participants, comprising children with diverse abilities and a music therapist, played a central role throughout the tool's development process. The findings indicate that children responded positively to the technology, revealing diverse applications in music education, therapy, and play. Furthermore, this study identified valuable opportunities for immediate improvements in the robot's design to enhance its overall usability and effectiveness in catering to the needs of its users. The collaborative design approach and the integration of music therapy perspectives demonstrate significant potential for advancing inclusive music education, play and therapeutic interventions for children with diverse abilities