A Pilot Study with a Novel Setup for Collaborative Play of the Humanoid Robot KASPAR with children with autism

This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.This article describes a pilot study in which a novel experimental setup, involving an autonomous humanoid robot, KASPAR, participating in a collaborative, dyadic video game, was implemented and tested with children with autism, all of whom had impairments in playing socially and communicating with others. The children alternated between playing the collaborative video game with a neurotypical adult and playing the same game with the humanoid robot, being exposed to each condition twice. The equipment and experimental setup were designed to observe whether the children would engage in more collaborative behaviours while playing the video game and interacting with the adult than performing the same activities with the humanoid robot. The article describes the development of the experimental setup and its first evaluation in a small-scale exploratory pilot study. The purpose of the study was to gain experience with the operational limits of the robot as well as the dyadic video game, to determine what changes should be made to the systems, and to gain experience with analyzing the data from this study in order to conduct a more extensive evaluation in the future. Based on our observations of the childrens’ experiences in playing the cooperative game, we determined that while the children enjoyed both playing the game and interacting with the robot, the game should be made simpler to play as well as more explicitly collaborative in its mechanics. Also, the robot should be more explicit in its speech as well as more structured in its interactions. Results show that the children found the activity to be more entertaining, appeared more engaged in playing, and displayed better collaborative behaviours with their partners (For the purposes of this article, ‘partner’ refers to the human/robotic agent which interacts with the children with autism. We are not using the term’s other meanings that refer to specific relationships or emotional involvement between two individuals.) in the second sessions of playing with human adults than during their first sessions. One way of explaining these findings is that the children’s intermediary play session with the humanoid robot impacted their subsequent play session with the human adult. However, another longer and more thorough study would have to be conducted in order to better re-interpret these findings. Furthermore, although the children with autism were more interested in and entertained by the robotic partner, the children showed more examples of collaborative play and cooperation while playing with the human adult.Peer reviewe

Integrated Web Accessibility Guidelines for Users on the Autism Spectrum - from Specification to Implementation

This research presented a compendium of web interface design guidelines and their implementation on a transport-planning website based on the needs and preferences of users on the autism spectrum. Results highlighted the importance of having simple navigation and meaningful headings, icons, labels and text to facilitate understanding and readability; these findings offer guidelines for the design of web user interfaces to continue improving the web experience of autistic users, and therefore of the whole community

Multi-Display Environments to Foster Emotional Intelligence in Hospitalized Children

© Owner/Author 2015. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in Interacción '15 Proceedings of the XVI International Conference on Human Computer Interactionhttp://dx.doi.org/10.1145/2829875.2829880Long-term and frequent hospitalized children are under high loads of emotional stress, which affects their well-being in addition to the illness they are suffering. This thesis proposes and will focus on an approach to use Multi-Display Environments (MDE) in pediatric hospitalization contexts to improve patients’ emotional intelligence so they can deal with the negative emotions produced by their situation.This work is supported by Spanish MINECO (TIN2010-20488 and TIN2014-60077-R), from Universitat Politècnica de València (UPV-FE-2014-24), and from GVA (APOSTD/2013/013 and ACIF/2014/214).García Sanjuan, F.; Jaén Martínez, FJ.; Catalá Bolós, A. (2015). Multi-Display Environments to Foster Emotional Intelligence in Hospitalized Children. ACM. https://doi.org/10.1145/2829875.2829880SGal, E., Bauminger, N., Goren-Bar, D., et al. Enhancing Social Communication of Children with High-functioning Autism Through a Co-located Interface. AI & Society 24, 1 (2009), 75--84.Hornecker, E., Marshall, P., Dalton, N.S., and Rogers, Y. Collaboration and Interference: Awareness with Mice or Touch Input. CSCW '08, ACM (2008), 167--176.Kaminski, M., Pellino, T., and Wish, J. Play and Pets: The Physical and Emotional Impact of Child-Life and Pet Therapy on Hospitalized Children. Children's Health Care 31, 4 (2002), 321--335.Mandryk, R.L., Inkpen, K.M., Bilezikjian, M., Klemmer, S.R., and Landay, J.A. Supporting children's collaboration across handheld computers. CHI EA '01, ACM (2001), 255--256.Morris, M.E., Marshall, C.S., Calix, M., Al Haj, M., MacDougall, J.S., and Carmean, D.M. PIXEE: Pictures, Interaction and Emotional Expression. CHI EA '13, ACM (2013), 2277--2286.Ohta, T. and Tanaka, J. Pinch: an interface that relates applications on multiple touch-screen by `pinching' gesture. ACE '12, Springer-Verlag (2012), 320--335.Ohta, T. Dynamically reconfigurable multi-display environment for CG contents. ACE '08, ACM (2008), 416.Rick, J., Marshall, P., and Yuill, N. Beyond One-size-fits-all: How Interactive Tabletops Support Collaborative Learning. IDC '11, ACM (2011), 109--117

Supporting Collaborative Learning in Computer-Enhanced Environments

As computers have expanded into almost every aspect of our lives, the ever-present graphical user interface (GUI) has begun facing its limitations. Demanding its own share of attention, GUIs move some of the users\u27 focus away from the task, particularly when the task is 3D in nature or requires collaboration. Researchers are therefore exploring other means of human-computer interaction. Individually, some of these new techniques show promise, but it is the combination of multiple approaches into larger systems that will allow us to more fully replicate our natural behavior within a computing environment. As computers become more capable of understanding our varied natural behavior (speech, gesture, etc.), the less we need to adjust our behavior to conform to computers\u27 requirements. Such capabilities are particularly useful where children are involved, and make using computers in education all the more appealing. Herein are described two approaches and implementations of educational computer systems that work not by user manipulation of virtual objects, but rather, by user manipulation of physical objects within their environment. These systems demonstrate how new technologies can promote collaborative learning among students, thereby enhancing both the students\u27 knowledge and their ability to work together to achieve even greater learning. With these systems, the horizon of computer-facilitated collaborative learning has been expanded. Included among this expansion is identification of issues for general and special education students, and applications in a variety of domains, which have been suggested

Blending human and artificial intelligence to support autistic children’s social communication skills

This paper examines the educational efficacy of a learning environment in which children diagnosed with Autism Spectrum Conditions (ASC) engage in social interactions with an artificially intelligent (AI) virtual agent and where a human practitioner acts in support of the interactions. A multi-site intervention study in schools across the UK was conducted with 29 children with ASC and learning difficulties, aged 4-14 years old. For reasons related to data completeness and amount of exposure to the AI environment, data for 15 children was included in the analysis. The analysis revealed a significant increase in the proportion of social responses made by ASC children to human practitioners. The number of initiations made to human practitioners and to the virtual agent by the ASC children also increased numerically over the course of the sessions. However, due to large individual differences within the ASC group, this did not reach significance. Although no evidence of transfer to the real-world post-test was shown, anecdotal evidence of classroom transfer was reported. The work presented in this paper offers an important contribution to the growing body of research in the context of AI technology design and use for autism intervention in real school contexts. Specifically, the work highlights key methodological challenges and opportunities in this area by leveraging interdisciplinary insights in a way that (i) bridges between educational interventions and intelligent technology design practices, (ii) considers the design of technology as well as the design of its use (context and procedures) on par with one another, and (iii) includes design contributions from different stakeholders, including children with and without ASC diagnosis, educational practitioners and researchers

Toward emotional interactive videogames for children with autism spectrum disorder

Technology and videogames have been proven as motivating tools for working attention and complex communication skills, especially in children with autism spectrum disorder (ASD). In this work, we present two experiences that used interactive games for promoting communication and attention. The first game considers emotions in order to measure children’s attention, concentration and satisfaction, while the second uses tangible tabletops for fostering cognitive planning. The analysis of the results obtained allows to propose a new study integrating both, in which the tangible interactive game is complemented with the emotional trainer in a way that allows identifying and classifying children’s emotion with ASD when they collaborate to solve cognitively significant and contextualized challenges. The first application proposed is an emotional trainer application in which the child can work out the seven basic emotions (happiness, sadness, fear, disgust, anger, surprise and neutral). Further, a serious videogame is proposed: a 3D maze where the emotions can be captured. The second case study was carried out in a Special Education Center, where a set of activities for working cognitive planning was proposed. In this case, a tangible interactive tabletop was used to analyze, in students with ASD, how the communication processes with these interfaces affect to the attention, memory, successive and simultaneous processing that compose cognitive planning from the PASS model. The results of the first study, suggest that the autistic children did not act with previous planning, but they used their perception to adjust their actions a posteriori (that explains the higher number of collisions). On the second case study, the successive processing was not explored. The inclusion of the mazes of case study 1 to a semantic rich scenario could allow us to measure the prior planning and the emotions involved in the maze game. The new physiological sensors will also help to validate the emotions felt by the children. The first study has as objective the capability to imitate emotions and resolve a maze without semantic context. The second study organized all the actions from a semantic context close to users. The attention results presented by the second study are coherent with the first study and complement it showing that attention can be receptive or selective. In the first study case, the receptive attention was the focus of analysis. In the second case, both contributed to explain and understand how it can be developed from a videogame

Shortages and challenges in augmentative communication through tangible interaction using a user-centered design and assessment process

In this article, we present an assessment process on a tangible interaction application oriented to individuals with complex communication needs, called ACoTI, and details about the main results obtained thus far. The process is based on a set of decisions that have been surveyed as key elements for assessing this type of experiences, based on a background review that was carried out. In addition to that, it has taken into account the contribution of key players from the special education field and it is the foundation for the user-centered and evolutionary design of the application. A number of findings and challenges that open up the door to keep contributing to this specific area was presented. For instance, creating an authoring tool that is available for the educators to be able to generate themselves customized activities for their students, considering the specific needs of each of them

Shortages and Challenges in Augmentative Communication through Tangible Interaction using a user-centered design and assessment process

In this article, we present an assessment process on a tangible interaction application oriented to individuals with complex communication needs, called ACoTI, and details about the main results obtained thus far. The process is based on a set of decisions that have been surveyed as key elements for assessing this type of experiences, based on a background review that was carried out. In addition to that, it has taken into account the contribution of key players from the special education field and it is the foundation for the user-centered and evolutionary design of the application. A number of findings and challenges that open up the door to keep contributing to this specific area was presented. For instance, creating an authoring tool that is available for the educators to be able to generate themselves customized activities for their students, considering the specific needs of each of them.Fil: Sanz, Cecilia Veronica. Universidad Nacional de La Plata. Facultad de Informática. Instituto de Investigación en Informática Lidi; Argentina. Provincia de Buenos Aires. Gobernación. Comisión de Investigaciones Científicas; ArgentinaFil: Artola, Verónica. Universidad Nacional de La Plata. Facultad de Informática. Instituto de Investigación en Informática Lidi; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - La Plata; ArgentinaFil: Guisen, Maria Andrea. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: Marco, Javier. Universidad de Zaragoza; EspañaFil: Cerezo, Eva. Universidad de Zaragoza; EspañaFil: Baldassarri, Sandra Silvia. Universidad de Zaragoza; Españ