A Virtual Conversational Agent for Teens with Autism: Experimental Results and Design Lessons

We present the design of an online social skills development interface for teenagers with autism spectrum disorder (ASD). The interface is intended to enable private conversation practice anywhere, anytime using a web-browser. Users converse informally with a virtual agent, receiving feedback on nonverbal cues in real-time, and summary feedback. The prototype was developed in consultation with an expert UX designer, two psychologists, and a pediatrician. Using the data from 47 individuals, feedback and dialogue generation were automated using a hidden Markov model and a schema-driven dialogue manager capable of handling multi-topic conversations. We conducted a study with nine high-functioning ASD teenagers. Through a thematic analysis of post-experiment interviews, identified several key design considerations, notably: 1) Users should be fully briefed at the outset about the purpose and limitations of the system, to avoid unrealistic expectations. 2) An interface should incorporate positive acknowledgment of behavior change. 3) Realistic appearance of a virtual agent and responsiveness are important in engaging users. 4) Conversation personalization, for instance in prompting laconic users for more input and reciprocal questions, would help the teenagers engage for longer terms and increase the system's utility

Leveling the Playing Field: Supporting Neurodiversity via Virtual Realities

Neurodiversity is a term that encapsulates the diverse expression of human neurology. By thinking in broad terms about neurological development, we can become focused on delivering a diverse set of design features to meet the needs of the human condition. In this work, we move toward developing virtual environments that support variations in sensory processing. If we understand that people have differences in sensory perception that result in their own unique sensory traits, many of which are clustered by diagnostic labels such as Autism Spectrum Disorder (ASD), Sensory Processing Disorder, Attention-Deficit/Hyperactivity Disorder, Rett syndrome, dyslexia, and so on, then we can leverage that knowledge to create new input modalities for accessible and assistive technologies. In an effort to translate differences in sensory perception into new variations of input modalities, we focus this work on ASD. ASD has been characterized by a complex sensory signature that can impact social, cognitive, and communication skills. By providing assistance for these diverse sensory perceptual abilities, we create an opportunity to improve the interactions people have with technology and the world. In this paper, we describe, through a variety of examples, the ways to address sensory differences to support neurologically diverse individuals by leveraging advances in virtual reality

Assistive learning technologies for learners with ADHD and ASD: – a review 2006-2016

This literature review was a part of a research project investigating how technologies can be utilised to support learners with developmental and attention deficit to be included in mainstream learning contexts.  The review contains research within the field of assistive learning technologies for learners with Attention Deficit Hyperactivity Disorder and Autism Spectrum Disorder from 2006 to 2016. The review is conducted, by using systematic and qualitative academically acknowledged literature search methods. Seven categories of technology-based interventions are recognised from current research, where technologies have been used to support: 1) memory disabilities and/or brain training, 2) increasing focusing attention, 3) time and task management, 4) communication, 5) reading, writing, language and literacy skills, 6) changing behaviour and 7) group work and collaboration. The results indicate that the overall findings of the rendered studies present mixed conclusions. The review calls for more research in a mainstream learning context with a universal design for learning approach

"Will I always be not social?": Re-Conceptualizing Sociality in the Context of a Minecraft Community for Autism

Traditional face-to-face social interactions can be challenging for individuals with autism, leading some to perceive and categorize them as less social than their typically-developing peers. Individuals with autism may even see themselves as less social relative to their peers. Online communities can provide an alternative venue for social expression, enabling different types of communication beyond face-to-face, oral interaction. Using ethnographic methods, we studied the communication ecology that has emerged around a Minecraft server for children with autism and their allies. Our analysis shows how members of this community search for, practice, and define sociality through a variety of communication channels. These findings suggest an expansion in how sociality has traditionally been conceptualized for individuals with autism

Computers as an environment for facilitating social interaction in children with autistic spectrum disorders

Autism is a developmental condition that affects communication, imagination and social interaction. Of these three impairments, it is the last which has the greatest negative impact on the life of children with autism and their families. Different intervention programs have attempted to address social interaction difficulties but there is clearly a need for a school-based program that helps develop social interaction and promote social skills within educationally 'natural' settings.Teachers, parents and researchers widely believe that children with autism enjoy using computers and in most western countries, most children with autism have access to them at home or at school. Drawing from communication theory, this thesis explores the hypothesis that computers can provide a motivating, real-life environment in which social interaction in children with autism can be facilitated.In a series of staged studies, the ways in which computers might be used to facilitate social interaction are investigated. The first phase established the level of access to computers that children with autism typically now have and how educators currently use computers with this group of children. The experience of those working in non-school based programmes aimed at developing social interaction in children with autism was also explored. It was also necessary to explore any inherent constraints on the development of software specifically aimed at children with autism.Having established available resources and constraints, the thesis then explored the social behaviours of children with autism within a computer-based environment, using play-based activities. In a number of interlinking studies, differences and similarities in social interactions were explored when i) working on a paper-based versus computer-based version of the same two player game, ii) playing the same game at the computer, either against a partner or alone, and iii) working with a partner on a series of graded, computer-based jigsaw puzzles, with the partner acting either as a collaborator or competitor.The findings presented illustrate the potential for eliciting increased social interaction in children with autism when working alongside other with computers, and suggest the possibility that time spent with computers by children with autism may help them to gravitate from a solitary activity towards a social one. The relevance of the findings of these studies to practice are discussed and the need for further studies highlighted

A Qualitative Descriptive Case Study of Special Education Teachers\u27 Experiences Utilizing Interactive Whiteboards for Students with Autism Spectrum Disorder in Elementary Self-Contained Classrooms

The purpose of this qualitative descriptive case study was to describe the experiences of special education teachers who use Interactive Whiteboards (IWBs) to instruct students diagnosed with autism spectrum disorder (ASD) in elementary self-contained special education classrooms. The theoretical framework for this study includes the persuasive technology theory and the social learning theory. Ten special education teachers from two elementary schools in a suburb of north Georgia will be asked to participate in this study. Data collection included an individual interview, and participant letters, followed by a focus group. Data analysis consisted of categorical aggregation, development of naturalistic generalizations, and development of themes. The methodology for this qualitative study followed the recommendation of Yin (2014) and has four stages: design the case study, conduct the case study, analyze the evidence, and develop the conclusion, recommendations, and implications

Assistive Technology to Improve Collaboration in Children with ASD: State-of-the-Art and Future Challenges in the Smart Products Sector

Within the field of products for autism spectrum disorder, one of the main research areas is focused on the development of assistive technology. Mid and high-tech products integrate interactive and smart functions with multisensory reinforcements, making the user experience more intuitive, adaptable, and dynamic. These products have a very significant impact on improving the skills of children with autism, including collaboration and social skills, which are essential for the integration of these children into society and, therefore, their well-being. This work carried out an exhaustive analysis of the scientific literature, as well as market research and trends, and patent analysis to explore the state-of-the-art of assistive technology and smart products for children with ASD, specifically those aimed at improving social and communication skills. The results show a reduced availability of products that act as facilitators of the special needs of children with ASD, which is even more evident for products aimed at improving collaboration skills. Products that allow the participation of several users simultaneously through multi-user interfaces are required. On top of this, the trend toward virtual environments is leading to a loss of material aspects in the design that are essential for the development of these children

Rett Syndrome

Rett syndrome is a thief! It robs little girls of their projected life. It lulls their families into a false sense of security while their little girls develop normally for 6 to 18 months. Then it insidiously robs them of their skills and abilities until they are trapped in a body that won't respond. These little girls are called "silent angels" (Hunter, 2007). Rett syndrome (RS) was originally identified in 1966 by the Austrian neurologist Andreas Rett, but his research and findings were written in an obscure form of the German language the medical world could not and did not translate. It wasn't until 1983, that Rett syndrome was re-identified and labeled as its own disorder (Hunter, 2007). The Rett Syndrome Research Foundation (2006) summarizes the condition best with: Rett syndrome is a debilitating neurological disorder diagnosed almost exclusively in females. Children with Rett syndrome appear to develop normally until 6 to 18 months of age when they enter a period of regression, losing speech and motor skills. Most develop repetitive hand movements, irregular breathing patterns, seizures and extreme motor control problems. Rett syndrome leaves its victims profoundly disabled, requiring maximum assistance with every aspect of daily living. There is no cure. (Retrieved October 14, 2008 from http://www.rsrf.org/about_rett_syndrome/) Research is ever going to regards to Rett syndrome. What is known as of now is that Rett syndrome is caused by a mutation of the gene MECP2. It is not passed down in families and it knows no ethnic boundaries. The majority of Rett girls live to adulthood (RSRF, 2006). The male child doesn't usually survive birth with Rett syndrome