A Virtual Conversational Agent for Teens with Autism: Experimental Results and Design Lessons

We present the design of an online social skills development interface for teenagers with autism spectrum disorder (ASD). The interface is intended to enable private conversation practice anywhere, anytime using a web-browser. Users converse informally with a virtual agent, receiving feedback on nonverbal cues in real-time, and summary feedback. The prototype was developed in consultation with an expert UX designer, two psychologists, and a pediatrician. Using the data from 47 individuals, feedback and dialogue generation were automated using a hidden Markov model and a schema-driven dialogue manager capable of handling multi-topic conversations. We conducted a study with nine high-functioning ASD teenagers. Through a thematic analysis of post-experiment interviews, identified several key design considerations, notably: 1) Users should be fully briefed at the outset about the purpose and limitations of the system, to avoid unrealistic expectations. 2) An interface should incorporate positive acknowledgment of behavior change. 3) Realistic appearance of a virtual agent and responsiveness are important in engaging users. 4) Conversation personalization, for instance in prompting laconic users for more input and reciprocal questions, would help the teenagers engage for longer terms and increase the system's utility

CHORUS Deliverable 2.2: Second report - identification of multi-disciplinary key issues for gap analysis toward EU multimedia search engines roadmap

After addressing the state-of-the-art during the first year of Chorus and establishing the existing landscape in multimedia search engines, we have identified and analyzed gaps within European research effort during our second year. In this period we focused on three directions, notably technological issues, user-centred issues and use-cases and socio- economic and legal aspects. These were assessed by two central studies: firstly, a concerted vision of functional breakdown of generic multimedia search engine, and secondly, a representative use-cases descriptions with the related discussion on requirement for technological challenges. Both studies have been carried out in cooperation and consultation with the community at large through EC concertation meetings (multimedia search engines cluster), several meetings with our Think-Tank, presentations in international conferences, and surveys addressed to EU projects coordinators as well as National initiatives coordinators. Based on the obtained feedback we identified two types of gaps, namely core technological gaps that involve research challenges, and “enablers”, which are not necessarily technical research challenges, but have impact on innovation progress. New socio-economic trends are presented as well as emerging legal challenges

Tech for Understanding: An Introduction to Assistive and Instructional Technology in the Classroom

This paper examines the different types of assistive and instructional technology available to students who are classified with one or more of the thirteen disabilities outlined in the Individuals with Disabilities Education Act (referred to as, IDEA). While the roles of assistive and instructional technology are different, there are many instances where their uses may overlap. Thus, while these two categories will be discussed separately, it should be noted that some information may be applied to each category and more than one piece of technology. The purpose of this paper is to provide an introduction to the world of assistive and instructional technology for those who may be new to its concepts, particularly parents who have recently learned that their child may benefit from extra assistance and future educators who are interested in learning more about the devices they will be using to reach their students. Each of the thirteen disabilities will be discussed briefly, and then each disability will be assigned several types of assistive and instructional technology that serve it well. This will by no means be an exhaustive list of all types of technology available to teachers, parents, and students. However, it will attempt to provide a varied glimpse at some of the options that are available and how they may help children who are struggling to access the curriculum