A brief review: assistive technology and autism, a proposal for virtual tools for improved communication and emotional recognition

Autism is a condition that affects over one percent of the population, and is a condition that has varying degrees of severity. There currently exist various therapies to help people with autism communicate effectively. As a result some researchers and schools have expanded this provision by creating virtual tools to assist the communication process and allow a greater level of independence and generalization. Therefore, this brief paper aims to present a review of literature surrounding assistive technology, augmentative and alternative communication and autism, and how these fields of knowledge can be better understood to help develop virtual tools – more specifically a virtual world

ARTIFICIAL INTELLIGENCE IN AUGMENTATIVE AND ALTERNATIVE COMMUNICATION SYSTEMS - A LITERATURE-BASED ASSESSMENT AND IMPLICATIONS OF DIFFERENT CONVERSATION PHASES AND CONTEXTS

Even though AAC systems and corresponding AI approaches have been investigated in the extant research, they still show remarkable drawbacks, resulting in a low prevalence among speech-impaired individuals. As the suggestions and adaptions proposed by AI within AAC systems may show insufficiencies in certain situations (e.g., unreliable suggestions, low conversational rates, unauthentic adaptions towards the users), we aim to take a more up-close look at the conversations, especially the conversational contexts and conversation phases in which the supporting AI is applied. Therefore, we have conducted a Systematic Literature Review as well as Literature Analysis. Thereby, we could reveal that there are indeed several gaps within the extant research on AI regarding the coverage of the conversational context “informativeness” and the conversation phases “beginning” and “closing”. To dismantle the existing communication barriers that speech-impaired individuals suffer from, several implications for investigating AI in the context of AAC systems are derived and proposed for future (IS) research

Use of an agile bridge in the development of assistive technology

Engaging with end users in the development of assistive technologies remains one of the major challenges for researchers and developers in the field of accessibility and HCI. Developing usable software systems for people with complex disabilities is problematic, software developers are wary of using user-centred design, one of the main methods by which usability can be improved, due to concerns about how best to work with adults with complex disabilities, in particular Severe Speech and Physical Impairments (SSPI) and how to involve them in research. This paper reports on how the adoption of an adapted agile approach involving the incorporation of a user advocate on the research team helped in meeting this challenge in one software project and offers suggestions for how this could be used by other development teams

Use of artificial intelligence (AI) in augmentative and alternative communication (AAC):community consultation on risks, benefits and the need for a code of practice

Purpose: This paper reports on a workshop discussing the views of the augmentative and alternative communication (AAC) community on the opportunities and risks posed by the integration of artificial intelligence (AI) into voice output communication aid systems. The views of the community on whether a Code of Practice was needed for the use of this new technology were also sought. Design/methodology/approach: This was an explorative, qualitative study in which members of the AAC community attending a session at a UK national conference were invited to discuss the topic, responding to structured questions from the research team. The use of AI for both novel language generation and rate enhancement was discussed within the session. Findings: Many potential opportunities and benefits of AI to AAC users were discussed by the group. Risks associated with new and existing biases in AI language models were raised, as was the need to ensure that outputs generated by AI were authentically authored by users. Whilst there was broad support for the idea of a Code of Practice, questions were posed about how it would be designed and what it should contain. Originality/value: This study presents a unique insight into the views of the AAC community on the benefits and risks of incorporating AI into AAC systems. The views of the community on the need for a Code of Practice may support how the field moves forward with this complex technology.</p

Predictive Composition of Pictogram Messages for Users with Autism.

Communication is a basic need for every person. However, there are many people who present disabilities that prevent communication through natural language. Augmentative and alternative communication (AAC) systems, including those based on pictograms, attempt to facilitate the communication for people with this kind of difficulties. In this paper we present PictoEditor, an augmentative and alternative communication application for the composition of pictogram messages for users with autism that incorporates prediction functionalities. Although such functionalities have been widely studied in text-based augmentative and alternative communication tools, they have not been applied to pictogram based ones. The results show that prediction based on frequency of use of specific pictograms improves the immediate availability of the desired pictograms, but the improvement with prediction based on sequencing of pseudo-syntactic types of pictogram is not as clear.pre-print4500 K

Usable Interface Design for Everyone

En el diseño de "interfaces para todo el mundo" para los sistemas interactivos, es importante tener en cuenta factores como el costo, el mercado de destino, el estado del medio ambiente,etc. Los interfaces de usuario son fundamentales para el proceso de desarrollo de cualquier aplicación, y su diseño debe estar contemplado desde el principio. De las distintas partes de un sistema (hardware y software), es la interfaz el sistema que permite al usuario el acceso a los recursos informáticos. Los siete principios del "Diseño Universal" o "Diseño para Todos" se centran en un diseño utilizable universal, pero al mismo tiempo reconocer la influencia de factores internos y externos. Los cambios estructurales en los servicios sociales y de salud podrían proporcionar un aumento en el bienestar de los ciudadanos de un país a través del uso de la programación de auto-cuidado y la gestión proactiva / prevención de la enfermedad. Plataformas automatizadas en el hogar pueden actuar como un instrumento que permitan a los usuarios evitar, compensar, mitigar o neutralizar las deficiencias y las dependencias causada por el envejecimiento.When designing “interfaces for everyone” for interactive systems, it is important to consider factors such as cost, the intended market, the state of the environment, etc. User interfaces are fundamental for the developmental process in any application, and its design must be contemplated from the start. Of the distinct parts of a system (hardware and software), it is the interface that permits the user access to computer resources. The seven principles of “Universal Design” or “Design for Everyone” focus on a universal usable design, but at the same time acknowledge the influences of internal and external factors. Structural changes in social and health services could provide an increase in the well-being of a country’s citizens through the use of self-care programming and proactive management/prevention of disease. Automated home platforms can act as an accessibility instrument which permits users to avoid, compensate, mitigate, or neutralize the deficiencies and dependencies caused by living alon

Interaction with smart assistants using alternative and augmentative communication

Smart assistants utilize speech recognition, sensing, artificial intelligence, and networking technologies to enable improved human-machine interaction. However, there remain use cases where smart assistants are not easily usable by humans. For example, voice-activated assistants are not accessible to those that are hearing or speech impaired. Touchscreen based assistants are not usable by those who lack fine motor skills and/or reading ability. This disclosure adds to the modalities by which humans can control and communicate with smart assistants by enabling use of physical objects, facial expressions, gross motor skills, body movements, etc. to provide commands. Collectively, these techniques of control and communication are referred to as alternative and augmentative communication (AAC)