Assessing real world imagery in virtual environments for people with cognitive disabilities

People with cognitive disabilities are often socially excluded. We propose a system based on Virtual and Augmented Reality that has the potential to act as an educational and support tool in everyday tasks for people with cognitive disabilities. Our solution consists of two components: the first that enables users to train for several essential quotidian activities and the second that is meant to offer real time guidance feedback for immediate support. In order to illustrate the functionality of our proposed system, we chose to train and support navigation skills. Thus, we conducted a preliminary study on people with Down Syndrome (DS) based on a navigation task. Our experiment was aimed at evaluating the visual and spatial perception of people with DS when interacting with different elements of our system. We provide a preliminary evaluation that illustrates how people with DS perceive different landmarks and types of visual feedback, in static images and videos. Although we focused our study on people with DS, people with different cognitive disabilities could also benefit from the features of our solution. This analysis is mandatory in the design of a virtual intelligent system with several functionalities that aims at helping disabled people in developing basic knowledge in every day tasks

Assessing real world imagery in virtual environments for people with cognitive disabilities

People with cognitive disabilities are often socially excluded. We propose a system based on Virtual and Augmented Reality that has the potential to act as an educational and support tool in everyday tasks for people with cognitive disabilities. Our solution consists of two components: the first that enables users to train for several essential quotidian activities and the second that is meant to offer real time guidance feedback for immediate support. In order to illustrate the functionality of our proposed system, we chose to train and support navigation skills. Thus, we conducted a preliminary study on people with Down Syndrome (DS) based on a navigation task. Our experiment was aimed at evaluating the visual and spatial perception of people with DS when interacting with different elements of our system. We provide a preliminary evaluation that illustrates how people with DS perceive different landmarks and types of visual feedback, in static images and videos. Although we focused our study on people with DS, people with different cognitive disabilities could also benefit from the features of our solution. This analysis is mandatory in the design of a virtual intelligent system with several functionalities that aims at helping disabled people in developing basic knowledge in every day tasks

Combining brain-computer interfaces and assistive technologies: state-of-the-art and challenges

In recent years, new research has brought the field of EEG-based Brain-Computer Interfacing (BCI) out of its infancy and into a phase of relative maturity through many demonstrated prototypes such as brain-controlled wheelchairs, keyboards, and computer games. With this proof-of-concept phase in the past, the time is now ripe to focus on the development of practical BCI technologies that can be brought out of the lab and into real-world applications. In particular, we focus on the prospect of improving the lives of countless disabled individuals through a combination of BCI technology with existing assistive technologies (AT). In pursuit of more practical BCIs for use outside of the lab, in this paper, we identify four application areas where disabled individuals could greatly benefit from advancements in BCI technology, namely,“Communication and Control”, “Motor Substitution”, “Entertainment”, and “Motor Recovery”. We review the current state of the art and possible future developments, while discussing the main research issues in these four areas. In particular, we expect the most progress in the development of technologies such as hybrid BCI architectures, user-machine adaptation algorithms, the exploitation of users’ mental states for BCI reliability and confidence measures, the incorporation of principles in human-computer interaction (HCI) to improve BCI usability, and the development of novel BCI technology including better EEG devices

Differentiation of the Causal Characteristics and Influences of Virtual Reality and the Effects on Learning at a Science Exhibit

Within the context of the informal science center, exhibits are the main interface for public learning. Essential to the success of a science center is how well exhibits model effective strategies for learning. Virtual Reality (VR) technology with its flexible, adaptive, multimedia, and immersive-learning capabilities is emerging for use by science centers in exhibits; however, research on learning in virtual environments at exhibits is scarce. To support the future development of VR science exhibits it is critical to investigate VR\u27s pedagogical value and effects on science learning. Research investigated the Smoke & Mirrors VR exhibit at the Reuben H. Fleet Science Center in San Diego, California. Inquiry focused on the interplay between elements of the exhibit\u27s design, assessing the separate and interactive effects of visual imagery, moving images, sound, narration, and interactive tools to differentiate the causal characteristics and influences that enhanced and detracted from learning. Case study methodology was employed utilizing visitor observations and interviews with 14 participants. Findings indicated that realistic visual elements with text were the primary sources of content learning; however, positive results were limited to only a few participants. High cognitive load due to interactive tools; instructional design; and movement of visual images were found to be significant detracting characteristics of participant learning. Other characteristics and influences of VR were also found that directly effected learning. Research results will inform the forthcoming design of a new VR exhibit at the Reuben H. Fleet Science Center and to the design and development of future VR exhibits at informal science centers. A prior brief mixed-methods evaluation of Smoke & Mirrors was conducted in 2003, contributing background to the study and its future implications and strategies

Integration of Assistive Technologies into 3D Simulations: Exploratory Studies

Virtual worlds and environments have many purposes, ranging from games to scientific research. However, universal accessibility features in such virtual environments are limited. As the impairment prevalence rate increases yearly, so does the research interests in the field of assistive technologies. This work introduces research in assistive technologies and presents three software developments that explore the integration of assistive technologies within virtual environments, with a strong focus on Brain-Computer Interfaces. An accessible gaming system, a hands-free navigation software system, and a Brain-Computer Interaction plugin have been developed to study the capabilities of accessibility features within virtual 3D environments. Details of the specification, design, and implementation of these software applications are presented in the thesis. Observations and preliminary results as well as directions of future work are also included

3D assistive technologies and advantageous themes for collaboration and blended learning of users with disabilities

The significance of newly emergent 3D virtual worlds to different genres of users is currently a controversial subject in deliberation. Users range from education pursuers, business contenders, and social seekers to technology enhancers and many more who comprise both users with normal abilities in physical life and those with different disabilities. This study aims to derive and critically analyze, using grounded theory, advantageous and disadvantageous themes and their sub concepts of providing elearning through 3D Virtual Learning Environments (VLEs), like Second Life, to disabled users; hence providing evidence that 3DVLEs not only support traditional physical learning, but also offer e-learning opportunities unavailable through 2D VLEs (like moodle, blackboard), and offer learning opportunities unavailable through traditional physical education. Furthermore, to achieve full potential from the above mentioned derived concepts, architectural and accessibility design requirements of 3D educational facilities proposed by different categories of disabled students to accommodate for their needs, are demonstrated

BCI controlled robotic arm as assistance to the rehabilitation of neurologically disabled patients

This presentation summarises the development of a portable and cost-efficient BCI controlled assistive technology using a non-invasive BCI headset 'OpenBCI' and an open source robotic arm, U-Arm, to accomplish tasks related to rehabilitation, such as access to resources, adaptability or home use. The resulting system used a combination of EEG and EMG sensor readings to control the arm, which could perform a number of different tasks such as picking/placing objects or assist users in eating