Mobile assistive technologies for the visually impaired

There are around 285 million visually impaired people worldwide, and around 370,000 people are registered as blind or partially sighted in the UK. Ongoing advances in information technology (IT) are increasing the scope for IT-based mobile assistive technologies to facilitate the independence, safety, and improved quality of life of the visually impaired. Research is being directed at making mobile phones and other handheld devices accessible via our haptic (touch) and audio sensory channels. We review research and innovation within the field of mobile assistive technology for the visually impaired and, in so doing, highlight the need for successful collaboration between clinical expertise, computer science, and domain users to realize fully the potential benefits of such technologies. We initially reflect on research that has been conducted to make mobile phones more accessible to people with vision loss. We then discuss innovative assistive applications designed for the visually impaired that are either delivered via mainstream devices and can be used while in motion (e.g., mobile phones) or are embedded within an environment that may be in motion (e.g., public transport) or within which the user may be in motion (e.g., smart homes)

Literature Review: Orientation and Mobility Assistive Technology for Students with Visual Impairment

The development of increasingly sophisticated technology is accompanied by the discovery of new assistive devices that should be accessible to all people, including the blind in order to maintain or improve functions so as to improve welfare. This study uses a literature review method with descriptive analysis by analyzing 20 articles. The purpose of this research is to examine more related to assistive technology for the blind in navigating indoors and outdoors including buildings and the accessibility of public services. The literature search was carried out through an electronic search for publications from ERIC, Researchgate, Spingerlink, Sage, Science Direct, Google Scholar and IEEE Xplore. The results of the study describe the use of various assistive technologies for the visually impaired related to navigation in spaces or buildings and even the wider environment as well as public services that are commonly accessed by the public. Furthermore, it is related to the existence of a brief description of the assistive technology developed and the benefits of the results of the development for users

Neuroplasticity in visual impairments

The visual acuity loss enables the brain to access new pathways in the quest to overcome the visual limitation and this is wellknown as neuroplasticity which have mechanisms to cortical reorganization. In this review, we related the evidences about the neuroplasticity as well as cortical anatomical differences and functional repercussions in visual impairments. We performed a systematic review of PUBMED database, without date or status publication restrictions. The findings demonstrate that the visual impairment produce a compensatory sensorial effect, in which non-visual areas are related to both cross (visual congenital) and multimodal (late blind) neuroplasticity

Multi-Sensory Interaction for Blind and Visually Impaired People

This book conveyed the visual elements of artwork to the visually impaired through various sensory elements to open a new perspective for appreciating visual artwork. In addition, the technique of expressing a color code by integrating patterns, temperatures, scents, music, and vibrations was explored, and future research topics were presented. A holistic experience using multi-sensory interaction acquired by people with visual impairment was provided to convey the meaning and contents of the work through rich multi-sensory appreciation. A method that allows people with visual impairments to engage in artwork using a variety of senses, including touch, temperature, tactile pattern, and sound, helps them to appreciate artwork at a deeper level than can be achieved with hearing or touch alone. The development of such art appreciation aids for the visually impaired will ultimately improve their cultural enjoyment and strengthen their access to culture and the arts. The development of this new concept aids ultimately expands opportunities for the non-visually impaired as well as the visually impaired to enjoy works of art and breaks down the boundaries between the disabled and the non-disabled in the field of culture and arts through continuous efforts to enhance accessibility. In addition, the developed multi-sensory expression and delivery tool can be used as an educational tool to increase product and artwork accessibility and usability through multi-modal interaction. Training the multi-sensory experiences introduced in this book may lead to more vivid visual imageries or seeing with the mind’s eye

A Haptic Study to Inclusively Aid Teaching and Learning in the Discipline of Design

Designers are known to use a blend of manual and virtual processes to produce design prototype solutions. For modern designers, computer-aided design (CAD) tools are an essential requirement to begin to develop design concept solutions. CAD, together with augmented reality (AR) systems have altered the face of design practice, as witnessed by the way a designer can now change a 3D concept shape, form, color, pattern, and texture of a product by the click of a button in minutes, rather than the classic approach to labor on a physical model in the studio for hours. However, often CAD can limit a designer’s experience of being ‘hands-on’ with materials and processes. The rise of machine haptic1 (MH) tools have afforded a great potential for designers to feel more ‘hands-on’ with the virtual modeling processes. Through the use of MH, product designers are able to control, virtually sculpt, and manipulate virtual 3D objects on-screen. Design practitioners are well placed to make use of haptics, to augment 3D concept creation which is traditionally a highly tactile process. For similar reasoning, it could also be said that, non-sighted and visually impaired (NS, VI) communities could also benefit from using MH tools to increase touch-based interactions, thereby creating better access for NS, VI designers. In spite of this the use of MH within the design industry (specifically product design), or for use by the non-sighted community is still in its infancy. Therefore the full benefit of haptics to aid non-sighted designers has not yet been fully realised. This thesis empirically investigates the use of multimodal MH as a step closer to improving the virtual hands-on process, for the benefit of NS, VI and fully sighted (FS) Designer-Makers. This thesis comprises four experiments, embedded within four case studies (CS1-4). Case study 1and2 worked with self-employed NS, VI Art Makers at Henshaws College for the Blind and Visual Impaired. The study examined the effects of haptics on NS, VI users, evaluations of experience. Case study 3 and4, featuring experiments 3 and4, have been designed to examine the effects of haptics on distance learning design students at the Open University. The empirical results from all four case studies showed that NS, VI users were able to navigate and perceive virtual objects via the force from the haptically rendered objects on-screen. Moreover, they were assisted by the whole multimodal MH assistance, which in CS2 appeared to offer better assistance to NS versus FS participants. In CS3 and 4 MH and multimodal assistance afforded equal assistance to NS, VI, and FS, but haptics were not as successful in bettering the time results recorded in manual (M) haptic conditions. However, the collision data between M and MH showed little statistical difference. The thesis showed that multimodal MH systems, specifically used in kinesthetic mode have enabled human (non-disabled and disabled) to credibly judge objects within the virtual realm. It also shows that multimodal augmented tooling can improve the interaction and afford better access to the graphical user interface for a wider body of users

Fruit scent and observer colour vision shape food-selection strategies in wild capuchin monkeys

The senses play critical roles in helping animals evaluate foods, including fruits that can change both in colour and scent during ripening to attract frugivores. Although numerous studies have assessed the impact of colour on fruit selection, comparatively little is known about fruit scent and how olfactory and visual data are integrated during foraging. We combine 25 months of behavioural data on 75 wild, white-faced capuchins (Cebus imitator) with measurements of fruit colours and scents from 18 dietary plant species. We show that frequency of fruit-directed olfactory behaviour is positively correlated with increases in the volume of fruit odours produced during ripening. Monkeys with red-green colour blindness sniffed fruits more often, indicating that increased reliance on olfaction is a behavioural strategy that mitigates decreased capacity to detect red-green colour contrast. These results demonstrate a complex interaction among fruit traits, sensory capacities and foraging strategies, which help explain variation in primate behaviour.https://www.nature.com/articles/s41467-019-10250-9Published versio

A Wrinkle in Autism Literature: An Analysis of Madeleine L’Engle’s A Wrinkle in Time and Hope Larson’s A Wrinkle in Time: The Graphic Novel

This literature review will examine Madeleine L’Engle’s classic intermediate novel A Wrinkle in Time, and Hope Larson’s A Wrinkle in Time: The Graphic Novel. Medical scholarship regarding autism, comics scholarship, and comments from online contributors are used to describe how a comparison of these two texts can provide positive representation of autism in literature. Consideration for how these texts can be used together in the Language Arts classroom to develop the comprehension skills of students on the spectrum is also considered. This thesis first examines the character Charles Wallace in L’Engle’s original text and how he represents a positive presentation of an autistic character. Next, the comic conventions in Larson’s adaptation are examined and used to show how these two texts can be used together to address common comprehension challenges ASD students face when reading narrative texts

Pictures in Your Mind: Using Interactive Gesture-Controlled Reliefs to Explore Art

Tactile reliefs offer many benefits over the more classic raised line drawings or tactile diagrams, as depth, 3D shape, and surface textures are directly perceivable. Although often created for blind and visually impaired (BVI) people, a wider range of people may benefit from such multimodal material. However, some reliefs are still difficult to understand without proper guidance or accompanying verbal descriptions, hindering autonomous exploration. In this work, we present a gesture-controlled interactive audio guide (IAG) based on recent low-cost depth cameras that can be operated directly with the hands on relief surfaces during tactile exploration. The interactively explorable, location-dependent verbal and captioned descriptions promise rapid tactile accessibility to 2.5D spatial information in a home or education setting, to online resources, or as a kiosk installation at public places. We present a working prototype, discuss design decisions, and present the results of two evaluation studies: the first with 13 BVI test users and the second follow-up study with 14 test users across a wide range of people with differences and difficulties associated with perception, memory, cognition, and communication. The participant-led research method of this latter study prompted new, significant and innovative developments