Accessibility of Health Data Representations for Older Adults: Challenges and Opportunities for Design

Health data of consumer off-the-shelf wearable devices is often conveyed to users through visual data representations and analyses. However, this is not always accessible to people with disabilities or older people due to low vision, cognitive impairments or literacy issues. Due to trade-offs between aesthetics predominance or information overload, real-time user feedback may not be conveyed easily from sensor devices through visual cues like graphs and texts. These difficulties may hinder critical data understanding. Additional auditory and tactile feedback can also provide immediate and accessible cues from these wearable devices, but it is necessary to understand existing data representation limitations initially. To avoid higher cognitive and visual overload, auditory and haptic cues can be designed to complement, replace or reinforce visual cues. In this paper, we outline the challenges in existing data representation and the necessary evidence to enhance the accessibility of health information from personal sensing devices used to monitor health parameters such as blood pressure, sleep, activity, heart rate and more. By creating innovative and inclusive user feedback, users will likely want to engage and interact with new devices and their own data

MaLT - combined motor and language therapy tool for brain injury patients using Kinect

Background: The functional connectivity and structural proximity of elements of the language and motor systems result in frequent co-morbidity post brain injury. Although rehabilitation services are becoming increasingly multidisciplinary and "integrated", treatment for language and motor functions often occurs in isolation. Thus, behavioural therapies which promote neural reorganisation do not reflect the high intersystem connectivity of the neurologically intact brain. As such, there is a pressing need for rehabilitation tools which better reflect and target the impaired cognitive networks. Objectives: The objective of this research is to develop a combined high dosage therapy tool for language and motor rehabilitation. The rehabilitation therapy tool developed, MaLT (Motor and Language Therapy), comprises a suite of computer games targeting both language and motor therapy that use the Kinect sensor as an interaction device. The games developed are intended for use in the home environment over prolonged periods of time. In order to track patients' engagement with the games and their rehabilitation progress, the game records patient performance data for the therapist to interrogate. Methods: MaLT incorporates Kinect-based games, a database of objects and language parameters, and a reporting tool for therapists. Games have been developed that target four major language therapy tasks involving single word comprehension, initial phoneme identification, rhyme identification and a naming task. These tasks have 8 levels each increasing in difficulty. A database of 750 objects is used to programmatically generate appropriate questions for the game, providing both targeted therapy and unique gameplay every time. The design of the games has been informed by therapists and by discussions with a Public Patient Involvement (PPI) group. Results: Pilot MaLT trials have been conducted with three stroke survivors for the duration of 6 to 8 weeks. Patients' performance is monitored through MaLT's reporting facility presented as graphs plotted from patient game data. Performance indicators include reaction time, accuracy, number of incorrect responses and hand use. The resultant games have also been tested by the PPI with a positive response and further suggestions for future modifications made. Conclusion: MaLT provides a tool that innovatively combines motor and language therapy for high dosage rehabilitation in the home. It has demonstrated that motion sensor technology can be successfully combined with a language therapy task to target both upper limb and linguistic impairment in patients following brain injury. The initial studies on stroke survivors have demonstrated that the combined therapy approach is viable and the outputs of this study will inform planned larger scale future trials

XR Academia:Research and Experiences in Virtual Reality, Augmented Reality, Mixed Reality, and Artificial Intelligence in Latin America and Europe

The book XR Academia: Research and Experiences in Virtual Reality, Augmented Reality, Mixed Reality, and Artificial Intelligence in Latin America and Europe, has at its core the objective of making immersive technology accessible and visible worldwide, with the simultaneous breaking-down of linguistic barriers. Both European and Latin American authors can read each other’s work(s), allowing knowledge and experience in extended reality to be shared. Another important aspect of XR Academia is its attempt to introduce an open science contribution to the issues of immersive technologies, in order to inspire new generations that do not have access to increasingly expensive publications. This volume includes fourteen selected chapters from presenters from the 2020 and 2021 events. These chapters describe research and experiences on a wide range of XR applications, which include entertainment, health, narration, education, psychotherapy, guidance, language, culture and arts. Considering that great inventions and innovations are developed in Latin America but fail to be published internationally, our aim was to open a door to allow the permanent exchange between two languages: Spanish and English

Virtual Reality pitch ranking in children with cochlear implants, hearing aids or normal hearing

Available online 5 August 2022When listening to music, one uses the hearing to identify all musical elements such as pitches, musical intervals, melodies, chords, rhythms, and timbre [1]. To determine the notes in a melody, it is critical to have the ability to distinguish and recognize musical pitches and their relationships. Subtle pitch changes play an important role in music perception, and major chords and harmonies, which may signal positive emotions, differ by one semitone from minor chords and harmonies which may signal negative emotions [2,3]. The pitch contour of a melody – its pattern of changes in pitch direction i.e. up or down, is perceptually noticeable for children with normal hearing (NH) and 5-year-old children can successfully identify, in other words pitch rank, upward and downward shifts of 4, 2, 1, 0.5, and 0.3 semitones i.e. a note not being on pitch, and these abilities improve from 5 to 8 years of age at which point they reach adult levels. The accuracy of pitch ranking decreases as the size of the shift i.e. number of semitones decreasesThis work was supported by the William Demant Foundation Ph.D. scholarship

GIVE-ME: Gamification In Virtual Environments for Multimodal Evaluation - A Framework

In the last few decades, a variety of assistive technologies (AT) have been developed to improve the quality of life of visually impaired people. These include providing an independent means of travel and thus better access to education and places of work. There is, however, no metric for comparing and benchmarking these technologies, especially multimodal systems. In this dissertation, we propose GIVE-ME: Gamification In Virtual Environments for Multimodal Evaluation, a framework which allows for developers and consumers to assess their technologies in a functional and objective manner. This framework is based on three foundations: multimodality, gamification, and virtual reality. It facilitates fuller and more controlled data collection, rapid prototyping and testing of multimodal ATs, benchmarking heterogeneous ATs, and conversion of these evaluation tools into simulation or training tools. Our contributions include: (1) a unified evaluation framework: via developing an evaluative approach for multimodal visual ATs; (2) a sustainable evaluation: by employing virtual environments and gamification techniques to create engaging games for users, while collecting experimental data for analysis; (3) a novel psychophysics evaluation: enabling researchers to conduct psychophysics evaluation despite the experiment being a navigational task; and (4) a novel collaborative environment: enabling developers to rapid prototype and test their ATs with users in an early stakeholder involvement that fosters communication between developers and users. This dissertation first provides a background in assistive technologies and motivation for the framework. This is followed by detailed description of the GIVE-ME Framework, with particular attention to its user interfaces, foundations, and components. Then four applications are presented that describe how the framework is applied. Results and discussions are also presented for each application. Finally, both conclusions and a few directions for future work are presented in the last chapter

VR Exergames for ocular diseases diagnosis

According to the World Health Organization, in 2011 there were about 314 million people with impaired vision, due either to ocular diseases or uncorrected ocular errors. Around 45 million people, of these 314 million, are blind. About 75% of all blindness and visual impairment cases caused by these diseases are avoidable. There are already some practical and relatively cheap tools to make this diagnosis, but all of them are intrusive, which doesn’t make them too attractive. To solve this issue, we thought of a non-intrusive way to diagnose eye problems. So we created a Virtual Reality exergame, EyeCare, that tests users’ vision, while they are having fun playing it. This exergame is meant to be played by teenagers and young adults, using only a smartphone and Virtual Reality visor. EyeCare consists in a game where users have to complete several puzzles to escape the forest. The users play the puzzles to assess their astigmatism, contrast sensitivity, color blindness, and peripheral vision. In the end, the results are given to the users as problems that they may have. With this solution, our goal is to diagnose diseases early enough, so they can be monitored, and thus reducing the number of people with impaired vision and blindness