Computer Entertainment Technologies for the Visually Impaired: An Overview

Over the last years, works related to accessible technologies have increased both in number and in quality. This work presents a series of articles which explore different trends in the field of accessible video games for the blind or visually impaired. Reviewed articles are distributed in four categories covering the following subjects: (1) video game design and architecture, (2) video game adaptations, (3) accessible games as learning tools or treatments and (4) navigation and interaction in virtual environments. Current trends in accessible game design are also analysed, and data is presented regarding keyword use and thematic evolution over time. As a conclusion, a relative stagnation in the field of human-computer interaction for the blind is detected. However, as the video game industry is becoming increasingly interested in accessibility, new research opportunities are starting to appear

From corporeality to virtual reality: theorizing literacy, bodies, and technology in the emerging media of virtual, augmented, and mixed realities

This dissertation explores the relationships between literacy, technology, and bodies in the emerging media of Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR). In response to the recent, rapid emergence of new media forms, questions arise as to how and why we should prepare to compose in new digital media. To interrogate the newness accorded to new media composing, I historicize the literacy practices demanded by new media by examining digital texts, such as video games and software applications, alongside analogous “antiquated” media, such as dioramas and museum exhibits. Comparative textual analysis of analogous digital and non-digital VR, AR, and MR texts reveals new media and “antiquated” media utilize common characteristics of dimensionality, layering, and absence/presence, respectively. The establishment of shared traits demonstrates how media operate on a continuum of mutually held textual practices; despite their distinctive forms, new media texts do not represent either a hierarchical or linear progression of maturing development. Such an understanding aids composing in new VR, AR, and MR media by enabling composers to make fuller use of prior knowledge in a rapidly evolving new media environment, a finding significant both for educators and communicators. As these technologies mature, we will continue to compose both traditional and new forms of texts. As such, we need literacy theory that attends to both the traditional and the new and also is comprehensive enough to encompass future acts of composing in media yet to emerge

Enabling audio-haptics

This thesis deals with possible solutions to facilitate orientation, navigation and overview of non-visual interfaces and virtual environments with the help of sound in combination with force-feedback haptics. Applications with haptic force-feedback, s

Psyche as a Playable Construct in Video Games

The aim of this master’s thesis called Psyche as a Playable Construct in Video Games is to explore how the human mind is reflected in video games and how thus the psyche becomes a playable environment. This study also analyzes whether video games as a medium can promote self-reflection and empathy by portraying the psyche and developing narratives around this theme. These set objectives are achieved by performing medium-specific multimodal discourse analysis of three case studies, as well as comparative game analysis. The purpose is to discover how the psyche nowadays becomes an accessible, interactive, and embodied virtual environment through various modern modes of expression. In addition to the topic of the psyche as a game setting the research also looks at the reflection of the psyche in the theories of psychoanalysts, the principles of creating playable virtual spaces and mental landscapes, and the unique manner of video games in representing phenomena. This thesis includes a review of relevant scholarship into game studies, psychoanalysis and multimodal discourse, as well as an examination of three video games of different scales and genres, all of which render the human psyche psyche a playable construct: Nevermind (2015), When the Darkness comes (2019) and Psychonauts 2 (2021). By showing distinctive approaches to representing the psyche and interaction with it, this research highlights the enormous potential of video games to offer their users experiences that cannot be delivered through any other channel. As well, my thesis demonstrates how game design reflects scientific discoveries about the psyche to the present day: as independent but influenceable; chaotic and multi-layered but deterministic. It also proposes future research suggestions in this context on how likely are games set in the human mind to promote compassion, empathy, and self-analysis in a wide audience.Master's Thesis in Digital CultureDIKULT350MAHF-DIKU

Abstracts: HASTAC 2017: The Possible Worlds of Digital Humanities

The document contains abstracts for HASTAC 2017

Exploring asymmetric roles in mixed-ability gaming

Tese de mestrado, Informática, Universidade de Lisboa, Faculdade de Ciências, 2020Noticeably, the majority of mainstreamgames — digitalgames and tabletopgames — are still designed for players with a standard set of abilities. As such, people with someformof disability, oftenface insurmountable challengestoplay mainstreamgames or are limited to playgames specifcally designed for them. By conducting an initial study, we share multiplayer gaming experiences of people with visual impairments collected from interviews with 10 adults and 10 minors, and 140 responses to an online survey. We include the perspectives of 17 sighted people who play with someone who has a visual impairment, collected in a second online survey. We found that people with visual impairments are playingdiversegames,butface limitationsin playing with others who have different visual abilities. What stood out is the lack of intersection ingaming opportunities, and consequently, in habits and interests of people with different visual abilities. In this study, we highlight barriers associated with these experiences beyond inaccessibility issues and discuss implications and opportunities for the design of mixed-abilitygaming.Asexpected,we foundaworrying absenceofgames that caterto different abilities. In this context, we explored ability-based asymmetric roles as a design approach to create engaging and challenging mixed-ability play. We designed and developed two collaborative testbedgamesexploring asymmetric interdependent roles. In a remote study with 13 mixed-visual-ability pairs we assessed how roles affected perceptions of engagement, competence, and autonomy, using a mixed-methods approach. The games provided an engaging and challenging experience, in which differences in visual ability were not limiting. Our results underline how experiences unequal by design can give rise to an equitable joint experience

Investigando Natural User Interfaces (NUIs) : tecnologias e interação em contexto de acessibilidade

Orientador: Maria Cecília Calani BaranauskasTese (doutorado) - Universidade Estadual de Campinas, Instituto de ComputaçãoResumo: Natural User Interfaces (NUIs) representam um novo paradigma de interação, com a promessa de ser mais intuitivo e fácil de usar do que seu antecessor, que utiliza mouse e teclado. Em um contexto no qual as tecnologias estão cada vez mais invisíveis e pervasivas, não só a quantidade mas também a diversidade de pessoas que participam deste contexto é crescente. Nesse caso, é preciso estudar como esse novo paradigma de interação de fato consegue ser acessível a todas as pessoas que podem utilizá-lo no dia-a-dia. Ademais, é preciso também caracterizar o paradigma em si, para entender o que o torna, de fato, natural. Portanto, nesta tese apresentamos o caminho que percorremos em busca dessas duas respostas: como caracterizar NUIs, no atual contexto tecnológico, e como tornar NUIs acessíveis para todos. Para tanto, primeiro apresentamos uma revisão sistemática de literatura com o estado da arte. Depois, mostramos um conjunto de heurísticas para o design e a avaliação de NUIs, que foram aplicadas em estudos de caso práticos. Em seguida, estruturamos as ideias desta pesquisa dentro dos artefatos da Semiótica Organizacional, e obtivemos esclarecimentos sobre como fazer o design de NUIs com Acessibilidade, seja por meio de Design Universal, seja para propor Tecnologias Assistivas. Depois, apresentamos três estudos de caso com sistemas NUI cujo design foi feito por nós. A partir desses estudos de caso, expandimos nosso referencial teórico e conseguimos, por fim, encontrar três elementos que resumem a nossa caracterização de NUI: diferenças, affordances e enaçãoAbstract: Natural User Interfaces (NUIs) represent a new interaction paradigm, with the promise of being more intuitive and easy to use than its predecessor, that utilizes mouse and keyboard. In a context where technology is becoming each time more invisible and pervasive, not only the amount but also the diversity of people who participate in this context is increasing. In this case, it must be studied how this new interaction paradigm can, in fact, be accessible to all the people who may use it on their daily routine. Furthermore, it is also necessary to characterize the paradigm itself, to understand what makes it, in fact, natural. Therefore, in this thesis we present the path we took in search of these two answers: how to characterize NUIs in the current technological context, and how to make NUIs accessible to all. To do so, first we present a systematic literature review with the state of the art. Then, we show a set of heuristics for the design and evaluation of NUIs, which were applied in practical study cases. Afterwards, we structure the ideas of this research into the Organizational Semiotics artifacts, and we obtain insights into how to design NUIs with Accessibility, be it through Universal Design, be it to propose Assistive Technologies. Then, we present three case studies with NUI systems which we designed. From these case studies, we expanded our theoretical references were able to, finally, find three elements that sum up our characterization of NUI: differences, affordances and enactionDoutoradoCiência da ComputaçãoDoutora em Ciência da Computação160911/2015-0CAPESCNP

Virtual Reality for the Visually Impaired

This thesis aims to illuminate and describe how there are problems with the development of virtual reality regarding visually impaired people. After discussing the reasons how and why this is a problem, this thesis will provide some possible solutions to develop virtual reality into a more user accessible technology, specifically for the visually impaired. As the popularity of virtual reality increases in digital culture, especially with Facebook announcing their development of Metaverse, there is a need for a future virtual reality environment that everyone can use. And it is in these early stages of development, that the need to address the problem of inaccessibility arises. As virtual reality is a relatively new medium in digital culture, the research on its use by visually impaired people has significant gaps. And as relatively few researchers are exploring this topic, my research will hopefully lead to more activity in this important area. Therefore, my research questions aim to address the current limitations of virtual reality, filling in some of the most significant gaps in this research area. My thesis will do this by conducting interviews and surveys to gather data that can further support and identify the crucial limitations of the visually impaired experience while trying to use virtual reality technology. The findings in this thesis will further address the problem, creating a possible solution and emphasizing the importance of user accessibility for the visually impaired in the future development of virtual reality. If digital companies and developers address this problem now, we can have a future where visually impaired people are treated more equally, with technologies developed specifically for them to experience virtual worlds.Master's Thesis in Digital CultureDIKULT350MAHF-DIKU

Users' performance of accessible sound-only computer games

This work is conducted at two levels to meet the requirements of this research. The first objective is to develop a better understanding of how to design better sound-only games for a wide range of users. A new theoretical framework has been crafted to achieve this objective (Human Understanding Theory of Novel Games with Simplex, or the HUNGS theory). Such a theory aims to capture the current consensus about user requirements (as far as it is possible to do so) whilst understanding the principles and practices of interactive systems, namely the design of accessible sound-only games. The second objective is to understand better the psychology of intended users of such games. The importance of the present work is to test psychological concepts in the very different and very popular context of computer games. Implications found for users at work or working on serious tasks may not generalize to game players. To achieve the second requirement, a number of existing games were explored before a new game was designed (namely the Totally Lost game), using a range of methods. The Totally Lost game and different versions of the same game have been designed and evaluated based on user experiences