An investigation into gaze-based interaction techniques for people with motor impairments

The use of eye movements to interact with computers offers opportunities for people with impaired motor ability to overcome the difficulties they often face using hand-held input devices. Computer games have become a major form of entertainment, and also provide opportunities for social interaction in multi-player environments. Games are also being used increasingly in education to motivate and engage young people. It is important that young people with motor impairments are able to benefit from, and enjoy, them. This thesis describes a program of research conducted over a 20-year period starting in the early 1990's that has investigated interaction techniques based on gaze position intended for use by people with motor impairments. The work investigates how to make standard software applications accessible by gaze, so that no particular modification to the application is needed. The work divides into 3 phases. In the first phase, ways of using gaze to interact with the graphical user interfaces of office applications were investigated, designed around the limitations of gaze interaction. Of these, overcoming the inherent inaccuracies of pointing by gaze at on-screen targets was particularly important. In the second phase, the focus shifted from office applications towards immersive games and on-line virtual worlds. Different means of using gaze position and patterns of eye movements, or gaze gestures, to issue commands were studied. Most of the testing and evaluation studies in this, like the first, used participants without motor-impairments. The third phase of the work then studied the applicability of the research findings thus far to groups of people with motor impairments, and in particular,the means of adapting the interaction techniques to individual abilities. In summary, the research has shown that collections of specialised gaze-based interaction techniques can be built as an effective means of completing the tasks in specific types of games and how these can be adapted to the differing abilities of individuals with motor impairments

An Arm-Mounted Accelerometer and Gyro-Based 3D Control System

This thesis examines the performance of a wearable accelerometer/gyroscope-based system for capturing arm motions in 3D. Two experiments conforming to ISO 9241-9 specifications for non-keyboard input devices were performed. The first, modeled after the Fitts' law paradigm described in ISO 9241-9, utilized the wearable system to control a telemanipulator compared with joystick control and the user's arm. The throughputs were 5.54 bits/s, 0.74 bits/s and 0.80 bits/s, respectively. The second experiment utilized the wearable system to control a cursor in a 3D fish-tank virtual reality setup. The participants performed a 3D Fitts' law task with three selection methods: button clicks, dwell, and a twist gesture. Error rates were 6.82 %, 0.00% and 3.59 % respectively. Throughput ranged from 0.8 to 1.0 bits/s. The thesis includes detailed analyses on lag and other issues that present user interface challenges for systems that employ human-mounted sensor inputs to control a telemanipulator apparatus

Moving out from the focus:Exploring gaze interaction design in games

Eye trackers have become an aordable and compelling input device for game interaction that is targeting the PC gaming community. The number of games adopting gaze input for in-game interaction has rapidly increased over the years with examples in mainstream game franchises. However, games have focused on integrating gaze input on top of fully functional games, utilising gaze as a pointing device and a tool for eciency; e.g. for the faster selection of game objects the player looks at to improve their performance. We deem this is limiting because the use of gaze is obvious, it does not harvest the full potential and richness of the eyes, and only considers that players look at game elements to interact with them. Accordingly, this thesis investigates new opportunities for gaze in games by exploring gaze concepts that challenge the interaction metaphor "what you look at is what you get" to propose adopting "not looking" gaze interactions that reflect what we can do with our eyes. Three playful concepts stem out from this principle: (1) playing with tension; (2) playing with peripheral vision; and (3) playing without looking. We operationalise each concept with game prototypes that pose different challenges based on visual attention, perception in the wider visual eld, and the ability to move the eyes with the eyelids closed. These demonstrate that ideas tested playfully can lead to useful solutions. Finally, we look across our work to distil guidelines to design with "not looking" interactions, the use of dramatisation to support the integration of gaze interaction in the game, and the exploration of interactive experiences only possible when taking input from the eyes. We aim to inspire the future of gaze-enabled games with new directions by proposing that there is more to the eyes than where players look

Playful Materialities

Game culture and material culture have always been closely linked. Analog forms of rule-based play (ludus) would hardly be conceivable without dice, cards, and game boards. In the act of free play (paidia), children as well as adults transform simple objects into multifaceted toys in an almost magical way. Even digital play is suffused with material culture: Games are not only mediated by technical interfaces, which we access via hardware and tangible peripherals. They are also subject to material hybridization, paratextual framing, and processes of de-, and re-materialization

Playful Materialities: The Stuff That Games Are Made Of

Game culture and material culture have always been closely linked. Analog forms of rule-based play (ludus) would hardly be conceivable without dice, cards, and game boards. In the act of free play (paidia), children as well as adults transform simple objects into multifaceted toys in an almost magical way. Even digital play is suffused with material culture: Games are not only mediated by technical interfaces, which we access via hardware and tangible peripherals. They are also subject to material hybridization, paratextual framing, and processes of de-, and re-materialization

Accesibilidad en videojuegos: su aporte a la inclusión y al proceso de creación de videojuegos inclusivos en la industria independiente

El presente trabajo de tesina de grado abarca la investigación, el estudio y análisis de la accesibilidad en videojuegos independientes, el desarrollo del plugin "Godot Subtitles" para el motor de videojuegos Godot Engine y su publicación en el repositorio de software GitHub, y la elaboración de un "Catálogo de buenas prácticas en el diseño de accesibilidad de videojuegos". En este trabajo se realiza un estudio sobre el surgimiento de la accesibilidad desde sus inicios hasta el presente, sobre su impacto en la era digital, haciendo foco en el desarrollo de videojuegos. Los conceptos y temáticas asociadas a la accesibilidad se analizan desde el punto de vista del jugador y del desarrollador, con especial atención en las discapacidades auditivas e intentando comprender la relación que existe entre estas dos perspectivas. Se analizan varios casos de estudio de desarrollos independientes para entender las limitaciones y dificultades en el desarrollo que pueden impactar en la accesibilidad.Facultad de Informátic

Playful Materialities

Game culture and material culture have always been closely linked. Analog forms of rule-based play (ludus) would hardly be conceivable without dice, cards, and game boards. In the act of free play (paidia), children as well as adults transform simple objects into multifaceted toys in an almost magical way. Even digital play is suffused with material culture: Games are not only mediated by technical interfaces, which we access via hardware and tangible peripherals. They are also subject to material hybridization, paratextual framing, and processes of de-, and re-materialization