Brave New GES World:A Systematic Literature Review of Gestures and Referents in Gesture Elicitation Studies

How to determine highly effective and intuitive gesture sets for interactive systems tailored to end users’ preferences? A substantial body of knowledge is available on this topic, among which gesture elicitation studies stand out distinctively. In these studies, end users are invited to propose gestures for specific referents, which are the functions to control for an interactive system. The vast majority of gesture elicitation studies conclude with a consensus gesture set identified following a process of consensus or agreement analysis. However, the information about specific gesture sets determined for specific applications is scattered across a wide landscape of disconnected scientific publications, which poses challenges to researchers and practitioners to effectively harness this body of knowledge. To address this challenge, we conducted a systematic literature review and examined a corpus of N=267 studies encompassing a total of 187, 265 gestures elicited from 6, 659 participants for 4, 106 referents. To understand similarities in users’ gesture preferences within this extensive dataset, we analyzed a sample of 2, 304 gestures extracted from the studies identified in our literature review. Our approach consisted of (i) identifying the context of use represented by end users, devices, platforms, and gesture sensing technology, (ii) categorizing the referents, (iii) classifying the gestures elicited for those referents, and (iv) cataloging the gestures based on their representation and implementation modalities. Drawing from the findings of this review, we propose guidelines for conducting future end-user gesture elicitation studies

Gesture elicitation to improve DJ to audience communication

When DJs perform they struggle to communicate their performance actions to their audience. DJs use turntables, CDJs, DJ mixers and/or computers with or without hardware DJ controllers. This equipment has small controls that are difficult to view from any distance. DJs bend over their equipment while performing small hand movements that are difficult for the audience to see. This research aims to investigate whether this visual communication problem can be solved by using full body gestures. The underlying motivation was to enhance DJ performance and the overall audience experience. Following a review of the relevant literature, this thesis begins by identifying common DJ techniques. Then gestures were elicited for each common DJ technique using the Gesture Elicitation Study (GES) methodology with the aim of creating a universally understood gesture set. The GES resulted in mainly low consensus, conflicting and inconsistent gestures which prevented an end-user gesture set from being directly produced. Therefore, three further gesture set creation studies were performed to try to create a conflict and inconsistency free gesture set. This project successfully created an end-user gesture set from the results of all four experiments. However, the inconsistencies and conflicts from these experiments suggest that that there is not a universal language that both DJs and audience members understand. Therefore, the strict GES method is deemed inappropriate for producing a DJ-audience communication focused gesture set; the author suggests adapting this methodology to involve subjective ratings to select the most suitable gestures

The Role of Situation Awareness Metrics in the Assessment of Indoor Orientation Assistive Technologies that Aid Blind Individuals in Unfamiliar Indoor Environments

The importance of raising user\u27s situation awareness has proven to be an important factor in the successful use of systems that involve mission-critical tasks. Indoor Orientation Assistive Technology (OAT) that supports blind individuals is one of the systems that needs to be oriented to support user\u27s situation awareness. In the tasks involved in this system, blind individuals try to maintain their spatial understanding of the environment. The current evaluation methods of Orientation Assistive Technology that aids blind travelers within indoor environments rely on the performance metrics. When enhancing such systems, evaluators conduct qualitative studies to learn where to focus their efforts. The main purpose of this thesis is to investigate the use of an objective method to facilitate blind travelers situation awareness when traveling unfamiliar indoor environments. We investigate the use of in-task probes using the Situation Awareness Global Assessment Technique (SAGAT) method, and post self-reported questionnaire using the Situation Awareness Rating Technique (SART) method. The goal of this metric is to design an objective method that can highlight design areas that need improvements when evaluating such systems. Also, we investigate the relationship between user\u27s situation awareness and user\u27s confidence, satisfaction, and stress levels