Gesture Interaction at a Distance

The aim of this work is to explore, from a perspective of human behavior, which\ud gestures are suited to control large display surfaces from a short distance away; why that is so; and, equally important, how such an interface can be made a reality. A well-known example of the type of interface that is the focus in this thesis is portrayed in the science fiction movie ‘Minority Report’. The lead character of this movie uses hand gestures such as pointing, picking-up and throwing-away to interact with a wall-sized display in a believable way. Believable, because the gestures are familiar from everyday life and because the interface responds predictably. Although only fictional in this movie, such gesture-based interfaces can, when realized, be applied in any environment that is equipped with large display surfaces. For example, in a laboratory for analyzing and interpreting large data sets; in interactive shopping windows to casually browse a product list; and in the operating room to easily access a patient’s MRI scans. The common denominator is that the user cannot or may not touch the display: the interaction occurs at arms-length and larger distances

Para uma taxonomia da multimodalidade na interacção homem-computador : proposta aberta da classificação pluridimensional

Tese de doutoramento, Belas-Artes (Design de Comunicação), Universidade de Lisboa, Faculdade de Belas-Artes, 2015A Interacção Homem-Computador tem-se assumido como uma área interdisciplinar que integra contributos de diversas áreas científicas como a engenharia, a filosofia, as ciências sociais e humanas e o design. A presente investigação tem como principal objectivo o estudo e a classificação das Interacções Homem-Computador de carácter multimodal e procura contribuir para a produção de ferramentas teóricas de concepção, análise e construção de interfaces, compreendendo a forma como agentes humanos e informáticos interagem entre si. A primeira parte, integra o enquadramento conceptual e histórico sustentado pela revisão de literatura. A segunda, apresenta propostas de sistemas de classificação de modalidades de interacção, de processos interactivos e de interacções, baseados em reflexão académica e análise prévia do estado da arte, quando existente. É dada especial atenção ao paradigma de interacção natural pelo seu carácter historicamente dominante. O défice de análise académica registado no âmbito desta temática, contribuiu para o desenvolvimento de uma investigação de carácter tipológico e exploratório.Human-computer interaction has emerged as a interdisciplinary area that integrates contributions from different scientific territories such as engineering, philosophy, psychology, and design. This conveys a need for shared conceptual tools that promote interface invention, development, and analyses. This study aims to develop a pluridimensional classification system that encompasses the maximum diversity through the consideration of the multiple classification systems that have been put forward in the analyses of multimodality in human-computer interaction. The present investigation intends to contribute with a deeper understanding on the manners that interactions develop and/or may develop between human and computer agents. The investigation comprises two parts. The first, reviews conceptual and historic back- ground supported by literature. The second, pursuits investigation goals supporting it self on the different classification dimensions portrayed in academic classification systems on the analyses of multimodality in human-computer interaction. This leads to interaction modalities, interactive processes, and interactions classification systems presentation. The natural interaction paradigm receives special attention given its dominant and historical status. The absence of relevant academic analyses in some of the main classifications dimensions promotes a typological and exploratory approach