A Video Analysis of Eye Movements during Typing: How Effective is Handwriting during Note-Taking Tasks?

Keyboard input for non-alphabetical languages, such as Chinese and Japanese, is problematic because it is labor intensive and imposes a high cognitive load. In our previous work, we measured the effectiveness of handwriting during a note-taking task in Japanese, and found that the input speed during note-taking was higher by hand than by keyboard. The results also showed that the quality of notes taken by hand was higher than that of notes taken by keyboard, and this might have been due to the higher cognitive load during typing. In addition, observation during the experiment revealed several problems subjects faced in the keyboard input task. To evaluate the significance of these observations, we had to obtain quantitative evidence through further study of participant behavior. Therefore, we repeated the experiment, this time with video analysis of the keyboard subtask. By analyzing the participants’ eye movements and their behavior throughout the keyboard subtask we obtained quantitative evidence to support our findings from the previous study. Here, we describe this experiment and our findings in detail

Video annotation tools

This research deals with annotations in scholarly work. Annotations have been studied by many people. A significant amount of research has shown that instead of implementing domain specific annotation applications a better approach is to develop general purpose annotation toolkits that can be used to create domain specific applications. A video annotation toolkit along with toolkits for searching, retrieving, analyzing and presenting videos can help achieve the broader goal of creating integrated work spaces for scholarly work in humanities research similar to existing environments in such fields as mathematics, engineering, statistics, software development and bioinformatics. This research implements a video annotation toolkit and evaluates it by looking at its usefulness in creating applications for different areas. It was found that many areas of study in the arts and sciences can benefit from a video annotation application tailored to their specific needs and that an annotation toolkit can significantly reduce the time for developing such applications. The toolkit was engineered through successive refinements of prototype applications developed for different application areas. The toolkit design was also guided by a set of features identified by the research community for an ideal general purpose annotation toolkit. This research contributes by combining these two different approaches to toolkit design and construction into a hybrid approach. This approach could be useful for similar or related efforts

Electronic Environments for Reading: An Annotated Bibliography of Pertinent Hardware and Software

In the development of new research environments, hardware has often been neglected. E-readers have (reasonably) successfully been developed for leisurely reading, but reading with the goal of writing demands a different approach. This bibliography has been written to inform the INKE research group on physical aspects of digital scholarly reading. It consists of two parts: a hardware section, including a description of commercial e-readers as well as an overview of academically developed digital reading devices and a software section, also including commercially available packages next to academically developed reading environments which allow for flexible manipulation of text and other modalities; as well as reflections on digital scholarly reading. Combined, the two sections inform an integrated approach in the development of new research environments

Técnicas de conexión de nodos en mesas interactivas: diseño y evaluación

[EN] In this work a set of interaction techniques has been designed and evaluated, which allow represent graphs visually in a very basic way over an interactive table. The drag and tap are developed starting from existing techniques in this technology. The Magnetic node technique is an adapted technique which suggests the user the final node to complete the union. An important contributionof this work is the design of assisted techniques, such as direction and proximity. These are innovative techniques not developed until the moment and pursue to dower of some assistance to the process of the establishment of edges. The objective of this work is to evaluate the performance of manual techniques (drag, tap, dragShift) and assisted (direction, proximity) in different tasks. These technique may be easily integrated into other surface applications, that is the case of a data flow expression editor.[ES] En este trabajo se han diseñado y evaluado un conjunto de técnicas de interacción, que permite representar grafos visualmente de forma muy básica sobre una mesa interactiva. La técnica de Arrastre y Pulsación, están desarrolladas a partir de técnicas ya existentes en esta tecnología. La técnica de Nodo magnético, es una técnica adaptada que sugiere al usuario, el nodo final para hacer la unión. Una aportación importante a este trabajo es el diseño de técnicas asistidas como es el caso de Dirección y Proximidad. Puede decirse que son técnicas novedosas, no desarrolladas hasta el momento y que persiguen dotar de cierta asistencia al proceso de establecimiento de aristas. El objetivo de este trabajo es evaluar el rendimiento de técnicas manuales (Arrastre, Pulsación, Arrastre con Visor) y asistidas (Dirección, Proximidad) en tareas diferentes. Se persigue la idea que puedan ser finalmente integradas en otras aplicaciones, tal es el caso de un editor de expresiones de flujos de datos.Zorrilla Bustamante, AM. (2013). Técnicas de conexión de nodos en mesas interactivas: diseño y evaluación. http://hdl.handle.net/10251/44565Archivo delegad

Casual Information Visualization on Exploring Spatiotemporal Data

The goal of this thesis is to study how the diverse data on the Web which are familiar to everyone can be visualized, and with a special consideration on their spatial and temporal information. We introduce novel approaches and visualization techniques dealing with different types of data contents: interactively browsing large amount of tags linking with geospace and time, navigating and locating spatiotemporal photos or videos in collections, and especially, providing visual supports for the exploration of diverse Web contents on arbitrary webpages in terms of augmented Web browsing

Barehand Mode Switching in Touch and Mid-Air Interfaces

Raskin defines a mode as a distinct setting within an interface where the same user input will produce results different to those it would produce in other settings. Most interfaces have multiple modes in which input is mapped to different actions, and, mode-switching is simply the transition from one mode to another. In touch interfaces, the current mode can change how a single touch is interpreted: for example, it could draw a line, pan the canvas, select a shape, or enter a command. In Virtual Reality (VR), a hand gesture-based 3D modelling application may have different modes for object creation, selection, and transformation. Depending on the mode, the movement of the hand is interpreted differently. However, one of the crucial factors determining the effectiveness of an interface is user productivity. Mode-switching time of different input techniques, either in a touch interface or in a mid-air interface, affects user productivity. Moreover, when touch and mid-air interfaces like VR are combined, making informed decisions pertaining to the mode assignment gets even more complicated. This thesis provides an empirical investigation to characterize the mode switching phenomenon in barehand touch-based and mid-air interfaces. It explores the potential of using these input spaces together for a productivity application in VR. And, it concludes with a step towards defining and evaluating the multi-faceted mode concept, its characteristics and its utility, when designing user interfaces more generally

Sistema multimodal para captura e anotação de vídeo

Dissertação para obtenção do Grau de Mestre em Engenharia InformáticaActualmente, existe um grande crescimento de popularidade de dispositivos tácteis e multi-toque e, por isso, é necessário cada vez mais o desenvolvimento de aplicações e interfaces que sejam elaboradas especificamente para esse tipo de interacção. Através da caneta digital e do toque humano, esta interacção torna-se natural para o utilizador, pois assemelha-se à interacção humano-papel-caneta. Este tipo de interacção pode ser aplicado a documentos multimédia, em particular ao controlo e à anotação de vídeo digital. Assim como as anotações em publicações impressas promovem a leitura activa, as anotações de vídeo promovem a visualização activa, facilitando a reflexão e a aprendizagem com o enriquecimento do conteúdo do vídeo. As formas de arte performativas, como a dança, são domínios que envolvem várias iterações de ensaio, onde a anotação de vídeo pode melhorar significativamente o processo criativo dos autores. Assim, a solução proposta tem como objectivo o desenvolvimento de uma ferramenta que suporte a captura e anotação multimodal de vídeo em tempo real, a ser executada num Tablet PC, explorando a interacção bimanual de toque humano com a caneta digital. A ferramenta permite ao utilizador capturar um vídeo através de uma fonte e, simultaneamente, anotá-lo, de forma a documentar segmentos desse vídeo para futura recuperação e pesquisa e aumentar o seu conteúdo, associando-lhe um significado próprio. No âmbito da dança contemporânea, um coreógrafo pode utilizar o sistema a fim de registar e anotar um ensaio ou uma performance ao vivo, actuando como um bloco de notas digital que pode ser revisto e partilhado com os artistas. Esta proposta está enquadrada no projecto TKB, desenvolvido em colaboração com a Faculdade de Ciências Sociais Humanas da Universidade Nova de Lisboa – FCSH/UNL, que inclui nos objectivos o desenvolvimento de um anotador de vídeo aplicado à dança contemporânea

VAST: A Human-Centered, Domain-Independent Video Analysis Support Tool

Providing computer-aided support for human analysis of videos has been a battle of extremes. Powerful solutions exist, but they tend to be domain-specific and complex. The user-friendly, simple systems provide little analysis support beyond basic media player functionality. We propose a human-centered, domain-independent solution between these two points. Our proposed model and system, VAST, is based on our experience in two diverse video analysis domains: science and athletics. Multiple-perspective location metadata is used to group related video clips together. Users interact with these clip groups through a novel interaction paradigm ? views. Each view provides a different context by which users can judge and evaluate the events that are captured by the video. Easy conversion between views allows the user to quickly switch between contexts. The model is designed to support a variety of user goals and expertise with minimal producer overhead. To evaluate our model, we developed a system prototype and conducted several rounds of user testing requiring the analysis of volleyball practice videos. The user tasks included: foreground analysis, ambiguous identification, background analysis, and planning. Both domain novices and experts participated in the study. User feedback, participant performance, and system logs were used to evaluate the system. VAST successfully supported a variety of problem solving strategies employed by participants during the course of the study. Participants had no difficulty handling multiple views (and resulting multiple video clips) simultaneously opened in the workspace. The capability to view multiple related clips at one time was highly regarded. In all tasks, except the open-ended portion of the background analysis, participants performed well. However, performance was not significantly influenced by domain expertise. Participants had a favorable opinion of the system?s intuitiveness, ease of use, enjoyability, and aesthetics. The majority of participants stated a desire to use VAST outside of the study, given the opportunity