Multi-Device Design in Contexts of Interchange and Task Migration

Com a miniaturização dos componentes digitais e o vasto desenvolvimento tecnológico dos últimos anos, a sociedade tem presenciado a redefinição dos "computadores pessoais" pelo advento dos dispositivos móveis. Além da inovação, eles introduziram o desafio do design multi-dispositivo para as aplicações desktop. Enquanto algumas abordagens criaram interfaces móveis sem aproveitar qualquer modelo, outras buscaram adaptações automáticas visando reduzir a sobrecarga de designo Em ambas, o foco do design deixou de ser o usuário, tornando as interfaces tão diferentes ao ponto de comprometerem a usabilidade na realização de uma mesma tarefa em vários dispositivos. Esta tese afirma que não existe uma abordagem de design multi-dispositivo capaz de garantir boa usabilidade em todos os contextos porque o usuário pode escolher apenas uma forma de acesso à aplicação ou alternar seu uso por meio de vários dispositivos. No primeiro caso, o usuário aprende a usar a interface para realizar suas tarefas, sendo relevante uma abordagem que aproveite os recursos do dispositivo e trate suas limitações. No segundo, o usuário já conhece uma das interfaces, o que gera uma expectativa no uso das demais. Logo, é necessário combinar abordagens com objetivos diferentes para atender ao usuário de acordo com o seu contexto de uso. Neste sentido, propõe-se o design multi-dispositivo por meio da preservação de uma hierarquia de prioridades de consistência definida em três níveis. Enquanto os dois primeiros dão suporte à expectativa do usuário em contextos de uso alternado (propensos à execução de tarefas em dispositivos diferentes) e migração de tarefas (iniciando tarefas com um dispositivo e concluindo com outro), o terceiro nível garante a personalização das tarefas de maior interesse visando eficiência e satisfação de uso em um dispositivo específico. A avaliação desta metodologia foi feita por meio de um experimento com três interfaces de pocket PC construídas a partir de uma aplicação desktop do domínio de Educação a Distância: a primeira delas era uma réplica da original (Migração Direta), a segunda não mantinha consistência de layout e era baseada em um processo de design personalizado adequado ao dispositivo (Linear) e a terceira aplicava apenas os dois primeiros níveis da hierarquia de prioridades (Overview). Os resultados da avaliação subjetiva mostraram que a abordagem Overview foi capaz de manter o modelo mental do usuário com maior precisão por preservar os atributos de facilidade, eficiência e segurança de uso na interação inter-dispositivo. Além disso, os resultados medidos para a eficácia (exatidão das respostas) e eficiênciá (tempo médio de execução das tarefas) foram iguais ou melhores com essa abordagem. Por outro lado, os usuários revelaram uma preferência pela personalização de tarefas presente na abordagem Linear. Este resultado dá suporte à proposta desta tese, mostrando que a eficácia gerada pelos dois primeiros níveis da hierarquia de prioridades (percepção e execução das tarefas) deve ser combinada com o terceiro nível de personalização. Para isso, sugere-se a disponibilização de padrões de interface criados pelo designer para escolha do usuário durante a interação. Essa combinação deve garantir usabilidade no acesso a uma aplicação feito sempre por um mesmo dispositivo ou em contextos de uso alternado e migração de tarefasWith the miniaturization of digital components and the vast technological development of the past years, society has remarked the redefinition of "personal computers" by the advent of modern mobile devices. Besides the innovation, these handhelds also introduced the challenge to develop multi-device interfaces for today's desktop applications. While some created mobile interfaces from scratch to get the best from the devices, others looked for automatic adaptations to reduce the load imposed to the designeI. In both cases, the user wasn't the focus anymore, which resulted interfaces so different from each other to the point of compromising usability when peHorming one task on many devices. This thesis claims that there is no multi-device approach capable to provi de full usability in every context because the user may choose only one interface to access the application or interchange its use via many devices. In the first case, the user learns to perform tasks with the given device, which makes relevant an approach that takes advantage of its resources and solves its limitations. In the second, the user already knows one of the available interfaces, which generates an expectation for the others. Therefore, it is necessary to combine approaches with different goals and suit the user according to the appropriate context. In this sense, we propose multi-device design via maintenance of a consistency priorities hierarchy defined in three levels. The first two levels give support to the user's expectation in contexts of interchange (prone to task execution with different devices) and task migration (starting tasks with one device and finishing with other). On the other side, the third level provides task personalization according to the user's interest towards higher efficiency and satisfaction of use with a specific device. The evaluation of this methodology was conducted by an experiment with three pocket PC interfaces designed from an e-learning desktop application: the first interface was an exact replica of the original desktop version (Direct Migration), the second didn't maintain layout consistency and was based in a personalized design process adequate to the device (Linear) while the third applied only the first two levels of the consistency priorities hierarchy (Overview). The subjective evaluation results pointed the Overview approach as the best to maintain the user's mental model by preserving easiness, efficiency and safety of use on inter-device interaction. Additionally, both measured efficacy (task result accuracy) and efficiency (task execution mean time) were the same or even better with this approach. On the other hand, users revealed their preference for the task personalization present in the Linear approach. This result gives support to our proposal, corroborating that the efficacy generated by the first two levels of the consistency priorities hierarchy (task perception and execution) should be combined with the third level of personalization. This could be done by letting designers create interface patterns and make them available to users during interaction. Such combination should guarantee usability while constantly accessing one application through the same device or in contexts of alternated use and task migratio

Contributions to the cornerstones of interaction in visualization: strengthening the interaction of visualization

Visualization has become an accepted means for data exploration and analysis. Although interaction is an important component of visualization approaches, current visualization research pays less attention to interaction than to aspects of the graphical representation. Therefore, the goal of this work is to strengthen the interaction side of visualization. To this end, we establish a unified view on interaction in visualization. This unified view covers four cornerstones: the data, the tasks, the technology, and the human.Visualisierung hat sich zu einem unverzichtbaren Werkzeug für die Exploration und Analyse von Daten entwickelt. Obwohl Interaktion ein wichtiger Bestandteil solcher Werkzeuge ist, wird der Interaktion in der aktuellen Visualisierungsforschung weniger Aufmerksamkeit gewidmet als Aspekten der graphischen Repräsentation. Daher ist es das Ziel dieser Arbeit, die Interaktion im Bereich der Visualisierung zu stärken. Hierzu wird eine einheitliche Sicht auf Interaktion in der Visualisierung entwickelt

Augmenting IDEs with Runtime Information for Software Maintenance

Object-oriented language features such as inheritance, abstract types, late-binding, or polymorphism lead to distributed and scattered code, rendering a software system hard to understand and maintain. The integrated development environment (IDE), the primary tool used by developers to maintain software systems, usually purely operates on static source code and does not reveal dynamic relationships between distributed source artifacts, which makes it difficult for developers to understand and navigate software systems. Another shortcoming of today's IDEs is the large amount of information with which they typically overwhelm developers. Large software systems encompass several thousand source artifacts such as classes and methods. These static artifacts are presented by IDEs in views such as trees or source editors. To gain an understanding of a system, developers have to open many such views, which leads to a workspace cluttered with different windows or tabs. Navigating through the code or maintaining a working context is thus difficult for developers working on large software systems. In this dissertation we address the question how to augment IDEs with dynamic information to better navigate scattered code while at the same time not overwhelming developers with even more information in the IDE views. We claim that by first reducing the amount of information developers have to deal with, we are subsequently able to embed dynamic information in the familiar source perspectives of IDEs to better comprehend and navigate large software spaces. We propose means to reduce or mitigate the information by highlighting relevant source elements, by explicitly representing working context, and by automatically housekeeping the workspace in the IDE. We then improve navigation of scattered code by explicitly representing dynamic collaboration and software features in the static source perspectives of IDEs. We validate our claim by conducting empirical experiments with developers and by analyzing recorded development sessions

Interactive Visualization Lenses:: Natural Magic Lens Interaction for Graph Visualization

Information visualization is an important research field concerned with making sense and inferring knowledge from data collections. Graph visualizations are specific techniques for data representation relevant in diverse application domains among them biology, software-engineering, and business finance. These data visualizations benefit from the display space provided by novel interactive large display environments. However, these environments also cause new challenges and result in new requirements regarding the need for interaction beyond the desktop and according redesign of analysis tools. This thesis focuses on interactive magic lenses, specialized locally applied tools that temporarily manipulate the visualization. These may include magnification of focus regions but also more graph-specific functions such as pulling in neighboring nodes or locally reducing edge clutter. Up to now, these lenses have mostly been used as single-user, single-purpose tools operated by mouse and keyboard. This dissertation presents the extension of magic lenses both in terms of function as well as interaction for large vertical displays. In particular, this thesis contributes several natural interaction designs with magic lenses for the exploration of graph data in node-link visualizations using diverse interaction modalities. This development incorporates flexible switches between lens functions, adjustment of individual lens properties and function parameters, as well as the combination of lenses. It proposes interaction techniques for fluent multi-touch manipulation of lenses, controlling lenses using mobile devices in front of large displays, and a novel concept of body-controlled magic lenses. Functional extensions in addition to these interaction techniques convert the lenses to user-configurable, personal territories with use of alternative interaction styles. To create the foundation for this extension, the dissertation incorporates a comprehensive design space of magic lenses, their function, parameters, and interactions. Additionally, it provides a discussion on increased embodiment in tool and controller design, contributing insights into user position and movement in front of large vertical displays as a result of empirical investigations and evaluations.Informationsvisualisierung ist ein wichtiges Forschungsfeld, das das Analysieren von Daten unterstützt. Graph-Visualisierungen sind dabei eine spezielle Variante der Datenrepräsentation, deren Nutzen in vielerlei Anwendungsfällen zum Einsatz kommt, u.a. in der Biologie, Softwareentwicklung und Finanzwirtschaft. Diese Datendarstellungen profitieren besonders von großen Displays in neuen Displayumgebungen. Jedoch bringen diese Umgebungen auch neue Herausforderungen mit sich und stellen Anforderungen an Nutzerschnittstellen jenseits der traditionellen Ansätze, die dadurch auch Anpassungen von Analysewerkzeugen erfordern. Diese Dissertation befasst sich mit interaktiven „Magischen Linsen“, spezielle lokal-angewandte Werkzeuge, die temporär die Visualisierung zur Analyse manipulieren. Dabei existieren zum Beispiel Vergrößerungslinsen, aber auch Graph-spezifische Manipulationen, wie das Anziehen von Nachbarknoten oder das Reduzieren von Kantenüberlappungen im lokalen Bereich. Bisher wurden diese Linsen vor allem als Werkzeug für einzelne Nutzer mit sehr spezialisiertem Effekt eingesetzt und per Maus und Tastatur bedient. Die vorliegende Doktorarbeit präsentiert die Erweiterung dieser magischen Linsen, sowohl in Bezug auf die Funktionalität als auch für die Interaktion an großen, vertikalen Displays. Insbesondere trägt diese Dissertation dazu bei, die Exploration von Graphen mit magischen Linsen durch natürliche Interaktion mit unterschiedlichen Modalitäten zu unterstützen. Dabei werden flexible Änderungen der Linsenfunktion, Anpassungen von individuellen Linseneigenschaften und Funktionsparametern, sowie die Kombination unterschiedlicher Linsen ermöglicht. Es werden Interaktionstechniken für die natürliche Manipulation der Linsen durch Multitouch-Interaktion, sowie das Kontrollieren von Linsen durch Mobilgeräte vor einer Displaywand vorgestellt. Außerdem wurde ein neuartiges Konzept körpergesteuerter magischer Linsen entwickelt. Funktionale Erweiterungen in Kombination mit diesen Interaktionskonzepten machen die Linse zu einem vom Nutzer einstellbaren, persönlichen Arbeitsbereich, der zudem alternative Interaktionsstile erlaubt. Als Grundlage für diese Erweiterungen stellt die Dissertation eine umfangreiche analytische Kategorisierung bisheriger Forschungsarbeiten zu magischen Linsen vor, in der Funktionen, Parameter und Interaktion mit Linsen eingeordnet werden. Zusätzlich macht die Arbeit Vor- und Nachteile körpernaher Interaktion für Werkzeuge bzw. ihre Steuerung zum Thema und diskutiert dabei Nutzerposition und -bewegung an großen Displaywänden belegt durch empirische Nutzerstudien

Phrasing Bimanual Interaction for Visual Design

Architects and other visual thinkers create external representations of their ideas to support early-stage design. They compose visual imagery with sketching to form abstract diagrams as representations. When working with digital media, they apply various visual operations to transform representations, often engaging in complex sequences. This research investigates how to build interactive capabilities to support designers in putting together, that is phrasing, sequences of operations using both hands. In particular, we examine how phrasing interactions with pen and multi-touch input can support modal switching among different visual operations that in many commercial design tools require using menus and tool palettes—techniques originally designed for the mouse, not pen and touch. We develop an interactive bimanual pen+touch diagramming environment and study its use in landscape architecture design studio education. We observe interesting forms of interaction that emerge, and how our bimanual interaction techniques support visual design processes. Based on the needs of architects, we develop LayerFish, a new bimanual technique for layering overlapping content. We conduct a controlled experiment to evaluate its efficacy. We explore the use of wearables to identify which user, and distinguish what hand, is touching to support phrasing together direct-touch interactions on large displays. From design and development of the environment and both field and controlled studies, we derive a set methods, based upon human bimanual specialization theory, for phrasing modal operations through bimanual interactions without menus or tool palettes

Task-based Adaptation of Graphical Content in Smart Visual Interfaces

To be effective visual representations must be adapted to their respective context of use, especially in so-called Smart Visual Interfaces striving to present specifically those information required for the task at hand. This thesis proposes a generic approach that facilitate the automatic generation of task-specific visual representations from suitable task descriptions. It is discussed how the approach is applied to four principal content types raster images, 2D vector and 3D graphics as well as data visualizations, and how existing display techniques can be integrated into the approach.Effektive visuelle Repräsentationen müssen an den jeweiligen Nutzungskontext angepasst sein, insbesondere in sog. Smart Visual Interfaces, welche anstreben, möglichst genau für die aktuelle Aufgabe benötigte Informationen anzubieten. Diese Arbeit entwirft einen generischen Ansatz zur automatischen Erzeugung aufgabenspezifischer Darstellungen anhand geeigneter Aufgabenbeschreibungen. Es wird gezeigt, wie dieser Ansatz auf vier grundlegende Inhaltstypen Rasterbilder, 2D-Vektor- und 3D-Grafik sowie Datenvisualisierungen anwendbar ist, und wie existierende Darstellungstechniken integrierbar sind