Freeform User Interfaces for Graphical Computing

報告番号: 甲15222 ; 学位授与年月日: 2000-03-29 ; 学位の種別: 課程博士 ; 学位の種類: 博士(工学) ; 学位記番号: 博工第4717号 ; 研究科・専攻: 工学系研究科情報工学専

Situated Sketching and Enactment for Pervasive Displays

International audienceSituated sketching and enactment aim at grounding designs in the spatial, social and cultural practices of a particular place. This is particularly relevant when designing for public places in which human activities are open-ended, multi-faceted, and difficult to anticipate, such as libraries, train stations, or commercial areas. In order to investigate situated sketching and enactment, we developed Ébauche. It enables designers to collaboratively sketch interfaces, distribute them across multiple displays and enact use cases. We present the lessons learned from six situated sketching and enactment workshops on public displays with Ébauche, and a controlled study with 8 pairs of designers who used paper and Ébauche. We describe how participants leveraged the place, and how paper or Ébauche influenced the integration of their designs in the place. Looking at the design outcomes, our results suggest that paper leads to broader exploration of ideas and deeper physical integration in the environment. Whereas Ébauche leads to more refined sketches and more animated enactments

Mixed-fidelity prototyping of user interfaces

This research presents a new technique for user interface prototyping, called mixed-fidelity prototyping. Mixed-fidelity prototyping combines low-, medium-, and high-fidelity interface elements within a single prototype in a lightweight manner, supporting independent refinement of individual elements. The approach allows designers to investigate alternate designs, including more innovative designs, and elicit feedback from stakeholders without having to commit too early in the process. As well, the approach encourages collaboration among a diverse group of stakeholders throughout the design process. For example, individuals who specialize in specific fidelities, such as high-fidelity components, are able to become involved earlier on in the process. We developed a conceptual model called the Region Model and implemented a proof-of-concept system called ProtoMixer. We demonstrated the mixed-fidelity approach by using ProtoMixer to design an example application. ProtoMixer has several benefits over other existing prototyping tools. With ProtoMixer, prototypes can be composed of multiple fidelities, and elements are easily refined and transitioned between different fidelities. Individual elements can be tied into data and functionality, and can be executed inside prototypes. As well, traditional informal practices such as sketching and storyboarding are supported. Furthermore, ProtoMixer is designed for collaborative use on a high-resolution, large display workspace

miMic: The microphone as a pencil

miMic, a sonic analogue of paper and pencil is proposed: An augmented microphone for vocal and gestural sonic sketching. Vocalizations are classified and interpreted as instances of sound models, which the user can play with by vocal and gestural control. The physical device is based on a modified microphone, with embedded inertial sensors and buttons. Sound models can be selected by vocal imitations that are automatically classified, and each model is mapped to vocal and gestural features for real-time control. With miMic, the sound designer can explore a vast sonic space and quickly produce expressive sonic sketches, which may be turned into sound prototypes by further adjustment of model parameters

Tools and Methods to Analyze Multimodal Data in Collaborative Design Ideation

Collaborative design ideation is typically characterized by informal acts of sketching, annotation, and discussion. Designers have always used the pencil-and-paper medium for this activity, partly because of the flexibility of the medium, and partly because the ambiguous and ill-defined nature of conceptual design cannot easily be supported by computers. However, recent computational tools for conceptual design have leveraged the availability of hand-held computing devices for creating and sharing ideas. In order to provide computer support for collaborative ideation in a way that augments traditional media rather than imitates it, it is necessary to study the affordances made available by digital media for this process, and to study designers\u27 cognitive and collaborative processes when using such media. In this thesis, we present tools and methods to help make sense of unstructured verbal and sketch data generated during collaborative design, with a view to better understand these collaborative and cognitive processes. This thesis has three main contributions

RealitySketch: Embedding Responsive Graphics and Visualizations in AR through Dynamic Sketching

We present RealitySketch, an augmented reality interface for sketching interactive graphics and visualizations. In recent years, an increasing number of AR sketching tools enable users to draw and embed sketches in the real world. However, with the current tools, sketched contents are inherently static, floating in mid air without responding to the real world. This paper introduces a new way to embed dynamic and responsive graphics in the real world. In RealitySketch, the user draws graphical elements on a mobile AR screen and binds them with physical objects in real-time and improvisational ways, so that the sketched elements dynamically move with the corresponding physical motion. The user can also quickly visualize and analyze real-world phenomena through responsive graph plots or interactive visualizations. This paper contributes to a set of interaction techniques that enable capturing, parameterizing, and visualizing real-world motion without pre-defined programs and configurations. Finally, we demonstrate our tool with several application scenarios, including physics education, sports training, and in-situ tangible interfaces.Comment: UIST 202

Co-refining interactive systems with older adults from function, form and interaction

Designing interactive systems that are pragmatic, attractive and easy to use for older adults is challenging. Participatory design, as an approach to enhance the mutual understanding between designers and end users, has been proved to be useful to improve the quality of design for older people. However, PD research has long been criticized for extensively dealing with the early-phase design while putting less emphasis on the later stages. In this paper, we argue for the importance of collaborative refinement when designing interactive systems for older adults. Through a case study, we describe our experience of co-refining the preliminary design of an interactive system with older participants from three perspectives: function, form and interaction. We also explored to adopt some potential PD methods and conclude by discussing the effectiveness of the chosen approach and methods