HandPainter – 3D sketching in VR with hand-based physical proxy

3D sketching in virtual reality (VR) enables users to create 3D virtual objects intuitively and immersively. However, previous studies showed that mid-air drawing may lead to inaccurate sketches. To address this issue, we propose to use one hand as a canvas proxy and the index finger of the other hand as a 3D pen. To this end, we first perform a formative study to compare two-handed interaction with tablet-pen interaction for VR sketching. Based on the findings of this study, we design HandPainter, a VR sketching system which focuses on the direct use of two hands for 3D sketching without requesting any tablet, pen, or VR controller. Our implementation is based on a pair of VR gloves, which provide hand tracking and gesture capture. We devise a set of intuitive gestures to control various functionalities required during 3D sketching, such as canvas panning and drawing positioning. We show the effectiveness of HandPainter by presenting a number of sketching results and discussing the outcomes of a user study-based comparison with mid-air drawing and tablet-based sketching tools

Modeling Sketching Primitives to Support Freehand Drawing Based on Context Awareness

Freehand drawing is an easy and intuitive method for thinking input and output. In sketch based interface, there lack support for natural sketching with drawing cues, like overlapping, overlooping, hatching, etc. which happen frequently in physical pen and paper. In this paper, we analyze some characters of drawing cues in sketch based interface and describe the different types of sketching primitives. An improved sketch information model is given and the idea is to present and record design thinking during freehand drawing process with individuality and diversification. The interaction model based on context is developed which can guide and help new sketch-based interface development. New applications with different context contents can be easily derived from it and developed further. Our approach can support the tasks that are common across applications, requiring the designer to only provide support for the application-specific tasks. It is capable of and applicable for modeling various sketching interfaces and applications. Finally, we illustrate the general operations of the system by examples in different applications

Phrasing Bimanual Interaction for Visual Design

Architects and other visual thinkers create external representations of their ideas to support early-stage design. They compose visual imagery with sketching to form abstract diagrams as representations. When working with digital media, they apply various visual operations to transform representations, often engaging in complex sequences. This research investigates how to build interactive capabilities to support designers in putting together, that is phrasing, sequences of operations using both hands. In particular, we examine how phrasing interactions with pen and multi-touch input can support modal switching among different visual operations that in many commercial design tools require using menus and tool palettes—techniques originally designed for the mouse, not pen and touch. We develop an interactive bimanual pen+touch diagramming environment and study its use in landscape architecture design studio education. We observe interesting forms of interaction that emerge, and how our bimanual interaction techniques support visual design processes. Based on the needs of architects, we develop LayerFish, a new bimanual technique for layering overlapping content. We conduct a controlled experiment to evaluate its efficacy. We explore the use of wearables to identify which user, and distinguish what hand, is touching to support phrasing together direct-touch interactions on large displays. From design and development of the environment and both field and controlled studies, we derive a set methods, based upon human bimanual specialization theory, for phrasing modal operations through bimanual interactions without menus or tool palettes

Investigating user preferences in utilizing a 2D paper or 3D sketch based interface for creating 3D virtual models

Computer modelling of 2D drawings is becoming increasingly popular in modern design as can be witnessed in the shift of modern computer modelling applications from software requiring specialised training to ones targeted for the general consumer market. Despite this, traditional sketching is still prevalent in design, particularly so in the early design stages. Thus, research trends in computer-aided modelling focus on the the development of sketch based interfaces that are as natural as possible. In this report, we present a hybrid sketch based interface which allows the user to make draw sketches using offline as well as online sketching modalities, displaying the 3D models in an immersive setup, thus linking the object interaction possible through immersive modelling to the flexibility allowed by paper-based sketching. The interface was evaluated in a user study which shows that such a hybrid system can be considered as having pragmatic and hedonic value.peer-reviewe

Support for participation in electronic paper prototyping

In this paper, we examine a range of tools for early prototyping of interactive systems that might be described as enabling 'electronic paper prototyping'. We then introduce Gabbeh, a prototype that we are developing to re-enable participatory design when using such tools. Paper-prototyping is an established approach to the creation of early prototypes in the participatory design of computer systems. Recent years have seen the rapid development of new interaction devices in which a display screen is combined with pen-based input to allow users to create sketches or hand-written notes in an interaction that is similar to writing with a pen on paper. Research with such devices has shown how this capability can be used to rapidly create simple prototypes of interactive systems such as websites. However, previous systems have not considered how end-users and other stakeholders could contribute to design dialogues around such prototypes.</p

Designerly Tools

An assumption behind this paper is that research aimed at improving interaction design practice is not as successful as it could be. We will argue that one reason for this is that the understanding of what constitutes designerly tools is not enough recognized among those who propose new tools for interaction design. We define designerly tools as methods, tools, techniques, and approaches that support design activity in way that is appreciated by practicing interaction designers. Based on a two empirical studies, we have developed a framework and a way of studying designers and their tools. We discuss some insights about what characterizes designerly tools and what kind of implications these insights might have for the further development of tools aimed at supporting design practice. Keywords: Design, Tools, Interaction Design, Activities, Support For Design</p

FreeForm: An informal environment for interface prototyping

Best practice in interface design suggests that hand-drawn sketches are preferable at the early stages of the design process. This paper describes the FreeForm software which supports informal sketched interface design by acting as a Visual Basic Add-In. The Software utilises a digital whiteboard and pen input to support sketching and “running” of an informal prototype

Developing Digital Media Platforms for Early Design

In recent times, mobile devices are becoming an integral part of our daily life. Software applications on these handheld devices are successfully migrating the traditional paper-based activities such as reading news, books, and even navigating through maps, onto the digital medium. While these applications allow information access anywhere and anytime, there is still a necessity for repurposing these digital media to support content/information creation especially in domains such as industrial design where paper-based activities are common. To utilize direct-touch tablets for collaborative conceptual design, we studied their affordances and iteratively developed a web-based wiki system, named skWiki. In this thesis, we first report an evaluation of the impact of utilizing a capacitive stylus for tracing and sketching on direct-touch tablets. This study uncovers the differences in quantitative and qualitative performance of the tablet medium compared to the paper medium when using a stylus (pen) or finger input for both tracing and sketching. While paper performed better overall, we found that the tablet medium, when used with a capacitive stylus, performed comparably to the paper medium for sketching tasks. These findings can guide sketch application designers in developing an appropriate interaction design for various input methods. In order to explore the advantages of the ubiquity of information generated on digital media, we developed Sketchbox, an Android application for sketching and sharing ideas using Dropbox as the storage cloud. An evaluation of the usage patterns of this application in a collaborative toy design scenario provided necessary guidelines for developing the skWiki system. skWiki overcomes the drawbacks of traditional wiki software, that are used as design repositories, by providing a rich editor infrastructure for sketching, text editing, and image editing. Apart from these features, skWiki provides a higher degree of freedom in sharing (cloning, branching, and merging) different versions of a sketch at various data granularities by introducing the concept of paths for maintaining revisions in a collaborative design process. We evaluated the utility of skWiki through a user study by comparing constrained and unconstrained sharing models. Furthermore, skWiki was used by the students of toy design and product design courses for both collaborative ideation and design activities. We discuss the findings and qualitative feedback from the evaluation of skWiki, and potential features for the next version of this tool

Freeform User Interfaces for Graphical Computing

報告番号: 甲15222 ; 学位授与年月日: 2000-03-29 ; 学位の種別: 課程博士 ; 学位の種類: 博士(工学) ; 学位記番号: 博工第4717号 ; 研究科・専攻: 工学系研究科情報工学専