Multicolour sketch recognition in a learning environment.

Virtual physics environments are becoming increasingly popular as a teaching tool for grade and high school level mechanical physics. While useful, these tools often offer a complex user interface, lacking the intuitive nature of the traditional whiteboard. Furthermore, the systems are often too advanced to be used by novices for further experimentation. In this paper we describe a physics learning environment using multicolour sketch recognition techniques on digital whiteboards. We argue that the use of coloured pens helps to resolve several ambiguities appearing in single colour sketching interfaces. The recognition system is based on a combination of Support Vector Machines and rule based methods. The system was evaluated using a constructive interaction method, with users completing a set task

Mediating Cognitive Transformation with VR 3D Sketching during Conceptual Architectural Design Process

Communications for information synchronization during the conceptual design phase require designers to employ more intuitive digital design tools. This paper presents findings of a feasibility study for using VR 3D sketching interface in order to replace current non-intuitive CAD tools. We used a sequential mixed method research methodology including a qualitative case study and a cognitive-based quantitative protocol analysis experiment. Foremost, the case study research was conducted in order to understand how novice designers make intuitive decisions. The case study documented the failure of conventional sketching methods in articulating complicated design ideas and shortcomings of current CAD tools in intuitive ideation. The case study’s findings then became the theoretical foundations for testing the feasibility of using VR 3D sketching interface during design. The latter phase of study evaluated the designers’ spatial cognition and collaboration at six different levels: “physical-actions”, “perceptualac ons”, “functional-actions”, “conceptual-actions”, “cognitive synchronizations”, and “gestures”. The results and confirmed hypotheses showed that the utilized tangible 3D sketching interface improved novice designers’ cognitive and collaborative design activities. In summary this paper presents the influences of current external representation tools on designers’ cognition and collaboration as well as providing the necessary theoretical foundations for implementing VR 3D sketching interface. It contributes towards transforming conceptual architectural design phase from analogue to digital by proposing a new VR design interface. The paper proposes this transformation to fill in the existing gap between analogue conceptual architectural design process and remaining digital engineering parts of building design process hence expediting digital design process

Designerly Tools

An assumption behind this paper is that research aimed at improving interaction design practice is not as successful as it could be. We will argue that one reason for this is that the understanding of what constitutes designerly tools is not enough recognized among those who propose new tools for interaction design. We define designerly tools as methods, tools, techniques, and approaches that support design activity in way that is appreciated by practicing interaction designers. Based on a two empirical studies, we have developed a framework and a way of studying designers and their tools. We discuss some insights about what characterizes designerly tools and what kind of implications these insights might have for the further development of tools aimed at supporting design practice. Keywords: Design, Tools, Interaction Design, Activities, Support For Design</p

Applying scenarios in user-centred design to develop a sketching interface for human modelling and animation

This paper presents our user and usability studies for applying scenarios in user-centred design to develop a sketching interface for virtual human modelling and animation. In this approach, we utilise the User Centred System Design (UCSD) strategy and spiral lifecycles to ensure system usability and functionalities. A series of usability techniques were employed. After the initial conceptual design, a preliminary user study (including questionnaires and sketching observations) was undertaken to establish the formal interface design. Second, an informal user test was conducted on the first prototype: a “sketch-based 3D stick figure animation interface”. Finally, a formal user evaluation (including performance tests, sketching observations, and interviews) was carried out on the latest version: a “sketch-based virtual human builder”. During this iterative process, various paper-based and electronic-based sketching scenarios were created, which were acted-out by users to help designers evoke and verify design ideas, identify users’ needs, and test the prototype interfaces in real contexts. Benefiting from applying the UCSD strategy and scenario-based design to develop a natural and supportive sketching interface, our investigation can be a useful instantiation for the design of other sketching interfaces where these techniques have not been widely acknowledged and utilised in the past

Towards Sketching Interfaces for Multi-Paradigm Modeling

International audienceExisting design processes typically begin with informal ideation by sketching out a basic approach that can be further developed into a more complete design. Although intuitively simple, and seemingly informal, the sketching process is actually a structured activity that strongly influences the design of the system; hence, it has an important role in the design success. In this work, we develop a well defined specification of the sketching activity. We consider sketching as a process of achieving agreement, based on stakeholders communicating ideas about a design and its properties, with the side-effect of incrementally developing a (set of) common language(s) specific to the idea domain. Our perspective on sketching further differs from more common notions of ideation by noting the roles of requirements and system properties, and offering a general perspective on sketching as a modular activity within design. We validate our approach by analyzing the sketches of a research group at the CAMPaM 2019 workshop. By recognizing sketching as a fundamental activity in design, we enhance the formalization of the design process, and suggest improvements to the tool support for sketching beyond the basic drawing features

Interactive Video Search

With an increasing amount of video data in our daily life, the need for content-based search in videos increases as well. Though a lot of research has been spent on video retrieval tools and methods which allow for automatic search in videos through content-based queries, still the performance of automatic video retrieval is far from optimal. In this tutorial we discussed (i) proposed solutions for improved video content navigation, (ii) typical interaction of content-based querying features, and (iii) advanced video content visualization methods. Moreover, we discussed interactive video search systems and ways to evaluate their performance

Developing Tangible Data Literacies for the Internet of Tangible Things

This paper poses the question how to design tangible interactions with the Internet of Things (IoT) in a way that supports people to develop better mental models of the underlying cyber-physical systems and thus enrich the ways that people engage with and create new knowledge from them

A profile-driven sketching interface for pen-and-paper sketches

This research is funded by the University of Malta under the research grant R30 31330 and is part of the project Innovative ‘Early Design’ Product Prototyping (InPro).Sketching interface tools are developed to allow designers to benefit from the powerful computational tools avail- able in computer aided design systems. However, despite the number of sketching tools such as PDAs and Tablet PCs available on market, designers typically create a number of initial conceptual ideas using paper-based sketches and scribbles such that these tools remain inaccessible to designers in the early design stages. In this paper we describe a profile-driven, paper-based sketching interface which infers the 3D geometry of objects drawn by designers using the traditional pen and paper sketching. We show that by making full use of the shape information present in the scribbled drawing, it is possible to obtain a paper-based sketching interface that retains the simplicity of the early- stage design drawings while allowing for the modeling of a variety of object shapes.peer-reviewe

RealitySketch: Embedding Responsive Graphics and Visualizations in AR through Dynamic Sketching

We present RealitySketch, an augmented reality interface for sketching interactive graphics and visualizations. In recent years, an increasing number of AR sketching tools enable users to draw and embed sketches in the real world. However, with the current tools, sketched contents are inherently static, floating in mid air without responding to the real world. This paper introduces a new way to embed dynamic and responsive graphics in the real world. In RealitySketch, the user draws graphical elements on a mobile AR screen and binds them with physical objects in real-time and improvisational ways, so that the sketched elements dynamically move with the corresponding physical motion. The user can also quickly visualize and analyze real-world phenomena through responsive graph plots or interactive visualizations. This paper contributes to a set of interaction techniques that enable capturing, parameterizing, and visualizing real-world motion without pre-defined programs and configurations. Finally, we demonstrate our tool with several application scenarios, including physics education, sports training, and in-situ tangible interfaces.Comment: UIST 202

ParSketch: a Sketch-based Interface for a 2D Parametric Geometry Editor

ParSketch is a software prototype to evaluate the usability and functionality of a sketching interface aimed at defining 2D parametric sections. Currently, ParSketch interprets strokes which can be recognized as geometry (line, arc, circle, ellipse, or composed entities that are automatically segmented into those basic entities), or graphic gestures representing constraints (dimension, parallel, perpendicular, tangent, concentric, horizontal or vertical). From the functionality point of view, ParSketch compares to current commercial parametric CAD applications, as it offers many of the features provided by such applications. A theoretical analysis of the efficiency component of usability is provided that justifies the potential capability of sketching interfaces to compete with classical WIMP applications. Finally, a usability study is presented, which makes special emphasis in the satisfaction component of usability.The Spanish Ministry of Science and Education and the European Union (Project DPI2004-01373) supported this work. It was also partially supported by Fundació Caixa Castelló-Bancaixa under the Universitat Jaume I program for Research Promotion (Project P1-1B2004-02)