Exploiting artistic cues to obtain line labels for free-hand sketches

Artistic cues help designers to communicate design intent in sketches. In this paper, we show how these artistic cues may be used to obtain a line labelling interpretation of freehand sketches, using a cue-based genetic algorithm to obtain a labelling solution that matches design intent. In the paper, we show how this can be achieved from off-line or paper based sketches, thereby allowing designers greater flexibility in the choice of sketching medium.peer-reviewe

A circle-based vectorization algorithm for drawings with shadows

This work is funded by the University of Malta, under the research grant SCERP02-03.Vectorization algorithms described in the literature assume that the drawings being vectorized are either binary images or have a clear white background. Sketches of artistic objects however also contain shadows which help the artist to portray intent, particularly in potentially ambiguous sketches. Such sketches are difficult to binarise since the shading strokes make these sketches non bimodal. For this reason, we describe a circle-based vectorization algorithm that uses signatures obtained from sample points on the line strokes to identify and vectorize the line strokes in the sketch. We show that the proposed algorithm performs as well as other vectorization techniques described in the literature, despite the shadows present in the sketch.peer-reviewe

Paper-based scribble simplification : where do we stand?

This research is funded by the University of Malta under theresearch grant IED 73-529 and is part of the project Innovative ‘Early Design’ Product Prototyping (InPro).This paper presents a formal evaluation of the paper-based scribble simplification algorithm described in [BCFB07] and [BCFB08]. A comparative analysis of different aspects of the algorithm with other algorithms described in the literature such as Sparse Pixel Vectorization, spatial moving average filtering and Principal Component Analysis is performed, hence establishing the qualities of this paper-based scribble simplification algorithm. To quantify the performance of the algorithm, performance measures established in the literature, such as the Pixel Recovery Index are used when suitable. However, since there exists no quantitative measure which measures scribble simplification, this paper proposes a new methodology with which scribble simplification may be quantitatively assessed. Through the evaluation described in this paper, we will be able to determine remaining difficulties in the interpretation of paper-based scribbles and hence identify future research areas.peer-reviewe

Adaptation of Brensen's thresholding algorithm for sketched line drawings

Image binarisation is one of the first image processing techniques within a sketched line drawing interpretation system. In order to achieve an automated system, it is necessary to have a single algorithm which may be used for all image types. This is difficult to obtain if the parameters required by an algorithm are set manually, however, the adaptive evaluation of parameters form image properties is a step towards this goal. This paper discusses the methods by which the parameters required for Brensen's Algorithm may be evaluated adaptively form the image properties.peer-reviewe

A new sketch based interface using the gray-level co-occurrence matrix for perceptual simplification of paper based scribbles

The sketching activity has an important role in conceptual design and a variety of tools exist which help designers to facilitate the generation of 3D models form sketched drawings. This paper describes a new sketch-to-3D tool, which uses annotations to aid the interpretation of the drawing. Over-traced lines present in the designer’s scrib- bles provide an interpretation challenge, which must be resolved in order to obtain 3D models from these sketches. Perceptual grouping techniques used to interpret such images require that the drawing is represented as vectors. These are generally obtained through thinning or edge detection. However, we show that processing scribbles using these techniques result in a large number of vectors which do not provide a faithful representation of the drawing. This paper investigates the use of the co-occurrence matrix to perceptually simplify these drawings, thus obtaining a smaller number of vectors which describe the drawing more faithfully.peer-reviewe

Scribbles to vectors : preparation of scribble drawings for CAD interpretation

This paper describes the work carried out on off-line paper based scribbles such that they can be incorporated into a sketch-based interface without forcing designers to change their natural drawing habits. In this work, the scribbled drawings are converted into a vectorial format which can be recognized by a CAD system. This is achieved by using pattern analysis techniques, namely the Gabor filter to simplify the scribbled drawing. Vector line are then extracted from the resulting drawing by means of Kalman filtering.peer-reviewe

A cameraphone-based approach for the generation of 3D models from paper sketches

Parts of the research work disclosed in this paper are subject to a pending patent application number 2130.Due to the advantages it offers, a sketch-based user-interface (UI) has been utilised in various domains, such as 3D modelling, 'graphical user-interface' design, 3D animation of cartoon characters, etc. However, its benefits have not yet been adequately exploited with those of a mobile phone, despite that the latter is nowadays a widely used wireless handheld device for mobile communication. Given this scenario, this paper discloses a novel approach of using a paper sketch-based UI, which combines the benefits of paper sketching and those of a cameraphone (a mobile phone with an integrated camera), in the domain of early form design modelling. More specifically, the framework disclosed and evaluated in this paper, enables users to remotely obtain visual representations of 3D geometric models from freehand sketches by combining the portability of paper with that of cameraphones. Based on this framework, a prototype tool has been implemented and evaluated. Despite the limitations of the current prototype tool, the evaluation results of the framework s underlying concepts and of the prototype tool collectively indicate that the idea disclosed in this paper contributes in providing users with a mobile sketch-based interface, which can also be used in other domains, beyond early form design modelling.peer-reviewe

OpenAlea 2.0: Architecture of an integrated modeling environment on the web

International audiencePlant modeling is based on the use of a diverse set of design paradigms (L-systems, visual programming, imperative languages or sketch-based interfaces). In this poster, the architecture of a new multi-paradigm and integrated modeling environment is presented. This desktop application will become a distributed web application, allowing to run simulations on a cloud computing system and share virtual experiments on the web. The modeling environment will run on a web browser using HTML5 and WebGL technologies

Modeling Sketching Primitives to Support Freehand Drawing Based on Context Awareness

Freehand drawing is an easy and intuitive method for thinking input and output. In sketch based interface, there lack support for natural sketching with drawing cues, like overlapping, overlooping, hatching, etc. which happen frequently in physical pen and paper. In this paper, we analyze some characters of drawing cues in sketch based interface and describe the different types of sketching primitives. An improved sketch information model is given and the idea is to present and record design thinking during freehand drawing process with individuality and diversification. The interaction model based on context is developed which can guide and help new sketch-based interface development. New applications with different context contents can be easily derived from it and developed further. Our approach can support the tasks that are common across applications, requiring the designer to only provide support for the application-specific tasks. It is capable of and applicable for modeling various sketching interfaces and applications. Finally, we illustrate the general operations of the system by examples in different applications

Investigating user preferences in utilizing a 2D paper or 3D sketch based interface for creating 3D virtual models

Computer modelling of 2D drawings is becoming increasingly popular in modern design as can be witnessed in the shift of modern computer modelling applications from software requiring specialised training to ones targeted for the general consumer market. Despite this, traditional sketching is still prevalent in design, particularly so in the early design stages. Thus, research trends in computer-aided modelling focus on the the development of sketch based interfaces that are as natural as possible. In this report, we present a hybrid sketch based interface which allows the user to make draw sketches using offline as well as online sketching modalities, displaying the 3D models in an immersive setup, thus linking the object interaction possible through immersive modelling to the flexibility allowed by paper-based sketching. The interface was evaluated in a user study which shows that such a hybrid system can be considered as having pragmatic and hedonic value.peer-reviewe