FreeForm: An informal environment for interface prototyping

Best practice in interface design suggests that hand-drawn sketches are preferable at the early stages of the design process. This paper describes the FreeForm software which supports informal sketched interface design by acting as a Visual Basic Add-In. The Software utilises a digital whiteboard and pen input to support sketching and “running” of an informal prototype

Evaluting a sketch environment for novice programmers

This paper describes the evaluation of an electronic sketch interface design tool for novice programmers. A comparative study was undertaken with small groups using two different shared space environments; a conventional informal design environment and the pen based digital whiteboard. The students reacted positively to the electronic environment, where they worked informally with their design ideas and checked them more carefully

Freeform: A Tool for Sketching Form Designs

This demonstration shows the tool we have developed for hand-sketching user interfaces. Our motivation for developing this tool is to provide an environment where novice programmers can move freely along the design continuum from informal low-fidelity prototypes to completed formal designs. A low-cost digital whiteboard is used to provide a shared work space for Freeform. The tool is integrated into a programming IDE and provides penbased sketching and editing, a storyboard, run mode, recognition of shapes and words and conversion into a formal design in the programming IDE

New interaction tools for preserving an old language

The Penan people of Malaysian Borneo were traditionally nomads of the rainforest. They would leave messages in the jungle for each other by shaping natural objects into language tokens and arranging these symbols in specific ways – much like words in a sentence. With settlement, the language is being lost as it is not being used by the younger generation. We report here, a tangible system designed to help the Penans preserve their unique object writing language. The key features of the system are that: the tangibles are made of real objects; it works in the wild; and new tangibles can be fabricated and added to the system by the users. Our evaluations show that the system is engaging and encourages intergenerational knowledge transfer, thus has the potential to help preserve this language

INTERACT 2015 Adjunct Proceedings. 15th IFIP TC.13 International Conference on Human-Computer Interaction 14-18 September 2015, Bamberg, Germany

INTERACT is among the world’s top conferences in Human-Computer Interaction. Starting with the first INTERACT conference in 1990, this conference series has been organised under the aegis of the Technical Committee 13 on Human-Computer Interaction of the UNESCO International Federation for Information Processing (IFIP). This committee aims at developing the science and technology of the interaction between humans and computing devices. The 15th IFIP TC.13 International Conference on Human-Computer Interaction - INTERACT 2015 took place from 14 to 18 September 2015 in Bamberg, Germany. The theme of INTERACT 2015 was "Connection.Tradition.Innovation". This volume presents the Adjunct Proceedings - it contains the position papers for the students of the Doctoral Consortium as well as the position papers of the participants of the various workshops

Special Issue on Diagram Aesthetics and Layout

Edited journal special issue

Recognizing Sketches of Euler Diagrams Drawn with Ellipses

Euler diagrams form the basis of a number of visual languages. However, the existing tool support for creating Euler diagrams is limited to generic diagram editing software that uses mouse and keyboard interfaces. A more natural and convenient mode of entry is via a sketching interface. In addition, it is known that sketching, as opposed to using an editing package, facilitates greater cognitive focus on the task of diagram creation. This paper presents the first sketch tool for Euler diagrams. In particular, we describe the recognition mechanism and conversion that takes a sketched Euler diagram and converts it into a formal diagram drawn with ellipses and circles. The semantics of the sketch is computed

Using shared displays to support group design; A study of the use of informal user interface designs when learning to program

Hand-drawn sketches have traditionally been used to depict design ideas because they are quick to draw and can include as much or little detail as is required to convey the essence of the ideas. Computer tools are now an alternative and offer advantages for editing, storing and transmitting designs. However, designers consistently reject using current computer tools because these tools interrupt the creative process. Various studies have supported the designer's position, consistently showing that traditional tools produce more and better design ideas. This thesis describes the development and evaluation of a design-friendly computer tool that focuses specifically on the needs of the novice programmer who is designing user interfaces. From an extensive review of the literature on design, learning to programming and previous sketch tools we extracted the specifications for a tool that: compares favourably as a design medium with traditional tools such as the pen, paper and whiteboards, provides the editing and storage support expected of computer tools, helps students to gain a better understanding of programming problems and integrates seamlessly into a program development environment. Freeform, the tool we have developed to these specifications, has had two iterations of development and usability testing. This tool is unique in that it: is integrated into a commercial program development environment, uses a digital whiteboard for interaction and includes character recognition. Using Freeform, students can both quickly hand-draw user interface designs and interact with the design while it is still rendered as a sketch. When satisfied with the design the student invokes the recognition engine. The sketch is then overlaid with recognition data. Any incorrect interpretations can be altered by the student. The student can then instruct Freeform to create the formal user interface in the program development environment. The translation of sketch glyphs to user interface widgets is achieved by parsing the sketch and recognition data with transformation rules. We have conducted two evaluation studies using Freeform. The first study directly compared Freeform to a traditional alternative. We found that, although the design quality was similar, the students believed that when they were using Freeform they both understood the problem better and enjoyed the experience more. We noted during this study that the interactive checking available in Freeform prompted more changes to the designs than the static checking done on a standard whiteboard. In the second study, we asked students to check designs rendered as both sketches in Freeform and as formal diagrams in a user interface builder. The students made significantly more revisions to the Freeform sketches and therefore produced better designs from Freeform. The usability tests and evaluation studies we have conducted suggest that computer-based low-fidelity design tools: can compete favourably with traditional tools as a design medium, offer better support for editing and storage, and may have advantages for checking over both traditional sketch mediums and formal interactive computer designs