Sketching-out virtual humans: From 2d storyboarding to immediate 3d character animation

Virtual beings are playing a remarkable role in today’s public entertainment, while ordinary users are still treated as audiences due to the lack of appropriate expertise, equipment, and computer skills. In this paper, we present a fast and intuitive storyboarding interface, which enables users to sketch-out 3D virtual humans, 2D/3D animations, and character intercommunication. We devised an intuitive “stick figurefleshing-outskin mapping” graphical animation pipeline, which realises the whole process of key framing, 3D pose reconstruction, virtual human modelling, motion path/timing control, and the final animation synthesis by almost pure 2D sketching. A “creative model-based method” is developed, which emulates a human perception process, to generate the 3D human bodies of variational sizes, shapes, and fat distributions. Meanwhile, our current system also supports the sketch-based crowd animation and the storyboarding of the 3D multiple character intercommunication. This system has been formally tested by various users on Tablet PC. After minimal training, even a beginner can create vivid virtual humans and animate them within minutes

Requirements gathering for tools in support of storyboarding in user experience design

Storytelling is often used support communication in early User Experience (UX) design, and the resulting stories are frequently visualized in the form of storyboards. However, storyboarding, the creation of storyboards, has also been identified as an important obstacle to the adoption of storytelling in UX design. Most UX designers do indeed not possess the drawing skills needed to produce professionally-looking storyboards. A problem that can be potentially overcome (or at least ameliorated) by using alternative (digital) storyboarding tools. A study into the user acceptance of existing tools is introduced in this paper. The results show that while traditional tools like pen and paper are still very much valued, digital tools are getting increasingly popular. We identify important limitations of existing tools and formulate requirements for future storyboarding tools.</p

Sketching & drawing as future inquiry in HCI

Creating visual imagery helps us to situate ourselves within unknown worlds, processes, make connections, and find solutions. By exploring drawn ideas for novel technologies, we can examine the implications of their place in the world. Drawing, or sketching, for future inquiry in Human Computer Interaction (HCI) can be a stand-alone investigative approach, part of a wider ‘world-building’ in design fiction, or simply ideation around a concept. By examining instances of existing practice in HCI, in this paper we establish recommendations and rationales for those wishing to utilise sketching and drawing within their research. We examine approaches ranging from ideation, diagramming, scenario building, comics creation and artistic representation to create a model for sketching and drawing as future inquiry for HCI. This work also reflects on the ways in which these arts can inform and elucidate research and practice in HCI, and makes recommendations for the field, within its teaching, processes and outcomes

Teaching Software Development to Non-Software Engineering Students

This paper argues that although the object-oriented programming (OOP) paradigm is appropriate for students taking programming modules on Higher Education (HE) software engineering course, this paradigm is not as relevant for students from other courses who study programming modules. It is also asserts that adopting another paradigm when teaching programming to non-software engineering students need not prevent the encouragement of good software engineering practices The paper discusses the software development model, procedures, techniques and programming language that the author requires non-software engineering students to employ when developing their software. This discussion also includes consideration of implementation issues in an educational context. The paper concludes that his alternative approach has been successfully implemented, that it requires the student to adopt a rigorous approach to development and that it encourages best software engineering practices. The conclusions also note that delivering this alternative offers the opportunity to include good educational practice, such as role-play

Design and semantics of form and movement (DeSForM 2006)

Design and Semantics of Form and Movement (DeSForM) grew from applied research exploring emerging design methods and practices to support new generation product and interface design. The products and interfaces are concerned with: the context of ubiquitous computing and ambient technologies and the need for greater empathy in the pre-programmed behaviour of the ‘machines’ that populate our lives. Such explorative research in the CfDR has been led by Young, supported by Kyffin, Visiting Professor from Philips Design and sponsored by Philips Design over a period of four years (research funding £87k). DeSForM1 was the first of a series of three conferences that enable the presentation and debate of international work within this field: • 1st European conference on Design and Semantics of Form and Movement (DeSForM1), Baltic, Gateshead, 2005, Feijs L., Kyffin S. & Young R.A. eds. • 2nd European conference on Design and Semantics of Form and Movement (DeSForM2), Evoluon, Eindhoven, 2006, Feijs L., Kyffin S. & Young R.A. eds. • 3rd European conference on Design and Semantics of Form and Movement (DeSForM3), New Design School Building, Newcastle, 2007, Feijs L., Kyffin S. & Young R.A. eds. Philips sponsorship of practice-based enquiry led to research by three teams of research students over three years and on-going sponsorship of research through the Northumbria University Design and Innovation Laboratory (nuDIL). Young has been invited on the steering panel of the UK Thinking Digital Conference concerning the latest developments in digital and media technologies. Informed by this research is the work of PhD student Yukie Nakano who examines new technologies in relation to eco-design textiles

Mixed-fidelity prototyping of user interfaces

This research presents a new technique for user interface prototyping, called mixed-fidelity prototyping. Mixed-fidelity prototyping combines low-, medium-, and high-fidelity interface elements within a single prototype in a lightweight manner, supporting independent refinement of individual elements. The approach allows designers to investigate alternate designs, including more innovative designs, and elicit feedback from stakeholders without having to commit too early in the process. As well, the approach encourages collaboration among a diverse group of stakeholders throughout the design process. For example, individuals who specialize in specific fidelities, such as high-fidelity components, are able to become involved earlier on in the process. We developed a conceptual model called the Region Model and implemented a proof-of-concept system called ProtoMixer. We demonstrated the mixed-fidelity approach by using ProtoMixer to design an example application. ProtoMixer has several benefits over other existing prototyping tools. With ProtoMixer, prototypes can be composed of multiple fidelities, and elements are easily refined and transitioned between different fidelities. Individual elements can be tied into data and functionality, and can be executed inside prototypes. As well, traditional informal practices such as sketching and storyboarding are supported. Furthermore, ProtoMixer is designed for collaborative use on a high-resolution, large display workspace

The MaggLite Post-WIMP Toolkit: Draw It, Connect It and Run It

International audienceThis article presents MaggLite, a toolkit and sketch-based interface builder allowing fast and interactive design of post-WIMP user interfaces. MaggLite improves design of advanced UIs thanks to its novel mixed-graph architecture that dynamically combines scene-graphs with interaction- graphs. Scene-graphs provide mechanisms to describe and produce rich graphical effects, whereas interaction-graphs allow expressive and fine-grained description of advanced interaction techniques and behaviors such as multiple pointers management, toolglasses, bimanual interaction, gesture, and speech recognition. Both graphs can be built interactively by sketching the UI and specifying the interaction using a dataflow visual language. Communication between the two graphs is managed at runtime by components we call Interaction Access Points. While developers can extend the toolkit by refining built-in generic mechanisms, UI designers can quickly and interactively design, prototype and test advanced user interfaces by applying the MaggLite principle: "draw it, connect it and run it"