369 research outputs found
Designing Digital Art and Communication Tools Inspired by Traditional Craft
Ph.DDOCTOR OF PHILOSOPH
SandCanvas: A Multi-touch Art Medium Inspired by Sand Animation
10.1145/1978942.1979133Conference on Human Factors in Computing Systems - Proceedings1283-129
A study of stakeholders' experience of the architectural design process to stimulate an interactive form of communication
The architectural design process involves the input of many stakeholders. Communication between them is crucial as it ensures an effective design process. The practice of architecture has been transformed by advances in hardware and software technologies, to the point where both the workflow and the design process are changing. These technologies have also impacted on the methods of representing and communicating design work. At present, traditional communication uses 2D and 3D drawings, as well as digital media such as animation, computer gaming or graphic design, which have impacted on architectural representations. While these tools are very useful, problems in communication between stakeholders are revealed. For instance, differences in architectural background knowledge and requirements lead to misunderstanding the design, confusion caused by working on inconsistent information, and use of incompatible software which causes difficulties in accessing work.
This research project attempts to identify and analyse issues relating to communication within the design process in order to improve it. The study is undertaken using a number of key questions to guide the development and progress of the research. The extent of communication via digital media in the design process, in contemporary architectural practice, is examined, along with the perceived value of digital technology by stakeholders. Architectural design work would benefit from exploiting digital media and the Internet to provide an effective form of communication for enabling a user/stakeholder-oriented involvement in the design process.
The work presented revisits the conventional methods of communication in design work, between various interested parties in any given project (stakeholders: architects, engineers, planners and clients), with a view to formulating an outline for a potential system that facilitates communication as part of a participatory design process. This study puts forward suggestions to improve communication in the design process, through a storyboard represents users’ experiences in using an interactive communication system. The suggestions are being tested through a mock-up of the web application, which is then presented to participants to receive feedback. Three guiding principles inform the development of the final system: interaction (to allow fast input and feedback); accessibility (to ensure any particular design software is able to interact with the system); and inclusivity (to allow both specialists and lay people to use the system)
Computer-Assisted Interactive Documentary and Performance Arts in Illimitable Space
This major component of the research described in this thesis is 3D computer
graphics, specifically the realistic physics-based softbody simulation and
haptic responsive environments. Minor components include advanced
human-computer interaction environments, non-linear documentary storytelling,
and theatre performance. The journey of this research has been unusual because
it requires a researcher with solid knowledge and background in multiple
disciplines; who also has to be creative and sensitive in order to combine the
possible areas into a new research direction. [...] It focuses on the advanced
computer graphics and emerges from experimental cinematic works and theatrical
artistic practices. Some development content and installations are completed to
prove and evaluate the described concepts and to be convincing. [...] To
summarize, the resulting work involves not only artistic creativity, but
solving or combining technological hurdles in motion tracking, pattern
recognition, force feedback control, etc., with the available documentary
footage on film, video, or images, and text via a variety of devices [....] and
programming, and installing all the needed interfaces such that it all works in
real-time. Thus, the contribution to the knowledge advancement is in solving
these interfacing problems and the real-time aspects of the interaction that
have uses in film industry, fashion industry, new age interactive theatre,
computer games, and web-based technologies and services for entertainment and
education. It also includes building up on this experience to integrate Kinect-
and haptic-based interaction, artistic scenery rendering, and other forms of
control. This research work connects all the research disciplines, seemingly
disjoint fields of research, such as computer graphics, documentary film,
interactive media, and theatre performance together.Comment: PhD thesis copy; 272 pages, 83 figures, 6 algorithm
HairBrush for Immersive Data-Driven Hair Modeling
International audienceWhile hair is an essential component of virtual humans, it is also one of the most challenging digital assets to create. Existing automatic techniques lack the generality and flexibility to create rich hair variations, while manual authoring interfaces often require considerable artistic skills and efforts, especially for intricate 3D hair structures that can be difficult to navigate. We propose an interactive hair modeling system that can help create complex hairstyles in minutes or hours that would otherwise take much longer with existing tools. Modelers, including novice users, can focus on the overall hairstyles and local hair deformations, as our system intelligently suggests the desired hair parts. Our method combines the flexibility of manual authoring and the convenience of data-driven automation. Since hair contains intricate 3D structures such as buns, knots, and strands, they are inherently challenging to create using traditional 2D interfaces. Our system provides a new 3D hair author-ing interface for immersive interaction in virtual reality (VR). Users can draw high-level guide strips, from which our system predicts the most plausible hairstyles via a deep neural network trained from a professionally curated dataset. Each hairstyle in our dataset is composed of multiple variations, serving as blend-shapes to fit the user drawings via global blending and local deformation. The fitted hair models are visualized as interactive suggestions that the user can select, modify, or ignore. We conducted a user study to confirm that our system can significantly reduce manual labor while improve the output quality for modeling a variety of head and facial hairstyles that are challenging to create via existing techniques
Design and Evaluation of a Real-World Virtual Environment for Architecture and Urban Planning
International audienceIn this paper we present a user-centered design approach to the development of a Virtual Environment (VE), by utilizing an iterative, user-informed process throughout the entire design and development cycle. A preliminary survey was first undertaken with end users, that is, architects, chief engineers, and decision makers of a real-world architectural and urban planning project, followed by a study of the traditional workflow employed. We then determined the elements required to make the VE useful in the real-world setting, choosing appropriate graphical and auditory techniques to develop audiovisual VEs with a high level of realism. Our user-centered design approach guided the development of an appropriate interface and an evaluation methodology to test the overall usability of the system. The VE was evaluated both in the laboratory and, most importantly, in the users' natural work environments. In this study we present the choices we made as part of the design and evaluation methodologies employed, which successfully combined research goals with those of a real-world project. Among other results, this evaluation suggests that involving users and designers from the beginning improves the effectiveness of the VE in the context of the real world urban planning project. Furthermore, it demonstrates that appropriate levels of realism, in particular spatialized 3D sound, high-detail vegetation, and shadows, as well as the presence of rendered crowds, are significant for the design process and for communicating about designs; they enable better appreciation of overall ambience of the VE, perception of space and physical objects, as well as the sense of scale. We believe this study is of interest to VE researchers, designers, and practitioners, as well as professionals interested in using VR in their workplace
Drawing from motion capture : developing visual languages of animation
The work presented in this thesis aims to explore novel approaches of combining motion capture with drawing and 3D animation. As the art form of animation matures, possibilities of hybrid techniques become more feasible, and crosses between traditional and digital media provide new opportunities for artistic expression. 3D computer animation is used for its keyframing and rendering advancements, that result in complex pipelines where different areas of technical and artistic specialists contribute to the end result. Motion capture is mostly used for realistic animation, more often than not for live-action filmmaking, as a visual effect. Realistic animated films depend on retargeting techniques, designed to preserve actors performances with a high degree of accuracy. In this thesis, we investigate alternative production methods that do not depend on retargeting, and provide animators with greater options for experimentation and expressivity. As motion capture data is a great source for naturalistic movements, we aim to combine it with interactive methods such as digital sculpting and 3D drawing. As drawing is predominately used in preproduction, in both the case of realistic animation and visual effects, we embed it instead to alternative production methods, where artists can benefit from improvisation and expression, while emerging in a three-dimensional environment. Additionally, we apply these alternative methods for the visual development of animation, where they become relevant for the creation of specific visual languages that can be used to articulate concrete ideas for storytelling in animation
To Affinity and Beyond: Interactive Digital Humans as a Human Computer Interface
The field of human computer interaction is increasingly exploring the use of more natural, human-like user interfaces to build intelligent agents to aid in everyday life. This is coupled with a move to people using ever more realistic avatars to represent themselves in their digital lives. As the ability to produce emotionally engaging digital human representations is only just now becoming technically possible, there is little research into how to approach such tasks. This is due to both technical complexity and operational implementation cost. This is now changing as we are at a nexus point with new approaches, faster graphics processing and enabling new technologies in machine learning and computer vision becoming available. I articulate the issues required for such digital humans to be considered successfully located on the other side of the phenomenon known as the Uncanny Valley. My results show that a complex mix of perceived and contextual aspects affect the sense making on digital humans and highlights previously undocumented effects of interactivity on the affinity. Users are willing to accept digital humans as a new form of user interface and they react to them emotionally in previously unanticipated ways. My research shows that it is possible to build an effective interactive digital human that crosses the Uncanny Valley. I directly explore what is required to build a visually realistic digital human as a primary research question and I explore if such a realistic face provides sufficient benefit to justify the challenges involved in building it. I conducted a Delphi study to inform the research approaches and then produced a complex digital human character based on these insights. This interactive and realistic digital human avatar represents a major technical undertaking involving multiple teams around the world. Finally, I explored a framework for examining the ethical implications and signpost future research areas
Animating observed emotional behaviour: a practice-based investigation comparing three approaches to self-figurative animation
This research explores different animation approaches to rendering observed emotional behaviour, through the creation of an animated artefact. It opens with an introduction to the research and the methodology chosen before progressing to a review of academic and practitioner-based literature associated with observed emotional behaviour. Building upon this foundation of literature, the thesis outlines how the artifact was created with a practice based approach drawn from Haseman’s cycle of creation, feedback, reflection and then creation. The main research question is augmented by a series of contributory questions that explore the research through iterations of animation drawn from a base of live action footage of observed emotional behaviour. These exploratory iterations progress though motion capture, rotoscopy and finally freeform animation. The completed artifact and its findings are explored first though a perception study and then a production study. This thesis is based on the investigation and discourse of observed emotional behaviour surrounding the use of animation, specifically, the direct study of the observation of emotional behaviour through the application of animation as a tool of research. It aims to provide a basis of discussion and contribution to knowledge for animation practitioners, theorists and practitioner-researchers seeking to use less performative and exaggerated forms
- …