Is immersive virtual reality the ultimate interface for 3D animators?

Creating computer animations is a labor-intensive task. Existing virtual reality (VR)-based animation solutions offer only heterogeneous subsets of traditional tools' functionalities. We present an add-on for the Blender animation suite that enables users to switch between native and immersive VR-based interfaces and employ the latter to perform a representative set of tasks

Interfaces for human-centered production and use of computer graphics assets

L'abstract è presente nell'allegato / the abstract is in the attachmen

Immersive Virtual Reality-Based Interfaces for Character Animation

Virtual Reality (VR) has increasingly attracted the attention of the computer animation community in search of more intuitive and effective alternatives to the current sophisticated user interfaces. Previous works in the literature already demonstrated the higher affordances offered by VR interaction, as well as the enhanced spatial understanding that arises thanks to the strong sense of immersion guaranteed by virtual environments. These factors have the potential to improve the animators' job, which is tremendously skill-intensive and time-consuming. The present paper explores the opportunities provided by VR-based interfaces for the generation of 3D animations via armature deformation. To the best of the authors' knowledge, for the first time a tool is presented which allows users to manage a complete pipeline supporting the above animation method, by letting them execute key tasks such as rigging, skinning and posing within a well-known animation suite using a customizable interface. Moreover, it is the first work to validate, in both objective and subjective terms, character animation performance in the above tasks and under realistic work conditions involving different user categories. In our experiments, task completion time was reduced by 26%, on average, while maintaining almost the same levels of accuracy and precision for both novice and experienced users

I-Light Symposium 2005 Proceedings

I-Light was made possible by a special appropriation by the State of Indiana. The research described at the I-Light Symposium has been supported by numerous grants from several sources. Any opinions, findings and conclusions, or recommendations expressed in the 2005 I-Light Symposium Proceedings are those of the researchers and authors and do not necessarily reflect the views of the granting agencies.Indiana University Office of the Vice President for Research and Information Technology, Purdue University Office of the Vice President for Information Technology and CI

HyperCell: A Bio-inspired Design Framework for Real-time Interactive Architectures

This pioneering research focuses on Biomimetic Interactive Architecture using “Computation”, “Embodiment”, and “Biology” to generate an intimate embodied convergence to propose a novel rule-based design framework for creating organic architectures composed of swarm-based intelligent components. Furthermore, the research boldly claims that Interactive Architecture should emerge as the next truly Organic Architecture. As the world and society are dynamically changing, especially in this digital era, the research dares to challenge the Utilitas, Firmitas, and Venustas of the traditional architectural Weltanschauung, and rejects them by adopting the novel notion that architecture should be dynamic, fluid, and interactive. This project reflects a trajectory from the 1960’s with the advent of the avant-garde architectural design group, Archigram, and its numerous intriguing and pioneering visionary projects. Archigram’s non-standard, mobile, and interactive projects profoundly influenced a new generation of architects to explore the connection between technology and their architectural projects. This research continues this trend of exploring novel design thinking and the framework of Interactive Architecture by discovering the interrelationship amongst three major topics: “Computation”, “Embodiment”, and “Biology”. The project aims to elucidate pioneering research combining these three topics in one discourse: “Bio-inspired digital architectural design”. These three major topics will be introduced in this Summary.   “Computation”, is any type of calculation that includes both arithmetical and nonarithmetical steps and follows a well-defined model understood and described as, for example, an algorithm. But, in this research, refers to the use of data storage, parametric design application, and physical computing for developing informed architectural designs. “Form” has always been the most critical focus in architectural design, and this focus has also been a major driver behind the application computational design in Architecture. Nonetheless, this research will interpret the term “Form” in architecture as a continual “information processor” rather than the result of information processing. In other words, “Form” should not be perceived only as an expressive appearance based computational outcome but rather as a real-time process of information processing, akin to organic “Formation”. Architecture embodying kinetic ability for adjusting or changing its shape with the ability to process the surroundings and feedback in accordance with its free will with an inherent interactive intelligent movement of a living body. Additionally, it is also crucial to address the question of whether computational technologies are being properly harnessed, if they are only used for form-generating purposes in architecture design, or should this be replaced with real-time information communication and control systems to produce interactive architectures, with embodied computation abilities?   “Embodiment” in the context of this research is embedded in Umberto Eco’s vision on Semiotics, theories underlying media studies in Marshall McLuhan’s “Body Extension” (McLuhan, 1964), the contemporary philosophical thought of “Body Without Organs” (Gilles Deleuze and Félix Guattari, 1983), the computational Logic of ‘Swarm Behavior’ and the philosophical notion of “Monadology” proposed by Gottfried Leibniz (Leibniz, 1714). Embodied computation and design are predominant today within the wearable computing and smart living domains, which combine Virtual and Real worlds. Technical progress and prowess in VR development also contribute to advancing 3D smart architectural design and display solutions. The proposed ‘Organic body-like architectural spaces’ emphasize upon the realization of a body-like interactive space. Developing Interactive Architecture will imply eliciting the collective intelligence prevalent in nature and the virtual world of Big Data. Interactive Architecture shall thus embody integrated Information exchange protocols and decision-making systems in order to possess organic body-like qualities.   “Biology”, in this research explores biomimetic principles intended to create purposedriven kinetic and organic architecture. This involves a detailed study/critique of organic architecture, generating organic shapes, performance optimization based digital fabrication techniques and kinetic systems. A holistic bio-inspired architecture embodies multiple performance criteria akin to natural systems, which integrate structural, infrastructure performances throughout the growth of an organic body. Such a natural morphogenesis process of architectural design explores what Janine M. Benyus described as “learning the natural process”. Profoundly influenced by the processes behind morphogenesis, the research further explores Evolutionary Development Biology (Evo-Devo) explaining how embryological regulation strongly affect the resulting formations. Evo-Devo in interactive architecture implies the development of architecture based on three fundamental principles: “Simple to Complex”, “Geometric Information Distribution”, and “On/Off Switch and Trigger.” The research seeks to create a relatively intelligent architectural body, and the tactile interactive spatial environment by applying the extracted knowledge from the study of the aforementioned principles of Evo-Devo in the following fashion: A. Extract a Self-Similar Componential System based approach from the “Simple to Complex” principle of Evo-Devo B. Extract the idea of “Collective Intelligence” from “Geometric information Distribution” principle of Evo-Devo C. Extract the principle of “Assembly Regulation” from “On/Off switch and trigger” principle of Evo-Devo The “HyperCell” research, through an elaborate investigation on the three aforementioned topics, develops a design framework for developing real-time adaptive spatial systems. HyperCell does this, by developing a system of transformable cubic elements which can self-organize, adapt and interact in real-time. These Hypercells shall comprise an organic space which can adjust itself in relation to our human bodies. The furniture system is literally reified and embodied to develop an intra-active space that proactively provokes human movement. The space thus acquires an emotive dimension and can become your pet, partner, or even friend, and might also involve multiple usabilities of the same space. The research and its progression were also had actively connected with a 5-year collaborative European Culture project: “MetaBody”. The research thus involves exploration of Interactive Architecture from the following perspectives: architectural design, digital architectural history trajectory, computational technology, philosophical discourse related to the embodiment, media and digital culture, current VR and body-related technology, and Evolutionary Developmental Biology. “HyperCell” will encourage young architects to pursue interdisciplinary design initiatives via the fusion of computational design, embodiment, and biology for developing bio-inspired organic architectures

HyperCell: A Bio-inspired Design Framework for Real-time Interactive Architectures

This pioneering research focuses on Biomimetic Interactive Architecture using “Computationâ€, “Embodimentâ€, and “Biology†to generate an intimate embodied convergence to propose a novel rule-based design framework for creating organic architectures composed of swarm-based intelligent components. Furthermore, the research boldly claims that Interactive Architecture should emerge as the next truly Organic Architecture. As the world and society are dynamically changing, especially in this digital era, the research dares to challenge the Utilitas, Firmitas, and Venustas of the traditional architectural Weltanschauung, and rejects them by adopting the novel notion that architecture should be dynamic, fluid, and interactive. This project reflects a trajectory from the 1960’s with the advent of the avant-garde architectural design group, Archigram, and its numerous intriguing and pioneering visionary projects. Archigram’s non-standard, mobile, and interactive projects profoundly influenced a new generation of architects to explore the connection between technology and their architectural projects. This research continues this trend of exploring novel design thinking and the framework of Interactive Architecture by discovering the interrelationship amongst three major topics: “Computationâ€, “Embodimentâ€, and “Biologyâ€. The project aims to elucidate pioneering research combining these three topics in one discourse: “Bio-inspired digital architectural designâ€. These three major topics will be introduced in this Summary. “Computationâ€, is any type of calculation that includes both arithmetical and nonarithmetical steps and follows a well-defined model understood and described as, for example, an algorithm. But, in this research, refers to the use of data storage, parametric design application, and physical computing for developing informed architectural designs. “Form†has always been the most critical focus in architectural design, and this focus has also been a major driver behind the application computational design in Architecture. Nonetheless, this research will interpret the term “Form†in architecture as a continual “information processor†rather than the result of information processing. In other words, “Form†should not be perceived only as an expressive appearance based computational outcome but rather as a real-time process of information processing, akin to organic “Formationâ€. Architecture embodying kinetic ability for adjusting or changing its shape with the ability to process the surroundings and feedback in accordance with its free will with an inherent interactive intelligent movement of a living body. Additionally, it is also crucial to address the question of whether computational technologies are being properly harnessed, if they are only used for form-generating purposes in architecture design, or should this be replaced with real-time information communication and control systems to produce interactive architectures, with embodied computation abilities? “Embodiment†in the context of this research is embedded in Umberto Eco’s vision on Semiotics, theories underlying media studies in Marshall McLuhan’s “Body Extension†(McLuhan, 1964), the contemporary philosophical thought of “Body Without Organs†(Gilles Deleuze and Félix Guattari, 1983), the computational Logic of ‘Swarm Behavior’ and the philosophical notion of “Monadology†proposed by Gottfried Leibniz (Leibniz, 1714). Embodied computation and design are predominant today within the wearable computing and smart living domains, which combine Virtual and Real worlds. Technical progress and prowess in VR development also contribute to advancing 3D smart architectural design and display solutions. The proposed ‘Organic body-like architectural spaces’ emphasize upon the realization of a body-like interactive space. Developing Interactive Architecture will imply eliciting the collective intelligence prevalent in nature and the virtual world of Big Data. Interactive Architecture shall thus embody integrated Information exchange protocols and decision-making systems in order to possess organic body-like qualities. “Biologyâ€, in this research explores biomimetic principles intended to create purposedriven kinetic and organic architecture. This involves a detailed study/critique of organic architecture, generating organic shapes, performance optimization based digital fabrication techniques and kinetic systems. A holistic bio-inspired architecture embodies multiple performance criteria akin to natural systems, which integrate structural, infrastructure performances throughout the growth of an organic body. Such a natural morphogenesis process of architectural design explores what Janine M. Benyus described as “learning the natural processâ€. Profoundly influenced by the processes behind morphogenesis, the research further explores Evolutionary Development Biology (Evo-Devo) explaining how embryological regulation strongly affect the resulting formations. Evo-Devo in interactive architecture implies the development of architecture based on three fundamental principles: “Simple to Complexâ€, “Geometric Information Distributionâ€, and “On/Off Switch and Trigger.†The research seeks to create a relatively intelligent architectural body, and the tactile interactive spatial environment by applying the extracted knowledge from the study of the aforementioned principles of Evo-Devo in the following fashion: A. Extract a Self-Similar Componential Systembased approach from the “Simple to Complex†principle of Evo-Devo B. Extract the idea of “Collective Intelligence†from “Geometric information Distribution†principle of Evo-Devo C. Extract the principle of “Assembly Regulation†from “On/Off switch and trigger†principle of Evo-Devo The “HyperCell†research, through an elaborate investigation on the three aforementioned topics, develops a design framework for developing real-time adaptive spatial systems. HyperCell does this, by developing a system of transformable cubic elements which can self-organize, adapt and interact in real-time. These Hypercells shall comprise an organic space which can adjust itself in relation to our human bodies. The furniture system is literally reified and embodied to develop an intra-active space that proactively provokes human movement. The space thus acquires an emotive dimension and can become your pet, partner, or even friend, and might also involve multiple usabilities of the same space. The research and its progression were also had actively connected with a 5-year collaborative European Culture project: “MetaBodyâ€. The research thus involves exploration of Interactive Architecture from the following perspectives: architectural design, digital architectural history trajectory, computational technology, philosophical discourse related to the embodiment, media and digital culture, current VR and body-related technology, and Evolutionary Developmental Biology. “HyperCell†will encourage young architects to pursue interdisciplinary design initiatives via the fusion of computational design, embodiment, and biology for developing bio-inspired organic architectures

Autonomous behaviour in tangible user interfaces as a design factor

PhD ThesisThis thesis critically explores the design space of autonomous and actuated artefacts, considering how autonomous behaviours in interactive technologies might shape and influence users’ interactions and behaviours. Since the invention of gearing and clockwork, mechanical devices were built that both fascinate and intrigue people through their mechanical actuation. There seems to be something magical about moving devices, which draws our attention and piques our interest. Progress in the development of computational hardware is allowing increasingly complex commercial products to be available to broad consumer-markets. New technologies emerge very fast, ranging from personal devices with strong computational power to diverse user interfaces, like multi-touch surfaces or gestural input devices. Electronic systems are becoming smaller and smarter, as they comprise sensing, controlling and actuation. From this, new opportunities arise in integrating more sensors and technology in physical objects. These trends raise some specific questions around the impacts smarter systems might have on people and interaction: how do people perceive smart systems that are tangible and what implications does this perception have for user interface design? Which design opportunities are opened up through smart systems? There is a tendency in humans to attribute life-like qualities onto non-animate objects, which evokes social behaviour towards technology. Maybe it would be possible to build user interfaces that utilise such behaviours to motivate people towards frequent use, or even motivate them to build relationships in which the users care for their devices. Their aim is not to increase the efficiency of user interfaces, but to create interfaces that are more engaging to interact with and excite people to bond with these tangible objects. This thesis sets out to explore autonomous behaviours in physical interfaces. More specifically, I am interested in the factors that make a user interpret an interface as autonomous. Through a review of literature concerned with animated objects, autonomous technology and robots, I have mapped out a design space exploring the factors that are important in developing autonomous interfaces. Building on this and utilising workshops conducted with other researchers, I have vi developed a framework that identifies key elements for the design of Tangible Autonomous Interfaces (TAIs). To validate the dimensions of this framework and to further unpack the impacts on users of interacting with autonomous interfaces I have adopted a ‘research through design’ approach. I have iteratively designed and realised a series of autonomous, interactive prototypes, which demonstrate the potential of such interfaces to establish themselves as social entities. Through two deeper case studies, consisting of an actuated helium balloon and desktop lamp, I provide insights into how autonomy could be implemented into Tangible User Interfaces. My studies revealed that through their autonomous behaviour (guided by the framework) these devices established themselves, in interaction, as social entities. They furthermore turned out to be acceptable, especially if people were able to find a purpose for them in their lives. This thesis closes with a discussion of findings and provides specific implications for design of autonomous behaviour in interfaces

Developing a mixed reality assistance system based on projection mapping technology for manual operations at assembly workstations.

ABSTRACT Manual tasks play an important role in social sustainable manufacturing enterprises. Commonly, manual operations are used for low volume productions, but are not limited to. Operational models in manufacturing sisters cased of x-to-order paradigms (e.g. assembly-to-order) may require manual operations to speed-up the ramp-up time of new product configuration assemblies. The implications of manual operations in any production line may imply that any manufacturing or assembly process become more susceptible to human errors and therefore translate into delays, defects and/or poor product quality. In this scenario, virtual and augmented realities can offer significant advantages to support the human operator in manual operations. This research work presents the development of a mixed (virtual and augmented) reality assistance system that permits real-time support in manual operations. A review of mixed reality techniques and technologies was conducted, where it was determined to use a projection mapping solution for the proposed assistance system. According to the specific requirements of the demonstration environment, hardware and software components were chosen. The developed mixed reality assistance system was able to guide any user without any prior knowledge through the successful completion of the specific assembly task

Designing a New Tactile Display Technology and its Disability Interactions

People with visual impairments have a strong desire for a refreshable tactile interface that can provide immediate access to full page of Braille and tactile graphics. Regrettably, existing devices come at a considerable expense and remain out of reach for many. The exorbitant costs associated with current tactile displays stem from their intricate design and the multitude of components needed for their construction. This underscores the pressing need for technological innovation that can enhance tactile displays, making them more accessible and available to individuals with visual impairments. This research thesis delves into the development of a novel tactile display technology known as Tacilia. This technology's necessity and prerequisites are informed by in-depth qualitative engagements with students who have visual impairments, alongside a systematic analysis of the prevailing architectures underpinning existing tactile display technologies. The evolution of Tacilia unfolds through iterative processes encompassing conceptualisation, prototyping, and evaluation. With Tacilia, three distinct products and interactive experiences are explored, empowering individuals to manually draw tactile graphics, generate digitally designed media through printing, and display these creations on a dynamic pin array display. This innovation underscores Tacilia's capability to streamline the creation of refreshable tactile displays, rendering them more fitting, usable, and economically viable for people with visual impairments

Tabletop tangible maps and diagrams for visually impaired users

En dépit de leur omniprésence et de leur rôle essentiel dans nos vies professionnelles et personnelles, les représentations graphiques, qu'elles soient numériques ou sur papier, ne sont pas accessibles aux personnes déficientes visuelles car elles ne fournissent pas d'informations tactiles. Par ailleurs, les inégalités d'accès à ces représentations ne cessent de s'accroître ; grâce au développement de représentations graphiques dynamiques et disponibles en ligne, les personnes voyantes peuvent non seulement accéder à de grandes quantités de données, mais aussi interagir avec ces données par le biais de fonctionnalités avancées (changement d'échelle, sélection des données à afficher, etc.). En revanche, pour les personnes déficientes visuelles, les techniques actuellement utilisées pour rendre accessibles les cartes et les diagrammes nécessitent l'intervention de spécialistes et ne permettent pas la création de représentations interactives. Cependant, les récentes avancées dans le domaine de l'adaptation automatique de contenus laissent entrevoir, dans les prochaines années, une augmentation de la quantité de contenus adaptés. Cette augmentation doit aller de pair avec le développement de dispositifs utilisables et abordables en mesure de supporter l'affichage de représentations interactives et rapidement modifiables, tout en étant accessibles aux personnes déficientes visuelles. Certains prototypes de recherche s'appuient sur une représentation numérique seulement : ils peuvent être instantanément modifiés mais ne fournissent que très peu de retour tactile, ce qui rend leur exploration complexe d'un point de vue cognitif et impose de fortes contraintes sur le contenu. D'autres prototypes s'appuient sur une représentation numérique et physique : bien qu'ils puissent être explorés tactilement, ce qui est un réel avantage, ils nécessitent un support tactile qui empêche toute modification rapide. Quant aux dispositifs similaires à des tablettes Braille, mais avec des milliers de picots, leur coût est prohibitif. L'objectif de cette thèse est de pallier les limitations de ces approches en étudiant comment développer des cartes et diagrammes interactifs physiques, modifiables et abordables. Pour cela, nous nous appuyons sur un type d'interface qui a rarement été étudié pour des utilisateurs déficients visuels : les interfaces tangibles, et plus particulièrement les interfaces tangibles sur table. Dans ces interfaces, des objets physiques représentent des informations numériques et peuvent être manipulés par l'utilisateur pour interagir avec le système, ou par le système lui-même pour refléter un changement du modèle numérique - on parle alors d'interfaces tangibles sur tables animées, ou actuated. Grâce à la conception, au développement et à l'évaluation de trois interfaces tangibles sur table (les Tangible Reels, la Tangible Box et BotMap), nous proposons un ensemble de solutions techniques répondant aux spécificités des interfaces tangibles pour des personnes déficientes visuelles, ainsi que de nouvelles techniques d'interaction non-visuelles, notamment pour la reconstruction d'une carte ou d'un diagramme et l'exploration de cartes de type " Pan & Zoom ". D'un point de vue théorique, nous proposons aussi une nouvelle classification pour les dispositifs interactifs accessibles.Despite their omnipresence and essential role in our everyday lives, online and printed graphical representations are inaccessible to visually impaired people because they cannot be explored using the sense of touch. The gap between sighted and visually impaired people's access to graphical representations is constantly growing due to the increasing development and availability of online and dynamic representations that not only give sighted people the opportunity to access large amounts of data, but also to interact with them using advanced functionalities such as panning, zooming and filtering. In contrast, the techniques currently used to make maps and diagrams accessible to visually impaired people require the intervention of tactile graphics specialists and result in non-interactive tactile representations. However, based on recent advances in the automatic production of content, we can expect in the coming years a growth in the availability of adapted content, which must go hand-in-hand with the development of affordable and usable devices. In particular, these devices should make full use of visually impaired users' perceptual capacities and support the display of interactive and updatable representations. A number of research prototypes have already been developed. Some rely on digital representation only, and although they have the great advantage of being instantly updatable, they provide very limited tactile feedback, which makes their exploration cognitively demanding and imposes heavy restrictions on content. On the other hand, most prototypes that rely on digital and physical representations allow for a two-handed exploration that is both natural and efficient at retrieving and encoding spatial information, but they are physically limited by the use of a tactile overlay, making them impossible to update. Other alternatives are either extremely expensive (e.g. braille tablets) or offer a slow and limited way to update the representation (e.g. maps that are 3D-printed based on users' inputs). In this thesis, we propose to bridge the gap between these two approaches by investigating how to develop physical interactive maps and diagrams that support two-handed exploration, while at the same time being updatable and affordable. To do so, we build on previous research on Tangible User Interfaces (TUI) and particularly on (actuated) tabletop TUIs, two fields of research that have surprisingly received very little interest concerning visually impaired users. Based on the design, implementation and evaluation of three tabletop TUIs (the Tangible Reels, the Tangible Box and BotMap), we propose innovative non-visual interaction techniques and technical solutions that will hopefully serve as a basis for the design of future TUIs for visually impaired users, and encourage their development and use. We investigate how tangible maps and diagrams can support various tasks, ranging from the (re)construction of diagrams to the exploration of maps by panning and zooming. From a theoretical perspective we contribute to the research on accessible graphical representations by highlighting how research on maps can feed research on diagrams and vice-versa. We also propose a classification and comparison of existing prototypes to deliver a structured overview of current research