Hierarchical Motion Brushes for Animation Instancing

International audienceOur work on "motion brushes" provides a new workflow for the creation and reuse of 3D animation with a focus on stylized movement and depiction. Conceptually, motion brushes expand existing brush models by incorporating hierarchies of 3D animated content including geometry, appearance information, and motion data as core brush primitives that are instantiated using a painting interface. Because motion brushes can encompass all the richness of detail and movement offered by animation software, they accommodate complex, varied effects that are not easily created by other means. To support reuse and provide an effective means for managing complexity, we propose a hierarchical representation that allows simple brushes to be combined into more complex ones. Our system provides stroke-based control over motion-brush parameters, including tools to effectively manage the temporal nature of the motion brush instances. We demonstrate the flexibility and richness of our system with motion brushes for splashing rain, footsteps appearing in the snow, and stylized visual effects

WorldBrush: Interactive Example-based Synthesis of Procedural Virtual Worlds

International audienceWe present a novel approach for the interactive synthesis and editing of virtual worlds. Our method is inspired by painting operations and uses methods for statistical example-based synthesis to automate content synthesis and deformation. Our real-time approach takes a form of local inverse procedural modeling based on intermediate statistical models: selected regions of procedurally and manually constructed example scenes are analyzed, and their parameters are stored as distributions in a palette, similar to colors on a painter’s palette. These distributions can then be interactively applied with brushes and combined in various ways, like in painting systems. Selected regions can also be moved or stretched while maintaining the consistency of their content. Our method captures both distributions of elements and structured objects, and models their interactions. Results range from the interactive editing of 2D artwork maps to the design of 3D virtual worlds, where constraints set by the terrain’s slope are also taken into account

A survey on personal computer applications in industrial design process

Thesis (Master)--Izmir Institute of Technology, Industrial Design, Izmir, 1999Includes bibliographical references (leaves: 157-162)Text in English, Abstract: Turkish and Englishxii, 194 leavesIn this thesis, computer aided design systems are studied from the industrial designer's point of view. The study includes industrial design processes, computer aided design systems and the integration aspects.The technical issues are priorly studied, including current hardware and software technologies. The pure technical concepts are tried to be supported with real-world examples and graphics. Several important design software are examined, whether by personal practice or by literature research, depending on the availability of the software.Finally, the thesis include a case study, a 17" LCD computer monitor designed with a set of graphic programs including two-dimensional and three-dimensional packages.Keywords: Computers, industrial design methods, design software, computer aided design

Conception et animation interactive de foules pour de vastes environnements

Crowds are increasingly present in audio-visual media, such as movies or video games. They help to strengthen the immersion of the subject in the virtual environment. However, creating crowds is most of the time based on models hard to master and which do not offer a direct control on the motion that you want to create. In this thesis we propose contributions for designing crowd motions through interactive and intuitive tools. Firstly, we present an interactive method for designing the crowds by distorting it like clay. The user can stretch, compress and twist the overall shape of the crowd to give it the shape he or she wishes. The inner characters of the crowd automatically adapt to the new shape imposed by the user. Secondly, we present a method to paint the motion and the density of the crowd to create it. We offer the opportunity to the user to create crowds by painting a grayscale density map and a motion map by gradients. Its colored maps are transformed by our system to crowds, thanks to our iterative algorithm seeking to optimize the different values of colored maps. Crowds obtained by these methods can occupy a very large space and are animated indefinitely. Unlike conventional methods of creating crowds, that are based on the adjustment of model parameters, our methods allow to design crowd motions based on higher level features of the crowd, as its overall shape, its internal movement or density. This offers the possibility to simply, quickly and intuitively create animated crowd contents.Les foules sont de plus en plus présentes dans les médias grands publics, comme le cinéma ou les jeux vidéo. Elles permettent de renforcer l'immersion du sujet dans l'environnement qui lui est présenté. Or, la création de mouvement de foule est la plus part du temps basé sur des modèles dures à prendre en main et qui n'offrent pas un contrôle direct sur le mouvement de foule que l'on souhaite créer. Dans cette thèse nous proposons des contributions sous forme de méthodes pour concevoir des mouvements de foules par le biais d'outils interactifs et intuitifs. Dans un premier temps, nous présentons une méthode interactive permettant de concevoir des foules en les déformant comme de l'argile. L'utilisateur peut tirer, compresser et torde la forme global de des foules pour leurs donner la forme qu'il ou elle souhaite. Les personnages qui composent la foule s'adaptent automatiquement à la nouvelle forme imposée par l'utilisateur. Dans un second temps, nous présentons une méthode permettant de peindre les mouvements et la densité de la foule pour la créer. Nous offrons la possibilité à l'utilisateur de créer des foules en peignant une carte de densité en niveau de gris, et une carte de mouvement via des dégradés. Ses cartes de couleurs sont utilisées par notre système pour le transformer en un mouvement de foule, via un algorithme itératif cherchant à optimiser les différentes valeurs des cartes de couleurs. Les foules obtenues par ces méthodes peuvent occupées un espace très large, et sont animées indéfiniment. Contrairement aux méthodes classiques de création de foules qui se basent sur l'ajustement de paramètres de modèles, nos méthodes permettent de concevoir les mouvements de foules en se basant sur des caractéristiques plus hauts niveaux de la foule, comme sa forme globale, ses mouvements internes ou sa densité. Ce qui offre la possibilité de créer du contenu de foule animée de manière simple, rapide et intuitif

Realistic reconstruction and rendering of detailed 3D scenarios from multiple data sources

During the last years, we have witnessed significant improvements in digital terrain modeling, mainly through photogrammetric techniques based on satellite and aerial photography, as well as laser scanning. These techniques allow the creation of Digital Elevation Models (DEM) and Digital Surface Models (DSM) that can be streamed over the network and explored through virtual globe applications like Google Earth or NASA WorldWind. The resolution of these 3D scenes has improved noticeably in the last years, reaching in some urban areas resolutions up to 1m or less for DEM and buildings, and less than 10 cm per pixel in the associated aerial imagery. However, in rural, forest or mountainous areas, the typical resolution for elevation datasets ranges between 5 and 30 meters, and typical resolution of corresponding aerial photographs ranges between 25 cm to 1 m. This current level of detail is only sufficient for aerial points of view, but as the viewpoint approaches the surface the terrain loses its realistic appearance. One approach to augment the detail on top of currently available datasets is adding synthetic details in a plausible manner, i.e. including elements that match the features perceived in the aerial view. By combining the real dataset with the instancing of models on the terrain and other procedural detail techniques, the effective resolution can potentially become arbitrary. There are several applications that do not need an exact reproduction of the real elements but would greatly benefit from plausibly enhanced terrain models: videogames and entertainment applications, visual impact assessment (e.g. how a new ski resort would look), virtual tourism, simulations, etc. In this thesis we propose new methods and tools to help the reconstruction and synthesis of high-resolution terrain scenes from currently available data sources, in order to achieve realistically looking ground-level views. In particular, we decided to focus on rural scenarios, mountains and forest areas. Our main goal is the combination of plausible synthetic elements and procedural detail with publicly available real data to create detailed 3D scenes from existing locations. Our research has focused on the following contributions: - An efficient pipeline for aerial imagery segmentation - Plausible terrain enhancement from high-resolution examples - Super-resolution of DEM by transferring details from the aerial photograph - Synthesis of arbitrary tree picture variations from a reduced set of photographs - Reconstruction of 3D tree models from a single image - A compact and efficient tree representation for real-time rendering of forest landscapesDurant els darrers anys, hem presenciat avenços significatius en el modelat digital de terrenys, principalment gràcies a tècniques fotogramètriques, basades en fotografia aèria o satèl·lit, i a escàners làser. Aquestes tècniques permeten crear Models Digitals d'Elevacions (DEM) i Models Digitals de Superfícies (DSM) que es poden retransmetre per la xarxa i ser explorats mitjançant aplicacions de globus virtuals com ara Google Earth o NASA WorldWind. La resolució d'aquestes escenes 3D ha millorat considerablement durant els darrers anys, arribant a algunes àrees urbanes a resolucions d'un metre o menys per al DEM i edificis, i fins a menys de 10 cm per píxel a les fotografies aèries associades. No obstant, en entorns rurals, boscos i zones muntanyoses, la resolució típica per a dades d'elevació es troba entre 5 i 30 metres, i per a les corresponents fotografies aèries varia entre 25 cm i 1m. Aquest nivell de detall només és suficient per a punts de vista aeris, però a mesura que ens apropem a la superfície el terreny perd tot el realisme. Una manera d'augmentar el detall dels conjunts de dades actuals és afegint a l'escena detalls sintètics de manera plausible, és a dir, incloure elements que encaixin amb les característiques que es perceben a la vista aèria. Així, combinant les dades reals amb instàncies de models sobre el terreny i altres tècniques de detall procedural, la resolució efectiva del model pot arribar a ser arbitrària. Hi ha diverses aplicacions per a les quals no cal una reproducció exacta dels elements reals, però que es beneficiarien de models de terreny augmentats de manera plausible: videojocs i aplicacions d'entreteniment, avaluació de l'impacte visual (per exemple, com es veuria una nova estació d'esquí), turisme virtual, simulacions, etc. En aquesta tesi, proposem nous mètodes i eines per ajudar a la reconstrucció i síntesi de terrenys en alta resolució partint de conjunts de dades disponibles públicament, per tal d'aconseguir vistes a nivell de terra realistes. En particular, hem decidit centrar-nos en escenes rurals, muntanyes i àrees boscoses. El nostre principal objectiu és la combinació d'elements sintètics plausibles i detall procedural amb dades reals disponibles públicament per tal de generar escenes 3D d'ubicacions existents. La nostra recerca s'ha centrat en les següents contribucions: - Un pipeline eficient per a segmentació d'imatges aèries - Millora plausible de models de terreny a partir d'exemples d’alta resolució - Super-resolució de models d'elevacions transferint-hi detalls de la fotografia aèria - Síntesis d'un nombre arbitrari de variacions d’imatges d’arbres a partir d'un conjunt reduït de fotografies - Reconstrucció de models 3D d'arbres a partir d'una única fotografia - Una representació compacta i eficient d'arbres per a navegació en temps real d'escenesPostprint (published version

Aesthetics of computation : unveiling the visual machine

Thesis (S.M.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2001."September 2001."Includes bibliographical references (p. 106-110).This thesis presents a new paradigm for the design of visual programming languages, with the goal of making computation visible and, in turn, more accessible. The Visual Machine Model emphasizes the need for clear visual representations of both machines and materials, and the importance of continuity. Five dynamic visual programming languages were designed and implemented according to the specification of the Visual Machine Model. In addition to individual analysis, a comparative evaluation of all five design experiments is conducted with respect to several ease of use metrics and Visual Machine qualities. While formal user tests have not been conducted, preliminary results from general user experiences indicate that being able to see and interact with computation does enhance the programming process.Jared Schiffman.S.M

Autocomplete element fields and interactive synthesis system development for aggregate applications.

Aggregate elements are ubiquitous in natural and man-made objects and have played an important role in the application of graphics, design and visualization. However, to efficiently arrange these aggregate elements with varying anisotropy and deformability still remains challenging, in particular in 3D environments. To overcome such a thorny issue, we thus introduce autocomplete element fields, including an element distribution formulation that can effectively cope with diverse output compositions with controllable element distributions in high production standard and efficiency as well as an element field formulation that can smoothly orient all the synthesized elements following given inputs, such as scalar or direction fields. The pro- posed formulations can not only properly synthesize distinct types of aggregate elements across various domain spaces without incorporating any extra process but also directly compute complete element fields from partial specifications without requiring fully specified inputs in any algorithmic step. Furthermore, in order to reduce input workload and enhance output quality for better usability and interactivity, we further develop an interactive synthesis system, centered on the idea of our autocomplete element fields, to facilitate the creation of element aggregations within different output do- mains. Analogous to conventional painting workflows, through a palette- based brushing interface, users can interactively mix and place a few aggregate elements over a brushing canvas and let our system automatically populate more aggregate elements with intended orientations and scales for the rest of outcome. The developed system can empower the users to iteratively design a variety of novel mixtures with reduced workload and enhanced quality under an intuitive and user-friendly brushing workflow with- out the necessity of a great deal of manual labor or technical expertise. We validate our prototype system with a pilot user study and exhibit its application in 2D graphic design, 3D surface collage, and 3D aggregate modeling

Procedural content generation for games

Virtual worlds play an increasingly important role in game development today. Whether in the entertainment industry, education, collaboration or data visualization - virtual space offers a freely definable environment that can be adapted to any purpose. Nevertheless, the creation of complex worlds is time-consuming and cost-intensive. A classic example for the use of a virtual world is a driving simulator where learner drivers can test their skills. The goal of the generation process is to model a realistic city that is large enough to move around for a long time without constantly passing places that have already been seen. Streets must be realistically modeled, have intersections, represent highways and country roads and create an image through buildings that create the greatest possible immersion in the virtual world. But there is still a lack of life. Pedestrians have to populate the streets in large numbers, other cars have to take part in the traffic, and a driving instructor has to sit next to the learner driver, commenting on the actions and chatting away on long journeys. In short, the effort to model such a world by hand would be immense. This thesis deals with different approaches to generate digital content for virtual worlds procedurally i.e., algorithmically. In the first part of this thesis, virtual, three-dimensional road networks are generated using a pre-defined network graph. The nodes in the graph can be generated procedurally or randomly or can be imported from open data platforms, e.g., from OpenStreetMaps (OSM). The automatic detection of intersections makes the generation flexible. The textures used for roads and intersections are constructed from prefabricated sprites whenever possible, or, in the case of a very individual construction, are newly generated during generation. The ability to create multi-lane roads gives the virtual cities a higher degree of realism. The interstices of the road network usually contain buildings, industrial areas, common areas or agricultural land. Once these so-called parcels have been identified, they can be populated with precisely these contents. In this dissertation we focus on accessible residential buildings. The second part of this thesis discusses a novel method of building generation that allows to procedurally create walk-in, multi-storey buildings. The proceeding of simple mesh generation as shown in the road network generation is extended by rules and constraints that allow a flexible floor planning and guarantee a connection of all rooms by a common corridor per floor and a staircase. Since a cityscape is usually characterised by different building shapes, the generation can be parameterized with regard to texturing, roof design, number of floors, and window and door layout. In order to ensure performance when rendering the city, each building is generated in three levels of detail. The lowest level only shows the outer walls, the highest level shows the interior rooms including stairs, doors and window frames. Once the environment is created in a way that allows the player a certain immersion, the game world has to be filled with life. Thus, the third part of this thesis discusses the procedural creation of stories for games based on pre-trained language models. The focus here is on an interactive, controlled way of playing, in which the player can interact with the objects, persons and places of the story and influence the plot. Actions generated from the entities of the previous section of the story should give a feeling of a prepared story, but always ensure the greatest possible flexibility of course. The controlled use of places, people and objects in the player's inventory allows a porting to a three-dimensional game world as well as the gameplay in the form of a text adventure. All methods for creating digital content presented in this thesis were fully implemented and evaluated with respect to usability and performance

An aesthetics of touch: investigating the language of design relating to form

How well can designers communicate qualities of touch? This paper presents evidence that they have some capability to do so, much of which appears to have been learned, but at present make limited use of such language. Interviews with graduate designer-makers suggest that they are aware of and value the importance of touch and materiality in their work, but lack a vocabulary to fully relate to their detailed explanations of other aspects such as their intent or selection of materials. We believe that more attention should be paid to the verbal dialogue that happens in the design process, particularly as other researchers show that even making-based learning also has a strong verbal element to it. However, verbal language alone does not appear to be adequate for a comprehensive language of touch. Graduate designers-makers’ descriptive practices combined non-verbal manipulation within verbal accounts. We thus argue that haptic vocabularies do not simply describe material qualities, but rather are situated competences that physically demonstrate the presence of haptic qualities. Such competencies are more important than groups of verbal vocabularies in isolation. Design support for developing and extending haptic competences must take this wide range of considerations into account to comprehensively improve designers’ capabilities

Procedurally generated realistic virtual rural worlds

Manually creating virtual rural worlds is often a difficult and lengthy task for artists, as plant species selection, plant distributions and water networks must be deduced such that they realistically reflect the environment being modelled. As virtual worlds grow in size and complexity, climates vary on the terrain itself and a single ecosystem is no longer sufficient to realistically model all vegetation. Consequentially, the task is only becoming more difficult for these artists. Procedural methods are extensively used in computer graphics to partially or fully automate some tasks and take some of the burden off the user. Input parameters for these procedural algorithms are often unintuitive, however, and their impact on the final results, unclear. This thesis proposes, implements, and evaluates an approach to procedurally generate vegetation and water networks for realistic virtual rural worlds. Rather than placing these to reflect the environment being modelled, the work-flow is mirrored and the user models the environment directly by specifying the resources available. These intuitive input parameters are subsequently used to configure procedural algorithms and determine suitable vegetation, plant distributions and water networks. By design, the placeable plant species are configurable so any type of environment can be modelled at various levels of detail. The system has been tested by creating three ecosystems with little effort on the part of the user