3D-GPT: Procedural 3D Modeling with Large Language Models

In the pursuit of efficient automated content creation, procedural generation, leveraging modifiable parameters and rule-based systems, emerges as a promising approach. Nonetheless, it could be a demanding endeavor, given its intricate nature necessitating a deep understanding of rules, algorithms, and parameters. To reduce workload, we introduce 3D-GPT, a framework utilizing large language models~(LLMs) for instruction-driven 3D modeling. 3D-GPT positions LLMs as proficient problem solvers, dissecting the procedural 3D modeling tasks into accessible segments and appointing the apt agent for each task. 3D-GPT integrates three core agents: the task dispatch agent, the conceptualization agent, and the modeling agent. They collaboratively achieve two objectives. First, it enhances concise initial scene descriptions, evolving them into detailed forms while dynamically adapting the text based on subsequent instructions. Second, it integrates procedural generation, extracting parameter values from enriched text to effortlessly interface with 3D software for asset creation. Our empirical investigations confirm that 3D-GPT not only interprets and executes instructions, delivering reliable results but also collaborates effectively with human designers. Furthermore, it seamlessly integrates with Blender, unlocking expanded manipulation possibilities. Our work highlights the potential of LLMs in 3D modeling, offering a basic framework for future advancements in scene generation and animation.Comment: Project page: https://chuny1.github.io/3DGPT/3dgpt.htm

Simulation of 3D Model, Shape, and Appearance Aging by Physical, Chemical, Biological, Environmental, and Weathering Effects

Physical, chemical, biological, environmental, and weathering effects produce a range of 3D model, shape, and appearance changes. Time introduces an assortment of aging, weathering, and decay processes such as dust, mold, patina, and fractures. These time-varying imperfections provide the viewer with important visual cues for realism and age. Existing approaches that create realistic aging effects still require an excessive amount of time and effort by extremely skilled artists to tediously hand fashion blemishes or simulate simple procedural rules. Most techniques do not scale well to large virtual environments. These limitations have prevented widespread utilization of many aging and weathering algorithms. We introduce a novel method for geometrically and visually simulating these processes in order to create visually realistic scenes. This work proposes the ``mu-ton system, a framework for scattering numerous mu-ton particles throughout an environment to mutate and age the world. We take a point based representation to discretize both the decay effects and the underlying geometry. The mu-ton particles simulate interactions between multiple phenomena. This mutation process changes both the physical properties of the external surface layer and the internal volume substrate. The mutation may add or subtract imperfections into the environment as objects age. First we review related work in aging and weathering, and illustrate the limitations of the current data-driven and physically based approaches. We provide a taxonomy of aging processes. We then describe the structure for our ``mu-ton framework, and we provide the user a short tutorial how to setup different effects. The first application of the ``mu-ton system focuses on inorganic aging and decay. We demonstrate changing material properties on a variety of objects, and simulate their transformation. We show the application of our system aging a simple city alley on different materials. The second application of the ``mu-ton system focuses organic aging. We provide details on simulating a variety of growth processes. We then evaluate and analyze the ``mu-ton framework and compare our results with ``gamma-ton tracing. Finally, we outline the contributions this thesis provides to computer-based aging and weathering simulation

Automatic 3D model creation with velocity-based surface deformations

The virtual worlds of Computer Graphics are populated by geometric objects, called models. Researchers have addressed the problem of synthesizing models automatically. Traditional modeling approaches often require a user to guide the synthesis process and to look after the geometry being synthesized, but user attention is expensive, and reducing user interaction is therefore desirable. I present a scheme for the automatic creation of geometry by deforming surfaces. My scheme includes a novel surface representation; it is an explicit representation consisting of points and edges, but it is not a traditional polygonal mesh. The novel surface representation is paired with a resampling policy to control the surface density and its evolution during deformation. The surface deforms with velocities assigned to its points through a set of deformation operators. Deformation operators avoid the manual computation and assignment of velocities, the operators allow a user to interactively assign velocities with minimal effort. Additionally, Petri nets are used to automatically deform a surface by mimicking a user assigning deformation operators. Furthermore, I present an algorithm to translate from the novel surface representations to a polygonal mesh. I demonstrate the utility of my model generation scheme with a gallery of models created automatically. The scheme's surface representation and resampling policy enables a surface to deform without requiring a user to control the deformation; self-intersections and hole creation are automatically prevented. The generated models show that my scheme is well suited to create organic-like models, whose surfaces have smooth transitions between surface features, but can also produce other kinds of models. My scheme allows a user to automatically generate varied instances of richly detailed models with minimal user interaction

PlantGL : a Python-based geometric library for 3D plant modelling at different scales

In this paper, we present PlantGL, an open-source graphic toolkit for the creation, simulation and analysis of 3D virtual plants. This C++ geometric library is embedded in the Python language which makes it a powerful user-interactive platform for plant modelling in various biological application domains. PlantGL makes it possible to build and manipulate geometric models of plants or plant parts, ranging from tissues and organs to plant populations. Based on a scene graph augmented with primitives dedicated to plant representation, several methods are provided to create plant architectures from either field measurements or procedural algorithms. Because they reveal particularly useful in plant design and analysis, special attention has been paid to the definition and use of branching system envelopes. Several examples from different modelling applications illustrate how PlantGL can be used to construct, analyse or manipulate geometric models at different scales

Photorealistic visualisation of urban greening in a low-cost high- density housing settlement.

Thesis (M.Sc.)-University of KwaZulu-Natal, Pietermaritzburg, 2005.Apartheid housing policies of the pre-1994 South African government, and the low-cost highdensity housing programmes of the post-1994 government, has given rise to numerous urban environmental problems, some of which could be addressed in a cost-effective and sustainable manner through urban greening, while simultaneously promoting biodiversity. Public participation in the planning of urban greening has been identified as being of vital importance, without which urban greening projects run a high, and expensive, risk of failure. Previous studies indicate that the greening priorities of residents in low-cost high-density housing settlements may differ considerably from those of managers and experts tasked with the protection and extension of the natural environment resource base. A system of participatory decision support is therefore required to reconcile the greening requirements of the community, and the ecological benefits of biodiversity. If language, literacy, map literacy and numeracy difficulties are to be avoided, and a sense of place or belonging is to be invoked, such a participatory decision support system should, ideally, be visually based, and capable of generating realistic eye-level depictions of the urban landscape. New computer-based landscape visualisation applications, which can directly utilise GIS, CAD and DEM data to produce detailed photo-realistic viewsheds, were deemed better suited to the task of visualising urban greening than existing GIS based mapping systems, CAD and traditional landscape visualisation methods. This dissertation examines the process of constructing a 3D computer model of the Mount Royal low-cost high-density housing settlement, situated in the eThekwini Municipality, KwaZulu-Natal, South Africa. Visualisations including terrain, natural features, indigenous vegetation, houses and roads were produced and submitted, with a questionnaire, to experts from different disciplines, Mount Royal residents and neighbors. Results from the expert survey indicate moderate support for visualisation in professional decision-making. However, both experts and residents expressed strong support for the accuracy and credibility ofthe visualisations, as well as for their potential in a participatory decision support system

Editorial: Rendering Research

To render is to give something “cause to be” or “hand over” (from the Latin reddere “give back”) and enter into an obligation to do or make something like a decision. More familiar perhaps in computing, to render is to take an image or file and convert it into another format or apply a modification of some kind; or in the case of 3D animation or scanning, to render is to animate it or give it volume. In this issue, we ask, what does it mean to render research? How does the rendering of research reinforce certain limitations of thought and action? We ask these questions in the context of more and more demands on researchers to produce academic outputs in standardised forms, in peer-reviewed journals and such like that are legitimised by normative values. So, then, how to render research otherwise

Upright posture and the meaning of meronymy: A synthesis of metaphoric and analytic accounts

Cross-linguistic strategies for mapping lexical and spatial relations from body partonym systems to external object meronymies (as in English ‘table leg’, ‘mountain face’) have attracted substantial research and debate over the past three decades. Due to the systematic mappings, lexical productivity and geometric complexities of body-based meronymies found in many Mesoamerican languages, the region has become focal for these discussions, prominently including contrastive accounts of the phenomenon in Zapotec and Tzeltal, leading researchers to question whether such systems should be explained as global metaphorical mappings from bodily source to target holonym or as vector mappings of shape and axis generated “algorithmically”. I propose a synthesis of these accounts in this paper by drawing on the species-specific cognitive affordances of human upright posture grounded in the reorganization of the anatomical planes, with a special emphasis on antisymmetrical relations that emerge between arm-leg and face-groin antinomies cross-culturally. Whereas Levinson argues that the internal geometry of objects “stripped of their bodily associations” (1994: 821) is sufficient to account for Tzeltal meronymy, making metaphorical explanations entirely unnecessary, I propose a more powerful, elegant explanation of Tzeltal meronymic mapping that affirms both the geometric-analytic and the global-metaphorical nature of Tzeltal meaning construal. I do this by demonstrating that the “algorithm” in question arises from the phenomenology of movement and correlative body memories—an experiential ground which generates a culturally selected pair of inverse contrastive paradigm sets with marked and unmarked membership emerging antithetically relative to the transverse anatomical plane. These relations are then selected diagrammatically for the classification of object orientations according to systematic geometric iconicities. Results not only serve to clarify the case in question but also point to the relatively untapped potential that upright posture holds for theorizing the emergence of human cognition, highlighting in the process the nature, origins and theoretical validity of markedness and double scope conceptual integration

Who Killed Sovereignty – or: Changing Norms Concerning Sovereignty in International Law

One of the oldest distinctions in philosophical discourse is that between words about words and words about things. \u27 Much scholarship among international lawyers and political scientists, as well as table-talk of diplomats and other practitioners concerning the somewhat airy concept of sovereignty, has suffered all too much from a failure to appreciate the confusion that flows from treating a word as though it were a fact. Now come to the table two pairs of scholars with contrasting interpretations of the central word of international law, sovereinty: at one end, international lawyers Abram and Antonia Handler Chayes; and at the other, political scientists Michael Ross Fowler and Julie Marie Bunck. Ironically, however, the lawyers unveil a new sovereignty by employing a variety of social science methodologies to explicate a nonlegal, managerial approach to the study of the transfer of state authority to international institutions. In a converse irony, the political scientists have appropriated the international lawyer\u27s interpretive canon, parsing international judicial and arbitral decisions and combing state practice as evidence of customary international law, to advance an essentially traditional conception of sovereignty as state sovereignty

Modeling and Visualization of Multi-material Volumes

The terminology of multi-material volumes is discussed. The classification of the multi-material volumes is given from the spatial partitions, spatial domain for material distribution, types of involved scalar fields and types of models for material distribution and composition of several materials points of view. In addition to the technical challenges of multi-material volume representations, a range of key challenges are considered before such representations can be adopted as mainstream practice