Foundry: Hierarchical Material Design for Multi-Material Fabrication

We demonstrate a new approach for designing functional material definitions for multi-material fabrication using our system called Foundry. Foundry provides an interactive and visual process for hierarchically designing spatially-varying material properties (e.g., appearance, mechanical, optical). The resulting meta-materials exhibit structure at the micro and macro level and can surpass the qualities of traditional composites. The material definitions are created by composing a set of operators into an operator graph. Each operator performs a volume decomposition operation, remaps space, or constructs and assigns a material composition. The operators are implemented using a domain-specific language for multi-material fabrication; users can easily extend the library by writing their own operators. Foundry can be used to build operator graphs that describe complex, parameterized, resolution-independent, and reusable material definitions. We also describe how to stage the evaluation of the final material definition which in conjunction with progressive refinement, allows for interactive material evaluation even for complex designs. We show sophisticated and functional parts designed with our system.National Science Foundation (U.S.) (1138967)National Science Foundation (U.S.) (1409310)National Science Foundation (U.S.) (1547088)National Science Foundation (U.S.). Graduate Research Fellowship ProgramMassachusetts Institute of Technology. Undergraduate Research Opportunities Progra

Procedurally generating surface detail for 3D models using voxel-based cellular automata

Procedural generation is used extensively in the field of computer graphics to automate content generation and speed up development. One particular area often automated is the generation of additional colour and structural detail for existing 3D models. This empowers artists by providing a tool-set that enhances their existing work-ow and saves time. 3D surface structures are traditionally represented by polygon mesh-based models augmented by 2D mapping techniques. These methods can approximate features, such as caves and overhangs, however they are complex and difficult to modify. As an alternative, a grid of voxels can model 3D shapes and surfaces, similar to how 2D pixels form an image. The regular form of voxel-based models is easier to alter, at the cost of additional computational overhead. One technique for generating and altering voxel content is by using Cellular Automata (CA). CAs are able to produce complex structures from simple rules and also easily map to higher dimensions, such as voxel datasets. However, creating CA rule-sets can be difficult and tedious. This is especially true when creating multidimensional CA. In our work we use a grammar system to create surface detail CA. The grammar we develop is similar to formal grammars used in procedural generation, such as L-systems and shape grammars. Our system is composed of three main sections: a model converter, grammar and CA executor. The model converter changes polygon-mesh models to and from a voxel-based model. The grammar provides a simple language to create CA that can consider 3D neighbourhoods and query parameters, such as colour or structure. Finally, the CA executor interprets the produced grammars into surface-oriented CAs. The final output of this system is a polygon-mesh model, altered by the CA, which is usable for graphics applications. We test the system by replicating a number of CA use-cases with our grammar system. From the results, we conclude that our grammar system is capable of creating a wide range of 3D detail CA. However, the high resolution of resulting meshes and slow processing times make the process more suited to o_-line processing and pre-production

Realistic reconstruction and rendering of detailed 3D scenarios from multiple data sources

During the last years, we have witnessed significant improvements in digital terrain modeling, mainly through photogrammetric techniques based on satellite and aerial photography, as well as laser scanning. These techniques allow the creation of Digital Elevation Models (DEM) and Digital Surface Models (DSM) that can be streamed over the network and explored through virtual globe applications like Google Earth or NASA WorldWind. The resolution of these 3D scenes has improved noticeably in the last years, reaching in some urban areas resolutions up to 1m or less for DEM and buildings, and less than 10 cm per pixel in the associated aerial imagery. However, in rural, forest or mountainous areas, the typical resolution for elevation datasets ranges between 5 and 30 meters, and typical resolution of corresponding aerial photographs ranges between 25 cm to 1 m. This current level of detail is only sufficient for aerial points of view, but as the viewpoint approaches the surface the terrain loses its realistic appearance. One approach to augment the detail on top of currently available datasets is adding synthetic details in a plausible manner, i.e. including elements that match the features perceived in the aerial view. By combining the real dataset with the instancing of models on the terrain and other procedural detail techniques, the effective resolution can potentially become arbitrary. There are several applications that do not need an exact reproduction of the real elements but would greatly benefit from plausibly enhanced terrain models: videogames and entertainment applications, visual impact assessment (e.g. how a new ski resort would look), virtual tourism, simulations, etc. In this thesis we propose new methods and tools to help the reconstruction and synthesis of high-resolution terrain scenes from currently available data sources, in order to achieve realistically looking ground-level views. In particular, we decided to focus on rural scenarios, mountains and forest areas. Our main goal is the combination of plausible synthetic elements and procedural detail with publicly available real data to create detailed 3D scenes from existing locations. Our research has focused on the following contributions: - An efficient pipeline for aerial imagery segmentation - Plausible terrain enhancement from high-resolution examples - Super-resolution of DEM by transferring details from the aerial photograph - Synthesis of arbitrary tree picture variations from a reduced set of photographs - Reconstruction of 3D tree models from a single image - A compact and efficient tree representation for real-time rendering of forest landscapesDurant els darrers anys, hem presenciat avenços significatius en el modelat digital de terrenys, principalment gràcies a tècniques fotogramètriques, basades en fotografia aèria o satèl·lit, i a escàners làser. Aquestes tècniques permeten crear Models Digitals d'Elevacions (DEM) i Models Digitals de Superfícies (DSM) que es poden retransmetre per la xarxa i ser explorats mitjançant aplicacions de globus virtuals com ara Google Earth o NASA WorldWind. La resolució d'aquestes escenes 3D ha millorat considerablement durant els darrers anys, arribant a algunes àrees urbanes a resolucions d'un metre o menys per al DEM i edificis, i fins a menys de 10 cm per píxel a les fotografies aèries associades. No obstant, en entorns rurals, boscos i zones muntanyoses, la resolució típica per a dades d'elevació es troba entre 5 i 30 metres, i per a les corresponents fotografies aèries varia entre 25 cm i 1m. Aquest nivell de detall només és suficient per a punts de vista aeris, però a mesura que ens apropem a la superfície el terreny perd tot el realisme. Una manera d'augmentar el detall dels conjunts de dades actuals és afegint a l'escena detalls sintètics de manera plausible, és a dir, incloure elements que encaixin amb les característiques que es perceben a la vista aèria. Així, combinant les dades reals amb instàncies de models sobre el terreny i altres tècniques de detall procedural, la resolució efectiva del model pot arribar a ser arbitrària. Hi ha diverses aplicacions per a les quals no cal una reproducció exacta dels elements reals, però que es beneficiarien de models de terreny augmentats de manera plausible: videojocs i aplicacions d'entreteniment, avaluació de l'impacte visual (per exemple, com es veuria una nova estació d'esquí), turisme virtual, simulacions, etc. En aquesta tesi, proposem nous mètodes i eines per ajudar a la reconstrucció i síntesi de terrenys en alta resolució partint de conjunts de dades disponibles públicament, per tal d'aconseguir vistes a nivell de terra realistes. En particular, hem decidit centrar-nos en escenes rurals, muntanyes i àrees boscoses. El nostre principal objectiu és la combinació d'elements sintètics plausibles i detall procedural amb dades reals disponibles públicament per tal de generar escenes 3D d'ubicacions existents. La nostra recerca s'ha centrat en les següents contribucions: - Un pipeline eficient per a segmentació d'imatges aèries - Millora plausible de models de terreny a partir d'exemples d’alta resolució - Super-resolució de models d'elevacions transferint-hi detalls de la fotografia aèria - Síntesis d'un nombre arbitrari de variacions d’imatges d’arbres a partir d'un conjunt reduït de fotografies - Reconstrucció de models 3D d'arbres a partir d'una única fotografia - Una representació compacta i eficient d'arbres per a navegació en temps real d'escenesPostprint (published version

Automatic 3D model creation with velocity-based surface deformations

The virtual worlds of Computer Graphics are populated by geometric objects, called models. Researchers have addressed the problem of synthesizing models automatically. Traditional modeling approaches often require a user to guide the synthesis process and to look after the geometry being synthesized, but user attention is expensive, and reducing user interaction is therefore desirable. I present a scheme for the automatic creation of geometry by deforming surfaces. My scheme includes a novel surface representation; it is an explicit representation consisting of points and edges, but it is not a traditional polygonal mesh. The novel surface representation is paired with a resampling policy to control the surface density and its evolution during deformation. The surface deforms with velocities assigned to its points through a set of deformation operators. Deformation operators avoid the manual computation and assignment of velocities, the operators allow a user to interactively assign velocities with minimal effort. Additionally, Petri nets are used to automatically deform a surface by mimicking a user assigning deformation operators. Furthermore, I present an algorithm to translate from the novel surface representations to a polygonal mesh. I demonstrate the utility of my model generation scheme with a gallery of models created automatically. The scheme's surface representation and resampling policy enables a surface to deform without requiring a user to control the deformation; self-intersections and hole creation are automatically prevented. The generated models show that my scheme is well suited to create organic-like models, whose surfaces have smooth transitions between surface features, but can also produce other kinds of models. My scheme allows a user to automatically generate varied instances of richly detailed models with minimal user interaction

Perceptual multivariate visualisation of volumetric Lagrangian fluid-flow processes

Lagrangian flow data in oceanography are highly complex, encompassing not only the underpinning Eulerian, advective, vectorial flow fields and the three-dimensional position coordinates of tracer particles but also supplementary trajectory information such as interaction radii of particles, lifecycle source-to-sink information and biochemical process data. Visualising all those data cooperatively in its three-dimensional context is a prime challenge, as it demands to present all relevant information to enable a contextual analysis of the flow process while preventing the most commonly-occurring perceptual issues of clutter, colourisation conflicts, artefacts and the lack of spatial references in fluid-flow applications. In this article, we present visualisation design approaches for 4D spatio-temporal data in their context and introduce a novel colour-mapping approach for 3D velocity tensors. The employed visualisation approach is evaluated towards perceptual adequacy and efficacy with respect to algebraic visualisation design and on an oceanographic case study. The technical and perceptual elements have further implications and applications for still-picture and animated volumetric visualisation design in related applications of the natural sciences, such as geological flow mapping

Isosurface modelling of soft objects in computer graphics.

There are many different modelling techniques used in computer graphics to describe a wide range of objects and phenomena. In this thesis, details of research into the isosurface modelling technique are presented. The isosurface technique is used in conjunction with more traditional modelling techniques to describe the objects needed in the different scenes of an animation. The isosurface modelling technique allows the description and animation of objects that would be extremely difficult, or impossible to describe using other methods. The objects suitable for description using isosurface modelling are soft objects. Soft objects merge elegantly with each other, pull apart, bubble, ripple and exhibit a variety of other effects. The representation was studied in three phases of a computer animation project: modelling of the objects; animation of the objects; and the production of the images. The research clarifies and presents many algorithms needed to implement the isosurface representation in an animation system. The creation of a hierarchical computer graphics animation system implementing the isosurface representation is described. The scalar fields defining the isosurfaces are represented using a scalar field description language, created as part of this research, which is automatically generated from the hierarchical description of the scene. This language has many techniques for combining and building the scalar field from a variety of components. Surface attributes of the objects are specified within the graphics system. Techniques are described which allow the handling of these attributes along with the scalar field calculation. Many animation techniques specific to the isosurface representation are presented. By the conclusion of the research, a graphics system was created which elegantly handles the isosurface representation in a wide variety of animation situations. This thesis establishes that isosurface modelling of soft objects is a powerful and useful technique which has wide application in the computer graphics community

Developmental delays and subcellular stress as downstream effects of sonoporation

Posters: no. 2Control ID: 1672434OBJECTIVES: The biological impact of sonoporation has often been overlooked. Here we seek to obtain insight into the cytotoxic impact of sonoporation by gaining new perspectives on anti-proliferative characteristics that may emerge within sonoporated cells. We particularly focused on investigating the cell-cycle progression kinetics of sonoporated cells and identifying organelles that may be stressed in the recovery process. METHODS: In line with recommendations on exposure hardware design, an immersion-based ultrasound platform has been developed. It delivers 1 MHz ultrasound pulses (100 cycles; 1 kHz PRF; 60 s total duration) with 0.45 MPa peak negative pressure to a cell chamber that housed HL-60 leukemia cells and lipid-shelled microbubbles at a 10:1 cell-tobubble ratio (for 1e6/ml cell density). Calcein was used to facilitate tracking of sonoporated cells with enhanced uptake of exogenous molecules. The developmental trend of sonoporated cells was quantitatively analyzed using BrdU/DNA flow cytometry that monitors the cell population’s DNA synthesis kinetics. This allowed us to measure the temporal progression of DNA synthesis of sonoporated cells. To investigate whether sonoporation would upset subcellular homeostasis, post-exposure cell samples were also assayed for various proteins using Western blot analysis. Analysis focus was placed on the endoplasmic reticulum (ER): an important organelle with multi-faceted role in cellular functioning. The post-exposure observation time spanned between 0-24 h. RESULTS: Despite maintaining viability, sonoporated cells were found to exhibit delays in cell-cycle progression. Specifically, their DNA synthesis time was lengthened substantially (for HL-60 cells: 8.7 h for control vs 13.4 h for the sonoporated group). This indicates that sonoporated cells were under stress: a phenomenon that is supported by our Western blot assays showing upregulation of ER-resident enzymes (PDI, Ero1), ER stress sensors (PERK, IRE1), and ER-triggered pro-apoptotic signals (CHOP, JNK). CONCLUSIONS: Sonoporation, whilst being able to facilitate internalization of exogenous molecules, may inadvertently elicit a cellular stress response. These findings seem to echo recent calls for reconsideration of efficiency issues in sonoporation-mediated drug delivery. Further efforts would be necessary to improve the efficiency of sonoporation-based biomedical applications where cell death is not desirable.postprin

A study on the change in plasma membrane potential during sonoporation

Posters: no. 4Control ID: 1680329OBJECTIVES: There has been validated that the correlation of sonoporation with calcium transients is generated by ultrasound-mediated microbubbles activity. Besides calcium, other ionic flows are likely involved in sonoporation. Our hypothesis is the cell electrophysiological properties are related to the intracellular delivery by ultrasound and microbubbles. In this study, a real-time live cell imaging platform is used to determine whether plasma membrane potential change is related to the sonoporation process at the cellular level. METHODS: Hela cells were cultured in DMEM supplemented with 10% FBS in Opticell Chamber at 37 °C and 5% CO2, and reached 80% confluency before experiments. The Calcein Blue-AM, DiBAC4(3) loaded cells in the Opticell chamber filled with PI solution and Sonovue microbubbles were immerged in a water tank on a inverted fluorescence microscope. Pulsed ultrasound (1MHz freq., 20 cycles, 20Hz PRF, 0.2-0.5MPa PNP) was irradiated at the angle of 45° to the region of interest for 1s.The real-time fluorescence imaging for different probes was acquired by a cooled CCD camera every 20s for 10min. The time-lapse fluorescence images were quantitatively analyzed to evaluate the correlation of cell viability, intracellular delivery with plasma membrane potential change. RESULTS: Our preliminary data showed that the PI fluorescence, which indicated intracellular delivery, was immediately accumulated in cells adjacent to microbubbles after exposure, suggesting that their membranes were damaged by ultrasound-activated microbubbles. However, the fluorescence reached its highest level within 4 to 6 minutes and was unchanged thereafter, indicating the membrane was gradually repaired within this period. Furthermore, using DIBAC4(3), which detected the change in the cell membrane potential, we found that the loss of membrane potential might be associated with intracellular delivery, because the PI fluorescence accumulation was usually accompanied with the change in DIBAC4 (3) fluorescence. CONCLUSIONS: Our study suggests that there may be a linkage between the cell membrane potential change and intracellular delivery mediated by ultrasound and microbubbles. We also suggest that other ionic flows or ion channels may be involved in the cell membrane potential change in sonoporation. Further efforts to explore the cellular mechanism of this phenomenon will improve our understanding of sonoporation.postprin

How sonoporation disrupts cellular structural integrity: morphological and cytoskeletal observations

Posters: no. 1Control ID: 1672429OBJECTIVES: In considering sonoporation for drug delivery applications, it is essential to understand how living cells respond to this puncturing force. Here we seek to investigate the effects of sonoporation on cellular structural integrity. We hypothesize that the membrane morphology and cytoskeletal behavior of sonoporated cells under recovery would inherently differ from that of normal viable cells. METHODS: A customized and calibrated exposure platform was developed for this work, and the ZR-75-30 breast carcinoma cells were used as the cell model. The cells were exposed to either single or multiple pulses of 1 MHz ultrasound (pulse length: 30 or 100 cycles; PRF: 1kHz; duration: up to 60s) with 0.45 MPa spatial-averaged peak negative pressure and in the presence of lipid-shelled microbubbles. Confocal microscopy was used to examine insitu the structural integrity of sonoporated cells (identified as ones with exogenous fluorescent marker internalization). For investigations on membrane morphology, FM 4-64 was used as the membrane dye (red), and calcein was used as the sonoporation marker (green); for studies on cytoskeletal behavior, CellLight (green) and propidium iodide (red) were used to respectively label actin filaments and sonoporated cells. Observation started from before exposure to up to 2 h after exposure, and confocal images were acquired at real-time frame rates. Cellular structural features and their temporal kinetics were quantitatively analyzed to assess the consistency of trends amongst a group of cells. RESULTS: Sonoporated cells exhibited membrane shrinkage (decreased by 61% in a cell’s cross-sectional area) and intracellular lipid accumulation (381% increase compared to control) over a 2 h period. The morphological repression of sonoporated cells was also found to correspond with post-sonoporation cytoskeletal processes: actin depolymerization was observed as soon as pores were induced on the membrane. These results show that cellular structural integrity is indeed disrupted over the course of sonoporation. CONCLUSIONS: Our investigation shows that the biophysical impact of sonoporation is by no means limited to the induction of membrane pores: e.g. structural integrity is concomitantly affected in the process. This prompts the need for further fundamental studies to unravel the complex sequence of biological events involved in sonoporation.postprin