On the Optimization of Visualizations of Complex Phenomena

The problem of perceptually optimizing complex visualizations is a difficult one, involving perceptual as well as aesthetic issues. In our experience, controlled experiments are quite limited in their ability to uncover interrelationships among visualization parameters, and thus may not be the most useful way to develop rules-of-thumb or theory to guide the production of high-quality visualizations. In this paper, we propose a new experimental approach to optimizing visualization quality that integrates some of the strong points of controlled experiments with methods more suited to investigating complex highly-coupled phenomena. We use human-in-the-loop experiments to search through visualization parameter space, generating large databases of rated visualization solutions. This is followed by data mining to extract results such as exemplar visualizations, guidelines for producing visualizations, and hypotheses about strategies leading to strong visualizations. The approach can easily address both perceptual and aesthetic concerns, and can handle complex parameter interactions. We suggest a genetic algorithm as a valuable way of guiding the human-in-the-loop search through visualization parameter space. We describe our methods for using clustering, histogramming, principal component analysis, and neural networks for data mining. The experimental approach is illustrated with a study of the problem of optimal texturing for viewing layered surfaces so that both surfaces are maximally observable

Shape: A 3D Modeling Tool for Astrophysics

We present a flexible interactive 3D morpho-kinematical modeling application for astrophysics. Compared to other systems, our application reduces the restrictions on the physical assumptions, data type and amount that is required for a reconstruction of an object's morphology. It is one of the first publicly available tools to apply interactive graphics to astrophysical modeling. The tool allows astrophysicists to provide a-priori knowledge about the object by interactively defining 3D structural elements. By direct comparison of model prediction with observational data, model parameters can then be automatically optimized to fit the observation. The tool has already been successfully used in a number of astrophysical research projects.Comment: 13 pages, 11 figures, accepted for publication in the "IEEE Transactions on Visualization and Computer Graphics

NNVA: Neural Network Assisted Visual Analysis of Yeast Cell Polarization Simulation

Complex computational models are often designed to simulate real-world physical phenomena in many scientific disciplines. However, these simulation models tend to be computationally very expensive and involve a large number of simulation input parameters which need to be analyzed and properly calibrated before the models can be applied for real scientific studies. We propose a visual analysis system to facilitate interactive exploratory analysis of high-dimensional input parameter space for a complex yeast cell polarization simulation. The proposed system can assist the computational biologists, who designed the simulation model, to visually calibrate the input parameters by modifying the parameter values and immediately visualizing the predicted simulation outcome without having the need to run the original expensive simulation for every instance. Our proposed visual analysis system is driven by a trained neural network-based surrogate model as the backend analysis framework. Surrogate models are widely used in the field of simulation sciences to efficiently analyze computationally expensive simulation models. In this work, we demonstrate the advantage of using neural networks as surrogate models for visual analysis by incorporating some of the recent advances in the field of uncertainty quantification, interpretability and explainability of neural network-based models. We utilize the trained network to perform interactive parameter sensitivity analysis of the original simulation at multiple levels-of-detail as well as recommend optimal parameter configurations using the activation maximization framework of neural networks. We also facilitate detail analysis of the trained network to extract useful insights about the simulation model, learned by the network, during the training process.Comment: Published at IEEE Transactions on Visualization and Computer Graphic

Learning Temporal Transformations From Time-Lapse Videos

Based on life-long observations of physical, chemical, and biologic phenomena in the natural world, humans can often easily picture in their minds what an object will look like in the future. But, what about computers? In this paper, we learn computational models of object transformations from time-lapse videos. In particular, we explore the use of generative models to create depictions of objects at future times. These models explore several different prediction tasks: generating a future state given a single depiction of an object, generating a future state given two depictions of an object at different times, and generating future states recursively in a recurrent framework. We provide both qualitative and quantitative evaluations of the generated results, and also conduct a human evaluation to compare variations of our models.Comment: ECCV201

Towards cost-efficient prospection and 3D visualization of underwater structures using compact ROVs

The deployment of Remotely Operated Vehicles (ROV) for underwater prospection and 3D visualization has grown significantly in civil applications for a few decades. The demand for a wide range of optical and physical parameters of underwater environments is explained by an increasing complexity of the monitoring requirements of these environments. The prospection of engineering constructions (e.g. quay walls or enclosure doors) and underwater heritage (e.g. wrecks or sunken structures) heavily relies on ROV systems. Furthermore, ROVs offer a very flexible platform to measure the chemical content of the water. The biggest bottleneck of currently available ROVs is the cost of the systems. This constrains the availability of ROVs to a limited number of companies and institutes. Fortunately, as with the recent introduction of cost-efficient Unmanned Aerial Vehicles on the consumer market, a parallel development is expected for ROVs. The ability to participate in this new field of expertise by building Do It Yourself (DIY) kits and by adapting and adding on-demand features to the platform will increase the range of this new technology. In this paper, the construction of a DIY OpenROV kit and its implementation in bathymetric research projects are elaborated. The original platform contains a modified webcam for visual underwater prospection and a Micro ElectroMechanical System (MEMS) based depth sensor, allowing relative positioning. However, the performance of the standard camera is limited and an absolute positioning system is absent. It is expected that 3D visualizations with conventional photogrammetric qualities are limited with the current system. Therefore, modifications to improve the standard platform are foreseen, allowing the development of a cost-efficient underwater platform. Preliminary results and expectations on these challenges are reported in this paper