A Survey of Ocean Simulation and Rendering Techniques in Computer Graphics

This paper presents a survey of ocean simulation and rendering methods in computer graphics. To model and animate the ocean's surface, these methods mainly rely on two main approaches: on the one hand, those which approximate ocean dynamics with parametric, spectral or hybrid models and use empirical laws from oceanographic research. We will see that this type of methods essentially allows the simulation of ocean scenes in the deep water domain, without breaking waves. On the other hand, physically-based methods use Navier-Stokes Equations (NSE) to represent breaking waves and more generally ocean surface near the shore. We also describe ocean rendering methods in computer graphics, with a special interest in the simulation of phenomena such as foam and spray, and light's interaction with the ocean surface

Visualizing characteristics of ocean data collected during the Shuttle Imaging Radar-B experiment

Topographic measurements of sea surface elevation collected by the Surface Contour Radar (SCR) during NASA's Shuttle Imaging Radar (SIR-B) experiment are plotted as three dimensional surface plots to observe wave height variance along the track of a P-3 aircraft. Ocean wave spectra were computed from rotating altimeter measurements acquired by the Radar Ocean Wave Spectrometer (ROWS). Fourier power spectra computed from SIR-B synthetic aperture radar (SAR) images of the ocean are compared to ROWS surface wave spectra. Fourier inversion of SAR spectra, after subtraction of spectral noise and modeling of wave height modulation, yields topography similar to direct measurements made by SCR. Visual perspectives on the SCR and SAR ocean data are compared. Threshold distinctions between surface elevation and texture modulations of SAR data are considered within the context of a dynamic statistical model of rough surface scattering. The result of these endeavors is insight as to the physical mechanism governing the imaging of ocean waves with SAR

Optical Image Blending for Underwater Mosaics

Typical problems for creation of consistent underwater mosaic are misalignment and inhomogeneous illumination of the image frames, which causes visible seams and consequently complicates post-processing of the mosaics such as object recognition and shape extraction. Two recently developed image blending methods were explored in the literature: gradient domain stitching and graph-cut method, and they allow for improvement of illumination inconsistency and ghosting effects, respectively. However, due to the specifics of underwater imagery, these two methods cannot be used within a straightforward manner. In this paper, a new improved blending algorithm is proposed based on these two methods. By comparing with the previous methods from a perceptual point of view and as a potential input for pattern recognition algorithms, our results show an improvement in decreasing the mosaic degradation due to feature doubling and rapid illumination change

Nodal sampling: a new image reconstruction algorithm for SMOS

Soil moisture and ocean salinity (SMOS) brightness temperature (TB) images and calibrated visibilities are related by the so-called G -matrix. Due to the incomplete sampling at some spatial frequencies, sharp transitions in the TB scenes generate a Gibbs-like contamination ringing and spread sidelobes. In the current SMOS image reconstruction strategy, a Blackman window is applied to the Fourier components of the TBs to diminish the amplitude of artifacts such as ripples, as well as other Gibbs -like effects. In this paper, a novel image reconstruction algorithm focused on the reduction of Gibbs -like contamination in TB images is proposed. It is based on sampling the TB images at the nodal points, that is, at those points at which the oscillating interference causes the minimum distortion to the geophysical signal. Results show a significant reduction of ripples and sidelobes in strongly radio-frequency interference contaminated images. This technique has been thoroughly validated using snapshots over the ocean, by comparing TBs reconstructed in the standard way or using the nodal sampling (NS) with modeled TBs. Tests have revealed that the standard deviation of the difference between the measurement and the model is reduced around 1 K over clean and stable zones when using NS technique with respect to the SMOS image reconstruction baseline. The reduction is approximately 0.7 K when considering the global ocean. This represents a crucial improvement in TB quality, which will translate in an enhancement of the retrieved geophysical parameters, particularly the sea surface salinity.Peer ReviewedPostprint (author's final draft

Digital Signal Processing

Contains an introduction and reports on fifteen research projects.U.S. Navy - Office of Naval Research (Contract N00O14-81-K-0742)U.S. Navy - Office of Naval Research (Contract N00014-77-C-0266)National Science Foundation (Grant ECS80-07102)National Science Foundation (Grant ECS84-07285)Amoco Foundation FellowshipSanders Associates, Inc.Advanced Television Research ProgramM.I.T. Vinton Hayes FellowshipHertz Foundation Fellowshi

Learning to Interpret Fluid Type Phenomena via Images

Learning to interpret fluid-type phenomena via images is a long-standing challenging problem in computer vision. The problem becomes even more challenging when the fluid medium is highly dynamic and refractive due to its transparent nature. Here, we consider imaging through such refractive fluid media like water and air. For water, we design novel supervised learning-based algorithms to recover its 3D surface as well as the highly distorted underground patterns. For air, we design a state-of-the-art unsupervised learning algorithm to predict the distortion-free image given a short sequence of turbulent images. Specifically, we design a deep neural network that estimates the depth and normal maps of a fluid surface by analyzing the refractive distortion of a reference background pattern. Regarding the recovery of severely downgraded underwater images due to the refractive distortions caused by water surface fluctuations, we present the distortion-guided network (DG-Net) for restoring distortion-free underwater images. The key idea is to use a distortion map to guide network training. The distortion map models the pixel displacement caused by water refraction. Furthermore, we present a novel unsupervised network to recover the latent distortion-free image. The key idea is to model non-rigid distortions as deformable grids. Our network consists of a grid deformer that estimates the distortion field and an image generator that outputs the distortion-free image. By leveraging the positional encoding operator, we can simplify the network structure while maintaining fine spatial details in the recovered images. We also develop a combinational deep neural network that can simultaneously perform recovery of the latent distortion-free image as well as 3D reconstruction of the transparent and dynamic fluid surface. Through extensive experiments on simulated and real captured fluid images, we demonstrate that our proposed deep neural networks outperform the current state-of-the-art on solving specific tasks