Neural View-Interpolation for Sparse Light Field Video

We suggest representing light field (LF) videos as "one-off" neural networks (NN), i.e., a learned mapping from view-plus-time coordinates to high-resolution color values, trained on sparse views. Initially, this sounds like a bad idea for three main reasons: First, a NN LF will likely have less quality than a same-sized pixel basis representation. Second, only few training data, e.g., 9 exemplars per frame are available for sparse LF videos. Third, there is no generalization across LFs, but across view and time instead. Consequently, a network needs to be trained for each LF video. Surprisingly, these problems can turn into substantial advantages: Other than the linear pixel basis, a NN has to come up with a compact, non-linear i.e., more intelligent, explanation of color, conditioned on the sparse view and time coordinates. As observed for many NN however, this representation now is interpolatable: if the image output for sparse view coordinates is plausible, it is for all intermediate, continuous coordinates as well. Our specific network architecture involves a differentiable occlusion-aware warping step, which leads to a compact set of trainable parameters and consequently fast learning and fast execution

Monte Carlo Simulation of the Short-time Behaviour of the Dynamic XY Model

Dynamic relaxation of the XY model quenched from a high temperature state to the critical temperature or below is investigated with Monte Carlo methods. When a non-zero initial magnetization is given, in the short-time regime of the dynamic evolution the critical initial increase of the magnetization is observed. The dynamic exponent $\theta$ is directly determined. The results show that the exponent $\theta$ varies with respect to the temperature. Furthermore, it is demonstrated that this initial increase of the magnetization is universal, i.e. independent of the microscopic details of the initial configurations and the algorithms.Comment: 14 pages with 5 figures in postscrip

Dynamic Optimization of Thermodynamically Rigorous Models of Multiphase Flow in Porous Subsurface Oil Reservoirs

In this paper, we consider dynamic optimization of thermal and isothermal oil recovery processes which involve multicomponent three-phase flow in porous media. We present thermodynamically rigorous models of these processes based on 1) conservation of mass and energy, and 2) phase equilibrium. The conservation equations are partial differential equations. The phase equilibrium problems that are relevant to thermal and isothermal models are called the UV and the VT flash, and they are based on the second law of thermodynamics. We formulate these phase equilibrium problems as optimization problems and the phase equilibrium conditions as the corresponding first order optimality conditions. We demonstrate that the thermal and isothermal flow models are in a semi-explicit differential-algebraic form, and we solve the dynamic optimization problems with a previously developed gradient-based algorithm implemented in C/C++. We present numerical examples of optimized thermal and isothermal oil recovery strategies and discuss the computational performance of the dynamic optimization algorithm in these examples.Comment: 20 pages, 6 figure

Transformation-aware Perceptual Image Metric

Predicting human visual perception has several applications such as compression, rendering, editing, and retargeting. Current approaches, however, ignore the fact that the human visual system compensates for geometric transformations, e.g., we see that an image and a rotated copy are identical. Instead, they will report a large, false-positive difference. At the same time, if the transformations become too strong or too spatially incoherent, comparing two images gets increasingly difficult. Between these two extrema, we propose a system to quantify the effect of transformations, not only on the perception of image differences but also on saliency and motion parallax. To this end, we first fit local homographies to a given optical flow field, and then convert this field into a field of elementary transformations, such as translation, rotation, scaling, and perspective. We conduct a perceptual experiment quantifying the increase of difficulty when compensating for elementary transformations. Transformation entropy is proposed as a measure of complexity in a flow field. This representation is then used for applications, such as comparison of nonaligned images, where transformations cause threshold elevation, detection of salient transformations, and a model of perceived motion parallax. Applications of our approach are a perceptual level-of-detail for real-time rendering and viewpoint selection based on perceived motion parallax

{HDR} Denoising and Deblurring by Learning Spatio-temporal Distortion Model

We seek to reconstruct sharp and noise-free high-dynamic range (HDR) video from a dual-exposure sensor that records different low-dynamic range (LDR) information in different pixel columns: Odd columns provide low-exposure, sharp, but noisy information; even columns complement this with less noisy, high-exposure, but motion-blurred data. Previous LDR work learns to deblur and denoise (DISTORTED->CLEAN) supervised by pairs of CLEAN and DISTORTED images. Regrettably, capturing DISTORTED sensor readings is time-consuming; as well, there is a lack of CLEAN HDR videos. We suggest a method to overcome those two limitations. First, we learn a different function instead: CLEAN->DISTORTED, which generates samples containing correlated pixel noise, and row and column noise, as well as motion blur from a low number of CLEAN sensor readings. Second, as there is not enough CLEAN HDR video available, we devise a method to learn from LDR video in-stead. Our approach compares favorably to several strong baselines, and can boost existing methods when they are re-trained on our data. Combined with spatial and temporal super-resolution, it enables applications such as re-lighting with low noise or blur