Motion parallax for 360° RGBD video

We present a method for adding parallax and real-time playback of 360° videos in Virtual Reality headsets. In current video players, the playback does not respond to translational head movement, which reduces the feeling of immersion, and causes motion sickness for some viewers. Given a 360° video and its corresponding depth (provided by current stereo 360° stitching algorithms), a naive image-based rendering approach would use the depth to generate a 3D mesh around the viewer, then translate it appropriately as the viewer moves their head. However, this approach breaks at depth discontinuities, showing visible distortions, whereas cutting the mesh at such discontinuities leads to ragged silhouettes and holes at disocclusions. We address these issues by improving the given initial depth map to yield cleaner, more natural silhouettes. We rely on a three-layer scene representation, made up of a foreground layer and two static background layers, to handle disocclusions by propagating information from multiple frames for the first background layer, and then inpainting for the second one. Our system works with input from many of today''s most popular 360° stereo capture devices (e.g., Yi Halo or GoPro Odyssey), and works well even if the original video does not provide depth information. Our user studies confirm that our method provides a more compelling viewing experience than without parallax, increasing immersion while reducing discomfort and nausea

PICOSECOND STUDIES OF SOLVENT-SOLUTE INTERACTIONS

Two types of solvent-solute interactions were studied with emphasis on measuring their dynamics. Using the solute ANF (2-amino, 7-nitroflourene), the relaxation process caused by the interaction of the solute dipole and the solvent dielectric was investigated. Studies of the solute acridine were performed to demonstrate how hydrogen bond formation between solvent and solute can cause inversion of solute energy levels. Both types of processes were monitored by time resolving solute fluorescence in a variety of solvents and solvent mixtures. A new method for picosecond time resolution of flourescence was developed, called frequency conversion gating, which surpasses the commonly used Kerr cell in sensitivity and versatility. To study ANF, time resolved measurements were made of the temperature dependent Stokes shift of the fluorescence spectrum. Fluorescence time profiles were measured at both the high and low frequency edges of the spectrum at several temperatures and found to vary by more than an order of magnitude. A model was proposed that relates the measured decay times at high frequencies and the corresponding risetimes at low frequencies to the rate of solvent dielectric relaxation. Using a binary solvent, the measured decay times reflected not only the relaxation of the polar solvent molecules in the vicinity of the ANF, but also the diffusion of the polar solvent component to the solute. Flourescence decay times and radiative lifetimes were measured for acridine in a variety of hydrogen bonding and non-hydrogen bonding solvents. The temperature dependence of the quantum yields and decay times were also measured. A new method was described for measuring radiative lifetimes based on absolute flourescence intensity. For the hydrogen bonding solvents, the radiative lifetimes were constant while the florescence decay times varied with solvent hydrogen bonding strength and temperature. The radiative lifetimes of the non-hydrogen bonding solvents were seen to vary with solvent polarizability and polarity, while the decay times were temperature independent and varied little with solvent. This data is discussed in terms of a model where hydrogen bond formation between solvent and solute causes the singlet energy levels to invert

Towards Anywhere Augmentation

Copyright c ○ 2007 b