Stereoscopic video quality assessment using binocular energy

Stereoscopic imaging is becoming increasingly popular. However, to ensure the best quality of experience, there is a need to develop more robust and accurate objective metrics for stereoscopic content quality assessment. Existing stereoscopic image and video metrics are either extensions of conventional 2D metrics (with added depth or disparity information) or are based on relatively simple perceptual models. Consequently, they tend to lack the accuracy and robustness required for stereoscopic content quality assessment. This paper introduces full-reference stereoscopic image and video quality metrics based on a Human Visual System (HVS) model incorporating important physiological findings on binocular vision. The proposed approach is based on the following three contributions. First, it introduces a novel HVS model extending previous models to include the phenomena of binocular suppression and recurrent excitation. Second, an image quality metric based on the novel HVS model is proposed. Finally, an optimised temporal pooling strategy is introduced to extend the metric to the video domain. Both image and video quality metrics are obtained via a training procedure to establish a relationship between subjective scores and objective measures of the HVS model. The metrics are evaluated using publicly available stereoscopic image/video databases as well as a new stereoscopic video database. An extensive experimental evaluation demonstrates the robustness of the proposed quality metrics. This indicates a considerable improvement with respect to the state-of-the-art with average correlations with subjective scores of 0.86 for the proposed stereoscopic image metric and 0.89 and 0.91 for the proposed stereoscopic video metrics

Reduced basis method for source mask optimization

Image modeling and simulation are critical to extending the limits of leading edge lithography technologies used for IC making. Simultaneous source mask optimization (SMO) has become an important objective in the field of computational lithography. SMO is considered essential to extending immersion lithography beyond the 45nm node. However, SMO is computationally extremely challenging and time-consuming. The key challenges are due to run time vs. accuracy tradeoffs of the imaging models used for the computational lithography. We present a new technique to be incorporated in the SMO flow. This new approach is based on the reduced basis method (RBM) applied to the simulation of light transmission through the lithography masks. It provides a rigorous approximation to the exact lithographical problem, based on fully vectorial Maxwell's equations. Using the reduced basis method, the optimization process is divided into an offline and an online steps. In the offline step, a RBM model with variable geometrical parameters is built self-adaptively and using a Finite Element (FEM) based solver. In the online step, the RBM model can be solved very fast for arbitrary illumination and geometrical parameters, such as dimensions of OPC features, line widths, etc. This approach dramatically reduces computational costs of the optimization procedure while providing accuracy superior to the approaches involving simplified mask models. RBM furthermore provides rigorous error estimators, which assure the quality and reliability of the reduced basis solutions. We apply the reduced basis method to a 3D SMO example. We quantify performance, computational costs and accuracy of our method.Comment: BACUS Photomask Technology 201

Short communication: Challenges and applications of structure-from-motion photogrammetry in a physical model of a braided river

For extending the applications of structure-from-motion (SfM) photogrammetry in river flumes, we present the main challenges and methods used to collect a large dataset ( \u3e 1000 digital elevation models, DEMs) of high-quality topographic data using close-range SfM photogrammetry. Automatic target detection, batch processing, and considerations for image quality were fundamental to the successful implementation of the SfM technique on such a large dataset, which was used primarily for capturing details of gravel-bed braided river morphodynamics and sedimentology. While the applications of close-range SfM photogrammetry are numerous, we include sample results from DEM differencing, which was used to quantify morphology change and provide estimates of water depth in braided rivers, as well as image analysis for mapping bed surface texture. These methods and results contribute to the growing field of SfM applications in geomorphology and close-range experimental settings in general

HOLODIFFUSION: Training a 3D Diffusion Model using 2D Images

Diffusion models have emerged as the best approach for generative modeling of 2D images. Part of their success is due to the possibility of training them on millions if not billions of images with a stable learning objective. However, extending these models to 3D remains difficult for two reasons. First, finding a large quantity of 3D training data is much more complex than for 2D images. Second, while it is conceptually trivial to extend the models to operate on 3D rather than 2D grids, the associated cubic growth in memory and compute complexity makes this infeasible. We address the first challenge by introducing a new diffusion setup that can be trained, end-to-end, with only posed 2D images for supervision; and the second challenge by proposing an image formation model that decouples model memory from spatial memory. We evaluate our method on real-world data, using the CO3D dataset which has not been used to train 3D generative models before. We show that our diffusion models are scalable, train robustly, and are competitive in terms of sample quality and fidelity to existing approaches for 3D generative modeling.Comment: CVPR 2023 conference; project page at: https://holodiffusion.github.io

Shaping spectral leakage for IEEE 802.11 p vehicular communications

IEEE 802.11p is a recently defined standard for the physical (PHY) and medium access control (MAC) layers for Dedicated Short-Range Communications. Four Spectrum Emission Masks (SEMs) are specified in 802.11p that are much more stringent than those for current 802.11 systems. In addition, the guard interval in 802.11p has been lengthened by reducing the bandwidth to support vehicular communication (VC) channels, and this results in a narrowing of the frequency guard. This raises a significant challenge for filtering the spectrum of 802.11p signals to meet the specifications of the SEMs. We investigate state of the art pulse shaping and filtering techniques for 802.11p, before proposing a new method of shaping the 802.11p spectral leakage to meet the most stringent, class D, SEM specification. The proposed method, performed at baseband to relax the strict constraints of the radio frequency (RF) front-end, allows 802.11p systems to be implemented using commercial off-the- shelf (COTS) 802.11a RF hardware, resulting in reduced total system cost

The Structure of the {\beta} Leonis Debris Disk

We combine nulling interferometry at 10 {\mu}m using the MMT and Keck Telescopes with spectroscopy, imaging, and photometry from 3 to 100 {\mu}m using Spitzer to study the debris disk around {\beta} Leo over a broad range of spatial scales, corresponding to radii of 0.1 to ~100 AU. We have also measured the close binary star o Leo with both Keck and MMT interferometers to verify our procedures with these instruments. The {\beta} Leo debris system has a complex structure: 1.) relatively little material within 1 AU; 2.) an inner component with a color temperature of ~600 K, fitted by a dusty ring from about 2 to 3 AU; and 3.) a second component with a color temperature of ~120 K fitted by a broad dusty emission zone extending from about ~5 AU to ~55 AU. Unlike many other A-type stars with debris disks, {\beta} Leo lacks a dominant outer belt near 100 AU.Comment: 14 page body, 3 page appendix, 15 figure

Dissecting the active galactic nucleus in Circinus -- I. Peculiar mid-IR morphology explained by a dusty hollow cone

Recent high angular resolution observations resolved for the first time the mid-infrared (MIR) structure of nearby active galactic nuclei (AGN). Surprisingly, they revealed that a major fraction of their MIR emission comes from the polar regions. This is at odds with the expectation based on AGN unification, which postulates a dusty torus in the equatorial region. The nearby, archetypical AGN in the Circinus galaxy offers one of the best opportunities to study the MIR emission in greater detail. New, high quality MIR images obtained with the upgraded VISIR instrument at the Very Large Telescope show that the previously detected bar-like structure extends up to at least 40 pc on both sides of the nucleus along the edges of the ionization cone. Motivated by observations across a wide wavelength range and on different spatial scales, we propose a phenomenological dust emission model for the AGN in the Circinus galaxy consisting of a compact dusty disk and a large-scale dusty cone shell, illuminated by a tilted accretion disk with an anisotropic emission pattern. Undertaking detailed radiative transfer simulations, we demonstrate that such a model is able to explain the peculiar MIR morphology and account for the entire IR spectral energy distribution. Our results call for caution when attributing dust emission of unresolved sources entirely to the torus and warrant further investigation of the MIR emission in the polar regions of AGN.Comment: Accepted to MNRAS. Version 2: typos correcte

Accuracy assessment of Digital Surface Models generated by Semiglobal matching algorithm using Lidar data

To measure the accuracy of Digital Surface Models (DSMs) generated by high resolution satellite images (HRSI) using semi-global matching algorithm in comparison with LIDAR DSMs, two different test areas with different properties and corresponding attributes and magnitudes of errors are considered. Error characteristics are classified as systematic and gross errors and significance of them to measure the accuracy of DSMs are evaluated. In this manner and to avoid the influence of outliers in accuracy assessment robust statistical methods are proposed. According to final values obtained for two test areas it can be concluded that the performance of DSMs generated by stereo matching for mountainous wooden areas in respect to the accuracy of LIDAR DSM are poor. In contrast, in case of residential urban areas the quality of the DSM generated by HRSI is able to follow the accuracy of LIDAR data