Motion-Compensated Coding and Frame-Rate Up-Conversion: Models and Analysis

Block-based motion estimation (ME) and compensation (MC) techniques are widely used in modern video processing algorithms and compression systems. The great variety of video applications and devices results in numerous compression specifications. Specifically, there is a diversity of frame-rates and bit-rates. In this paper, we study the effect of frame-rate and compression bit-rate on block-based ME and MC as commonly utilized in inter-frame coding and frame-rate up conversion (FRUC). This joint examination yields a comprehensive foundation for comparing MC procedures in coding and FRUC. First, the video signal is modeled as a noisy translational motion of an image. Then, we theoretically model the motion-compensated prediction of an available and absent frames as in coding and FRUC applications, respectively. The theoretic MC-prediction error is further analyzed and its autocorrelation function is calculated for coding and FRUC applications. We show a linear relation between the variance of the MC-prediction error and temporal-distance. While the affecting distance in MC-coding is between the predicted and reference frames, MC-FRUC is affected by the distance between the available frames used for the interpolation. Moreover, the dependency in temporal-distance implies an inverse effect of the frame-rate. FRUC performance analysis considers the prediction error variance, since it equals to the mean-squared-error of the interpolation. However, MC-coding analysis requires the entire autocorrelation function of the error; hence, analytic simplicity is beneficial. Therefore, we propose two constructions of a separable autocorrelation function for prediction error in MC-coding. We conclude by comparing our estimations with experimental results

Inverse scattering of 2d photonic structures by layer-stripping

Design and reconstruction of 2d and 3d photonic structures are usually carried out by forward simulations combined with optimization or intuition. Reconstruction by means of layer-stripping has been applied in seismic processing as well as in design and characterization of 1d photonic structures such as fiber Bragg gratings. Layer-stripping is based on causality, where the earliest scattered light is used to recover the structure layer-by-layer. Our set-up is a 2d layered nonmagnetic structure probed by plane polarized harmonic waves entering normal to the layers. It is assumed that the dielectric permittivity in each layer only varies orthogonal to the polarization. Based on obtained reflectance data covering a suitable frequency interval, time-localized pulse data are synthesized and applied to reconstruct the refractive index profile in the leftmost layer by identifying the local, time-domain Fresnel reflection at each point. Once the first layer is known, its impact on the reflectance data is stripped off, and the procedure repeated for the next layer. Through numerical simulations it will be demonstrated that it is possible to reconstruct structures consisting of several layers. The impact of evanescent modes and limited bandwidth is discussed