A Survey of Signal Processing Problems and Tools in Holographic Three-Dimensional Television

Cataloged from PDF version of article.Diffraction and holography are fertile areas for application of signal theory and processing. Recent work on 3DTV displays has posed particularly challenging signal processing problems. Various procedures to compute Rayleigh-Sommerfeld, Fresnel and Fraunhofer diffraction exist in the literature. Diffraction between parallel planes and tilted planes can be efficiently computed. Discretization and quantization of diffraction fields yield interesting theoretical and practical results, and allow efficient schemes compared to commonly used Nyquist sampling. The literature on computer-generated holography provides a good resource for holographic 3DTV related issues. Fast algorithms to compute Fourier, Walsh-Hadamard, fractional Fourier, linear canonical, Fresnel, and wavelet transforms, as well as optimization-based techniques such as best orthogonal basis, matching pursuit, basis pursuit etc., are especially relevant signal processing techniques for wave propagation, diffraction, holography, and related problems. Atomic decompositions, multiresolution techniques, Gabor functions, and Wigner distributions are among the signal processing techniques which have or may be applied to problems in optics. Research aimed at solving such problems at the intersection of wave optics and signal processing promises not only to facilitate the development of 3DTV systems, but also to contribute to fundamental advances in optics and signal processing theory. © 2007 IEEE

Three-dimensional media for mobile devices

Cataloged from PDF version of article.This paper aims at providing an overview of the core technologies enabling the delivery of 3-D Media to next-generation mobile devices. To succeed in the design of the corresponding system, a profound knowledge about the human visual system and the visual cues that form the perception of depth, combined with understanding of the user requirements for designing user experience for mobile 3-D media, are required. These aspects are addressed first and related with the critical parts of the generic system within a novel user-centered research framework. Next-generation mobile devices are characterized through their portable 3-D displays, as those are considered critical for enabling a genuine 3-D experience on mobiles. Quality of 3-D content is emphasized as the most important factor for the adoption of the new technology. Quality is characterized through the most typical, 3-D-specific visual artifacts on portable 3-D displays and through subjective tests addressing the acceptance and satisfaction of different 3-D video representation, coding, and transmission methods. An emphasis is put on 3-D video broadcast over digital video broadcasting-handheld (DVB-H) in order to illustrate the importance of the joint source-channel optimization of 3-D video for its efficient compression and robust transmission over error-prone channels. The comparative results obtained identify the best coding and transmission approaches and enlighten the interaction between video quality and depth perception along with the influence of the context of media use. Finally, the paper speculates on the role and place of 3-D multimedia mobile devices in the future internet continuum involving the users in cocreation and refining of rich 3-D media content

Diffraction field computation from arbitrarily distributed data points in space

Cataloged from PDF version of article.Computation of the diffraction field from a given set of arbitrarily distributed data points in space is an important signal processing problem arising in digital holographic 3D displays. The field arising from such distributed data points has to be solved simultaneously by considering all mutual couplings to get correct results. In our approach, the discrete form of the plane wave decomposition is used to calculate the diffraction field. Two approaches, based on matrix inversion and on projections on to convex sets (POCS), are studied. Both approaches are able to obtain the desired field when the number of given data points is larger than the number of data points on a transverse cross-section of the space. The POCS-based algorithm outperforms the matrix-inversion-based algorithm when the number of known data points is large. (C) 2006 Elsevier B.V. All rights reserved

Reconstruction of scalar diffraction field from distributed data points over 3D space

Diffraction field computation is an important task in the signal conversion stage of the holographic 3DTV. We consider an abstract setting, where the diffraction field of the desired 3D scene to be displayed is given by discrete samples distributed over 3D space. Based on these samples, a model of the diffraction field should be built to allow the field computation at any desired point. In our previous works, we have proved our concepts for the simplistic 2D case. In this paper, we generalize the earlier proposed techniques, namely the projection onto convex sets and conjugate gradient based techniques and test them for their computational efficiency and memory requirements for a specific 3D case

Three-dimensional monochromatic light field synthesis with a deflectable mirror array device

We investigated the problem of complex scalar monochromatic light field synthesis with a deflectable mirror array device (DMAD). First, an analysis of the diffraction field produced by the device upon certain configurations is given assuming Fresnel diffraction. Specifically, we derived expressions for the diffraction field given the parameters of the illumination wave and the tilt angles of the mirrors. The results of the analysis are used in later stages of the work to compute the samples of light fields produced by mirrors at certain points in space. Second, the light field synthesis problem is formulated as a linear constrained optimization problem assuming that mirrors of the DMAD can be tilted among a finite number of different tilt angles. The formulation is initially developed in the analog domain. Transformation to digital domain is carried out assuming that desired fields are originating from spatially bounded objects. In particular, we arrived at a Dp = b type of problem with some constraints on p, where D and b are known, and p will be solved for and will determine the configuration of the device. This final form is directly amenable to digital processing. Finally, we adapt and apply matching pursuit and simulated annealing algorithms to this digital problem. Simulations are carried out to illustrate the results. Simulated annealing performs successful synthesis when supplied with good initial conditions. However, we should come up with systematic approaches for providing good initial conditions to the algorithm. We do not have an appropriate strategy currently. Our results also suggest that simulated annealing achieves better results than MP. However, if only a part of the mirrors can be used, and the rest can be turned off, the performance of MP is acceptable and it turns out to be stable for different types of fields

An overview of the holographic display related tasks within the European 3DTV project

A European consortium has been working since September 2004 on all video-based technical aspects of three-dimensional television. The group has structured its technical activities under five technical committees focusing on capturing 3D live scenes, converting the captured scenes to an abstract 3D representations, transmitting the 3D visual information, displaying the 3D video, and processing of signals for the conversion of the abstract 3D video to signals needed to drive the display. The display of 3D video signals by holographic means is highly desirable. Synthesis of high-resolution computer generated holograms with high spatial frequency content, using fast algorithms, is crucial. Fresnel approximation with its fast implementations, fast superposition of zonelens terms, look-up tables using pre-computed holoprimitives are reported in the literature. Phase-retrieval methods are also under investigation. Successful solutions to this problem will benefit from proper utilization and adaptation of signal processing tools like waveletes, fresnelets, chirplets. and atomic decompositions and various optimization algorithms like matching pursuit or simulated annealing

Performance assessment of a diffraction field computation method based on source model

Efficient computation of scalar optical diffraction field due to an object is an essential issue in holographic 3D television systems. The first step in the computation process is to construct an object. As a solution for this step, we assume that an object can be represented by a set of distributed data points over a space. The second step is to determine which algorithm provides better performance. The source model whose performance is investigated is based on superposition of the diffraction fields emanated from the hypothetical light sources located at the given sample points. Its performance is evaluated according to visual quality of the reconstructed field and its algorithmic complexity. Source model provides acceptable reconstructed patterns when the region in which the samples are given has a narrow depth along the longitudinal direction and a wide extent along the transversal directions. Also, the source model gives good results when the cumulative field at the location of each point due to all other sources tends to be independent of that location. ©2008 IEEE

Bessel functions - Based reconstruction of non-uniformly sampled diffraction fields

A discrete computational model for the diffraction process is essential in forward problems related to holographic TV. The model must be as general as possible, since the shape of the displayed objects does not bear any restrictions. We derive a discrete diffraction model which suits the problem of reconstruction of diffraction fields from a set of non-uniformly distributed samples. The only restriction of the model is the wave nature of the field. The derivation takes advantage of changing the spatial and frequency coordinates to polar form and ends up with a model stated in terms of Bessel functions. The model proves to be a separable orthogonal basis. It shows rapid convergence when evaluated in the framework of the non-uniform sampling problem

Signal processing problems and algorithms in display side of 3DTV

Two important signal processing problems in the display side of a holographic 3DTV are the computation of the diffraction field of a 3D object from its abstract representation, and determination of the best display configuration to synthesize some intended light distribution. To solve the former problem, we worked on the computation of ID diffraction patterns from discrete data distributed over 2D space. The problem is solved using matrix pseudo-inversion which dominates the computational complexity. Then, the light field synthesis problem by a deflectable mirror array device (DMAD) is posed as a constrained linear optimization problem. The formulation makes direct application of common optimization algorithms quite easy. The simulations indicate that developed methods are promising. ©2006 IEEE