Evaluation of further reduced resolution depth coding for stereoscopic 3D video

This paper presents the results and analysis of the objective and subjective quality evaluations of Further Reduced Resolution Depth Coding (FRRDC) method for stereoscopic 3D video. FRRDC is developed based on the Scalable Video Coding (SVC) reference software and the result are objectively evaluated using rate distortion curve and subjectively evaluated using LCD and auto-stereoscopic video displays. FRRDC uses the Down-Sampling and Up-Sampling (DSUS) method of the depth data of the stereoscopic 3D video. The emergence of numerous auto-stereoscopic displays in the market confirms the growth of 3DTV services. It is essential that the coding method of stereoscopic 3D videos produces high quality 3D videos on both stereoscopic displays and emerging auto-stereoscopic 3D video displays to ensure the interoperability and compatibility among all the different display devices. In this paper, the stereoscopic 3D videos are compressed using the H.264/SVC codec with Reduced Resolution Depth Coding (RRDC) and compared with H.264/SVC-FRRDC. The experimental results indicate good 3D depth perception of FRRDC on both stereoscopic and auto-stereoscopic display devices with lesser bit rates compared to H.264/SVC-RRDC

Reduced resolution depth coding for stereoscopic 3D video

In this paper, Reduced Resolution Depth Compression (RRDC) is proposed for Scalable Video Coding (SVC) to improve the 3D video rate distortion performance. RRDC is applied by using Down-Sampling and Up-Sampling (DSUS) of the depth data of the stereoscopic 3D video. The depth data is down-sampled before SVC encoding and up-sampled after SVC decoding operation. The proposed DSUS method reduces the overall bit rates and consequently: 1) improves SVC rate distortion for 3D video, particularly at lower bit rates in error free channels; and 2) improves 3D SVC performance for 3D transmission in error prone channels. The objective quality evaluation of the stereoscopic 3D video yields higher PSNR values at low bit rates for SVCDSUS compared to the original SVC (SVC-Org), which makes it advantageous in terms of reduced storage and bandwidth requirements. Moreover, the subjective quality evaluation of the stereoscopic 3D video further confirmed that the perceived stereoscopic 3D video quality of the SVC-DSUS is very similar to the stereoscopic 3D video of the SVC-Org by up to 98.2%

Multiple description coding with side information for stereoscopic 3D

Stereoscopic video as the simplest form of 3D video is already being used in consumer devices such as 3DTV and 3D mobile phone. When the 3D video from the 3D mobile phone is compressed and transmitted over error prone channels, error propagation due to packet loss leads to poor 3D visual quality. The objective of the paper is to provide error resilience 3D video using the well known multiple description coding (MDC) technique. Specifically, the MDC is modified for 2D plus depth stereoscopic video with the addition of spatially reduced resolution of the side information. The proposed method reduces the depth bit rates and consequently: 1) improves their rate distortion, particularly at higher bit rates in error free channels; and 2) improves their performance in ideal MDC channel

Multiple description video coding for stereoscopic 3D

In this paper, we propose an MDC schemes for stereoscopic 3D video. In the literature, MDC has previously been applied in 2D video but not so much in 3D video. The proposed algorithm enhances the error resilience of the 3D video using the combination of even and odd frame based MDC while retaining good temporal prediction efficiency for video over error-prone networks. Improvements are made to the original even and odd frame MDC scheme by adding a controllable amount of side information to improve frame interpolation at the decoder. The side information is also sent according to the video sequence motion for further improvement. The performance of the proposed algorithms is evaluated in error free and error prone environments especially for wireless channels. Simulation results show improved performance using the proposed MDC at high error rates compared to the single description coding (SDC) and the original even and odd frame MDC

Apparent sharpness of 3D video when one eye's view is more blurry.

When the images presented to each eye differ in sharpness, the fused percept remains relatively sharp. Here, we measure this effect by showing stereoscopic videos that have been blurred for one eye, or both eyes, and psychophysically determining when they appear equally sharp. For a range of blur magnitudes, the fused percept always appeared significantly sharper than the blurrier view. From these data, we investigate to what extent discarding high spatial frequencies from just one eye's view reduces the bandwidth necessary to transmit perceptually sharp 3D content. We conclude that relatively high-resolution video transmission has the most potential benefit from this method

Hierarchical Hole-filling For Depth-based View Synthesis In Ftv And 3d Video

Methods for hierarchical hole-filling and depth adaptive hierarchical hole-filling and error correcting in 2D images, 3D images, and 3D wrapped images are provided. Hierarchical hole-filling can comprise reducing an image that contains holes, expanding the reduced image, and filling the holes in the image with data obtained from the expanded image. Depth adaptive hierarchical hole-filling can comprise preprocessing the depth map of a 3D wrapped image that contains holes, reducing the preprocessed image, expanding the reduced image, and filling the holes in the 3D wrapped image with data obtained from the expanded image. These methods are can efficiently reduce errors in images and produce 3D images from a 2D images and/or depth map information.Georgia Tech Research Corporatio

Motion and disparity estimation with self adapted evolutionary strategy in 3D video coding

Real world information, obtained by humans is three dimensional (3-D). In experimental user-trials, subjective assessments have clearly demonstrated the increased impact of 3-D pictures compared to conventional flat-picture techniques. It is reasonable, therefore, that we humans want an imaging system that produces pictures that are as natural and real as things we see and experience every day. Three-dimensional imaging and hence, 3-D television (3DTV) are very promising approaches expected to satisfy these desires. Integral imaging, which can capture true 3D color images with only one camera, has been seen as the right technology to offer stress-free viewing to audiences of more than one person. In this paper, we propose a novel approach to use Evolutionary Strategy (ES) for joint motion and disparity estimation to compress 3D integral video sequences. We propose to decompose the integral video sequence down to viewpoint video sequences and jointly exploit motion and disparity redundancies to maximize the compression using a self adapted ES. A half pixel refinement algorithm is then applied by interpolating macro blocks in the previous frame to further improve the video quality. Experimental results demonstrate that the proposed adaptable ES with Half Pixel Joint Motion and Disparity Estimation can up to 1.5 dB objective quality gain without any additional computational cost over our previous algorithm.1Furthermore, the proposed technique get similar objective quality compared to the full search algorithm by reducing the computational cost up to 90%