Using disparity for quality assessment of stereoscopic images

International audience3DTV has been widely studied these last years from a technical point of view but the related quality evaluations does not follow this enthusiasm. This article reviews the quality assessment for 3DTV. Compared to 2D quality measure, the third dimension adds several new problems and quality assessment becomes a complex issue. Nevertheless, efforts made for 2D content quality estimation can be used for an extension to 3D. In this paper we propose a first attempt to adapt such 2D metrics to 3D content and add the contribution of a measure of the distortion on the disparity map for stereoscopic image pairs. This 3D metric performances has been evaluated with subjective tests

Object-based 2D-to-3D video conversion for effective stereoscopic content generation in 3D-TV applications

Three-dimensional television (3D-TV) has gained increasing popularity in the broadcasting domain, as it enables enhanced viewing experiences in comparison to conventional two-dimensional (2D) TV. However, its application has been constrained due to the lack of essential contents, i.e., stereoscopic videos. To alleviate such content shortage, an economical and practical solution is to reuse the huge media resources that are available in monoscopic 2D and convert them to stereoscopic 3D. Although stereoscopic video can be generated from monoscopic sequences using depth measurements extracted from cues like focus blur, motion and size, the quality of the resulting video may be poor as such measurements are usually arbitrarily defined and appear inconsistent with the real scenes. To help solve this problem, a novel method for object-based stereoscopic video generation is proposed which features i) optical-flow based occlusion reasoning in determining depth ordinal, ii) object segmentation using improved region-growing from masks of determined depth layers, and iii) a hybrid depth estimation scheme using content-based matching (inside a small library of true stereo image pairs) and depth-ordinal based regularization. Comprehensive experiments have validated the effectiveness of our proposed 2D-to-3D conversion method in generating stereoscopic videos of consistent depth measurements for 3D-TV applications

Video Quality Assessment: From 2D to 3D - Challenges and Future Trends

International audienceThree-dimensional (3D) video is gaining a strong momentum both in the cinema and broadcasting industries as it is seen as a technology that will extensively enhance the user's visual experience. One of the major concerns for the wide adoption of such technology is the ability to provide sufficient visual quality, especially if 3D video is to be transmitted over a limited bandwidth for home viewing (i.e. 3DTV). Means to measure perceptual video quality in an accurate and practical way is therefore of highest importance for content providers, service providers, and display manufacturers. This paper discusses recent advances in video quality assessment and the challenges foreseen for 3D video. Both subjective and objective aspects are examined. An outline of ongoing efforts in standards-related bodies is also provided

Blickpunkt-adaptive Verschiebung der Stereo-3D-Konvergenzebene

Die Diskrepanz zwischen Akkomodation und Konvergenz beim Betrachten von Stereo-3D-Inhalten führt bei vielen Menschen zu Kopfschmerzen und weiteren Symptomen der Erschöpfung des visuellen Systems. In der Stereo-3D-Produktion werden verschiedene Maßnahmen ergriffen, diesen Effekt möglichst gering zu halten. Dies führt jedoch nicht immer zum gewünschten Erfolg oder bringt Nachteile mit sich. In diesem Dokument wird daher ein Verfahren vorgeschlagen und untersucht, welches den Konflikt zwischen Akkomodation und Konvergenz in eine andere Domäne transformiert und die Diskrepanz auf diesem Wege eliminiert. Das Verfahren funktioniert in der Art, dass die Konvergenzebene immer zu der Tiefe des momentan betrachteten virtuellen Objekts verschoben wird. Dabei ist die Konvergenzebene die virtuelle Tiefenebene, die keine Disparität hat. Das Verfahren basiert auf Blickpunktdetektion und Signalverarbeitung in Kombination mit Disparitätskarten. Dieser Artikel beschreibt die ersten Schritte in diesem Projekt

A QUALITY ASSESSMENT PROTOCOL FOR FREE-VIEWPOINT VIDEO SEQUENCES SYNTHESIZED FROM DECOMPRESSED DEPTH DATA

International audienceIn this paper, the analysis of a subjective quality experiment consisting in assessing the quality of free-viewpoint video sequences generated from decompressed depth data is pre- sented. In the absence of a dedicated subjective assessment protocol for the evaluation of such 3D systems, a subjective quality assessment methodology is proposed for the context of MVD compression. The proposed methodology includes the assessment of free-viewpoint video sequences generated from decompressed depth data and from view synthesis pro- cesses. The proposed methodology is meant to assess the per- formances of depth map compression and view synthesis al- gorithms

Crosstalk measurement and mitigation for autostereoscopic displays

International audienceIn this paper we address the problem of crosstalk reduction for autostereoscopic displays. Crosstalk refers to the perception of one or more unwanted views in addition to the desired one. Specifically, the proposed approach consists of three different stages: a crosstalk measurement stage, where the crosstalk is modeled, a filter design stage, based on the results obtained out of the measurements, to mitigate the crosstalk effect, and a validation test carried out by means of subjective measurements performed in a controlled environment as recommended in ITU BT 500-11. Our analysis, synthesis, and subjective experiments are performed on the Alioscopy® display, which is a lenticular multiview display

Supervised stereo visual acuity tests implemented on 3D TV monitors

International audienceIn this paper we discuss under which conditions standard stereo visual acuity tests can be implemented on 3D TV monitors. In particular, we emphasize the role of environmental lighting conditions, on the measurement of the stereo visual acuity, when using conventional 3D tests, such as Wirt stereotests. We investigate the impact of parameters such as luminance, backlight and contrast when these tests are implemented on 3D TV monitors. We demonstrate that some deviations are observed when modifying the room luminance and the type of displays used (e.g. plasma (PDP) or liquid crystal (LCD) displays). Our measurements carried out on an human sample are supervised by pupil size measurements, using an eyes-tracker, enabling a better interpretation of the results. Finally, we discuss the benefit of using 3D tools to implement stereo visual acuity measurements

Active crosstalk reduction system for multiview autostereoscopic displays

Multiview autostereoscopic displays are considered as the future of 3DTV. However, these displays suffer from a high level of crosstalk, which negatively impacts quality of experience (QoE). In this paper, we propose a system to improve 3D QoE on multiview autostereoscopic displays. First, the display is characterized in terms of luminance distribution. Then, the luminance profiles are modeled using a limited set of parameters. A Kinect sensor is used to determine the viewer position in front of the display. Finally, the proposed system performs an intelligent on the fly allocation of the output views to minimize the perceived crosstalk. The user preference between 2D and 3D modes and the proposed system is evaluated. Results show that picture quality is significantly improved when compared to the standard 3D mode, for a similar depth perception and visual comfort

AUTOSTEREOSCOPY AND MOTION PARALLAX FOR MOBILE COMPUTER GAMES USING COMMERCIALLY AVAILABLE HARDWARE

ABSTRACT In this paper we present a solution for the three dimensional representation of mobile computer games which includes both motion parallax and an autostereoscopic display. The system was built on hardware which is available on the consumer market: an iPhone 3G with a Wazabee 3Dee Shell, which is an autostereoscopic extension for the iPhone. The motion sensor of the phone was used for the implementation of the motion parallax effect as well as for a tilt compensation for the autostereoscopic display. This system was evaluated in a limited user study on mobile 3D displays. Despite some obstacles that needed to be overcome and a few remaining shortcomings of the final system, an overall acceptable 3D experience could be reached. That leads to the conclusion that portable systems for the consumer market which include 3D displays are within reach