Quality Assessment of Stereoscopic 360-degree Images from Multi-viewports

Objective quality assessment of stereoscopic panoramic images becomes a challenging problem owing to the rapid growth of 360-degree contents. Different from traditional 2D image quality assessment (IQA), more complex aspects are involved in 3D omnidirectional IQA, especially unlimited field of view (FoV) and extra depth perception, which brings difficulty to evaluate the quality of experience (QoE) of 3D omnidirectional images. In this paper, we propose a multi-viewport based fullreference stereo 360 IQA model. Due to the freely changeable viewports when browsing in the head-mounted display (HMD), our proposed approach processes the image inside FoV rather than the projected one such as equirectangular projection (ERP). In addition, since overall QoE depends on both image quality and depth perception, we utilize the features estimated by the difference map between left and right views which can reflect disparity. The depth perception features along with binocular image qualities are employed to further predict the overall QoE of 3D 360 images. The experimental results on our public Stereoscopic OmnidirectionaL Image quality assessment Database (SOLID) show that the proposed method achieves a significant improvement over some well-known IQA metrics and can accurately reflect the overall QoE of perceived images

Stereoscopic image quality assessment method based on binocular combination saliency model

The objective quality assessment of stereoscopic images plays an important role in three-dimensional (3D) technologies. In this paper, we propose an effective method to evaluate the quality of stereoscopic images that are afflicted by symmetric distortions. The major technical contribution of this paper is that the binocular combination behaviours and human 3D visual saliency characteristics are both considered. In particular, a new 3D saliency map is developed, which not only greatly reduces the computational complexity by avoiding calculation of the depth information, but also assigns appropriate weights to the image contents. Experimental results indicate that the proposed metric not only significantly outperforms conventional 2D quality metrics, but also achieves higher performance than the existing 3D quality assessment models

A no-reference optical flow-based quality evaluator for stereoscopic videos in curvelet domain

Most of the existing 3D video quality assessment (3D-VQA/SVQA) methods only consider spatial information by directly using an image quality evaluation method. In addition, a few take the motion information of adjacent frames into consideration. In practice, one may assume that a single data-view is unlikely to be sufficient for effectively learning the video quality. Therefore, integration of multi-view information is both valuable and necessary. In this paper, we propose an effective multi-view feature learning metric for blind stereoscopic video quality assessment (BSVQA), which jointly focuses on spatial information, temporal information and inter-frame spatio-temporal information. In our study, a set of local binary patterns (LBP) statistical features extracted from a computed frame curvelet representation are used as spatial and spatio-temporal description, and the local flow statistical features based on the estimation of optical flow are used to describe the temporal distortion. Subsequently, a support vector regression (SVR) is utilized to map the feature vectors of each single view to subjective quality scores. Finally, the scores of multiple views are pooled into the final score according to their contribution rate. Experimental results demonstrate that the proposed metric significantly outperforms the existing metrics and can achieve higher consistency with subjective quality assessment

A New Metric of Image Quality Assessment for Stereoscopic Content

International audienceAutomatic or semi-automatic stereoscopic image quality assessment has arisen due to the recent diffusion of a new generation of stereoscopic technologies and content demand. Thereby, there is a growth in asking for algorithms of Stereoscopic Image Quality Metrics (SIQA). In this paper, we present a method for assessing the stereoscopic image quality, QUALITAS. QUALITAS is grounded on some human visual system features such as contrast sensitivity, effect of disparate image quality in left and right images, and distance perception, which do not depend on the images being tested. QUALITAS is defined in five stages. Instead of averaging individual qualities of the stereo-pair, QUALITAS introduces Contrast Band-Pass Filtering on a wavelet domain at both views, namely our algorithm perceptually weights left and right images depending on certain viewing conditions. This paper includes the comparison of 27 Metrics SIQA proposed by 16 authors, which summarizes the work made in this field in the recent five years, on image database LIVE 3D. Some algorithms can be combined with any 2D/Normal Image Quality Assessments (NIQA), giving as a result that QUALITAS was compared against 221 Metrics. QUALITAS obtained the best results in terms of overall performance of correlation coefficients. We conclude all metrics in SIQA-SET are simple modifications of NIQA, which take into account some extra characteristics from the disparity map (usually depth variances). Instead QUALITAS incorporates disparity masking in addition to divide 3D scenario in two parts: background and foreground planes. Moreover QUALITAS employs a contrast band-pass filtering, so dynamic parameters are considered as observational distance. It includes loss of correlation, luminance and contrast distortion. It takes into account the visual differences between left and right images, employing a penalization depending on their wavelet energy. Thus, the novelty of QUALITAS lies in combining some the best features of stereoscopic image quality assessments

Video Quality Assessment: From 2D to 3D - Challenges and Future Trends

International audienceThree-dimensional (3D) video is gaining a strong momentum both in the cinema and broadcasting industries as it is seen as a technology that will extensively enhance the user's visual experience. One of the major concerns for the wide adoption of such technology is the ability to provide sufficient visual quality, especially if 3D video is to be transmitted over a limited bandwidth for home viewing (i.e. 3DTV). Means to measure perceptual video quality in an accurate and practical way is therefore of highest importance for content providers, service providers, and display manufacturers. This paper discusses recent advances in video quality assessment and the challenges foreseen for 3D video. Both subjective and objective aspects are examined. An outline of ongoing efforts in standards-related bodies is also provided