1,325 research outputs found
Geometry-based spherical JND modeling for 360 display
360 videos have received widespread attention due to its realistic
and immersive experiences for users. To date, how to accurately model the user
perceptions on 360 display is still a challenging issue. In this paper,
we exploit the visual characteristics of 360 projection and display and
extend the popular just noticeable difference (JND) model to spherical JND
(SJND). First, we propose a quantitative 2D-JND model by jointly considering
spatial contrast sensitivity, luminance adaptation and texture masking effect.
In particular, our model introduces an entropy-based region classification and
utilizes different parameters for different types of regions for better
modeling performance. Second, we extend our 2D-JND model to SJND by jointly
exploiting latitude projection and field of view during 360 display.
With this operation, SJND reflects both the characteristics of human vision
system and the 360 display. Third, our SJND model is more consistent
with user perceptions during subjective test and also shows more tolerance in
distortions with fewer bit rates during 360 video compression. To
further examine the effectiveness of our SJND model, we embed it in Versatile
Video Coding (VVC) compression. Compared with the state-of-the-arts, our
SJND-VVC framework significantly reduced the bit rate with negligible loss in
visual quality
Streaming and User Behaviour in Omnidirectional Videos
Omnidirectional videos (ODVs) have gone beyond the passive paradigm of traditional video,
offering higher degrees of immersion and interaction. The revolutionary novelty of this technology is the possibility for users to interact with the surrounding environment, and to feel a
sense of engagement and presence in a virtual space. Users are clearly the main driving force of
immersive applications and consequentially the services need to be properly tailored to them.
In this context, this chapter highlights the importance of the new role of users in ODV streaming applications, and thus the need for understanding their behaviour while navigating within
ODVs. A comprehensive overview of the research efforts aimed at advancing ODV streaming
systems is also presented. In particular, the state-of-the-art solutions under examination in this
chapter are distinguished in terms of system-centric and user-centric streaming approaches: the
former approach comes from a quite straightforward extension of well-established solutions for
the 2D video pipeline while the latter one takes the benefit of understanding users’ behaviour
and enable more personalised ODV streaming
- …