From Capture to Display: A Survey on Volumetric Video

Volumetric video, which offers immersive viewing experiences, is gaining increasing prominence. With its six degrees of freedom, it provides viewers with greater immersion and interactivity compared to traditional videos. Despite their potential, volumetric video services poses significant challenges. This survey conducts a comprehensive review of the existing literature on volumetric video. We firstly provide a general framework of volumetric video services, followed by a discussion on prerequisites for volumetric video, encompassing representations, open datasets, and quality assessment metrics. Then we delve into the current methodologies for each stage of the volumetric video service pipeline, detailing capturing, compression, transmission, rendering, and display techniques. Lastly, we explore various applications enabled by this pioneering technology and we present an array of research challenges and opportunities in the domain of volumetric video services. This survey aspires to provide a holistic understanding of this burgeoning field and shed light on potential future research trajectories, aiming to bring the vision of volumetric video to fruition.Comment: Submitte

Augmented Reality and Its Application

Augmented Reality (AR) is a discipline that includes the interactive experience of a real-world environment, in which real-world objects and elements are enhanced using computer perceptual information. It has many potential applications in education, medicine, and engineering, among other fields. This book explores these potential uses, presenting case studies and investigations of AR for vocational training, emergency response, interior design, architecture, and much more

3D Computer Graphics and Virtual Reality

This chapter is dedicated to the description of 3D computer graphics used for the needs of virtual reality. Virtual reality (VR) is the use of computer technology to create a 3D virtual environment. The chapter presents some graphical features used in an environment as well as an explanation of good design practice. The chapter contains also the description of lighting settings, 3D objects/models and virtualization sequence, camera, and scenes where the wheelchair simulator is used as an example of the implementation environment

Into the Wilds: Influences from Video Games on Our Perception of \u27Nature\u27

In this paper I examine how representations of human-sparse natural environments, e.g. wilderness, influence what expectations we have when we actually engage with comparable physical places. I use Don Ihde\u27s phenomenology of technology to describe my own experiences playing three games that take place among large photorealistic human-sparse natural environments: Elder Scrolls V: Skyrim, Horizon Zero Dawn, and theHunter: Call of the Wild. I also conduct a brief literature review on the effects of video games as interactive media on players. I argue that players are capable of applying their expectations of what constitutes realism from digital to physical environments, and that some of these translocations (transferring the perceptual framework from one space to another) limit our ability to meaningfully engage with the world. Although some video games may condition players to hyperreal expectations that leave them disappointed with physical spaces, some games might also produce increased interest and care for human-sparse spaces. The causal relationship between playing video games, changing expectations, and offline behavior therefore merits further study. I conclude with the claim that our experiences with unmediated physical nature should ground our perceptual baselines, rather than evaluating the physical by the standards of the digital

Real-time Illumination and Visual Coherence for Photorealistic Augmented/Mixed Reality

A realistically inserted virtual object in the real-time physical environment is a desirable feature in augmented reality (AR) applications and mixed reality (MR) in general. This problem is considered a vital research area in computer graphics, a field that is experiencing ongoing discovery. The algorithms and methods used to obtain dynamic and real-time illumination measurement, estimating, and rendering of augmented reality scenes are utilized in many applications to achieve a realistic perception by humans. We cannot deny the powerful impact of the continuous development of computer vision and machine learning techniques accompanied by the original computer graphics and image processing methods to provide a significant range of novel AR/MR techniques. These techniques include methods for light source acquisition through image-based lighting or sampling, registering and estimating the lighting conditions, and composition of global illumination. In this review, we discussed the pipeline stages with the details elaborated about the methods and techniques that contributed to the development of providing a photo-realistic rendering, visual coherence, and interactive real-time illumination results in AR/MR