Providing 3D video services: the challenge from 2D to 3DTV quality of experience

Recently, three-dimensional (3D) video has decisively burst onto the entertainment industry scene, and has arrived in households even before the standardization process has been completed. 3D television (3DTV) adoption and deployment can be seen as a major leap in television history, similar to previous transitions from black and white (B&W) to color, from analog to digital television (TV), and from standard definition to high definition. In this paper, we analyze current 3D video technology trends in order to define a taxonomy of the availability and possible introduction of 3D-based services. We also propose an audiovisual network services architecture which provides a smooth transition from two-dimensional (2D) to 3DTV in an Internet Protocol (IP)-based scenario. Based on subjective assessment tests, we also analyze those factors which will influence the quality of experience in those 3D video services, focusing on effects of both coding and transmission errors. In addition, examples of the application of the architecture and results of assessment tests are provided

Representation and coding of 3D video data

Livrable D4.1 du projet ANR PERSEECe rapport a été réalisé dans le cadre du projet ANR PERSEE (n° ANR-09-BLAN-0170). Exactement il correspond au livrable D4.1 du projet

Adaptive delivery of immersive 3D multi-view video over the Internet

The increase in Internet bandwidth and the developments in 3D video technology have paved the way for the delivery of 3D Multi-View Video (MVV) over the Internet. However, large amounts of data and dynamic network conditions result in frequent network congestion, which may prevent video packets from being delivered on time. As a consequence, the 3D video experience may well be degraded unless content-aware precautionary mechanisms and adaptation methods are deployed. In this work, a novel adaptive MVV streaming method is introduced which addresses the future generation 3D immersive MVV experiences with multi-view displays. When the user experiences network congestion, making it necessary to perform adaptation, the rate-distortion optimum set of views that are pre-determined by the server, are truncated from the delivered MVV streams. In order to maintain high Quality of Experience (QoE) service during the frequent network congestion, the proposed method involves the calculation of low-overhead additional metadata that is delivered to the client. The proposed adaptive 3D MVV streaming solution is tested using the MPEG Dynamic Adaptive Streaming over HTTP (MPEG-DASH) standard. Both extensive objective and subjective evaluations are presented, showing that the proposed method provides significant quality enhancement under the adverse network conditions

End-to-end 3D video communication over heterogeneous networks

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.Three-dimensional technology, more commonly referred to as 3D technology, has revolutionised many fields including entertainment, medicine, and communications to name a few. In addition to 3D films, games, and sports channels, 3D perception has made tele-medicine a reality. By the year 2015, 30% of the all HD panels at home will be 3D enabled, predicted by consumer electronics manufacturers. Stereoscopic cameras, a comparatively mature technology compared to other 3D systems, are now being used by ordinary citizens to produce 3D content and share at a click of a button just like they do with the 2D counterparts via sites like YouTube. But technical challenges still exist, including with autostereoscopic multiview displays. 3D content requires many complex considerations--including how to represent it, and deciphering what is the best compression format--when considering transmission or storage, because of its increased amount of data. Any decision must be taken in the light of the available bandwidth or storage capacity, quality and user expectations. Free viewpoint navigation also remains partly unsolved. The most pressing issue getting in the way of widespread uptake of consumer 3D systems is the ability to deliver 3D content to heterogeneous consumer displays over the heterogeneous networks. Optimising 3D video communication solutions must consider the entire pipeline, starting with optimisation at the video source to the end display and transmission optimisation. Multi-view offers the most compelling solution for 3D videos with motion parallax and freedom from wearing headgear for 3D video perception. Optimising multi-view video for delivery and display could increase the demand for true 3D in the consumer market. This thesis focuses on an end-to-end quality optimisation in 3D video communication/transmission, offering solutions for optimisation at the compression, transmission, and decoder levels.Brunel University - Isambard Research Scholarshi

Study of encapsulation and transport of 3DTV by satellite

The project was developed in EADS ASTRIUM Toulouse in the framework of the MUSCADE project with the latest technologies in 3DTV. Currently most of the research in satellite broadcasting field is focused in 3DTV transmission as the following of HDTV. MUSCADE is a European project funded by the 7th Framework Program whose objective is to demonstrate a complete multiview 3DTV live chain over wireline, wireless and satellite networks. This project aims to set up a satellite testbed to validate the 3D content format defined by MUSCADE in an emulated satellite environment. The document’s first chapter describes the environment where the internship has taken place and a brief overview of the EADS Company. After, a short description of the whole MUSCADE project can be found in section 5. This allows the reader to achieve a global vision of all the technological concepts involved in the project even if this internship is focused in satellite transmission. Section 6 describes the internship development. By means of conclusion, the new skills achieved, the knowledge applied and a professional and personal balance could be found at the end of this report.Ingeniería de TelecomunicaciónTelekomunikazio Ingeniaritz

3D video transmission over LTE

This thesis presents a research work on quality of experience in 3D video transmission over LTE networks. The objective is to study the state-of-art of LTE and 3D video, described in the scientific literature, and to quantify the user quality of experience (QoE) during a simulated LTE transmission. The work will start by a study of the University of Wien “LTE-A System Simulator” and its capabilities. In addition, different scenarios with various users equipment (UEs) and base stations (eNodeBs) densities will be configured and simulated in order to obtain the frame-by-frame Block Error Rate (BLER) values experienced by different UEs. Once obtained, the Block Error Rate frames will be converted to packet level error traces, which will be used to introduce erasures and corruptions into the packetized 3D video bitstream. The corrupted encoded video stream will be decoded using an error-concealment capable video decoder and the decoded/recovered video quality (QoE) will be estimated based on the Structural Similarity Index of the recovered video. Finally, the QoE results for the different system configurations will allow classifying the severity of the QoE degradations due to transmission losses, through inferring the relationship between those system parameters and the achievable QoE.Esta dissertação apresenta um trabalho de investigação sobre a qualidade de experiência numa transmissão de vídeo 3D sobre redes LTE. O objectivo é estudar o estado-da-arte no que respeita a rede LTE e vídeo 3D, descrito na literatura científica, e obter a qualidade de experiência de usuário (QoE) durante uma simulação de transmissão LTE. O trabalho começará por um estudo do University of Wien “LTE-A System Simulator” e as suas capacidades. Para este efeito, vão ser configurados diferentes cenários com distintas densidades de utilizadores (UEs) e estações base (eNodeBs), com o fim de obter a taxa de erros do bloco (BLER) experimentada por diferentes utilizadores. Depois de obter esta taxa, as tramas da taxa de erros do bloco (BLER) serão convertidas em tramas de nível de erro de pacotes, que vão ser usadas para adicionar corrupções de bit em ficheiros de vídeo 3D. O fluxo de vídeo codificado e corrompido será descodificado usando um descodificador de vídeo e a qualidade do vídeo recuperado vai ser calculada com base no Índice de Similitude Estrutural. Finalmente, os resultados de QoE para as diferentes configurações do sistema permitirão classificar o nível das degradações de QoE devido a perdas de transmissão, por meio de inferir a relação entre os parâmetros do sistema e a QoE obtida.Ingeniería de Telecomunicació