Segmentation in object-oriented encoding and multi-view images transmission

Показаны актуальность проблемы повышения эффективности кодирования многоракурсных изображений для передачи по радиоканалам в мобильных системах видеонаблюдения и необходимость разработки методов, алгоритмов и специализированных кодеков сжатия с приемлемой вычислительной сложностью. Определено место сегментации в объектно-ориентированном кодировании многоракурсных изображений. Предложены выражения для относительной оценки вычислительной сложности алгоритмов сегментации и объектно-ориентированного кодирования многоракурсных изображений. Показано, что применение древовидно-волновой сегментации и узловых квадросеток пикселей позволяет снизить вычислительную сложность объектно-ориентированного кодирования многоракурсных изображений и соответственно уменьшить задержку их передачи в мобильных системах видеонаблюдения. The urgency of the problem efficiency increasing of coding of the multi-view images for transmission over radio channels in mobile video surveillance systems and the need to develop methods, algorithms and specialized compression codecs with acceptable computational complexity are shown. The segmentation place in the object-oriented coding of multi-view images is determined. Expressions for the relative evaluation of the computational complexity of segmentation algorithms and object-oriented coding of multi-view images are proposed. It is shown that tree-wave segmentation and nodal quad-grids use reduces the computational complexity of object-oriented coding of multi-view images and, accordingly, reduces the delay in their transmission in mobile video surveillance systems

СЕГМЕНТАЦИЯ В ОБЪЕКТНО-ОРИЕНТИРОВАННОМ КОДИРОВАНИИ И ПЕРЕДАЧЕ МНОГОРАКУРСНЫХ ИЗОБРАЖЕНИЙ

The urgency of the problem efficiency increasing of coding of the multi-view images for transmission over radio channels in mobile video surveillance systems and the need to develop methods, algorithms and specialized compression codecs with acceptable computational complexity are shown. The segmentation place in the object-oriented coding of multi-view images is determined. Expressions for the relative evaluation of the computational complexity of segmentation algorithms and object-oriented coding of multi-view images are proposed. It is shown that tree-wave segmentation and nodal quad-grids use reduces the computational complexity of object-oriented coding of multi-view images and, accordingly, reduces the delay in their transmission in mobile video surveillance systems.Показаны актуальность проблемы повышения эффективности кодирования многоракурсных изображений для передачи по радиоканалам в мобильных системах видеонаблюдения и необходимость разработки методов, алгоритмов и специализированных кодеков сжатия с приемлемой вычислительной сложностью. Определено место сегментации в объектно-ориентированном кодировании многоракурсных изображений. Предложены выражения для относительной оценки вычислительной сложности алгоритмов сегментации и объектно-ориентированного кодирования многоракурсных изображений. Показано, что применение древовидно-волновой сегментации и узловых квадросеток пикселей позволяет снизить вычислительную сложность объектно-ориентированного кодирования многоракурсных изображений и соответственно уменьшить задержку их передачи в мобильных системах видеонаблюдения

End-to-end stereoscopic video streaming with content-adaptive rate and format control

We address efficient compression and real-time streaming of stereoscopic video over the current Internet. We first propose content-adaptive stereo video coding (CA-SC), where additional coding gain, over that can be achieved by exploiting only inter-view correlations, is targeted by clown-sampling one of the views spatially or temporally depending on the content, based on the well-known theory that the human visual system can perceive high frequencies in three-dimensional (3D) from the higher quality view. We also developed stereoscopic 3D video streaming server and clients by modifying available open source platforms, where each client can view the video in mono or stereo mode depending on its display capabilities. The performance of the end-to-end stereoscopic streaming system is demonstrated using subjective quality tests

PEER-TO-PEER 3D/MULTI-VIEW VIDEO STREAMING

Abstract The recent advances in stereoscopic video capture, compression and display have made 3D video a visually appealing and costly affordable technology. More sophisticated multi-view videos have also been demonstrated. Yet their remarkably increased data volume poses greater challenges to the conventional client/server systems. The stringent synchronization demands from different views further complicate the system design. In this thesis, we present an initial attempt toward efficient streaming of 3D videos over peer-to-peer networks. We show that the inherent multi-stream nature of 3D video makes playback synchronization more difficult. We address this by a 2-stream buffer, together with a novel segment scheduling. We further extend our system to support multi-view video with view diversity and dynamics. We have evaluated our system under different end-system and network configurations with typical stereo video streams. The simulation results demonstrate the superiority of our system in terms of scalability, streaming quality and dealing with view dynamics

End-to-end 3D video communication over heterogeneous networks

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.Three-dimensional technology, more commonly referred to as 3D technology, has revolutionised many fields including entertainment, medicine, and communications to name a few. In addition to 3D films, games, and sports channels, 3D perception has made tele-medicine a reality. By the year 2015, 30% of the all HD panels at home will be 3D enabled, predicted by consumer electronics manufacturers. Stereoscopic cameras, a comparatively mature technology compared to other 3D systems, are now being used by ordinary citizens to produce 3D content and share at a click of a button just like they do with the 2D counterparts via sites like YouTube. But technical challenges still exist, including with autostereoscopic multiview displays. 3D content requires many complex considerations--including how to represent it, and deciphering what is the best compression format--when considering transmission or storage, because of its increased amount of data. Any decision must be taken in the light of the available bandwidth or storage capacity, quality and user expectations. Free viewpoint navigation also remains partly unsolved. The most pressing issue getting in the way of widespread uptake of consumer 3D systems is the ability to deliver 3D content to heterogeneous consumer displays over the heterogeneous networks. Optimising 3D video communication solutions must consider the entire pipeline, starting with optimisation at the video source to the end display and transmission optimisation. Multi-view offers the most compelling solution for 3D videos with motion parallax and freedom from wearing headgear for 3D video perception. Optimising multi-view video for delivery and display could increase the demand for true 3D in the consumer market. This thesis focuses on an end-to-end quality optimisation in 3D video communication/transmission, offering solutions for optimisation at the compression, transmission, and decoder levels.Brunel University - Isambard Research Scholarshi