Multimedia delivery in the future internet

The term “Networked Media” implies that all kinds of media including text, image, 3D graphics, audio and video are produced, distributed, shared, managed and consumed on-line through various networks, like the Internet, Fiber, WiFi, WiMAX, GPRS, 3G and so on, in a convergent manner [1]. This white paper is the contribution of the Media Delivery Platform (MDP) cluster and aims to cover the Networked challenges of the Networked Media in the transition to the Future of the Internet. Internet has evolved and changed the way we work and live. End users of the Internet have been confronted with a bewildering range of media, services and applications and of technological innovations concerning media formats, wireless networks, terminal types and capabilities. And there is little evidence that the pace of this innovation is slowing. Today, over one billion of users access the Internet on regular basis, more than 100 million users have downloaded at least one (multi)media file and over 47 millions of them do so regularly, searching in more than 160 Exabytes1 of content. In the near future these numbers are expected to exponentially rise. It is expected that the Internet content will be increased by at least a factor of 6, rising to more than 990 Exabytes before 2012, fuelled mainly by the users themselves. Moreover, it is envisaged that in a near- to mid-term future, the Internet will provide the means to share and distribute (new) multimedia content and services with superior quality and striking flexibility, in a trusted and personalized way, improving citizens’ quality of life, working conditions, edutainment and safety. In this evolving environment, new transport protocols, new multimedia encoding schemes, cross-layer inthe network adaptation, machine-to-machine communication (including RFIDs), rich 3D content as well as community networks and the use of peer-to-peer (P2P) overlays are expected to generate new models of interaction and cooperation, and be able to support enhanced perceived quality-of-experience (PQoE) and innovative applications “on the move”, like virtual collaboration environments, personalised services/ media, virtual sport groups, on-line gaming, edutainment. In this context, the interaction with content combined with interactive/multimedia search capabilities across distributed repositories, opportunistic P2P networks and the dynamic adaptation to the characteristics of diverse mobile terminals are expected to contribute towards such a vision. Based on work that has taken place in a number of EC co-funded projects, in Framework Program 6 (FP6) and Framework Program 7 (FP7), a group of experts and technology visionaries have voluntarily contributed in this white paper aiming to describe the status, the state-of-the art, the challenges and the way ahead in the area of Content Aware media delivery platforms

Random Linear Network Coding for 5G Mobile Video Delivery

An exponential increase in mobile video delivery will continue with the demand for higher resolution, multi-view and large-scale multicast video services. Novel fifth generation (5G) 3GPP New Radio (NR) standard will bring a number of new opportunities for optimizing video delivery across both 5G core and radio access networks. One of the promising approaches for video quality adaptation, throughput enhancement and erasure protection is the use of packet-level random linear network coding (RLNC). In this review paper, we discuss the integration of RLNC into the 5G NR standard, building upon the ideas and opportunities identified in 4G LTE. We explicitly identify and discuss in detail novel 5G NR features that provide support for RLNC-based video delivery in 5G, thus pointing out to the promising avenues for future research.Comment: Invited paper for Special Issue "Network and Rateless Coding for Video Streaming" - MDPI Informatio

Analysis domain model for shared virtual environments

The field of shared virtual environments, which also encompasses online games and social 3D environments, has a system landscape consisting of multiple solutions that share great functional overlap. However, there is little system interoperability between the different solutions. A shared virtual environment has an associated problem domain that is highly complex raising difficult challenges to the development process, starting with the architectural design of the underlying system. This paper has two main contributions. The first contribution is a broad domain analysis of shared virtual environments, which enables developers to have a better understanding of the whole rather than the part(s). The second contribution is a reference domain model for discussing and describing solutions - the Analysis Domain Model

Network coding meets multimedia: a review

While every network node only relays messages in a traditional communication system, the recent network coding (NC) paradigm proposes to implement simple in-network processing with packet combinations in the nodes. NC extends the concept of "encoding" a message beyond source coding (for compression) and channel coding (for protection against errors and losses). It has been shown to increase network throughput compared to traditional networks implementation, to reduce delay and to provide robustness to transmission errors and network dynamics. These features are so appealing for multimedia applications that they have spurred a large research effort towards the development of multimedia-specific NC techniques. This paper reviews the recent work in NC for multimedia applications and focuses on the techniques that fill the gap between NC theory and practical applications. It outlines the benefits of NC and presents the open challenges in this area. The paper initially focuses on multimedia-specific aspects of network coding, in particular delay, in-network error control, and mediaspecific error control. These aspects permit to handle varying network conditions as well as client heterogeneity, which are critical to the design and deployment of multimedia systems. After introducing these general concepts, the paper reviews in detail two applications that lend themselves naturally to NC via the cooperation and broadcast models, namely peer-to-peer multimedia streaming and wireless networkin

Point-to-Multipoint Services on Fifth-Generation Mobile Networks

[ES] Esta disertación cubre el estado del arte en LTE eMBMS Release 14, también conocido como Enhanced Television Services (ENTV). ENTV trajo un conjunto de mejoras, tanto a nivel radio como a nivel de núcleo, que transformó a eMBMS en un estándar de televisión terrestre completo. La última versión de esta tecnología se denomina LTE-based 5G Broadcast; pero no usa New Radio ni el núcleo 5G. Para proveer una solución nativa 5G de servicios punto-a-multipunto, hubo investigación en entornos acad\'emicos y colaboraciones público-privada. La iniciativa más notable en este aspecto fue el proyecto del Horizon 2020 5G-Xcast, que transcurrió de 2017 a 2019. 5G-Xcast produjo varias soluciones a nivel de arquitectura, desde la perspectiva de provisión de contenidos, nuevas funciones de red interoperables con el núcleo 5G, hasta modificaciones a la interfaz aire basada en New Radio. Los hallazgos del proyecto están descritos en esta tesis. La tesis incluye dos ejemplos de eMBMS aplicados a verticales diferentes, una para el uso de eMBMS en entornos industriales, y otra presentando eMBMS como un sistema SAP. Incluir servicios punto-a-multipunto como un modo adicional celular trae algunos desafíos, como ya mostró la estandarización de eMBMS: las redes de radiodifusión terrestre y las redes celulares son muy distintas entre ellas. Encontrar una forma de onda viable para ambas infraestructuras es complejo. Esta tesis ofrece un punto de vista distinto al problema: un escenario de colaboración entre cadenas televisivas y operadores móviles, donde la infraestructura de radiodifusión y móvil son compartidas. Este concepto se ha definido como Convergence of Terrestrial and Mobile Networks. Las tecnologías elegidas para converger son ATSC 3.0 y 5G, usando el Advanced Traffic Steering, Switching and Splitting (ATSSS). ATSSS está compuesto de una serie de procedimientos, interfaces, funciones de red, para permitir el uso compartido de un acceso 3GPP con uno non-3GPP, como Wi-Fi. Sin embargo, el uso de ATSSS para juntar radiodifusión y celular no es trivial, ya que ATSSS no fue dise\~{n}ado para enlaces radio unidireccionales como ATSC 3.0. Estas limitaciones son descritas en detalle, y una propuesta para solventarlas tambi\'en está incluida. La solución se basa en Quick UDP Internet Connections (QUIC), y se usa como ejemplo para la provisión de Convergent Services (File Repair y Video Offloading). La tesis concluye con una descripción de Release 17 5MBS, con los nuevos conceptos introducidos. 5MBS es capaz de cambiar entre unicast, multicast y broadcast; dependiendo del servicio, la ubicación geográfica de los usuarios, y las capacidades de la infraestructura móvil involucradas. Para evaluar 5MBS, se ha realizado un estudio de prestaciones, basado en comunicaciones multicast dentro del núcleo de red 5G. Este prototipo 5MBS forma parte del laboratorio VLC Campus 5G, y utiliza el software comercial Open5GCore como base del desarrollo. El modelo de sistema para la experimentación esta formado por un servidor de vídeo, que se conecta al Open5GCore y a las funciones de red mejoradas con funcionalidades 5MBS. Estas funciones de red envían el contenido mediante punto-a-multipunto a un entorno radio y terminales simulados. Los resultados obtenidos resaltan el objetivo principal de la tesis: las comunicaciones punto-a-multipunto son una solución escalable para el envío de contenido multimedia en directo.[CA] Aquesta dissertació cobreix capdavanter en LTE eMBMS Release 14, també conegut com Enhanced Television Services (ENTV). ENTV va portar un conjunt de millores, tant a nivell de ràdio com a nivell de nucli, que va transformar el eMBMS en un estàndard de televisió terrestre complet. La última versió d'aquesta tecnologia es denomina LTE-based 5G Broadcast; però no fa servir New Ràdio ni el nucli 5G. Per a proveir una solució nativa 5G de serveis punt-a-multipunt, va haver-hi investigació en entorns acadèmics i col·laboracions pública i privada. La iniciativa més notable en aquest aspecte va ser el projecte del Horizon 2020 5G-Xcast, que va transcórrer del 2017 a 2019. 5G-Xcast va produir diverses solucions a nivell d'arquitectura, des de la perspectiva de provisió de continguts, noves funcions de xarxa interoperables amb el nucli 5G, fins a modificacions a la interfície aire basada en New Radio. Les troballes del projecte estan descrits en aquesta tesi. La tesi inclou dos exemples de eMBMS aplicats a verticals diferents, una per a l'ús de eMBMS en entorns industrials, i una altra presentant eMBMS com un sistema SAP. Incloure serveis punt-a-multipunt com una manera addicional cel·lular duu alguns desafiaments, com ja va mostrar l'estandardització de eMBMS: les xarxes de radiodifusió terrestre i les xarxes cel·lulars són molt diferents entre elles. Trobar una forma d'ona viable per a totes dues infraestructures és complex. Aquesta tesi ofereix un punt de vista diferent al problema: un escenari de col·laboració entre cadenes televisives i operadors mòbils, on la infraestructura de radiodifusió i mòbil són compartides. Aquest concepte s'ha definit com Convergence of Terrestrial and Mobile Networks. Les tecnologies triades per a convergir són ATSC 3.0 i 5G, usant el Advanced Traffic Steering, Switching and Splitting (ATSSS). ATSSS està compost d'una sèrie de procediments, interfícies, funcions de xarxa, per a permetre l'ús compartit d'un accés 3GPP amb un non-3GPP, com a Wi-Fi. No obstant això, l'ús de ATSSS per a adjuntar radiodifusió i cel·lular no és trivial, ja que ATSSS no va ser dissenyada per a per a enllaços ràdio unidireccionals com ATSC 3.0. Aquestes limitacions són descrites detalladament, i una proposta per a solucionar-les també està inclosa. La solució es basa en Quick UDP Internet Connections (QUIC), i s'usa com a exemple per a la provisió de Convergent Services (File Repair i Vídeo Offloading). La tesi conclou amb una descripció de Release 17 5MBS, amb els nous conceptes introduïts. 5MBS és capaç de canviar entre unicast, multicast i broadcast; depenent del servei, la ubicació geogràfica dels usuaris, i les capacitats de la infraestructura mòbil involucrades. Per a avaluar 5MBS, s'ha realitzat un estudi de prestacions, basat en comunicacions multicast dins del nucli de xarxa 5G. Aquest prototip 5MBS forma part del laboratori VLC Campus 5G, i utilitza el programari comercial Open5GCore com a base del desenvolupament. El model de sistema per a l'experimentació està format per un servidor de vídeo, que es connecta al Open5GCore i a les funcions de xarxa millorades amb funcionalitats 5MBS. Aquestes funcions de xarxa envien el contingut mitjançant punt-a-multipunt a un entorn ràdio i terminals simulats. Els resultats obtinguts ressalten l'objectiu principal de la tesi: les comunicacions punt-a-multipunt són una solució escalable per a l'enviament de contingut multimèdia en directe.[EN] This dissertation covers the state-of-the-art in LTE eMBMS Release 14, also known as Enhanced Television Services (ENTV). ENTV provided a suite of radio and core enhancements that made eMBMS into a viable terrestrial broadcast standard. The latest iteration of this technology is known as LTE-based 5G Broadcast; even though it is not New Radio or 5G Core based. To bridge this gap, research efforts by academia, public and private enterprises evaluated how to provide a 5G-based solution for point-to-multipoint services. The most notable effort in this regard is the Horizon 2020 project 5G-Xcast, which ran from 2017 to 2019. 5G-Xcast provided several architectural solutions, from the content delivery perspective down to air interface specifics; providing new waveforms based on New Radio and Network Functions interoperable with a Release 15 5G Core. The findings are summarized in this thesis. Two examples of eMBMS applied to different verticals are included in the thesis, one for the use of eMBMS in industrial environments, and the other using eMBMS as a PWS technology. Providing point-to-multipoint services as another cellular service poses some problems, as the standardization process of eMBMS showed: the broadcast infrastructure is different than the cellular one. Having a waveform that is suited for both scenarios is a difficult endeavour. The thesis provides a new perspective into this problem: Having existing Terrestrial Broadcast standards and infrastructure be the point-to-multipoint solution of 5G, where mobile operators and broadcasters collaborate together. This is defined in the dissertation as Convergence of Terrestrial and Mobile Networks. The technologies chosen to be converged together were ATSC 3.0 and 5G; using the existing Release 16 framework known as Advanced Traffic Steering, Switching and Splitting (ATSSS). ATSSS is a series of procedures, interfaces, new Network Functions, to allow the joint use of a 3GPP Access Network alongside a non-3GPP one, like Wi-Fi. However, the use of ATSSS for cellular plus broadcast brings challenges, as the ATSSS technology was not designed to be used with a unidirectional access network like ATSC 3.0. These limitations are described in detail, and an architectural proposal that overcomes the limitations is proposed. This solution is based on Quick UDP Internet Connections (QUIC), and how to provide Convergent Services (i.e File Repair and Video Offloading) is shown. The thesis concludes with a description of Release 17 5MBS, including the new concepts introduced. 5MBS features the capacity of switching between unicast, multicast and broadcast; depending on the service addressed, the geographical location of the users, and the capability of the RAN infrastructure targeted. In order to evaluate 5MBS, a performance study of the use of multicast inside the 5G Core has been carried out. The 5MBS prototype was developed as part of the VLC Campus 5G laboratory, using the commercial software Open5GCore which provides the libraries and Network Functions to deploy your own 5G Private Network in testing environments. The system model of the experiment is formed by a video server, connected to the Open5GCore and the 5MBS enhanced functions; which will deliver the content to an emulated RAN environment hosting virtual gNBs and devices. The results obtained reinforce the objective of the thesis, positioning point-to-multipoint as a scalable way to deliver live content.Research projects: 5G-Xcast: Broadcast and Multicast Communication Enablers for the Fifth-Generation of Wireless Systems (H2020 No 761498); 5G-TOURS: SmarT mObility, media and e-health for toURists and citizenS (H2020 No 856950); FUDGE-5G: FUlly DisinteGrated private nEtworks for 5G verticals (H2020 No 957242).Barjau Estevan, CS. (2022). Point-to-Multipoint Services on Fifth-Generation Mobile Networks [Tesis doctoral]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/19140

Quality of Service improvements for real time multimedia applications using next generation network architectures and blockchain in Internet Service Provider cooperative scenario

Real time communications are becoming part of our daily life, requiring constrained requisites with the purpose of being enjoyed in harmony by end users. The factors ruling these requisites are Quality of Service parameters of the users' Internet connections. Achieving a satisfactory QoS level for real time communications depends on parameters that are strongly influenced by the quality of the network connections among the Internet Service Providers, which are located in the path between final users and Over The Top service providers that are supplying them with real time services. Final users can be: business people having real time videoconferences, or adopting crytpocurrencies in their exchanges, videogamers playing online games together with others residing in other countries, migrants talking with their relatives or watching their children growing up in their home countries, people with disabilities adopting tecnologies to help them, doctors performing remote surgeries, manufacturers adopting augmented reality devices to perform dangerous tasks. Each of them performing their daily activities are requiring specific QoS parameters to their ISPs, that nowadays seem to be unable to provide them with a satisfactory QoS level for these kinds of real time services. Through the adoption of next generation networks, such as the Information Centric Networking, it would be possible to overcome the QoS problems that nowadays are experienced. By adopting Blockchain technologies, in several use cases, it would be possible to improve those security aspects related to the non-temperability of information and privacy. I started this thesis analyzing next generation architectures enabling real time multimedia communications. In Software Defined Networking, Named Data Networking and Community Information Centric Networking, I highlighted potential approaches to solve QoS problems that are affecting real time multimedia applications. During my experiments I found that applications able to transmit high quality videos, such as 4k or 8k videos, or to directly interact with devices AR/VR enabled are missing for both ICN approaches. Then I proposed a REST interface for the enforcing of a specific QoS parameter, the round trip time (RTT) taking into consideration the specific use case of a game company that connects with the same telecommunication company of the final user. Supposing that the proposed REST APIs have been deployed in the game company and in the ISP, when one or more users are experiencing lag, the game company will try to ask the ISP to reduce the RTT for that specific user or that group of users. This request can be done by performing a call to a method where IP address(es) and the maximum RTT desired are passed. I also proposed other methods, through which it would be possible to retrieve information about the QoS parameters, and exchange, if necessary, an exceeding parameter in change of another one. The proposed REST APIs can also be used in more complex scenarios, where ISPs along the path are chained together, in order to improve the end to end QoS among Over The Top service provider and final users. To store the information exchanged by using the proposed REST APIs, I proposed to adopt a permissioned blockchain, analizying the ISPs cooperative use case with Hyperledger Fabric, where I proposed the adoption of the Proof of Authority consensus algorithm, to increase the throughput in terms of transactions per second. In a specific case that I examined, I am proposing a combination of Information Centric Networking and Blockchain, in an architecture where ISPs are exchanging valuable information regarding final Users, to improve their QoS parameters. I also proposed my smart contract for the gaming delay use case, that can be used to rule the communication among those ISPs that are along the path among OTT and final users. An extension of this work can be done, by defining billing costs for the QoS improvements