Multimedia delivery in the future internet

The term “Networked Media” implies that all kinds of media including text, image, 3D graphics, audio and video are produced, distributed, shared, managed and consumed on-line through various networks, like the Internet, Fiber, WiFi, WiMAX, GPRS, 3G and so on, in a convergent manner [1]. This white paper is the contribution of the Media Delivery Platform (MDP) cluster and aims to cover the Networked challenges of the Networked Media in the transition to the Future of the Internet. Internet has evolved and changed the way we work and live. End users of the Internet have been confronted with a bewildering range of media, services and applications and of technological innovations concerning media formats, wireless networks, terminal types and capabilities. And there is little evidence that the pace of this innovation is slowing. Today, over one billion of users access the Internet on regular basis, more than 100 million users have downloaded at least one (multi)media file and over 47 millions of them do so regularly, searching in more than 160 Exabytes1 of content. In the near future these numbers are expected to exponentially rise. It is expected that the Internet content will be increased by at least a factor of 6, rising to more than 990 Exabytes before 2012, fuelled mainly by the users themselves. Moreover, it is envisaged that in a near- to mid-term future, the Internet will provide the means to share and distribute (new) multimedia content and services with superior quality and striking flexibility, in a trusted and personalized way, improving citizens’ quality of life, working conditions, edutainment and safety. In this evolving environment, new transport protocols, new multimedia encoding schemes, cross-layer inthe network adaptation, machine-to-machine communication (including RFIDs), rich 3D content as well as community networks and the use of peer-to-peer (P2P) overlays are expected to generate new models of interaction and cooperation, and be able to support enhanced perceived quality-of-experience (PQoE) and innovative applications “on the move”, like virtual collaboration environments, personalised services/ media, virtual sport groups, on-line gaming, edutainment. In this context, the interaction with content combined with interactive/multimedia search capabilities across distributed repositories, opportunistic P2P networks and the dynamic adaptation to the characteristics of diverse mobile terminals are expected to contribute towards such a vision. Based on work that has taken place in a number of EC co-funded projects, in Framework Program 6 (FP6) and Framework Program 7 (FP7), a group of experts and technology visionaries have voluntarily contributed in this white paper aiming to describe the status, the state-of-the art, the challenges and the way ahead in the area of Content Aware media delivery platforms

Context-awareness for ubiquitous media service delivery in next generation networks

Les récentes avancées technologiques permettent désormais la fabrication de terminaux mobiles de plus en plus compacts et dotés de plusieurs interfaces réseaux. Le nouveau modèle de consommation de médias se résume par le concept "Anytime, Anywhere, Any Device" et impose donc de nouvelles exigences en termes de déploiement de services ubiquitaires. Cependant la conception et le developpement de réseaux ubiquitaires et convergents de nouvelles générations soulèvent un certain nombre de défis techniques. Les standards actuels ainsi que les solutions commerciales pourraient être affectés par le manque de considération du contexte utilisateur. Le ressenti de l'utilisateur concernant certains services multimédia tels que la VoIP et l'IPTV dépend fortement des capacités du terminal et des conditions du réseau d'accès. Cela incite les réseaux de nouvelles générations à fournir des services ubiquitaires adaptés à l'environnement de l'utilisateur optimisant par la même occasion ses resources. L'IP Multimedia Subsystem (IMS) est une architecture de nouvelle génération qui centralise l'accès aux services et permet la convergence des réseaux fixe/mobile. Néanmoins, l'évolution de l'IMS est nécessaire sur les points suivants :- l'introduction de la sensibilité au contexte utilisateur et de la PQoS (Perceived QoS) : L'architecture IMS ne prend pas en compte l'environnement de l'utilisateur, ses préférences et ne dispose pas d'un méchanisme de gestion de PQOS. Pour s'assurer de la qualité fournit à l'utilisateur final, des informations sur l'environnement de l'utilisateur ainsi que ses préférences doivent transiter en cœur de réseau afin d'y être analysés. Ce traitement aboutit au lancement du service qui sera adapté et optimisé aux conditions observées. De plus pour le service d'IPTV, les caractéristiques spatio-temporelles de la vidéo influent de manière importante sur la PQoS observée côté utilisateur. L'adaptation des services multimédias en fonction de l'évolution du contexte utilisateur et de la nature de la vidéo diffusée assure une qualité d'expérience à l'utilisateur et optimise par la même occasion l'utilisation des ressources en cœur de réseau.- une solution de mobilité efficace pour les services conversationnels tels que la VoIP : Les dernières publications 3GPP fournissent deux solutions de mobilité: le LTE proposeMIP comme solution de mobilité alors que l'IMS définit une mobilité basée sur le protocoleapplicatif SIP. Ces standards définissent le système de signalisation mais ne s'avancent pas sur la gestion du flux média lors du changement d'interface réseau. La deuxième section introduit une étude comparative détaillée des solutions de mobilité dans les NGNs.Notre première contribution est la spécification de l'architecture globale de notre plateforme IMS sensible au contexte utilisateur réalisée au sein du projet Européen ADAMANTIUM. Nous détaillons tout d'abord le serveur MCMS intelligent placé dans la couche application de l'IMS. Cet élément récolte les informations de qualité de services à différents équipements réseaux et prend la décision d'une action sur l'un de ces équipements. Ensuite nous définissons un profil utilisateur permettant de décrire son environnement et de le diffuser en coeur de réseau. Une étude sur la prédiction de satisfaction utilisateur en fonction des paramètres spatio-temporels de la vidéo a été réalisée afin de connaître le débit idéal pour une PQoS désirée.Notre deuxième contribution est l'introduction d'une solution de mobilité adaptée aux services conversationnels (VoIP) tenant compte du contexte utilisateur. Notre solution s'intègre à l'architecture IMS existante de façon transparente et permet de réduire le temps de latence du handover. Notre solution duplique les paquets de VoIP sur les deux interfaces actives pendant le temps de la transition. Parallèlement, un nouvel algorithme de gestion de mémoire tampon améliore la qualité d'expérience pour le service de VoIP.The latest advances in technology have already defied Moore s law. Thanks to research and industry, hand-held devices are composed of high processing embedded systems enabling the consumption of high quality services. Furthermore, recent trends in communication drive users to consume media Anytime, Anywhere on Any Device via multiple wired and wireless network interfaces. This creates new demands for ubiquitous and high quality service provision management. However, defining and developing the next generation of ubiquitous and converged networks raise a number of challenges. Currently, telecommunication standards do not consider context-awareness aspects for network management and service provisioning. The experience felt by the end-user consuming for instance Voice over IP (VoIP) or Internet Protocol TeleVision (IPTV) services varies depending mainly on user preferences, device context and network resources. It is commonly held that Next Generation Network (NGN) should deliver personalized and effective ubiquitous services to the end user s Mobile Node (MN) while optimizing the network resources at the network operator side. IP Multimedia Subsystem (IMS) is a standardized NGN framework that unifies service access and allows fixed/mobile network convergence. Nevertheless IMS technology still suffers from a number of confining factors that are addressed in this thesis; amongst them are two main issues :The lack of context-awareness and Perceived-QoS (PQoS):-The existing IMS infrastructure does not take into account the environment of the user ,his preferences , and does not provide any PQoS aware management mechanism within its service provisioning control system. In order to ensure that the service satisfies the consumer, this information need to be sent to the core network for analysis. In order to maximize the end-user satisfaction while optimizing network resources, the combination of a user-centric network management and adaptive services according to the user s environment and network conditions are considered. Moreover, video content dynamics are also considered as they significantly impact on the deduced perceptual quality of IPTV services. -The lack of efficient mobility mechanism for conversational services like VoIP :The latest releases of Third Generation Partnership Project (3GPP) provide two types of mobility solutions. Long-Term Evolution (LTE) uses Mobile IP (MIP) and IMS uses Session Initiation Protocol (SIP) mobility. These standards are focusing on signaling but none of them define how the media should be scheduled in multi-homed devices. The second section introduces a detailed study of existing mobility solutions in NGNs. Our first contribution is the specification of the global context-aware IMS architecture proposed within the European project ADAptative Management of mediA distributioN based on saTisfaction orIented User Modeling (ADAMANTIUM). We introduce the innovative Multimedia Content Management System (MCMS) located in the application layer of IMS. This server combines the collected monitoring information from different network equipments with the data of the user profile and takes adaptation actions if necessary. Then, we introduce the User Profile (UP) management within the User Equipment (UE) describing the end-user s context and facilitating the diffusion of the end-user environment towards the IMS core network. In order to optimize the network usage, a PQoS prediction mechanism gives the optimal video bit-rate according to the video content dynamics. Our second contribution in this thesis is an efficient mobility solution for VoIP service within IMS using and taking advantage of user context. Our solution uses packet duplication on both active interfaces during handover process. In order to leverage this mechanism, a new jitter buffer algorithm is proposed at MN side to improve the user s quality of experience. Furthermore, our mobility solution integrates easily to the existing IMS platform.BORDEAUX1-Bib.electronique (335229901) / SudocSudocFranceF

Contribution to quality of user experience provision over wireless networks

The widespread expansion of wireless networks has brought new attractive possibilities to end users. In addition to the mobility capabilities provided by unwired devices, it is worth remarking the easy configuration process that a user has to follow to gain connectivity through a wireless network. Furthermore, the increasing bandwidth provided by the IEEE 802.11 family has made possible accessing to high-demanding services such as multimedia communications. Multimedia traffic has unique characteristics that make it greatly vulnerable against network impairments, such as packet losses, delay, or jitter. Voice over IP (VoIP) communications, video-conference, video-streaming, etc., are examples of these high-demanding services that need to meet very strict requirements in order to be served with acceptable levels of quality. Accomplishing these tough requirements will become extremely important during the next years, taking into account that consumer video traffic will be the predominant traffic in the Internet during the next years. In wired systems, these requirements are achieved by using Quality of Service (QoS) techniques, such as Differentiated Services (DiffServ), traffic engineering, etc. However, employing these methodologies in wireless networks is not that simple as many other factors impact on the quality of the provided service, e.g., fading, interferences, etc. Focusing on the IEEE 802.11g standard, which is the most extended technology for Wireless Local Area Networks (WLANs), it defines two different architecture schemes. On one hand, the infrastructure mode consists of a central point, which manages the network, assuming network controlling tasks such as IP assignment, routing, accessing security, etc. The rest of the nodes composing the network act as hosts, i.e., they send and receive traffic through the central point. On the other hand, the IEEE 802.11 ad-hoc configuration mode is less extended than the infrastructure one. Under this scheme, there is not a central point in the network, but all the nodes composing the network assume both host and router roles, which permits the quick deployment of a network without a pre-existent infrastructure. This type of networks, so called Mobile Ad-hoc NETworks (MANETs), presents interesting characteristics for situations when the fast deployment of a communication system is needed, e.g., tactics networks, disaster events, or temporary networks. The benefits provided by MANETs are varied, including high mobility possibilities provided to the nodes, network coverage extension, or network reliability avoiding single points of failure. The dynamic nature of these networks makes the nodes to react to topology changes as fast as possible. Moreover, as aforementioned, the transmission of multimedia traffic entails real-time constraints, necessary to provide these services with acceptable levels of quality. For those reasons, efficient routing protocols are needed, capable of providing enough reliability to the network and with the minimum impact to the quality of the service flowing through the nodes. Regarding quality measurements, the current trend is estimating what the end user actually perceives when consuming the service. This paradigm is called Quality of user Experience (QoE) and differs from the traditional Quality of Service (QoS) approach in the human perspective given to quality estimations. In order to measure the subjective opinion that a user has about a given service, different approaches can be taken. The most accurate methodology is performing subjective tests in which a panel of human testers rates the quality of the service under evaluation. This approach returns a quality score, so-called Mean Opinion Score (MOS), for the considered service in a scale 1 - 5. This methodology presents several drawbacks such as its high expenses and the impossibility of performing tests at real time. For those reasons, several mathematical models have been presented in order to provide an estimation of the QoE (MOS) reached by different multimedia services In this thesis, the focus is on evaluating and understanding the multimedia-content transmission-process in wireless networks from a QoE perspective. To this end, firstly, the QoE paradigm is explored aiming at understanding how to evaluate the quality of a given multimedia service. Then, the influence of the impairments introduced by the wireless transmission channel on the multimedia communications is analyzed. Besides, the functioning of different WLAN schemes in order to test their suitability to support highly demanding traffic such as the multimedia transmission is evaluated. Finally, as the main contribution of this thesis, new mechanisms or strategies to improve the quality of multimedia services distributed over IEEE 802.11 networks are presented. Concretely, the distribution of multimedia services over ad-hoc networks is deeply studied. Thus, a novel opportunistic routing protocol, so-called JOKER (auto-adJustable Opportunistic acK/timEr-based Routing) is presented. This proposal permits better support to multimedia services while reducing the energy consumption in comparison with the standard ad-hoc routing protocols.Universidad Politécnica de CartagenaPrograma Oficial de Doctorado en Tecnologías de la Información y Comunicacione

Empirical studies of Quality of Experience (QoE) : A Systematic Literature Survey

Quality of Experience (QoE) is a relatively new phenomenon. The main focus of this thesis has been to conduct a systematic literature survey of research done in the field of QoE over a ten year period. The method, developed by A. Fink, has been used to survey empirical studies. A framework of QoE has been developed, which created the possibility of grouping together and analysing all the studies in a common framework. In total, 44 studies were analysed. 66 per cent of them were studies with human participants and 34 per cent of them were studies without human participants. The majority of the selected empirical studies have analysed the sub-aspect ‘satisfaction’. Among other vital sub-aspects, which were of interest to researches, were ‘usefulness’, ‘ease of use’, ‘communication’, ‘loss/packet loss’, ‘delay’, ‘bandwidth’, and ‘jitter’. The results of this survey show that different sub-aspects depend on different services. It is not enough that one sub-aspect functions very well, because most of sub-aspects are closely related to each other. Therefore, it is very important that sub-aspects, which are dependent on each other, are functioning as one group to achieve higher QoE on user experience. This thesis may contribute to deeper understanding of the phenomenon QoE. Knowledge of QoE can bring in new ideas and new possibilities for developing a new system or products for achieving satisfaction of user experience

Measuring And Improving Internet Video Quality Of Experience

Streaming multimedia content over the IP-network is poised to be the dominant Internet traffic for the coming decade, predicted to account for more than 91% of all consumer traffic in the coming years. Streaming multimedia content ranges from Internet television (IPTV), video on demand (VoD), peer-to-peer streaming, and 3D television over IP to name a few. Widespread acceptance, growth, and subscriber retention are contingent upon network providers assuring superior Quality of Experience (QoE) on top of todays Internet. This work presents the first empirical understanding of Internet’s video-QoE capabilities, and tools and protocols to efficiently infer and improve them. To infer video-QoE at arbitrary nodes in the Internet, we design and implement MintMOS: a lightweight, real-time, noreference framework for capturing perceptual quality. We demonstrate that MintMOS’s projections closely match with subjective surveys in accessing perceptual quality. We use MintMOS to characterize Internet video-QoE both at the link level and end-to-end path level. As an input to our study, we use extensive measurements from a large number of Internet paths obtained from various measurement overlays deployed using PlanetLab. Link level degradations of intra– and inter–ISP Internet links are studied to create an empirical understanding of their shortcomings and ways to overcome them. Our studies show that intra–ISP links are often poorly engineered compared to peering links, and that iii degradations are induced due to transient network load imbalance within an ISP. Initial results also indicate that overlay networks could be a promising way to avoid such ISPs in times of degradations. A large number of end-to-end Internet paths are probed and we measure delay, jitter, and loss rates. The measurement data is analyzed offline to identify ways to enable a source to select alternate paths in an overlay network to improve video-QoE, without the need for background monitoring or apriori knowledge of path characteristics. We establish that for any unstructured overlay of N nodes, it is sufficient to reroute key frames using a random subset of k nodes in the overlay, where k is bounded by O(lnN). We analyze various properties of such random subsets to derive simple, scalable, and an efficient path selection strategy that results in a k-fold increase in path options for any source-destination pair; options that consistently outperform Internet path selection. Finally, we design a prototype called source initiated frame restoration (SIFR) that employs random subsets to derive alternate paths and demonstrate its effectiveness in improving Internet video-QoE

Network overload avoidance by traffic engineering and content caching

The Internet traffic volume continues to grow at a great rate, now driven by video and TV distribution. For network operators it is important to avoid congestion in the network, and to meet service level agreements with their customers. This thesis presents work on two methods operators can use to reduce links loads in their networks: traffic engineering and content caching. This thesis studies access patterns for TV and video and the potential for caching. The investigation is done both using simulation and by analysis of logs from a large TV-on-Demand system over four months. The results show that there is a small set of programs that account for a large fraction of the requests and that a comparatively small local cache can be used to significantly reduce the peak link loads during prime time. The investigation also demonstrates how the popularity of programs changes over time and shows that the access pattern in a TV-on-Demand system very much depends on the content type. For traffic engineering the objective is to avoid congestion in the network and to make better use of available resources by adapting the routing to the current traffic situation. The main challenge for traffic engineering in IP networks is to cope with the dynamics of Internet traffic demands. This thesis proposes L-balanced routings that route the traffic on the shortest paths possible but make sure that no link is utilised to more than a given level L. L-balanced routing gives efficient routing of traffic and controlled spare capacity to handle unpredictable changes in traffic. We present an L-balanced routing algorithm and a heuristic search method for finding L-balanced weight settings for the legacy routing protocols OSPF and IS-IS. We show that the search and the resulting weight settings work well in real network scenarios

QUALITY-DRIVEN CROSS LAYER DESIGN FOR MULTIMEDIA SECURITY OVER RESOURCE CONSTRAINED WIRELESS SENSOR NETWORKS

The strong need for security guarantee, e.g., integrity and authenticity, as well as privacy and confidentiality in wireless multimedia services has driven the development of an emerging research area in low cost Wireless Multimedia Sensor Networks (WMSNs). Unfortunately, those conventional encryption and authentication techniques cannot be applied directly to WMSNs due to inborn challenges such as extremely limited energy, computing and bandwidth resources. This dissertation provides a quality-driven security design and resource allocation framework for WMSNs. The contribution of this dissertation bridges the inter-disciplinary research gap between high layer multimedia signal processing and low layer computer networking. It formulates the generic problem of quality-driven multimedia resource allocation in WMSNs and proposes a cross layer solution. The fundamental methodologies of multimedia selective encryption and stream authentication, and their application to digital image or video compression standards are presented. New multimedia selective encryption and stream authentication schemes are proposed at application layer, which significantly reduces encryption/authentication complexity. In addition, network resource allocation methodologies at low layers are extensively studied. An unequal error protection-based network resource allocation scheme is proposed to achieve the best effort media quality with integrity and energy efficiency guarantee. Performance evaluation results show that this cross layer framework achieves considerable energy-quality-security gain by jointly designing multimedia selective encryption/multimedia stream authentication and communication resource allocation