Video Quality Prediction for Video over Wireless Access Networks (UMTS and WLAN)

Transmission of video content over wireless access networks (in particular, Wireless Local Area Networks (WLAN) and Third Generation Universal Mobile Telecommunication System (3G UMTS)) is growing exponentially and gaining popularity, and is predicted to expose new revenue streams for mobile network operators. However, the success of these video applications over wireless access networks very much depend on meeting the user’s Quality of Service (QoS) requirements. Thus, it is highly desirable to be able to predict and, if appropriate, to control video quality to meet user’s QoS requirements. Video quality is affected by distortions caused by the encoder and the wireless access network. The impact of these distortions is content dependent, but this feature has not been widely used in existing video quality prediction models. The main aim of the project is the development of novel and efficient models for video quality prediction in a non-intrusive way for low bitrate and resolution videos and to demonstrate their application in QoS-driven adaptation schemes for mobile video streaming applications. This led to five main contributions of the thesis as follows:(1) A thorough understanding of the relationships between video quality, wireless access network (UMTS and WLAN) parameters (e.g. packet/block loss, mean burst length and link bandwidth), encoder parameters (e.g. sender bitrate, frame rate) and content type is provided. An understanding of the relationships and interactions between them and their impact on video quality is important as it provides a basis for the development of non-intrusive video quality prediction models.(2) A new content classification method was proposed based on statistical tools as content type was found to be the most important parameter. (3) Efficient regression-based and artificial neural network-based learning models were developed for video quality prediction over WLAN and UMTS access networks. The models are light weight (can be implemented in real time monitoring), provide a measure for user perceived quality, without time consuming subjective tests. The models have potential applications in several other areas, including QoS control and optimization in network planning and content provisioning for network/service providers.(4) The applications of the proposed regression-based models were investigated in (i) optimization of content provisioning and network resource utilization and (ii) A new fuzzy sender bitrate adaptation scheme was presented at the sender side over WLAN and UMTS access networks. (5) Finally, Internet-based subjective tests that captured distortions caused by the encoder and the wireless access network for different types of contents were designed. The database of subjective results has been made available to research community as there is a lack of subjective video quality assessment databases.Partially sponsored by EU FP7 ADAMANTIUM Project (EU Contract 214751

Quality-Oriented Mobility Management for Multimedia Content Delivery to Mobile Users

The heterogeneous wireless networking environment determined by the latest developments in wireless access technologies promises a high level of communication resources for mobile computational devices. Although the communication resources provided, especially referring to bandwidth, enable multimedia streaming to mobile users, maintaining a high user perceived quality is still a challenging task. The main factors which affect quality in multimedia streaming over wireless networks are mainly the error-prone nature of the wireless channels and the user mobility. These factors determine a high level of dynamics of wireless communication resources, namely variations in throughput and packet loss as well as network availability and delays in delivering the data packets. Under these conditions maintaining a high level of quality, as perceived by the user, requires a quality oriented mobility management scheme. Consequently we propose the Smooth Adaptive Soft-Handover Algorithm, a novel quality oriented handover management scheme which unlike other similar solutions, smoothly transfer the data traffic from one network to another using multiple simultaneous connections. To estimate the capacity of each connection the novel Quality of Multimedia Streaming (QMS) metric is proposed. The QMS metric aims at offering maximum flexibility and efficiency allowing the applications to fine tune the behavior of the handover algorithm. The current simulation-based performance evaluation clearly shows the better performance of the proposed Smooth Adaptive Soft-Handover Algorithm as compared with other handover solutions. The evaluation was performed in various scenarios including multiple mobile hosts performing handover simultaneously, wireless networks with variable overlapping areas, and various network congestion levels

Quality of service differentiation for multimedia delivery in wireless LANs

Delivering multimedia content to heterogeneous devices over a variable networking environment while maintaining high quality levels involves many technical challenges. The research reported in this thesis presents a solution for Quality of Service (QoS)-based service differentiation when delivering multimedia content over the wireless LANs. This thesis has three major contributions outlined below: 1. A Model-based Bandwidth Estimation algorithm (MBE), which estimates the available bandwidth based on novel TCP and UDP throughput models over IEEE 802.11 WLANs. MBE has been modelled, implemented, and tested through simulations and real life testing. In comparison with other bandwidth estimation techniques, MBE shows better performance in terms of error rate, overhead, and loss. 2. An intelligent Prioritized Adaptive Scheme (iPAS), which provides QoS service differentiation for multimedia delivery in wireless networks. iPAS assigns dynamic priorities to various streams and determines their bandwidth share by employing a probabilistic approach-which makes use of stereotypes. The total bandwidth to be allocated is estimated using MBE. The priority level of individual stream is variable and dependent on stream-related characteristics and delivery QoS parameters. iPAS can be deployed seamlessly over the original IEEE 802.11 protocols and can be included in the IEEE 802.21 framework in order to optimize the control signal communication. iPAS has been modelled, implemented, and evaluated via simulations. The results demonstrate that iPAS achieves better performance than the equal channel access mechanism over IEEE 802.11 DCF and a service differentiation scheme on top of IEEE 802.11e EDCA, in terms of fairness, throughput, delay, loss, and estimated PSNR. Additionally, both objective and subjective video quality assessment have been performed using a prototype system. 3. A QoS-based Downlink/Uplink Fairness Scheme, which uses the stereotypes-based structure to balance the QoS parameters (i.e. throughput, delay, and loss) between downlink and uplink VoIP traffic. The proposed scheme has been modelled and tested through simulations. The results show that, in comparison with other downlink/uplink fairness-oriented solutions, the proposed scheme performs better in terms of VoIP capacity and fairness level between downlink and uplink traffic

Context-awareness for ubiquitous media service delivery in next generation networks

Les récentes avancées technologiques permettent désormais la fabrication de terminaux mobiles de plus en plus compacts et dotés de plusieurs interfaces réseaux. Le nouveau modèle de consommation de médias se résume par le concept "Anytime, Anywhere, Any Device" et impose donc de nouvelles exigences en termes de déploiement de services ubiquitaires. Cependant la conception et le developpement de réseaux ubiquitaires et convergents de nouvelles générations soulèvent un certain nombre de défis techniques. Les standards actuels ainsi que les solutions commerciales pourraient être affectés par le manque de considération du contexte utilisateur. Le ressenti de l'utilisateur concernant certains services multimédia tels que la VoIP et l'IPTV dépend fortement des capacités du terminal et des conditions du réseau d'accès. Cela incite les réseaux de nouvelles générations à fournir des services ubiquitaires adaptés à l'environnement de l'utilisateur optimisant par la même occasion ses resources. L'IP Multimedia Subsystem (IMS) est une architecture de nouvelle génération qui centralise l'accès aux services et permet la convergence des réseaux fixe/mobile. Néanmoins, l'évolution de l'IMS est nécessaire sur les points suivants :- l'introduction de la sensibilité au contexte utilisateur et de la PQoS (Perceived QoS) : L'architecture IMS ne prend pas en compte l'environnement de l'utilisateur, ses préférences et ne dispose pas d'un méchanisme de gestion de PQOS. Pour s'assurer de la qualité fournit à l'utilisateur final, des informations sur l'environnement de l'utilisateur ainsi que ses préférences doivent transiter en cœur de réseau afin d'y être analysés. Ce traitement aboutit au lancement du service qui sera adapté et optimisé aux conditions observées. De plus pour le service d'IPTV, les caractéristiques spatio-temporelles de la vidéo influent de manière importante sur la PQoS observée côté utilisateur. L'adaptation des services multimédias en fonction de l'évolution du contexte utilisateur et de la nature de la vidéo diffusée assure une qualité d'expérience à l'utilisateur et optimise par la même occasion l'utilisation des ressources en cœur de réseau.- une solution de mobilité efficace pour les services conversationnels tels que la VoIP : Les dernières publications 3GPP fournissent deux solutions de mobilité: le LTE proposeMIP comme solution de mobilité alors que l'IMS définit une mobilité basée sur le protocoleapplicatif SIP. Ces standards définissent le système de signalisation mais ne s'avancent pas sur la gestion du flux média lors du changement d'interface réseau. La deuxième section introduit une étude comparative détaillée des solutions de mobilité dans les NGNs.Notre première contribution est la spécification de l'architecture globale de notre plateforme IMS sensible au contexte utilisateur réalisée au sein du projet Européen ADAMANTIUM. Nous détaillons tout d'abord le serveur MCMS intelligent placé dans la couche application de l'IMS. Cet élément récolte les informations de qualité de services à différents équipements réseaux et prend la décision d'une action sur l'un de ces équipements. Ensuite nous définissons un profil utilisateur permettant de décrire son environnement et de le diffuser en coeur de réseau. Une étude sur la prédiction de satisfaction utilisateur en fonction des paramètres spatio-temporels de la vidéo a été réalisée afin de connaître le débit idéal pour une PQoS désirée.Notre deuxième contribution est l'introduction d'une solution de mobilité adaptée aux services conversationnels (VoIP) tenant compte du contexte utilisateur. Notre solution s'intègre à l'architecture IMS existante de façon transparente et permet de réduire le temps de latence du handover. Notre solution duplique les paquets de VoIP sur les deux interfaces actives pendant le temps de la transition. Parallèlement, un nouvel algorithme de gestion de mémoire tampon améliore la qualité d'expérience pour le service de VoIP.The latest advances in technology have already defied Moore s law. Thanks to research and industry, hand-held devices are composed of high processing embedded systems enabling the consumption of high quality services. Furthermore, recent trends in communication drive users to consume media Anytime, Anywhere on Any Device via multiple wired and wireless network interfaces. This creates new demands for ubiquitous and high quality service provision management. However, defining and developing the next generation of ubiquitous and converged networks raise a number of challenges. Currently, telecommunication standards do not consider context-awareness aspects for network management and service provisioning. The experience felt by the end-user consuming for instance Voice over IP (VoIP) or Internet Protocol TeleVision (IPTV) services varies depending mainly on user preferences, device context and network resources. It is commonly held that Next Generation Network (NGN) should deliver personalized and effective ubiquitous services to the end user s Mobile Node (MN) while optimizing the network resources at the network operator side. IP Multimedia Subsystem (IMS) is a standardized NGN framework that unifies service access and allows fixed/mobile network convergence. Nevertheless IMS technology still suffers from a number of confining factors that are addressed in this thesis; amongst them are two main issues :The lack of context-awareness and Perceived-QoS (PQoS):-The existing IMS infrastructure does not take into account the environment of the user ,his preferences , and does not provide any PQoS aware management mechanism within its service provisioning control system. In order to ensure that the service satisfies the consumer, this information need to be sent to the core network for analysis. In order to maximize the end-user satisfaction while optimizing network resources, the combination of a user-centric network management and adaptive services according to the user s environment and network conditions are considered. Moreover, video content dynamics are also considered as they significantly impact on the deduced perceptual quality of IPTV services. -The lack of efficient mobility mechanism for conversational services like VoIP :The latest releases of Third Generation Partnership Project (3GPP) provide two types of mobility solutions. Long-Term Evolution (LTE) uses Mobile IP (MIP) and IMS uses Session Initiation Protocol (SIP) mobility. These standards are focusing on signaling but none of them define how the media should be scheduled in multi-homed devices. The second section introduces a detailed study of existing mobility solutions in NGNs. Our first contribution is the specification of the global context-aware IMS architecture proposed within the European project ADAptative Management of mediA distributioN based on saTisfaction orIented User Modeling (ADAMANTIUM). We introduce the innovative Multimedia Content Management System (MCMS) located in the application layer of IMS. This server combines the collected monitoring information from different network equipments with the data of the user profile and takes adaptation actions if necessary. Then, we introduce the User Profile (UP) management within the User Equipment (UE) describing the end-user s context and facilitating the diffusion of the end-user environment towards the IMS core network. In order to optimize the network usage, a PQoS prediction mechanism gives the optimal video bit-rate according to the video content dynamics. Our second contribution in this thesis is an efficient mobility solution for VoIP service within IMS using and taking advantage of user context. Our solution uses packet duplication on both active interfaces during handover process. In order to leverage this mechanism, a new jitter buffer algorithm is proposed at MN side to improve the user s quality of experience. Furthermore, our mobility solution integrates easily to the existing IMS platform.BORDEAUX1-Bib.electronique (335229901) / SudocSudocFranceF

Distribuição de vídeo para grupos de utilizadores em redes móveis heterogéneas19

The evolutions veri ed in mobile devices capabilities (storage capacity, screen resolution, processor, etc.) over the last years led to a signi cant change in mobile user behavior, with the consumption and creation of multimedia content becoming more common, in particular video tra c. Consequently, mobile operator networks, despite being the target of architectural evolutions and improvements over several parameters (such as capacity, transmission and reception performance, amongst others), also increasingly become more frequently challenged by performance aspects associated to the nature of video tra c, whether by the demanding requirements associated to that service, or by its volume increase in such networks. This Thesis proposes modi cations to the mobile architecture towards a more e cient video broadcasting, de ning and developing mechanisms applicable to the network, or to the mobile terminal. Particularly, heterogeneous networks multicast IP mobility supported scenarios are focused, emphasizing their application over di erent access technologies. The suggested changes are applicable to mobile or static user scenarios, whether it performs the role of receiver or source of the video tra c. Similarly, the de ned mechanisms propose solutions targeting operators with di erent video broadcasting goals, or whose networks have di erent characteristics. The pursued methodology combined an experimental evaluation executed over physical testbeds, with the mathematical evaluation using network simulation, allowing the veri cation of its impact on the optimization of video reception in mobile terminalsA evolução veri cada nas características dos dispositivos moveis (capacidade de armazenamento, resolução do ecrã, processador, etc.) durante os últimos anos levou a uma alteração signi cativa nos comportamentos dos utilizadores, sendo agora comum o consumo e produção de conteúdos multimédia envolvendo terminais móveis, em particular o tráfego vídeo. Consequentemente, as redes de operador móvel, embora tendo também sido alvo constante de evoluções arquitecturais e melhorias em vários parâmetros (tais como capacidade, ritmo de transmissão/recepção, entre outros), vêemse cada vez mais frequentemente desa adas por aspectos de desempenho associados à natureza do tráfego de vídeo, seja pela exigência de requisitos associados a esse serviço, quer pelo aumento do volume do mesmo nesse tipo de redes. Esta Tese propôe alterações à arquitetura móvel para a disseminação de vídeo mais e ciente, de nindo e desenvolvendo mecanismos aplicáveis à rede, ou ao utilizador móvel. Em particular, são focados cenários suportados por IP multicast em redes móveis heterogéneas, isto é, com ênfase na aplicação destes mecanismos sobre diferentes tecnologias de acesso. As alterações sugeridas aplicam-se a cenários de utilizador estático ou móvel, sendo este a fonte ou receptor do tráfego vídeo. Da mesma forma, são propostas soluções tendo em vista operadores com diferentes objectivos de disseminação de vídeo, ou cujas redes têm diferentes características. A metodologia utilizada combinou a avaliação experimental em testbeds físicas com a avaliação matemática em simulações de redes, e permitiu veri car o impacto sobre a optimização da recepção de vídeo em terminais móveisPrograma Doutoral em Telecomunicaçõe

Handoff management for infotainment services over vehicular networks

Intelligent Transportation Systems (ITS) has impulsed the vehicular communications at the present time. The vehicular communications field is a hot research topic and is attracting a great interest in the automotive industry and telecommunications. There are essentially two main lines of work: (1) communication services related to road safety and traffic information; and (2) information and entertainment services, also named infotainment services. These latter services include both transmitting multimedia (voice over IP, streaming, on-line gaming, etc.) and classic data services (e-mail, access to private networks, web browsing, file sharing, etc.). In this thesis we will focus on these infotainment services because further research in this immature research field is necessary and, until nowadays, the main effort of the research community regarding vehicular communication has been focused on road safety and traffic information. Vehicular nodes need to be reached from the Internet and vice versa to be able to access to infotainment services. While vehicles move along the road infrastructure, they change their wireless point of attachment to the network. During this process, connectivity breaks down until the vehicle is connected again to a new road side unit in its area. This disconnection causes a disruption in the communications. Fast handoffs are a crucial requirement for vehicular networks to avoid long disruption times, since the high speed of vehicular nodes involves suffering a lot of handoffs during an Internet connection. This thesis is focused on Vehicular-to-Infrastructure (V2I) real-time infotainment services. The main contributions of this thesis are: i) a new testing framework for V2I communications to be able to test infotainment services in an easy way; ii) the analysis of the deployability of infotainment video services in vehicular networks using mobility protocols; and iii) the development of a new TCP architecture that will provide a better performance for all TCP-based infotainment services in a vehicular scenario with handoffs. In this thesis, firstly, we propose a new testing framework for vehicular infotainment applications. This framework is a vehicular emulation platform that allows testing real applications installed on Linux virtual machines. Using emulation, we are able to evaluate the performance of real applications with real-time requirements, so we can test multimedia applications used to offer infotainment services in vehicular scenarios in a straightforward way. Secondly, using the testing framework implemented in the first part of the thesis, we have done a performance evaluation of an infotainment service. Among these services, we think that video on demand services on highways will be interesting for users, and generate revenue to network operators. So we evaluated how network-layer handoffs can limit the deployment of a video streaming service. According to the results obtained, driving at high speeds will be an issue for a correct playback of video content, even using fast handoffs techniques. Finally, we developed a new TCP architecture to enhance performance during handoffs. Most of the non-safety services on ITS rely on the Transport Control Protocol (TCP), one of the core protocols of the Internet Protocol Suite. However there exists several issues related to TCP and mobility that can affect to TCP performance, and these issues are particularly important in vehicular networks due to its high mobility. Using new IEEE 802.21 MIH services, we propose a new TCP architecture that is able to anticipate handoffs, permitting to resume the communication after a handoff, avoiding long delays caused by TCP issues and adapting the TCP parameters to the new characteristics of the network. Using the architecture proposed, the performance of TCP is enhanced, getting a higher overall throughput and avoiding TCP fairness issues between users.Els Sistemes de Transport Intel·ligents (ITS) han impulsat les comunicacions vehiculars en l'actualitat. Les comunicacions vehiculars és un camp d'investigació de moda, i està atraient un gran interès en la indústria automobilística i de les telecomunicacions. En el camp de les comunicacions vehiculars, hi ha principalment dues línies de treball: (1) serveis de comunicacions relacionats amb la seguretat viària i la informació del trànsit; i (2) serveis d'informació i entreteniment, també anomenats serveis d'infotainment. Aquests últims inclouen tant serveis multimèdia (veu sobre IP, streaming, jocs on-line, etc.), com serveis clàssics de dades (correu electrònic, accés a xarxes privades, navegació web, compartir arxius, etc.). En aquesta tesi ens centrarem en aquests serveis d'infotainment ja que és necessari aprofundir en la investigació per aquests tipus de serveis, ja que, fins avui, els esforços de la comunitat científica en el camp de les comunicacions vehiculars s'ha centrat en els serveis relacionats amb la seguretat viària i la informació del trànsit. Els nodes vehiculars necessiten tenir connexió a Internet per a poder tenir accés als serveis d'infotainment. Mentre els vehicles estan en moviment a través de la xarxa viària, els vehicles han d'anar canviant el punt de connexió sense fils amb la xarxa. Durant aquest procés de canvi de punt de connexió, anomenat handoff, es perd la connectivitat fins que el vehicle es reconnecta a un altre punt de connexió viària prop de la seva àrea. Aquesta desconnexió causa interrupcions en les comunicacions. Uns handoffs ràpids són bàsics a les xarxes vehiculars per a evitar llargs períodes d'interrupció durant les comunicacions, ja que la gran velocitat a la que es mouen els nodes vehiculars significa un gran nombre de handoffs durant una connexió a Internet. Aquesta tesi es centra en serveis d'infotaiment en temps real per a comunicacions Vehicle-a-Infraestructura (V2I). Les principals contribucions d'aquesta tesi son: i) un nou marc de proves per a les comunicacions (V2I) per a poder provar serveis d'infotainment d'una manera fàcil; ii) l'anàlisi de la viabilitat del desplegament de serveis d'infotainment de vídeo en xarxes vehiculars utilitzant protocols de mobilitat IP; i iii) el desenvolupament d'una nova arquitectura TCP que proporciona un millor funcionament per a tots aquells serveis d'infotainment basats en el protocol TCP en un escenari vehicular amb handoffs. En aquesta tesi, primer proposem un nou marc de proves per a aplicacions vehiculars d'infotainment. Aquest marc és una plataforma d'emulació vehicular que permet provar aplicacions reals instal·lades en màquines virtuals Linux. Utilitzant l'emulació, som capaços d'avaluar el rendiment d'aplicacions reals amb característiques de temps real. D'aquesta manera es poden avaluar aplicacions multimèdia utilitzades per oferir serveis d'infotainment d'una forma senzilla en escenaris vehiculars. Segon, utilitzant el marc de prova implementat en la primera part de la tesi, hem avaluat el rendiment d'un servei d'infotainment. Entre aquest tipus de servei, creem que els serveis de vídeo sota demanda en autopistes/autovies serà interessant pels usuaris i generarà beneficis per als operadors de la xarxa. Per tant, hem avaluat com els handoffs a nivell de la capa de xarxa poden limitar el desplegament d'un servei de streaming de vídeo sota demanda. D'acord amb els resultats obtinguts, conduir a grans velocitats podria ser un problema per a poder reproduir un vídeo correctament, tot i utilitzar tècniques de handoffs ràpids. Finalment, hem desenvolupat una nova arquitectura TCP per a millorar el rendiment del protocol durant els handoffs. La majoria dels serveis d'infotainment utilitzen el Protocol de Control de Transport (TCP), un dels principals protocols de la pila de protocols d'Internet. Però existeixen forces problemes relacionats amb l'ús de TCP i la mobilitat que n'afecta el rendiment, i aquests problemes són particular

MediaSync: Handbook on Multimedia Synchronization

This book provides an approachable overview of the most recent advances in the fascinating field of media synchronization (mediasync), gathering contributions from the most representative and influential experts. Understanding the challenges of this field in the current multi-sensory, multi-device, and multi-protocol world is not an easy task. The book revisits the foundations of mediasync, including theoretical frameworks and models, highlights ongoing research efforts, like hybrid broadband broadcast (HBB) delivery and users' perception modeling (i.e., Quality of Experience or QoE), and paves the way for the future (e.g., towards the deployment of multi-sensory and ultra-realistic experiences). Although many advances around mediasync have been devised and deployed, this area of research is getting renewed attention to overcome remaining challenges in the next-generation (heterogeneous and ubiquitous) media ecosystem. Given the significant advances in this research area, its current relevance and the multiple disciplines it involves, the availability of a reference book on mediasync becomes necessary. This book fills the gap in this context. In particular, it addresses key aspects and reviews the most relevant contributions within the mediasync research space, from different perspectives. Mediasync: Handbook on Multimedia Synchronization is the perfect companion for scholars and practitioners that want to acquire strong knowledge about this research area, and also approach the challenges behind ensuring the best mediated experiences, by providing the adequate synchronization between the media elements that constitute these experiences