Beyond multimedia adaptation: Quality of experience-aware multi-sensorial media delivery

Multiple sensorial media (mulsemedia) combines multiple media elements which engage three or more of human senses, and as most other media content, requires support for delivery over the existing networks. This paper proposes an adaptive mulsemedia framework (ADAMS) for delivering scalable video and sensorial data to users. Unlike existing two-dimensional joint source-channel adaptation solutions for video streaming, the ADAMS framework includes three joint adaptation dimensions: video source, sensorial source, and network optimization. Using an MPEG-7 description scheme, ADAMS recommends the integration of multiple sensorial effects (i.e., haptic, olfaction, air motion, etc.) as metadata into multimedia streams. ADAMS design includes both coarse- and fine-grained adaptation modules on the server side: mulsemedia flow adaptation and packet priority scheduling. Feedback from subjective quality evaluation and network conditions is used to develop the two modules. Subjective evaluation investigated users' enjoyment levels when exposed to mulsemedia and multimedia sequences, respectively and to study users' preference levels of some sensorial effects in the context of mulsemedia sequences with video components at different quality levels. Results of the subjective study inform guidelines for an adaptive strategy that selects the optimal combination for video segments and sensorial data for a given bandwidth constraint and user requirement. User perceptual tests show how ADAMS outperforms existing multimedia delivery solutions in terms of both user perceived quality and user enjoyment during adaptive streaming of various mulsemedia content. In doing so, it highlights the case for tailored, adaptive mulsemedia delivery over traditional multimedia adaptive transport mechanisms

Multimedia delivery in the future internet

The term “Networked Media” implies that all kinds of media including text, image, 3D graphics, audio and video are produced, distributed, shared, managed and consumed on-line through various networks, like the Internet, Fiber, WiFi, WiMAX, GPRS, 3G and so on, in a convergent manner [1]. This white paper is the contribution of the Media Delivery Platform (MDP) cluster and aims to cover the Networked challenges of the Networked Media in the transition to the Future of the Internet. Internet has evolved and changed the way we work and live. End users of the Internet have been confronted with a bewildering range of media, services and applications and of technological innovations concerning media formats, wireless networks, terminal types and capabilities. And there is little evidence that the pace of this innovation is slowing. Today, over one billion of users access the Internet on regular basis, more than 100 million users have downloaded at least one (multi)media file and over 47 millions of them do so regularly, searching in more than 160 Exabytes1 of content. In the near future these numbers are expected to exponentially rise. It is expected that the Internet content will be increased by at least a factor of 6, rising to more than 990 Exabytes before 2012, fuelled mainly by the users themselves. Moreover, it is envisaged that in a near- to mid-term future, the Internet will provide the means to share and distribute (new) multimedia content and services with superior quality and striking flexibility, in a trusted and personalized way, improving citizens’ quality of life, working conditions, edutainment and safety. In this evolving environment, new transport protocols, new multimedia encoding schemes, cross-layer inthe network adaptation, machine-to-machine communication (including RFIDs), rich 3D content as well as community networks and the use of peer-to-peer (P2P) overlays are expected to generate new models of interaction and cooperation, and be able to support enhanced perceived quality-of-experience (PQoE) and innovative applications “on the move”, like virtual collaboration environments, personalised services/ media, virtual sport groups, on-line gaming, edutainment. In this context, the interaction with content combined with interactive/multimedia search capabilities across distributed repositories, opportunistic P2P networks and the dynamic adaptation to the characteristics of diverse mobile terminals are expected to contribute towards such a vision. Based on work that has taken place in a number of EC co-funded projects, in Framework Program 6 (FP6) and Framework Program 7 (FP7), a group of experts and technology visionaries have voluntarily contributed in this white paper aiming to describe the status, the state-of-the art, the challenges and the way ahead in the area of Content Aware media delivery platforms

Evaluation of the MDC and FEC over the quality of service and quality of experience for video distribution in ad hoc networks

Mobile ad hoc networks (MANETs) offer an excellent scenario for deploying communication applications because of the connectivity and versatility of this kind of networks. In contrast, the topology is usually extremely dynamic causing high rate of packet loss, so that ensuring a specific Quality of Service (QoS) for real-time video services becomes a hard challenge. In this paper, we evaluate the effect of using Multiple Description Coding (MDC) and Forward Error Correction (FEC) techniques for improving video quality in a multimedia content distribution system. A hybrid architecture using fixed and wireless ad hoc networks is proposed, which enables the use of multipoint-to-point transmission. MDC and FEC mechanisms can be combined with multipath transmission to increase the network efficiency and recover lost packets, improving the overall Quality of Experience (QoE) of the receiver. Simulations have been analyzed paying attention to objective parameters (Peak Signal to Noise Ratio, Packet Delivery Ratio, Decodable Frame Rate and interruptions) and subjective parameters. Results show that MDC increases the probability of packet delivery and FEC is able to recover lost frames and reduce video interruptions in moderate mobility scenarios, resulting in the improvement of video quality and the final user experience.This work was supported by project MIQUEL (TEC2007- 68119-C02-01/TCM) of the Spanish Ministry of Education and Science. The authors would like to thank the Editor and the reviewers for helpful suggestions to improve the quality of this paper.Acelas Delgado, P.; Arce Vila, P.; Guerri Cebollada, JC.; Castellanos Hernández, WE. (2014). Evaluation of the MDC and FEC over the quality of service and quality of experience for video distribution in ad hoc networks. Multimedia Tools and Applications. 68(3):969-989. https://doi.org/10.1007/s11042-012-1111-3969989683Apostolopoulos JG, Wong T, Tan W, Wee SJ (2002) On multiple description streaming with content delivery networks. IEEE INFOCOMBoukerche A (2009) Algorithms and protocols for wireless and mobile ad hoc networks. John Wiley & Sons IncChow CO, Ishii H (2007) Enhancing real-time video streaming over mobile ad hoc networks using multipoint-to-point communication. Comput Commun 30:1754–1764Clausen T, Jacquet P (2003) Optimized link state routing protocol (OLSR), RFC 3626Corrie B et al (2003) Towards quality of experience in advanced collaborative environments. Third Annual Workshop on Advanced Collaborative EnvironmentsGabrielyan E, Hersch R (2006) Reliable multi-path routing schemes for real-time streaming. International Conference on Digital Telecommunications, pp 65–65Gandikota VR, Tamma BR, Murthy CSR (2008) Adaptive-FEC based packet loss resilience scheme for supporting voice communication over adhoc wireless networks. IEEE Trans Mobile Comput 7:1184–1199Gharavi H (2008) Multi-channel for multihop communication links. International Conference on Telecommunications, pp 1–6Grega M, Janowski L, Leszczuk M, Romaniak P, Papir Z (2008) Quality of experience evaluation for multimedia services. Przegląd Telekomunikacyjny i Wiadomości Telekomunikacyjne 4:142–153Hsieh MY, Huang YM, Chian TC (2007) Transmission of layered video streaming via multi-path on ad hoc networks. Multimed Tool Appl 34:155–177ITU—International Telecommunication Union (2007) Definition of quality of experience (QoE)”, Reference: TD 109rev2 (PLEN/12)ITU-R Recommendation BT.500-12 (2009) Methodology for the subjective assessment of the quality of television pictures. International Telecommunication Union, GenevaITU-T Recommendation P.910 (2000) Subjective video quality assessment methods for multimedia applications. International Telecommunication Union, GenevaKao KL, Ke ChH, Shieh CH (2006) An advanced simulation tool-set for video transmission performance evaluation. IEEE Region 10 Conference, pp 1–40Ke CH et al (2006) A novel realistic simulation tool for video transmission over wireless network. Proceedings of the IEEE International Conference on Sensor Networks, Ubiquitous, and Trsutworthy ComputingKeisuke U, Cheeonn C, Hiroshi I (2008) A study on video performance of multipoint-to-point video streaming with multiple description coding over ad hoc networks. EEJ Trans Electron, Inf Syst 128:1431–1437Kilkki K (2008) Quality of experience in communications ecosystem. J Univers Comput Sci 14:615–624Li A (2007) RTP payload format for generic forward error correction. RFC 5109, Dec. 2007Li J, Blake C, Couto DD, Lee H, Morris R (2001) Capacity of ad hoc wireless networks. 7th Annual International Conference on Mobile Computing and Networking, pp 16–21Liao Y, Gibson JD (2011) Routing-aware multiple description video coding over mobile ad-hoc networks. IEEE Trans Multimed 13:132–142Lindeberg M, Kristiansen S, Plagemann T, Goebel V (2011) Challenges and techniques for video streaming over mobile ad hoc networks. Multimed Syst 17:51–82Mao S et al (2003) Video transport over ad hoc networks: multistream coding with multipath transport. IEEE J Sel Area Comm 21:1721–1737Ni P (2009) Towards Optimal Quality of Experience Via Scalable Video Coding. Mälardalen University Press Licentiate Theses, SwedenPinson MH, Wolf S (2004) A new standardized method for objectively measuring video quality. IEEE Trans Broadcast 50:312–322Rong B, Qian Y, Lu K, Hu RQ, Kadoch M (2010) Multipath routing over wireless mesh networks for multiple description video transmission. IEEE J Sel Area Comm 28:321–331Schierl T, Ganger K, Hellge C, Wiegand T, Stockhammer T (2006) SVC-based multisource streaming for robust video trans- mission in mobile ad hoc networks. IEEE Wireless Comm 13:96–103Schierl T, Stockhammer T, Wiegand T (2007) Mobile video transmission using scalable video coding. IEEE Trans Circ Syst Video Tech 17:1204–1217Schwarz H, Marpe D, Wiegand T (2007) Overview of the scalable video coding extension of the H.264/AVC standard. IEEE Trans Circ Syst Video Tech 17:1103–1120VQEG (2008) Video quality experts group. Available online: http://www.vqeg.orgWang Z et al (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13:600–612Wei W, Zakhor A (2004) Robust multipath source routing protocol (RMPSR) for video communication over wireless ad hoc net- works. Proceedings of IEEE International Conference on Multimedia and Expo 2:1379–1382Winkler S, Mohandas P (2008) The evolution of video quality measurement: from PSNR to hybrid metrics. IEEE Trans Broadcast 54:660–668Xunqi Y, Modestino JW, Bajic IV (2005) Performance analysis of the efficacy of packet-level FEC in improving video transport over networks. IEEE International Conference on Image Processing 2:177–180Zink M, Schmitt J, Steinmetz R (2005) Layer-encoded video in scalable adaptive streaming. IEEE Trans Multimed 7:75–8

Smart PIN: utility-based replication and delivery of multimedia content to mobile users in wireless networks

Next generation wireless networks rely on heterogeneous connectivity technologies to support various rich media services such as personal information storage, file sharing and multimedia streaming. Due to users’ mobility and dynamic characteristics of wireless networks, data availability in collaborating devices is a critical issue. In this context Smart PIN was proposed as a personal information network which focuses on performance of delivery and cost efficiency. Smart PIN uses a novel data replication scheme based on individual and overall system utility to best balance the requirements for static data and multimedia content delivery with variable device availability due to user mobility. Simulations show improved results in comparison with other general purpose data replication schemes in terms of data availability

Modeling and Evaluation of Multisource Streaming Strategies in P2P VoD Systems

In recent years, multimedia content distribution has largely been moved to the Internet, inducing broadcasters, operators and service providers to upgrade with large expenses their infrastructures. In this context, streaming solutions that rely on user devices such as set-top boxes (STBs) to offload dedicated streaming servers are particularly appropriate. In these systems, contents are usually replicated and scattered over the network established by STBs placed at users' home, and the video-on-demand (VoD) service is provisioned through streaming sessions established among neighboring STBs following a Peer-to-Peer fashion. Up to now the majority of research works have focused on the design and optimization of content replicas mechanisms to minimize server costs. The optimization of replicas mechanisms has been typically performed either considering very crude system performance indicators or analyzing asymptotic behavior. In this work, instead, we propose an analytical model that complements previous works providing fairly accurate predictions of system performance (i.e., blocking probability). Our model turns out to be a highly scalable, flexible, and extensible tool that may be helpful both for designers and developers to efficiently predict the effect of system design choices in large scale STB-VoD system

An autonomic delivery framework for HTTP adaptive streaming in multicast-enabled multimedia access networks

The consumption of multimedia services over HTTP-based delivery mechanisms has recently gained popularity due to their increased flexibility and reliability. Traditional broadcast TV channels are now offered over the Internet, in order to support Live TV for a broad range of consumer devices. Moreover, service providers can greatly benefit from offering external live content (e. g., YouTube, Hulu) in a managed way. Recently, HTTP Adaptive Streaming (HAS) techniques have been proposed in which video clients dynamically adapt their requested video quality level based on the current network and device state. Unlike linear TV, traditional HTTP- and HAS-based video streaming services depend on unicast sessions, leading to a network traffic load proportional to the number of multimedia consumers. In this paper we propose a novel HAS-based video delivery architecture, which features intelligent multicasting and caching in order to decrease the required bandwidth considerably in a Live TV scenario. Furthermore we discuss the autonomic selection of multicasted content to support Video on Demand (VoD) sessions. Experiments were conducted on a large scale and realistic emulation environment and compared with a traditional HAS-based media delivery setup using only unicast connections