A Survey on Multimedia-Based Cross-Layer Optimization in Visual Sensor Networks

Visual sensor networks (VSNs) comprised of battery-operated electronic devices endowed with low-resolution cameras have expanded the applicability of a series of monitoring applications. Those types of sensors are interconnected by ad hoc error-prone wireless links, imposing stringent restrictions on available bandwidth, end-to-end delay and packet error rates. In such context, multimedia coding is required for data compression and error-resilience, also ensuring energy preservation over the path(s) toward the sink and improving the end-to-end perceptual quality of the received media. Cross-layer optimization may enhance the expected efficiency of VSNs applications, disrupting the conventional information flow of the protocol layers. When the inner characteristics of the multimedia coding techniques are exploited by cross-layer protocols and architectures, higher efficiency may be obtained in visual sensor networks. This paper surveys recent research on multimedia-based cross-layer optimization, presenting the proposed strategies and mechanisms for transmission rate adjustment, congestion control, multipath selection, energy preservation and error recovery. We note that many multimedia-based cross-layer optimization solutions have been proposed in recent years, each one bringing a wealth of contributions to visual sensor networks

Network coding meets multimedia: a review

While every network node only relays messages in a traditional communication system, the recent network coding (NC) paradigm proposes to implement simple in-network processing with packet combinations in the nodes. NC extends the concept of "encoding" a message beyond source coding (for compression) and channel coding (for protection against errors and losses). It has been shown to increase network throughput compared to traditional networks implementation, to reduce delay and to provide robustness to transmission errors and network dynamics. These features are so appealing for multimedia applications that they have spurred a large research effort towards the development of multimedia-specific NC techniques. This paper reviews the recent work in NC for multimedia applications and focuses on the techniques that fill the gap between NC theory and practical applications. It outlines the benefits of NC and presents the open challenges in this area. The paper initially focuses on multimedia-specific aspects of network coding, in particular delay, in-network error control, and mediaspecific error control. These aspects permit to handle varying network conditions as well as client heterogeneity, which are critical to the design and deployment of multimedia systems. After introducing these general concepts, the paper reviews in detail two applications that lend themselves naturally to NC via the cooperation and broadcast models, namely peer-to-peer multimedia streaming and wireless networkin

Multimedia delivery in the future internet

The term “Networked Media” implies that all kinds of media including text, image, 3D graphics, audio and video are produced, distributed, shared, managed and consumed on-line through various networks, like the Internet, Fiber, WiFi, WiMAX, GPRS, 3G and so on, in a convergent manner [1]. This white paper is the contribution of the Media Delivery Platform (MDP) cluster and aims to cover the Networked challenges of the Networked Media in the transition to the Future of the Internet. Internet has evolved and changed the way we work and live. End users of the Internet have been confronted with a bewildering range of media, services and applications and of technological innovations concerning media formats, wireless networks, terminal types and capabilities. And there is little evidence that the pace of this innovation is slowing. Today, over one billion of users access the Internet on regular basis, more than 100 million users have downloaded at least one (multi)media file and over 47 millions of them do so regularly, searching in more than 160 Exabytes1 of content. In the near future these numbers are expected to exponentially rise. It is expected that the Internet content will be increased by at least a factor of 6, rising to more than 990 Exabytes before 2012, fuelled mainly by the users themselves. Moreover, it is envisaged that in a near- to mid-term future, the Internet will provide the means to share and distribute (new) multimedia content and services with superior quality and striking flexibility, in a trusted and personalized way, improving citizens’ quality of life, working conditions, edutainment and safety. In this evolving environment, new transport protocols, new multimedia encoding schemes, cross-layer inthe network adaptation, machine-to-machine communication (including RFIDs), rich 3D content as well as community networks and the use of peer-to-peer (P2P) overlays are expected to generate new models of interaction and cooperation, and be able to support enhanced perceived quality-of-experience (PQoE) and innovative applications “on the move”, like virtual collaboration environments, personalised services/ media, virtual sport groups, on-line gaming, edutainment. In this context, the interaction with content combined with interactive/multimedia search capabilities across distributed repositories, opportunistic P2P networks and the dynamic adaptation to the characteristics of diverse mobile terminals are expected to contribute towards such a vision. Based on work that has taken place in a number of EC co-funded projects, in Framework Program 6 (FP6) and Framework Program 7 (FP7), a group of experts and technology visionaries have voluntarily contributed in this white paper aiming to describe the status, the state-of-the art, the challenges and the way ahead in the area of Content Aware media delivery platforms

Network-aware Adaptation with Real-Time Channel Statistics for Wireless LAN Multimedia Transmissions in the Digital Home

This paper suggests the use of intelligent network-aware processing agents in wireless local area network drivers to generate metrics for bandwidth estimation based on real-time channel statistics to enable wireless multimedia application adaptation. Various configurations in the wireless digital home are studied and the experimental results with performance variations are presented.Comment: 6 pages, 12 figure

Enhancement of Adaptive Forward Error Correction Mechanism for Video Transmission Over Wireless Local Area Network

Video transmission over the wireless network faces many challenges. The most critical challenge is related to packet loss. To overcome the problem of packet loss, Forward Error Correction is used by adding extra packets known as redundant packet or parity packet. Currently, FEC mechanisms have been adopted together with Automatic Repeat reQuest (ARQ) mechanism to overcome packet losses and avoid network congestion in various wireless network conditions. The number of FEC packets need to be generated effectively because wireless network usually has varying network conditions. In the current Adaptive FEC mechanism, the FEC packets are decided by the average queue length and average packet retransmission times. The Adaptive FEC mechanisms have been proposed to suit the network condition by generating FEC packets adaptively in the wireless network. However, the current Adaptive FEC mechanism has some major drawbacks such as the reduction of recovery performance which injects too many excessive FEC packets into the network. This is not flexible enough to adapt with varying wireless network condition. Therefore, the enhancement of Adaptive FEC mechanism (AFEC) known as Enhanced Adaptive FEC (EnAFEC) has been proposed. The aim is to improve recovery performance on the current Adaptive FEC mechanism by injecting FEC packets dynamically based on varying wireless network conditions. The EnAFEC mechanism is implemented in the simulation environment using Network Simulator 2 (NS-2). Performance evaluations are also carried out. The EnAFEC was tested with the random uniform error model. The results from experiments and performance analyses showed that EnAFEC mechanism outperformed the other Adaptive FEC mechanism in terms of recovery efficiency. Based on the findings, the optimal amount of FEC generated by EnAFEC mechanism can recover high packet loss and produce good video quality

Evaluation of the MDC and FEC over the quality of service and quality of experience for video distribution in ad hoc networks

Mobile ad hoc networks (MANETs) offer an excellent scenario for deploying communication applications because of the connectivity and versatility of this kind of networks. In contrast, the topology is usually extremely dynamic causing high rate of packet loss, so that ensuring a specific Quality of Service (QoS) for real-time video services becomes a hard challenge. In this paper, we evaluate the effect of using Multiple Description Coding (MDC) and Forward Error Correction (FEC) techniques for improving video quality in a multimedia content distribution system. A hybrid architecture using fixed and wireless ad hoc networks is proposed, which enables the use of multipoint-to-point transmission. MDC and FEC mechanisms can be combined with multipath transmission to increase the network efficiency and recover lost packets, improving the overall Quality of Experience (QoE) of the receiver. Simulations have been analyzed paying attention to objective parameters (Peak Signal to Noise Ratio, Packet Delivery Ratio, Decodable Frame Rate and interruptions) and subjective parameters. Results show that MDC increases the probability of packet delivery and FEC is able to recover lost frames and reduce video interruptions in moderate mobility scenarios, resulting in the improvement of video quality and the final user experience.This work was supported by project MIQUEL (TEC2007- 68119-C02-01/TCM) of the Spanish Ministry of Education and Science. The authors would like to thank the Editor and the reviewers for helpful suggestions to improve the quality of this paper.Acelas Delgado, P.; Arce Vila, P.; Guerri Cebollada, JC.; Castellanos Hernández, WE. (2014). Evaluation of the MDC and FEC over the quality of service and quality of experience for video distribution in ad hoc networks. Multimedia Tools and Applications. 68(3):969-989. https://doi.org/10.1007/s11042-012-1111-3969989683Apostolopoulos JG, Wong T, Tan W, Wee SJ (2002) On multiple description streaming with content delivery networks. IEEE INFOCOMBoukerche A (2009) Algorithms and protocols for wireless and mobile ad hoc networks. John Wiley & Sons IncChow CO, Ishii H (2007) Enhancing real-time video streaming over mobile ad hoc networks using multipoint-to-point communication. Comput Commun 30:1754–1764Clausen T, Jacquet P (2003) Optimized link state routing protocol (OLSR), RFC 3626Corrie B et al (2003) Towards quality of experience in advanced collaborative environments. Third Annual Workshop on Advanced Collaborative EnvironmentsGabrielyan E, Hersch R (2006) Reliable multi-path routing schemes for real-time streaming. International Conference on Digital Telecommunications, pp 65–65Gandikota VR, Tamma BR, Murthy CSR (2008) Adaptive-FEC based packet loss resilience scheme for supporting voice communication over adhoc wireless networks. IEEE Trans Mobile Comput 7:1184–1199Gharavi H (2008) Multi-channel for multihop communication links. International Conference on Telecommunications, pp 1–6Grega M, Janowski L, Leszczuk M, Romaniak P, Papir Z (2008) Quality of experience evaluation for multimedia services. Przegląd Telekomunikacyjny i Wiadomości Telekomunikacyjne 4:142–153Hsieh MY, Huang YM, Chian TC (2007) Transmission of layered video streaming via multi-path on ad hoc networks. Multimed Tool Appl 34:155–177ITU—International Telecommunication Union (2007) Definition of quality of experience (QoE)”, Reference: TD 109rev2 (PLEN/12)ITU-R Recommendation BT.500-12 (2009) Methodology for the subjective assessment of the quality of television pictures. International Telecommunication Union, GenevaITU-T Recommendation P.910 (2000) Subjective video quality assessment methods for multimedia applications. International Telecommunication Union, GenevaKao KL, Ke ChH, Shieh CH (2006) An advanced simulation tool-set for video transmission performance evaluation. IEEE Region 10 Conference, pp 1–40Ke CH et al (2006) A novel realistic simulation tool for video transmission over wireless network. Proceedings of the IEEE International Conference on Sensor Networks, Ubiquitous, and Trsutworthy ComputingKeisuke U, Cheeonn C, Hiroshi I (2008) A study on video performance of multipoint-to-point video streaming with multiple description coding over ad hoc networks. EEJ Trans Electron, Inf Syst 128:1431–1437Kilkki K (2008) Quality of experience in communications ecosystem. J Univers Comput Sci 14:615–624Li A (2007) RTP payload format for generic forward error correction. RFC 5109, Dec. 2007Li J, Blake C, Couto DD, Lee H, Morris R (2001) Capacity of ad hoc wireless networks. 7th Annual International Conference on Mobile Computing and Networking, pp 16–21Liao Y, Gibson JD (2011) Routing-aware multiple description video coding over mobile ad-hoc networks. IEEE Trans Multimed 13:132–142Lindeberg M, Kristiansen S, Plagemann T, Goebel V (2011) Challenges and techniques for video streaming over mobile ad hoc networks. Multimed Syst 17:51–82Mao S et al (2003) Video transport over ad hoc networks: multistream coding with multipath transport. IEEE J Sel Area Comm 21:1721–1737Ni P (2009) Towards Optimal Quality of Experience Via Scalable Video Coding. Mälardalen University Press Licentiate Theses, SwedenPinson MH, Wolf S (2004) A new standardized method for objectively measuring video quality. IEEE Trans Broadcast 50:312–322Rong B, Qian Y, Lu K, Hu RQ, Kadoch M (2010) Multipath routing over wireless mesh networks for multiple description video transmission. IEEE J Sel Area Comm 28:321–331Schierl T, Ganger K, Hellge C, Wiegand T, Stockhammer T (2006) SVC-based multisource streaming for robust video trans- mission in mobile ad hoc networks. IEEE Wireless Comm 13:96–103Schierl T, Stockhammer T, Wiegand T (2007) Mobile video transmission using scalable video coding. IEEE Trans Circ Syst Video Tech 17:1204–1217Schwarz H, Marpe D, Wiegand T (2007) Overview of the scalable video coding extension of the H.264/AVC standard. IEEE Trans Circ Syst Video Tech 17:1103–1120VQEG (2008) Video quality experts group. Available online: http://www.vqeg.orgWang Z et al (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13:600–612Wei W, Zakhor A (2004) Robust multipath source routing protocol (RMPSR) for video communication over wireless ad hoc net- works. Proceedings of IEEE International Conference on Multimedia and Expo 2:1379–1382Winkler S, Mohandas P (2008) The evolution of video quality measurement: from PSNR to hybrid metrics. IEEE Trans Broadcast 54:660–668Xunqi Y, Modestino JW, Bajic IV (2005) Performance analysis of the efficacy of packet-level FEC in improving video transport over networks. IEEE International Conference on Image Processing 2:177–180Zink M, Schmitt J, Steinmetz R (2005) Layer-encoded video in scalable adaptive streaming. IEEE Trans Multimed 7:75–8