A Survey of multimedia streaming in wireless sensor networks: progress, issues and design challenges

Advancements in Complementary Metal Oxide Semiconductor (CMOS) technology have enabled Wireless Sensor Networks (WSN) to gather, process and transport multimedia (MM) data as well and not just limited to handling ordinary scalar data anymore. This new generation of WSN type is called Wireless Multimedia Sensor Networks (WMSNs). Better and yet relatively cheaper sensors that are able to sense both scalar data and multimedia data with more advanced functionalities such as being able to handle rather intense computations easily have sprung up. In this paper, the applications, architectures, challenges and issues faced in the design of WMSNs are explored. Security and privacy issues, over all requirements, proposed and implemented solutions so far, some of the successful achievements and other related works in the field are also highlighted. Open research areas are pointed out and a few solution suggestions to the still persistent problems are made, which, to the best of my knowledge, so far have not been explored yet

Packet prioritizing and delivering for multimedia streaming

Ph.DDOCTOR OF PHILOSOPH

Evaluation of the MDC and FEC over the quality of service and quality of experience for video distribution in ad hoc networks

Mobile ad hoc networks (MANETs) offer an excellent scenario for deploying communication applications because of the connectivity and versatility of this kind of networks. In contrast, the topology is usually extremely dynamic causing high rate of packet loss, so that ensuring a specific Quality of Service (QoS) for real-time video services becomes a hard challenge. In this paper, we evaluate the effect of using Multiple Description Coding (MDC) and Forward Error Correction (FEC) techniques for improving video quality in a multimedia content distribution system. A hybrid architecture using fixed and wireless ad hoc networks is proposed, which enables the use of multipoint-to-point transmission. MDC and FEC mechanisms can be combined with multipath transmission to increase the network efficiency and recover lost packets, improving the overall Quality of Experience (QoE) of the receiver. Simulations have been analyzed paying attention to objective parameters (Peak Signal to Noise Ratio, Packet Delivery Ratio, Decodable Frame Rate and interruptions) and subjective parameters. Results show that MDC increases the probability of packet delivery and FEC is able to recover lost frames and reduce video interruptions in moderate mobility scenarios, resulting in the improvement of video quality and the final user experience.This work was supported by project MIQUEL (TEC2007- 68119-C02-01/TCM) of the Spanish Ministry of Education and Science. The authors would like to thank the Editor and the reviewers for helpful suggestions to improve the quality of this paper.Acelas Delgado, P.; Arce Vila, P.; Guerri Cebollada, JC.; Castellanos Hernández, WE. (2014). Evaluation of the MDC and FEC over the quality of service and quality of experience for video distribution in ad hoc networks. Multimedia Tools and Applications. 68(3):969-989. https://doi.org/10.1007/s11042-012-1111-3969989683Apostolopoulos JG, Wong T, Tan W, Wee SJ (2002) On multiple description streaming with content delivery networks. IEEE INFOCOMBoukerche A (2009) Algorithms and protocols for wireless and mobile ad hoc networks. John Wiley & Sons IncChow CO, Ishii H (2007) Enhancing real-time video streaming over mobile ad hoc networks using multipoint-to-point communication. Comput Commun 30:1754–1764Clausen T, Jacquet P (2003) Optimized link state routing protocol (OLSR), RFC 3626Corrie B et al (2003) Towards quality of experience in advanced collaborative environments. Third Annual Workshop on Advanced Collaborative EnvironmentsGabrielyan E, Hersch R (2006) Reliable multi-path routing schemes for real-time streaming. International Conference on Digital Telecommunications, pp 65–65Gandikota VR, Tamma BR, Murthy CSR (2008) Adaptive-FEC based packet loss resilience scheme for supporting voice communication over adhoc wireless networks. IEEE Trans Mobile Comput 7:1184–1199Gharavi H (2008) Multi-channel for multihop communication links. International Conference on Telecommunications, pp 1–6Grega M, Janowski L, Leszczuk M, Romaniak P, Papir Z (2008) Quality of experience evaluation for multimedia services. Przegląd Telekomunikacyjny i Wiadomości Telekomunikacyjne 4:142–153Hsieh MY, Huang YM, Chian TC (2007) Transmission of layered video streaming via multi-path on ad hoc networks. Multimed Tool Appl 34:155–177ITU—International Telecommunication Union (2007) Definition of quality of experience (QoE)”, Reference: TD 109rev2 (PLEN/12)ITU-R Recommendation BT.500-12 (2009) Methodology for the subjective assessment of the quality of television pictures. International Telecommunication Union, GenevaITU-T Recommendation P.910 (2000) Subjective video quality assessment methods for multimedia applications. International Telecommunication Union, GenevaKao KL, Ke ChH, Shieh CH (2006) An advanced simulation tool-set for video transmission performance evaluation. IEEE Region 10 Conference, pp 1–40Ke CH et al (2006) A novel realistic simulation tool for video transmission over wireless network. Proceedings of the IEEE International Conference on Sensor Networks, Ubiquitous, and Trsutworthy ComputingKeisuke U, Cheeonn C, Hiroshi I (2008) A study on video performance of multipoint-to-point video streaming with multiple description coding over ad hoc networks. EEJ Trans Electron, Inf Syst 128:1431–1437Kilkki K (2008) Quality of experience in communications ecosystem. J Univers Comput Sci 14:615–624Li A (2007) RTP payload format for generic forward error correction. RFC 5109, Dec. 2007Li J, Blake C, Couto DD, Lee H, Morris R (2001) Capacity of ad hoc wireless networks. 7th Annual International Conference on Mobile Computing and Networking, pp 16–21Liao Y, Gibson JD (2011) Routing-aware multiple description video coding over mobile ad-hoc networks. IEEE Trans Multimed 13:132–142Lindeberg M, Kristiansen S, Plagemann T, Goebel V (2011) Challenges and techniques for video streaming over mobile ad hoc networks. Multimed Syst 17:51–82Mao S et al (2003) Video transport over ad hoc networks: multistream coding with multipath transport. IEEE J Sel Area Comm 21:1721–1737Ni P (2009) Towards Optimal Quality of Experience Via Scalable Video Coding. Mälardalen University Press Licentiate Theses, SwedenPinson MH, Wolf S (2004) A new standardized method for objectively measuring video quality. IEEE Trans Broadcast 50:312–322Rong B, Qian Y, Lu K, Hu RQ, Kadoch M (2010) Multipath routing over wireless mesh networks for multiple description video transmission. IEEE J Sel Area Comm 28:321–331Schierl T, Ganger K, Hellge C, Wiegand T, Stockhammer T (2006) SVC-based multisource streaming for robust video trans- mission in mobile ad hoc networks. IEEE Wireless Comm 13:96–103Schierl T, Stockhammer T, Wiegand T (2007) Mobile video transmission using scalable video coding. IEEE Trans Circ Syst Video Tech 17:1204–1217Schwarz H, Marpe D, Wiegand T (2007) Overview of the scalable video coding extension of the H.264/AVC standard. IEEE Trans Circ Syst Video Tech 17:1103–1120VQEG (2008) Video quality experts group. Available online: http://www.vqeg.orgWang Z et al (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13:600–612Wei W, Zakhor A (2004) Robust multipath source routing protocol (RMPSR) for video communication over wireless ad hoc net- works. Proceedings of IEEE International Conference on Multimedia and Expo 2:1379–1382Winkler S, Mohandas P (2008) The evolution of video quality measurement: from PSNR to hybrid metrics. IEEE Trans Broadcast 54:660–668Xunqi Y, Modestino JW, Bajic IV (2005) Performance analysis of the efficacy of packet-level FEC in improving video transport over networks. IEEE International Conference on Image Processing 2:177–180Zink M, Schmitt J, Steinmetz R (2005) Layer-encoded video in scalable adaptive streaming. IEEE Trans Multimed 7:75–8

A Survey on Multimedia-Based Cross-Layer Optimization in Visual Sensor Networks

Visual sensor networks (VSNs) comprised of battery-operated electronic devices endowed with low-resolution cameras have expanded the applicability of a series of monitoring applications. Those types of sensors are interconnected by ad hoc error-prone wireless links, imposing stringent restrictions on available bandwidth, end-to-end delay and packet error rates. In such context, multimedia coding is required for data compression and error-resilience, also ensuring energy preservation over the path(s) toward the sink and improving the end-to-end perceptual quality of the received media. Cross-layer optimization may enhance the expected efficiency of VSNs applications, disrupting the conventional information flow of the protocol layers. When the inner characteristics of the multimedia coding techniques are exploited by cross-layer protocols and architectures, higher efficiency may be obtained in visual sensor networks. This paper surveys recent research on multimedia-based cross-layer optimization, presenting the proposed strategies and mechanisms for transmission rate adjustment, congestion control, multipath selection, energy preservation and error recovery. We note that many multimedia-based cross-layer optimization solutions have been proposed in recent years, each one bringing a wealth of contributions to visual sensor networks

Network coding for transport protocols

With the proliferation of smart devices that require Internet connectivity anytime, anywhere, and the recent technological advances that make it possible, current networked systems will have to provide a various range of services, such as content distribution, in a wide range of settings, including wireless environments. Wireless links may experience temporary losses, however, TCP, the de facto protocol for robust unicast communications, reacts by reducing the congestion window drastically and injecting less traffic in the network. Consequently the wireless links are underutilized and the overall performance of the TCP protocol in wireless environments is poor. As content delivery (i.e. multicasting) services, such as BBC iPlayer, become popular, the network needs to support the reliable transport of the data at high rates, and with specific delay constraints. A typical approach to deliver content in a scalable way is to rely on peer-to-peer technology (used by BitTorrent, Spotify and PPLive), where users share their resources, including bandwidth, storage space, and processing power. Still, these systems suffer from the lack of incentives for resource sharing and cooperation, and this problem is exacerbated in the presence of heterogenous users, where a tit-for-tat scheme is difficult to implement. Due to the issues highlighted above, current network architectures need to be changed in order to accommodate the users¿ demands for reliable and quality communications. In other words, the emergent need for advanced modes of information transport requires revisiting and improving network components at various levels of the network stack. The innovative paradigm of network coding has been shown as a promising technique to change the design of networked systems, by providing a shift from how data flows traditionally move through the network. This shift implies that data flows are no longer kept separate, according to the ¿store-and-forward¿ model, but they are also processed and mixed in the network. By appropriately combining data by means of network coding, it is expected to obtain significant benefits in several areas of network design and architecture. In this thesis, we set out to show the benefits of including network coding into three communication paradigms, namely point-topoint communications (e.g. unicast), point-to-multipoint communications (e.g. multicast), and multipoint-to-multipoint communications (e.g. peer-to-peer networks). For the first direction, we propose a network coding-based multipath scheme and show that TCP unicast sessions are feasible in highly volatile wireless environments. For point-to-multipoint communications, we give an algorithm to optimally achieve all the rate pairs from the rate region in the case of degraded multicast over the combination network. We also propose a system for live streaming that ensures reliability and quality of service to heterogenous users, even if data transmissions occur over lossy wireless links. Finally, for multipoint-to-multipoint communications, we design a system to provide incentives for live streaming in a peer-to-peer setting, where users have subscribed to different levels of quality. Our work shows that network coding enables a reliable transport of data, even in highly volatile environments, or in delay sensitive scenarios such as live streaming, and facilitates the implementation of an efficient incentive system, even in the presence of heterogenous users. Thus, network coding can solve the challenges faced by next generation networks in order to support advanced information transport.Postprint (published version

Multicast Scheduling and Resource Allocation Algorithms for OFDMA-Based Systems: A Survey

Multicasting is emerging as an enabling technology for multimedia transmissions over wireless networks to support several groups of users with flexible quality of service (QoS)requirements. Although multicast has huge potential to push the limits of next generation communication systems; it is however one of the most challenging issues currently being addressed. In this survey, we explain multicast group formation and various forms of group rate determination approaches. We also provide a systematic review of recent channel-aware multicast scheduling and resource allocation (MSRA) techniques proposed for downlink multicast services in OFDMA based systems. We study these enabling algorithms, evaluate their core characteristics, limitations and classify them using multidimensional matrix. We cohesively review the algorithms in terms of their throughput maximization, fairness considerations, performance complexities, multi-antenna support, optimality and simplifying assumptions. We discuss existing standards employing multicasting and further highlight some potential research opportunities in multicast systems

3D multiple description coding for error resilience over wireless networks

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.Mobile communications has gained a growing interest from both customers and service providers alike in the last 1-2 decades. Visual information is used in many application domains such as remote health care, video –on demand, broadcasting, video surveillance etc. In order to enhance the visual effects of digital video content, the depth perception needs to be provided with the actual visual content. 3D video has earned a significant interest from the research community in recent years, due to the tremendous impact it leaves on viewers and its enhancement of the user’s quality of experience (QoE). In the near future, 3D video is likely to be used in most video applications, as it offers a greater sense of immersion and perceptual experience. When 3D video is compressed and transmitted over error prone channels, the associated packet loss leads to visual quality degradation. When a picture is lost or corrupted so severely that the concealment result is not acceptable, the receiver typically pauses video playback and waits for the next INTRA picture to resume decoding. Error propagation caused by employing predictive coding may degrade the video quality severely. There are several ways used to mitigate the effects of such transmission errors. One widely used technique in International Video Coding Standards is error resilience. The motivation behind this research work is that, existing schemes for 2D colour video compression such as MPEG, JPEG and H.263 cannot be applied to 3D video content. 3D video signals contain depth as well as colour information and are bandwidth demanding, as they require the transmission of multiple high-bandwidth 3D video streams. On the other hand, the capacity of wireless channels is limited and wireless links are prone to various types of errors caused by noise, interference, fading, handoff, error burst and network congestion. Given the maximum bit rate budget to represent the 3D scene, optimal bit-rate allocation between texture and depth information rendering distortion/losses should be minimised. To mitigate the effect of these errors on the perceptual 3D video quality, error resilience video coding needs to be investigated further to offer better quality of experience (QoE) to end users. This research work aims at enhancing the error resilience capability of compressed 3D video, when transmitted over mobile channels, using Multiple Description Coding (MDC) in order to improve better user’s quality of experience (QoE). Furthermore, this thesis examines the sensitivity of the human visual system (HVS) when employed to view 3D video scenes. The approach used in this study is to use subjective testing in order to rate people’s perception of 3D video under error free and error prone conditions through the use of a carefully designed bespoke questionnaire.Petroleum Technology Development Fund (PTDF