Distributed video coding for wireless video sensor networks: a review of the state-of-the-art architectures

Distributed video coding (DVC) is a relatively new video coding architecture originated from two fundamental theorems namely, Slepian–Wolf and Wyner–Ziv. Recent research developments have made DVC attractive for applications in the emerging domain of wireless video sensor networks (WVSNs). This paper reviews the state-of-the-art DVC architectures with a focus on understanding their opportunities and gaps in addressing the operational requirements and application needs of WVSNs

A Survey on Multimedia-Based Cross-Layer Optimization in Visual Sensor Networks

Visual sensor networks (VSNs) comprised of battery-operated electronic devices endowed with low-resolution cameras have expanded the applicability of a series of monitoring applications. Those types of sensors are interconnected by ad hoc error-prone wireless links, imposing stringent restrictions on available bandwidth, end-to-end delay and packet error rates. In such context, multimedia coding is required for data compression and error-resilience, also ensuring energy preservation over the path(s) toward the sink and improving the end-to-end perceptual quality of the received media. Cross-layer optimization may enhance the expected efficiency of VSNs applications, disrupting the conventional information flow of the protocol layers. When the inner characteristics of the multimedia coding techniques are exploited by cross-layer protocols and architectures, higher efficiency may be obtained in visual sensor networks. This paper surveys recent research on multimedia-based cross-layer optimization, presenting the proposed strategies and mechanisms for transmission rate adjustment, congestion control, multipath selection, energy preservation and error recovery. We note that many multimedia-based cross-layer optimization solutions have been proposed in recent years, each one bringing a wealth of contributions to visual sensor networks

Immersive interconnected virtual and augmented reality : a 5G and IoT perspective

Despite remarkable advances, current augmented and virtual reality (AR/VR) applications are a largely individual and local experience. Interconnected AR/VR, where participants can virtually interact across vast distances, remains a distant dream. The great barrier that stands between current technology and such applications is the stringent end-to-end latency requirement, which should not exceed 20 ms in order to avoid motion sickness and other discomforts. Bringing AR/VR to the next level to enable immersive interconnected AR/VR will require significant advances towards 5G ultra-reliable low-latency communication (URLLC) and a Tactile Internet of Things (IoT). In this article, we articulate the technical challenges to enable a future AR/VR end-to-end architecture, that combines 5G URLLC and Tactile IoT technology to support this next generation of interconnected AR/VR applications. Through the use of IoT sensors and actuators, AR/VR applications will be aware of the environmental and user context, supporting human-centric adaptations of the application logic, and lifelike interactions with the virtual environment. We present potential use cases and the required technological building blocks. For each of them, we delve into the current state of the art and challenges that need to be addressed before the dream of remote AR/VR interaction can become reality

AdamRTP: Adaptive multi-flow real-time multimedia transport protocol for Wireless Sensor Networks

Real-time multimedia applications are time sensitive and require extra resources from the network, e.g. large bandwidth and big memory. However, Wireless Sensor Networks (WSNs) suffer from limited resources such as computational, storage, and bandwidth capabilities. Therefore, sending real-time multimedia applications over WSNs can be very challenging. For this reason, we propose an Adaptive Multi-flow Real-time Multimedia Transport Protocol (AdamRTP) that has the ability to ease the process of transmitting real-time multimedia over WSNs by splitting the multimedia source stream into smaller independent flows using an MDC-aware encoder, then sending each flow to the destination using joint/disjoint path. AdamRTP uses dynamic adaptation techniques, e.g. number of flows and rate adaptation. Simulations experiments demonstrate that AdamRTP enhances the Quality of Service (QoS) of transmission. Also, we showed that in an ideal WSN, using multi-flows consumes less power than using a single flow and extends the life-time of the network

Cross-layer design for multimedia applications in cognitive radio networks.

Ph. D. University of KwaZulu-Natal, Durban 2015.The exponential growth in wireless services and the current trend of development in wireless communication technologies have resulted into an overcrowded radio spectrum band in such a way that it can no longer meet the ever increasing requirements of wireless applications. In contrary however, literature surveys indicate that a large amount of the licensed radio spectrum bands are underutilized. This has necessitated the need for efficient ways to be implemented for spectrum sharing among different systems, applications and services in dynamic wireless environment. Cognitive radio (CR) technology emerges as a way to improve the overall efficiency of radio spectrum utilization by allowing unlicensed users (also known as secondary user) to utilize a licensed band when it is vacant. Multimedia applications are being targeted for CR networks. However, the performance and success of CR technology will be determined by the quality of service (QoS) perceived by secondary users. In order to transmit multimedia contents which have stringent QoS requirements over the CR networks, many technical challenges have to be addressed that are constrained by the layered protocol architecture. Cross-layer design has shown a promise as an approach to optimize network performance among different layers. This work is aimed at addressing the question on how to provide QoS guarantee for multimedia transmission over CR networks in terms of throughput maximization while ensuring that the interference to primary users is avoided or minimized. Spectrum sensing is a fundamental problem in cognitive radio networks for the protection of primary users and therefore the first part of this work provides a review of some low complex spectrum sensing schemes. A cooperative spectrum sensing scheme where multi-users are independently performing spectrum sensing is also developed. In order to address a hidden node problem, a cooperate relay based on amplify-and-forward technique (AF) is formulated. Usually the performance of a spectrum sensor is evaluated using receiver operating characteristic (ROC) curve which provides a trade-off between the probability of miss detection and the probability of false alarm. Due to hardware limitations, the spectrum sensor can not sense the whole range of radio spec- trum which results into partial information of the channel state. In order to model a media access control(MAC) protocol which is able to make channel access decision under partial information about the state of the system we apply a partially observable Markov decision process (POMDP) technique as a suitable tool in making decision under uncertainty. A throughput optimization MAC scheme in presence of spectrum sensing errors is then devel- oped using the concept of cross-layer design which integrates the design of spectrum sensing at physical layer (PHY) and sensing and access strategies at MAC layer in order to maximize the overall network throughput. A problem is formulated as a POMDP and the throughput performance of the scheme is evaluated using computer simulations under greedy sensing algorithm. Simulation results demonstrate an improved overall throughput performance. Further more, multiple channels with multiple secondary users having random message ar- rivals are considered during simulation and the throughput performance is evaluated under greedy sensing scheme which forms a benchmark for cross-layer MAC scheme in presence of spectrum sensing errors. By realizing that speech communication is still the most dom- inant and common service in wireless application, we develop a cross-layer MAC scheme for speech transmission in CR networks. The design is aimed at maximizing throughput of secondary users by integrating the design of spectrum sensing at PHY, quantization param- eter of speech traffic at application layer (APP), together with strategy for spectrum access at MAC layer with the main goal to improve the QoS perceived by secondary users in CR networks. Simulation results demonstrate throughput performance improvement and hence QoS is improved. One of the main features of the modern communication systems is the parameterized operation at different layers of the protocol stack. The feature aims at providing them with the capability of adapting to the rapidly changing traffic, channel and system conditions. Another interesting research problem in this thesis is the combination of individual adap- tation mechanisms into a cross-layer that can maximize their effectiveness. We propose a joint cross-layer design MAC scheme that integrates the design of spectrum sensing at PHY layer, access at MAC layer and APP information in order to improve the QoS for video transmission in CR networks. The end-to-end video distortion which is considered as an APP parameter resides in the video encoder. This is integrated in the state space and the problem is formulated as a constrained POMDP. H.264 coding algorithm which is one of the high efficient video coding standards is considered. The objective is to minimize this end-to- end video distortion while maximizes the overall network throughput for video transmission in CR networks. The end-to-end video distortion has signifficant effects to the QoS the per- ceived by the user and is viewed as the cost in the overall system design. Given the target system throughput, the packet loss ration when the system is in the state i and a composite action is taken in time slot t, the system immediate cost is evaluated. The expected total cost for overall end-to-end video distortion over the total time slots is then computed. A joint optimal policy which minimizes the expected total end-to-end distortion in total time slots is computed iteratively. The minimum expected cost (which also known as the value function) is also evaluated iteratively for the total time slots. The throughput performance of the proposed scheme is evaluated through computer simulation. In order to study the throughput performance of the proposed scheme, we considered four simulation scenarios namely simulation scenario A, simulation scenario B, simulation scenario C, and simulation scenario D. These simulation scenarios enabled us to study the throughput performance of the proposed scheme by by computer simulations. In the simulation scenario A, the av- erage throughput performance as a function of time horizon is studied. The throughput performance under channel access decision based on belief vector and that of channel access decision based on the end-to-end distortion are compared. Simulation results show that the channel access decision based on end-to-end distortion outperforms that of channel access decision based on a belief vector. In the simulation scenario B we aimed at studying the spectral efficiency as a function of prescribed collision probability. The simulation results show that, at large values of collision probability the overall spectral efficiency performs poorly. However, there is an optimal value of collision probability of which the spectral efficiency approaches that of the perfect channel access decision. In the simulation scenario C, we aimed at studying the average throughput performance and the spectral efficiency both as a function of prescribed collision probability. The simulation results show that both average throughput and the spectral efficiency are highly affected by the increase in collision probability. However, there is an optimal prescribed collision probability which achieves the maximum average throughput and maximum spectral efficiency

Contribution to quality of user experience provision over wireless networks

The widespread expansion of wireless networks has brought new attractive possibilities to end users. In addition to the mobility capabilities provided by unwired devices, it is worth remarking the easy configuration process that a user has to follow to gain connectivity through a wireless network. Furthermore, the increasing bandwidth provided by the IEEE 802.11 family has made possible accessing to high-demanding services such as multimedia communications. Multimedia traffic has unique characteristics that make it greatly vulnerable against network impairments, such as packet losses, delay, or jitter. Voice over IP (VoIP) communications, video-conference, video-streaming, etc., are examples of these high-demanding services that need to meet very strict requirements in order to be served with acceptable levels of quality. Accomplishing these tough requirements will become extremely important during the next years, taking into account that consumer video traffic will be the predominant traffic in the Internet during the next years. In wired systems, these requirements are achieved by using Quality of Service (QoS) techniques, such as Differentiated Services (DiffServ), traffic engineering, etc. However, employing these methodologies in wireless networks is not that simple as many other factors impact on the quality of the provided service, e.g., fading, interferences, etc. Focusing on the IEEE 802.11g standard, which is the most extended technology for Wireless Local Area Networks (WLANs), it defines two different architecture schemes. On one hand, the infrastructure mode consists of a central point, which manages the network, assuming network controlling tasks such as IP assignment, routing, accessing security, etc. The rest of the nodes composing the network act as hosts, i.e., they send and receive traffic through the central point. On the other hand, the IEEE 802.11 ad-hoc configuration mode is less extended than the infrastructure one. Under this scheme, there is not a central point in the network, but all the nodes composing the network assume both host and router roles, which permits the quick deployment of a network without a pre-existent infrastructure. This type of networks, so called Mobile Ad-hoc NETworks (MANETs), presents interesting characteristics for situations when the fast deployment of a communication system is needed, e.g., tactics networks, disaster events, or temporary networks. The benefits provided by MANETs are varied, including high mobility possibilities provided to the nodes, network coverage extension, or network reliability avoiding single points of failure. The dynamic nature of these networks makes the nodes to react to topology changes as fast as possible. Moreover, as aforementioned, the transmission of multimedia traffic entails real-time constraints, necessary to provide these services with acceptable levels of quality. For those reasons, efficient routing protocols are needed, capable of providing enough reliability to the network and with the minimum impact to the quality of the service flowing through the nodes. Regarding quality measurements, the current trend is estimating what the end user actually perceives when consuming the service. This paradigm is called Quality of user Experience (QoE) and differs from the traditional Quality of Service (QoS) approach in the human perspective given to quality estimations. In order to measure the subjective opinion that a user has about a given service, different approaches can be taken. The most accurate methodology is performing subjective tests in which a panel of human testers rates the quality of the service under evaluation. This approach returns a quality score, so-called Mean Opinion Score (MOS), for the considered service in a scale 1 - 5. This methodology presents several drawbacks such as its high expenses and the impossibility of performing tests at real time. For those reasons, several mathematical models have been presented in order to provide an estimation of the QoE (MOS) reached by different multimedia services In this thesis, the focus is on evaluating and understanding the multimedia-content transmission-process in wireless networks from a QoE perspective. To this end, firstly, the QoE paradigm is explored aiming at understanding how to evaluate the quality of a given multimedia service. Then, the influence of the impairments introduced by the wireless transmission channel on the multimedia communications is analyzed. Besides, the functioning of different WLAN schemes in order to test their suitability to support highly demanding traffic such as the multimedia transmission is evaluated. Finally, as the main contribution of this thesis, new mechanisms or strategies to improve the quality of multimedia services distributed over IEEE 802.11 networks are presented. Concretely, the distribution of multimedia services over ad-hoc networks is deeply studied. Thus, a novel opportunistic routing protocol, so-called JOKER (auto-adJustable Opportunistic acK/timEr-based Routing) is presented. This proposal permits better support to multimedia services while reducing the energy consumption in comparison with the standard ad-hoc routing protocols.Universidad Politécnica de CartagenaPrograma Oficial de Doctorado en Tecnologías de la Información y Comunicacione

Quality-Oriented Mobility Management for Multimedia Content Delivery to Mobile Users

The heterogeneous wireless networking environment determined by the latest developments in wireless access technologies promises a high level of communication resources for mobile computational devices. Although the communication resources provided, especially referring to bandwidth, enable multimedia streaming to mobile users, maintaining a high user perceived quality is still a challenging task. The main factors which affect quality in multimedia streaming over wireless networks are mainly the error-prone nature of the wireless channels and the user mobility. These factors determine a high level of dynamics of wireless communication resources, namely variations in throughput and packet loss as well as network availability and delays in delivering the data packets. Under these conditions maintaining a high level of quality, as perceived by the user, requires a quality oriented mobility management scheme. Consequently we propose the Smooth Adaptive Soft-Handover Algorithm, a novel quality oriented handover management scheme which unlike other similar solutions, smoothly transfer the data traffic from one network to another using multiple simultaneous connections. To estimate the capacity of each connection the novel Quality of Multimedia Streaming (QMS) metric is proposed. The QMS metric aims at offering maximum flexibility and efficiency allowing the applications to fine tune the behavior of the handover algorithm. The current simulation-based performance evaluation clearly shows the better performance of the proposed Smooth Adaptive Soft-Handover Algorithm as compared with other handover solutions. The evaluation was performed in various scenarios including multiple mobile hosts performing handover simultaneously, wireless networks with variable overlapping areas, and various network congestion levels

Semantics-Empowered Communication: A Tutorial-cum-Survey

Along with the springing up of the semantics-empowered communication (SemCom) research, it is now witnessing an unprecedentedly growing interest towards a wide range of aspects (e.g., theories, applications, metrics and implementations) in both academia and industry. In this work, we primarily aim to provide a comprehensive survey on both the background and research taxonomy, as well as a detailed technical tutorial. Specifically, we start by reviewing the literature and answering the "what" and "why" questions in semantic transmissions. Afterwards, we present the ecosystems of SemCom, including history, theories, metrics, datasets and toolkits, on top of which the taxonomy for research directions is presented. Furthermore, we propose to categorize the critical enabling techniques by explicit and implicit reasoning-based methods, and elaborate on how they evolve and contribute to modern content & channel semantics-empowered communications. Besides reviewing and summarizing the latest efforts in SemCom, we discuss the relations with other communication levels (e.g., conventional communications) from a holistic and unified viewpoint. Subsequently, in order to facilitate future developments and industrial applications, we also highlight advanced practical techniques for boosting semantic accuracy, robustness, and large-scale scalability, just to mention a few. Finally, we discuss the technical challenges that shed light on future research opportunities.Comment: Submitted to an IEEE journal. Copyright might be transferred without further notic