Markov Decision Processes with Applications in Wireless Sensor Networks: A Survey

Wireless sensor networks (WSNs) consist of autonomous and resource-limited devices. The devices cooperate to monitor one or more physical phenomena within an area of interest. WSNs operate as stochastic systems because of randomness in the monitored environments. For long service time and low maintenance cost, WSNs require adaptive and robust methods to address data exchange, topology formulation, resource and power optimization, sensing coverage and object detection, and security challenges. In these problems, sensor nodes are to make optimized decisions from a set of accessible strategies to achieve design goals. This survey reviews numerous applications of the Markov decision process (MDP) framework, a powerful decision-making tool to develop adaptive algorithms and protocols for WSNs. Furthermore, various solution methods are discussed and compared to serve as a guide for using MDPs in WSNs

Energy-Efficient Load Balancing Ant Based Routing Algorithm for Wireless Sensor Networks

Wireless Sensor Networks (WSNs) are a type of self-organizing networks with limited energy supply and communication ability. One of the most crucial issues in WSNs is to use an energy-efficient routing protocol to prolong the network lifetime. We therefore propose the novel Energy-Efficient Load Balancing Ant-based Routing Algorithm (EBAR) for WSNs. EBAR adopts a pseudo-random route discovery algorithm and an improved pheromone trail update scheme to balance the energy consumption of the sensor nodes. It uses an efficient heuristic update algorithm based on a greedy expected energy cost metric to optimize the route establishment. Finally, in order to reduce the energy consumption caused by the control overhead, EBAR utilizes an energy-based opportunistic broadcast scheme. We simulate WSNs in different application scenarios to evaluate EBAR with respect to performance metrics such as energy consumption, energy efficiency, and predicted network lifetime. The results of this comprehensive study show that EBAR provides a significant improvement in comparison to the state-of-the-art approaches EEABR, SensorAnt, and IACO

Cross-layer Balanced and Reliable Opportunistic Routing Algorithm for Mobile Ad Hoc Networks

For improving the efficiency and the reliability of the opportunistic routing algorithm, in this paper, we propose the cross-layer and reliable opportunistic routing algorithm (CBRT) for Mobile Ad Hoc Networks, which introduces the improved efficiency fuzzy logic and humoral regulation inspired topology control into the opportunistic routing algorithm. In CBRT, the inputs of the fuzzy logic system are the relative variance (rv) of the metrics rather than the values of the metrics, which reduces the number of fuzzy rules dramatically. Moreover, the number of fuzzy rules does not increase when the number of inputs increases. For reducing the control cost, in CBRT, the node degree in the candidate relays set is a range rather than a constant number. The nodes are divided into different categories based on their node degree in the candidate relays set. The nodes adjust their transmission range based on which categories that they belong to. Additionally, for investigating the effection of the node mobility on routing performance, we propose a link lifetime prediction algorithm which takes both the moving speed and moving direction into account. In CBRT, the source node determines the relaying priorities of the relaying nodes based on their utilities. The relaying node which the utility is large will have high priority to relay the data packet. By these innovations, the network performance in CBRT is much better than that in ExOR, however, the computation complexity is not increased in CBRT.Comment: 14 pages, 17 figures, 31 formulas, IEEE Sensors Journal, 201

Routing Protocols for Underwater Acoustic Sensor Networks: A Survey from an Application Perspective

Underwater acoustic communications are different from terrestrial radio communications; acoustic channel is asymmetric and has large and variable end‐to‐end propagation delays, distance‐dependent limited bandwidth, high bit error rates, and multi‐path fading. Besides, nodes’ mobility and limited battery power also cause problems for networking protocol design. Among them, routing in underwater acoustic networks is a challenging task, and many protocols have been proposed. In this chapter, we first classify the routing protocols according to application scenarios, which are classified according to the number of sinks that an underwater acoustic sensor network (UASN) may use, namely single‐sink, multi‐sink, and no‐sink. We review some typical routing strategies proposed for these application scenarios, such as cross‐layer and reinforcement learning as well as opportunistic routing. Finally, some remaining key issues are highlighted

Cross-layer design of multi-hop wireless networks

MULTI -hop wireless networks are usually defined as a collection of nodes equipped with radio transmitters, which not only have the capability to communicate each other in a multi-hop fashion, but also to route each others’ data packets. The distributed nature of such networks makes them suitable for a variety of applications where there are no assumed reliable central entities, or controllers, and may significantly improve the scalability issues of conventional single-hop wireless networks. This Ph.D. dissertation mainly investigates two aspects of the research issues related to the efficient multi-hop wireless networks design, namely: (a) network protocols and (b) network management, both in cross-layer design paradigms to ensure the notion of service quality, such as quality of service (QoS) in wireless mesh networks (WMNs) for backhaul applications and quality of information (QoI) in wireless sensor networks (WSNs) for sensing tasks. Throughout the presentation of this Ph.D. dissertation, different network settings are used as illustrative examples, however the proposed algorithms, methodologies, protocols, and models are not restricted in the considered networks, but rather have wide applicability. First, this dissertation proposes a cross-layer design framework integrating a distributed proportional-fair scheduler and a QoS routing algorithm, while using WMNs as an illustrative example. The proposed approach has significant performance gain compared with other network protocols. Second, this dissertation proposes a generic admission control methodology for any packet network, wired and wireless, by modeling the network as a black box, and using a generic mathematical 0. Abstract 3 function and Taylor expansion to capture the admission impact. Third, this dissertation further enhances the previous designs by proposing a negotiation process, to bridge the applications’ service quality demands and the resource management, while using WSNs as an illustrative example. This approach allows the negotiation among different service classes and WSN resource allocations to reach the optimal operational status. Finally, the guarantees of the service quality are extended to the environment of multiple, disconnected, mobile subnetworks, where the question of how to maintain communications using dynamically controlled, unmanned data ferries is investigated

Diseños de capa cruzada para redes inalámbricas de área corporal energéticamente eficientes: una revisión

RESUMEN: El diseño de capa cruzada se considera una poderosa alternativa para dar solución a las complejidades introducidas por las comunicaciones inalámbricas en redes de área corporal (WBAN), donde el modelo clásico de comunicaciones no ha exhibido un desempeño adecuado. Respecto al problema puntual de consumo de energía, hemos preparado la presente revisión de las publicaciones más relevantes que tratan la eficiencia energética para WBAN usando diseño de capa cruzada. En este artículo se proporciona una revisión exhaustiva de los avances en aproximaciones, protocolos y optimizaciones de capa cruzada cuyo objetivo es incrementar el tiempo de vida de las redes WBAN mediante el ahorro de energía. Luego, se discute los aspectos relevantes y deficiencias de las técnicas de capa cruzada energéticamente eficientes. Además, se introducen aspectos de investigación abiertos y retos en el diseño de capa cruzada para WBAN. En esta revisión proponemos una taxonomía de las aproximaciones de capa cruzada, de modo que las técnicas revisadas se ajustan en categorías de acuerdo a los protocolos involucrados en el diseño. Una clasificación novedosa se incluye para hacer claridad en los conceptos teóricos involucrados en cada esquema de capa cruzada y para luego agrupar aproximaciones similares evidenciando las diferencias con otras técnicas entre sí. Nuestras conclusiones consideran los aspectos de movilidad y modelamiento del canal en escenarios de WBAN como las direcciones para futura investigación en WBAN y en aplicaciones de telemedicina.ABSTRACT: Cross-layer design is considered a powerful alternative to solve the complexities of wireless communication in wireless body area networks (WBAN), where the classical communication model has been shown to be inaccurate. Regarding the energy consumption problem, we have prepared a current survey of the most relevant scientific publications on energy-efficient cross-layer design for WBAN. In this paper, we provide a comprehensive review of the advances in cross-layer approaches, protocols and optimizations aimed at increasing the network lifetime by saving energy in WBANs. Subsequently, we discuss the relevant aspects and shortcomings of these energy-efficient cross-layer techniques and point out the open research issues and challenges in WBAN cross-layer design. In this survey, we propose a taxonomy for cross-layer approaches to fit them into categories based on the protocols involved in the cross-layer scheme. A novel classification is included to clarify the theoretical concepts behind each cross-layer scheme; and to group similar approaches by establishing their differences from the other strategies reviewed. Our conclusion considers the aspects of mobility and channel modeling in WBAN scenarios as the directions of future cross-layer research for WBAN and telemedicine applications

Several Categories of Energy Harvested Routing Protocols, Challenges, and Characteristics in WSN: A Review

The routing protocol is a technique for determining the most efficient channel for data transmission. The route selection procedure, which relies on the kind of network, channel conditions, and measurement systems, presents several challenges. Routing is essential in Wireless Sensor Networks (WSNs) for environmental monitoring, traffic monitoring, and other applications. WSNs are small nodes that can sense, interpret data, and communicate wirelessly. Many routing, power control, and data dissemination techniques have been developed specifically for WSNs, where energy efficiency is a crucial design factor. On the other hand, the focus has been on energy harvesting and standard routing methods, which can vary depending on the design and network architecture. In a Wireless Sensor Network (WSN), the data collected by the sensor nodes is typically transferred to the base station, which connects the sensor network to other networks (such as the internet), where it is processed and necessary action is taken. WSN has recently been developed to allow various applications, including traffic enforcement building automation, smart warfare, environmental sensing, and many more.WSN integrates several sensors or nodes deployed around a specific node to perform computational processes