Markov Decision Processes with Applications in Wireless Sensor Networks: A Survey

Wireless sensor networks (WSNs) consist of autonomous and resource-limited devices. The devices cooperate to monitor one or more physical phenomena within an area of interest. WSNs operate as stochastic systems because of randomness in the monitored environments. For long service time and low maintenance cost, WSNs require adaptive and robust methods to address data exchange, topology formulation, resource and power optimization, sensing coverage and object detection, and security challenges. In these problems, sensor nodes are to make optimized decisions from a set of accessible strategies to achieve design goals. This survey reviews numerous applications of the Markov decision process (MDP) framework, a powerful decision-making tool to develop adaptive algorithms and protocols for WSNs. Furthermore, various solution methods are discussed and compared to serve as a guide for using MDPs in WSNs

Radio Resource Management for Wireless Mesh Networks Supporting Heterogeneous Traffic

Wireless mesh networking has emerged as a promising technology for future broadband wireless access, providing a viable and economical solution for both peer-to-peer applications and Internet access. The success of wireless mesh networks (WMNs) is highly contingent on effective radio resource management. In conventional wireless networks, system throughput is usually a common performance metric. However, next-generation broadband wireless access networks including WMNs are anticipated to support multimedia traffic (e.g., voice, video, and data traffic). With heterogeneous traffic, quality-of-service (QoS) provisioning and fairness support are also imperative. Recently, wireless mesh networking for suburban/rural residential areas has been attracting a plethora of attentions from industry and academia. With austere suburban and rural networking environments, multi-hop communications with decentralized resource allocation are preferred. In WMNs without powerful centralized control, simple yet effective resource allocation approaches are desired for the sake of system performance melioration. In this dissertation, we conduct a comprehensive research study on the topic of radio resource management for WMNs supporting multimedia traffic. In specific, this dissertation is intended to shed light on how to effectively and efficiently manage a WMN for suburban/rural residential areas, provide users with high-speed wireless access, support the QoS of multimedia applications, and improve spectrum utilization by means of novel radio resource allocation. As such, five important resource allocation problems for WMNs are addressed, and our research accomplishments are briefly outlined as follows: Firstly, we propose a novel node clustering algorithm with effective subcarrier allocation for WMNs. The proposed node clustering algorithm is QoS-aware, and the subcarrier allocation is optimality-driven and can be performed in a decentralized manner. Simulation results show that, compared to a conventional conflict-graph approach, our proposed approach effectively fosters frequency reuse, thereby improving system performance; Secondly, we propose three approaches for joint power-frequency-time resource allocation. Simulation results show that all of the proposed approaches are effective in provisioning packet-level QoS over their conventional resource allocation counterparts. Our proposed approaches are of low complexity, leading to preferred candidates for practical implementation; Thirdly, to further enhance system performance, we propose two low-complexity node cooperative resource allocation approaches for WMNs with partner selection/allocation. Simulation results show that, with beneficial node cooperation, both proposed approaches are promising in supporting QoS and elevating system throughput over their non-cooperative counterparts; Fourthly, to further utilize the temporarily available radio spectrum, we propose a simple channel sensing order for unlicensed secondary users. By sensing the channels according to the descending order of their achievable rates, we prove that a secondary user should stop at the first sensed free channel for the sake of optimality; and Lastly, we derive a unified optimization framework to effectively attain different degrees of performance tradeoff between throughput and fairness with QoS support. By introducing a bargaining floor, the optimal tradeoff curve between system throughput and fairness can be obtained by solving the proposed optimization problem iteratively

Recent Developments on Mobile Ad-Hoc Networks and Vehicular Ad-Hoc Networks

This book presents collective works published in the recent Special Issue (SI) entitled "Recent Developments on Mobile Ad-Hoc Networks and Vehicular Ad-Hoc Networks”. These works expose the readership to the latest solutions and techniques for MANETs and VANETs. They cover interesting topics such as power-aware optimization solutions for MANETs, data dissemination in VANETs, adaptive multi-hop broadcast schemes for VANETs, multi-metric routing protocols for VANETs, and incentive mechanisms to encourage the distribution of information in VANETs. The book demonstrates pioneering work in these fields, investigates novel solutions and methods, and discusses future trends in these field

Telecommunications Networks

This book guides readers through the basics of rapidly emerging networks to more advanced concepts and future expectations of Telecommunications Networks. It identifies and examines the most pressing research issues in Telecommunications and it contains chapters written by leading researchers, academics and industry professionals. Telecommunications Networks - Current Status and Future Trends covers surveys of recent publications that investigate key areas of interest such as: IMS, eTOM, 3G/4G, optimization problems, modeling, simulation, quality of service, etc. This book, that is suitable for both PhD and master students, is organized into six sections: New Generation Networks, Quality of Services, Sensor Networks, Telecommunications, Traffic Engineering and Routing

Markov decision processes with applications in wireless sensor networks: A survey

Ministry of Education, Singapore under its Academic Research Funding Tier

A Priority-based Fair Queuing (PFQ) Model for Wireless Healthcare System

Healthcare is a very active research area, primarily due to the increase in the elderly population that leads to increasing number of emergency situations that require urgent actions. In recent years some of wireless networked medical devices were equipped with different sensors to measure and report on vital signs of patient remotely. The most important sensors are Heart Beat Rate (ECG), Pressure and Glucose sensors. However, the strict requirements and real-time nature of medical applications dictate the extreme importance and need for appropriate Quality of Service (QoS), fast and accurate delivery of a patient’s measurements in reliable e-Health ecosystem. As the elderly age and older adult population is increasing (65 years and above) due to the advancement in medicine and medical care in the last two decades; high QoS and reliable e-health ecosystem has become a major challenge in Healthcare especially for patients who require continuous monitoring and attention. Nevertheless, predictions have indicated that elderly population will be approximately 2 billion in developing countries by 2050 where availability of medical staff shall be unable to cope with this growth and emergency cases that need immediate intervention. On the other side, limitations in communication networks capacity, congestions and the humongous increase of devices, applications and IOT using the available communication networks add extra layer of challenges on E-health ecosystem such as time constraints, quality of measurements and signals reaching healthcare centres. Hence this research has tackled the delay and jitter parameters in E-health M2M wireless communication and succeeded in reducing them in comparison to current available models. The novelty of this research has succeeded in developing a new Priority Queuing model ‘’Priority Based-Fair Queuing’’ (PFQ) where a new priority level and concept of ‘’Patient’s Health Record’’ (PHR) has been developed and integrated with the Priority Parameters (PP) values of each sensor to add a second level of priority. The results and data analysis performed on the PFQ model under different scenarios simulating real M2M E-health environment have revealed that the PFQ has outperformed the results obtained from simulating the widely used current models such as First in First Out (FIFO) and Weight Fair Queuing (WFQ). PFQ model has improved transmission of ECG sensor data by decreasing delay and jitter in emergency cases by 83.32% and 75.88% respectively in comparison to FIFO and 46.65% and 60.13% with respect to WFQ model. Similarly, in pressure sensor the improvements were 82.41% and 71.5% and 68.43% and 73.36% in comparison to FIFO and WFQ respectively. Data transmission were also improved in the Glucose sensor by 80.85% and 64.7% and 92.1% and 83.17% in comparison to FIFO and WFQ respectively. However, non-emergency cases data transmission using PFQ model was negatively impacted and scored higher rates than FIFO and WFQ since PFQ tends to give higher priority to emergency cases. Thus, a derivative from the PFQ model has been developed to create a new version namely “Priority Based-Fair Queuing-Tolerated Delay” (PFQ-TD) to balance the data transmission between emergency and non-emergency cases where tolerated delay in emergency cases has been considered. PFQ-TD has succeeded in balancing fairly this issue and reducing the total average delay and jitter of emergency and non-emergency cases in all sensors and keep them within the acceptable allowable standards. PFQ-TD has improved the overall average delay and jitter in emergency and non-emergency cases among all sensors by 41% and 84% respectively in comparison to PFQ model

Quality of service support for multimedia applications in mobile ad hoc networks

EThOS - Electronic Theses Online ServiceGBUnited Kingdo