Optimal Sensing and Transmission in Energy Harvesting Sensor Networks

Sensor networks equipped with energy harvesting (EH) devices have attracted great attentions recently. Compared with conventional sensor networks powered by batteries, the energy harvesting abilities of the sensor nodes make sustainable and environment-friendly sensor networks possible. However, the random, scarce and non-uniform energy supply features also necessitate a completely different approach to energy management. A typical EH wireless sensor node consists of an EH module that converts ambient energy to electrical energy, which is stored in a rechargeable battery, and will be used to power the sensing and transmission operations of the sensor. Therefore, both sensing and transmission are subject to the stochastic energy constraint imposed by the EH process. In this dissertation, we investigate optimal sensing and transmission policies for EH sensor networks under such constraints. For EH sensing, our objective is to understand how the temporal and spatial variabilities of the EH processes would affect the sensing performance of the network, and how sensor nodes should coordinate their data collection procedures with each other to cope with the random and non-uniform energy supply and provide reliable sensing performance with analytically provable guarantees. Specifically, we investigate optimal sensing policies for a single sensor node with infinite and finite battery sizes in Chapter 2, status updating/transmission strategy of an EH Source in Chapter 3, and a collaborative sensing policy for a multi-node EH sensor network in Chapter 4. For EH communication, our objective is to evaluate the impacts of stochastic variability of the EH process and practical battery usage constraint on the EH systems, and develop optimal transmission policies by taking such impacts into consideration. Specifically, we consider throughput optimization in an EH system under battery usage constraint in Chapter 5

Data Collection and Information Freshness in Energy Harvesting Networks

An Internet of Things (IoT) network consists of multiple devices with sensor(s), and one or more access points or gateways. These devices monitor and sample targets, such as valuable assets, before transmitting their samples to an access point or the cloud for storage or/and analysis. A critical issue is that devices have limited energy, which constrains their operational lifetime. To this end, researchers have proposed various solutions to extend the lifetime of devices. A popular solution involves optimizing the duty cycle of devices; equivalently, the ratio of their active and inactive/sleep time. Another solution is to employ energy harvesting technologies. Specifically, devices rely on one or more energy sources such as wind, solar or Radio Frequency (RF) signals to power their operations. Apart from energy, another fundamental problem is the limited spectrum shared by devices. This means they must take turns to transmit to a gateway. Equivalently, they need a transmission schedule that determines when they transmit their samples to a gateway. To this end, this thesis addresses three novel device/sensor selection problems. It first aims to determine the best devices to transmit in each time slot in an RF Energy-Harvesting Wireless Sensor Network (EH-WSN) in order to maximize throughput or sum-rate. Briefly, a Hybrid Access Point (HAP) is responsible for charging devices via downlink RF energy transfer. After that, the HAP selects a subset of devices to transmit their data. A key challenge is that the HAP has neither channel state information nor energy level information of device. In this respect, this thesis outlines two centralized algorithms that are based on cross-entropy optimization and Gibbs sampling. Next, this thesis considers information freshness when selecting devices, where the HAP aims to minimize the average Age of Information (AoI) of samples from devices. Specifically, the HAP must select devices to sample and transmit frequently. Further, it must select devices without channel state information. To this end, this thesis outlines a decentralized Q-learning algorithm that allows the HAP to select devices according to their AoI. Lastly, this thesis considers targets with time-varying states. As before, the aim is to determine the best set of devices to be active in each frame in order to monitor targets. However, the aim is to optimize a novel metric called the age of incorrect information. Further, devices cooperate with one another to monitor target(s). To choose the best set of devices and minimize the said metric, this thesis proposes two decentralized algorithms, i.e., a decentralized Q-learning algorithm and a novel state space free learning algorithm. Different from the decentralized Q-learning algorithm, the state space free learning algorithm does not require devices to store Q-tables, which record the expected reward of actions taken by devices

Green cooperative spectrum sensing and scheduling in heterogeneous cognitive radio networks

The motivation behind the cognitive radio networks (CRNs) is rooted in scarcity of the radio spectrum and inefficiency of its management to meet the ever increasing high quality of service demands. Furthermore, information and communication technologies have limited and/or expensive energy resources and contribute significantly to the global carbon footprint. To alleviate these issues, energy efficient and energy harvesting (EEH) CRNs can harvest the required energy from ambient renewable sources while collecting the necessary bandwidth by discovering free spectrum for a minimized energy cost. Therefore, EEH-CRNs have potential to achieve green communications by enabling spectrum and energy self-sustaining networks. In this thesis, green cooperative spectrum sensing (CSS) policies are considered for large scale heterogeneous CRNs which consist of multiple primary channels (PCs) and a large number of secondary users (SUs) with heterogeneous sensing and reporting channel qualities. Firstly, a multi-objective clustering optimization (MOCO) problem is formulated from macro and micro perspectives; Macro perspective partitions SUs into clusters with the objectives: 1) Intra-cluster energy minimization of each cluster, 2) Intra-cluster throughput maximization of each cluster, and 3) Inter-cluster energy and throughput fairness. A multi-objective genetic algorithm, Non-dominated Sorting Genetic Algorithm-II (NSGA-II), is adopted and demonstrated how to solve the MOCO. The micro perspective, on the other hand, works as a sub-procedure on cluster formations given by macro perspective. For the micro perspective, a multihop reporting based CH selection procedure is proposed to find: 1) The best CH which gives the minimum total multi-hop error rate, and 2) the optimal routing paths from SUs to the CHs using Dijkstra\u27s algorithm. Using Poisson-Binomial distribution, a novel and generalized K-out-of-N voting rule is developed for heterogeneous CRNs to allow SUs to have different levels of local detection performance. Then, a convex optimization framework is established to minimize the intra-cluster energy cost subject to collision and spectrum utilization constraints.Likewise, instead of a common fixed sample size test, a weighted sample size test is considered for quantized soft decision fusion to obtain a more EE regime under heterogeneity. Secondly, an energy and spectrum efficient CSS scheduling (CSSS) problem is investigated to minimize the energy cost per achieved data rate subject to collision and spectrum utilization constraints. The total energy cost is calculated as the sum of energy expenditures resulting from sensing, reporting and channel switching operations. Then, a mixed integer non-linear programming problem is formulated to determine: 1) The optimal scheduling subset of a large number of PCs which cannot be sensed at the same time, 2) The SU assignment set for each scheduled PC, and 3) Optimal sensing parameters of SUs on each PC. Thereafter, an equivalent convex framework is developed for specific instances of above combinatorial problem. For the comparison, optimal detection and sensing thresholds are also derived analytically under the homogeneity assumption. Based on these, a prioritized ordering heuristic is developed to order channels under the spectrum, energy and spectrum-energy limited regimes. After that, a scheduling and assignment heuristic is proposed and shown to have a very close performance to the exhaustive optimal solution. Finally, the behavior of the CRN is numerically analyzed under these regimes with respect to different numbers of SUs, PCs and sensing qualities. Lastly, a single channel energy harvesting CSS scheme is considered with SUs experiencing different energy arrival rates, sensing, and reporting qualities. In order to alleviate the half- duplex EH constraint, which precludes from charging and discharging at the same time, and to harvest energy from both renewable sources and ambient radio signals, a full-duplex hybrid energy harvesting (EH) model is developed. After formulating the energy state evolution of half and full duplex systems under stochastic energy arrivals, a convex optimization framework is established to jointly obtain the optimal harvesting ratio, sensing duration and detection threshold of each SU to find an optimal myopic EH policy subject to collision and energy- causality constraints

Practical Evaluation of Low-complexity Medium Access Control Protocols for Wireless Sensor Networks

This thesis studies the potential of a novel approach to ensure more efficient and intelligent assignment of capacity through medium access control (MAC) in practical wireless sensor networks (WSNs), whereby Reinforcement Learning (RL) is employed as an intelligent transmission strategy. RL is applied to framed slotted-ALOHA to provide perfect scheduling. The system converges to a steady state of a unique transmission slot assigned per node in single-hop and multi-hop communication if there is sufficient number of slots available in the network, thereby achieving the optimum performance. The stability of the system against possible changes in the environment and changing channel conditions is studied. A Markov model is provided to represent the learning behaviour, which is also used to predict how the system loses its operation after convergence. Novel schemes are proposed to protect the lifetime of the system when the environment and channel conditions are insufficient to maintain the operation of the system. Taking real sensor platform architectures into consideration, the practicality of MAC protocols for WSNs must be considered based on hardware limitations/constraints. Therefore, the performance of the schemes developed is demonstrated through extensive simulations and evaluations in various test-beds. Practical evaluations show that RL-based schemes provide a high level of flexibility for hardware implementation

IoT and Sensor Networks in Industry and Society

The exponential progress of Information and Communication Technology (ICT) is one of the main elements that fueled the acceleration of the globalization pace. Internet of Things (IoT), Artificial Intelligence (AI) and big data analytics are some of the key players of the digital transformation that is affecting every aspect of human's daily life, from environmental monitoring to healthcare systems, from production processes to social interactions. In less than 20 years, people's everyday life has been revolutionized, and concepts such as Smart Home, Smart Grid and Smart City have become familiar also to non-technical users. The integration of embedded systems, ubiquitous Internet access, and Machine-to-Machine (M2M) communications have paved the way for paradigms such as IoT and Cyber Physical Systems (CPS) to be also introduced in high-requirement environments such as those related to industrial processes, under the forms of Industrial Internet of Things (IIoT or I2oT) and Cyber-Physical Production Systems (CPPS). As a consequence, in 2011 the German High-Tech Strategy 2020 Action Plan for Germany first envisioned the concept of Industry 4.0, which is rapidly reshaping traditional industrial processes. The term refers to the promise to be the fourth industrial revolution. Indeed, the first industrial revolution was triggered by water and steam power. Electricity and assembly lines enabled mass production in the second industrial revolution. In the third industrial revolution, the introduction of control automation and Programmable Logic Controllers (PLCs) gave a boost to factory production. As opposed to the previous revolutions, Industry 4.0 takes advantage of Internet access, M2M communications, and deep learning not only to improve production efficiency but also to enable the so-called mass customization, i.e. the mass production of personalized products by means of modularized product design and flexible processes. Less than five years later, in January 2016, the Japanese 5th Science and Technology Basic Plan took a further step by introducing the concept of Super Smart Society or Society 5.0. According to this vision, in the upcoming future, scientific and technological innovation will guide our society into the next social revolution after the hunter-gatherer, agrarian, industrial, and information eras, which respectively represented the previous social revolutions. Society 5.0 is a human-centered society that fosters the simultaneous achievement of economic, environmental and social objectives, to ensure a high quality of life to all citizens. This information-enabled revolution aims to tackle today’s major challenges such as an ageing population, social inequalities, depopulation and constraints related to energy and the environment. Accordingly, the citizens will be experiencing impressive transformations into every aspect of their daily lives. This book offers an insight into the key technologies that are going to shape the future of industry and society. It is subdivided into five parts: the I Part presents a horizontal view of the main enabling technologies, whereas the II-V Parts offer a vertical perspective on four different environments. The I Part, dedicated to IoT and Sensor Network architectures, encompasses three Chapters. In Chapter 1, Peruzzi and Pozzebon analyse the literature on the subject of energy harvesting solutions for IoT monitoring systems and architectures based on Low-Power Wireless Area Networks (LPWAN). The Chapter does not limit the discussion to Long Range Wise Area Network (LoRaWAN), SigFox and Narrowband-IoT (NB-IoT) communication protocols, but it also includes other relevant solutions such as DASH7 and Long Term Evolution MAchine Type Communication (LTE-M). In Chapter 2, Hussein et al. discuss the development of an Internet of Things message protocol that supports multi-topic messaging. The Chapter further presents the implementation of a platform, which integrates the proposed communication protocol, based on Real Time Operating System. In Chapter 3, Li et al. investigate the heterogeneous task scheduling problem for data-intensive scenarios, to reduce the global task execution time, and consequently reducing data centers' energy consumption. The proposed approach aims to maximize the efficiency by comparing the cost between remote task execution and data migration. The II Part is dedicated to Industry 4.0, and includes two Chapters. In Chapter 4, Grecuccio et al. propose a solution to integrate IoT devices by leveraging a blockchain-enabled gateway based on Ethereum, so that they do not need to rely on centralized intermediaries and third-party services. As it is better explained in the paper, where the performance is evaluated in a food-chain traceability application, this solution is particularly beneficial in Industry 4.0 domains. Chapter 5, by De Fazio et al., addresses the issue of safety in workplaces by presenting a smart garment that integrates several low-power sensors to monitor environmental and biophysical parameters. This enables the detection of dangerous situations, so as to prevent or at least reduce the consequences of workers accidents. The III Part is made of two Chapters based on the topic of Smart Buildings. In Chapter 6, Petroșanu et al. review the literature about recent developments in the smart building sector, related to the use of supervised and unsupervised machine learning models of sensory data. The Chapter poses particular attention on enhanced sensing, energy efficiency, and optimal building management. In Chapter 7, Oh examines how much the education of prosumers about their energy consumption habits affects power consumption reduction and encourages energy conservation, sustainable living, and behavioral change, in residential environments. In this Chapter, energy consumption monitoring is made possible thanks to the use of smart plugs. Smart Transport is the subject of the IV Part, including three Chapters. In Chapter 8, Roveri et al. propose an approach that leverages the small world theory to control swarms of vehicles connected through Vehicle-to-Vehicle (V2V) communication protocols. Indeed, considering a queue dominated by short-range car-following dynamics, the Chapter demonstrates that safety and security are increased by the introduction of a few selected random long-range communications. In Chapter 9, Nitti et al. present a real time system to observe and analyze public transport passengers' mobility by tracking them throughout their journey on public transport vehicles. The system is based on the detection of the active Wi-Fi interfaces, through the analysis of Wi-Fi probe requests. In Chapter 10, Miler et al. discuss the development of a tool for the analysis and comparison of efficiency indicated by the integrated IT systems in the operational activities undertaken by Road Transport Enterprises (RTEs). The authors of this Chapter further provide a holistic evaluation of efficiency of telematics systems in RTE operational management. The book ends with the two Chapters of the V Part on Smart Environmental Monitoring. In Chapter 11, He et al. propose a Sea Surface Temperature Prediction (SSTP) model based on time-series similarity measure, multiple pattern learning and parameter optimization. In this strategy, the optimal parameters are determined by means of an improved Particle Swarm Optimization method. In Chapter 12, Tsipis et al. present a low-cost, WSN-based IoT system that seamlessly embeds a three-layered cloud/fog computing architecture, suitable for facilitating smart agricultural applications, especially those related to wildfire monitoring. We wish to thank all the authors that contributed to this book for their efforts. We express our gratitude to all reviewers for the volunteering support and precious feedback during the review process. We hope that this book provides valuable information and spurs meaningful discussion among researchers, engineers, businesspeople, and other experts about the role of new technologies into industry and society

Bandwidth and Power Management in Broadband Wireless Networks

Bandwidth and power are considered as two important resources in wireless networks. Therefore, how to management these resources becomes a critical issue. In this thesis, we investigate this issue majorally in IEEE 802.16 networks. We first perform performance analysis on two bandwidth request mechanisms defined in IEEE 802.16 networks. We also propose two practical performance objectives. Based on the analysis, we design two scheduling algorithm to achieve the objectives. Due to the characteristics of popular variable bit rate (VBR) traffic, it is very difficult for subscriber stations (SSs) to make appropriate bandwidth reservation. Therefore, the bandwidth may not be utilized all the time. We propose a new protocol, named bandwidth recycling, to utilized unused bandwidth. Our simulation shows that the proposed scheme can improve system utilization averagely by 40\%. We also propose a more aggressive solution to reduce the gap between bandwidth reservation and real usage. We first design a centralized approach by linear programming to obtain the optimal solution. Further, we design a fully distributed scheme based on game theory, named bandwidth reservation (BR) game. Due to different quality of service (QoS) requirements, we customize the utility function for each scheduling class. Our numerical and simulation show that the gap between BR game and optimal solution is limited. Due to the advantage of dynamical fractional frequency reuse (DFFR), the base station (BS) can dynamically adjust transmission power on each frequency partition. We emphasis on power allocation issue in DFFR to achieve most ecomicical data transmission. We first formulate the problem by integer linear programming (ILP). Due to high computation complexity, we further design a greedy algorithm. Our simulation shows that the results of the greedy algorithm is very close to the ILP results