Q-learning Channel Access Methods for Wireless Powered Internet of Things Networks

The Internet of Things (IoT) is becoming critical in our daily life. A key technology of interest in this thesis is Radio Frequency (RF) charging. The ability to charge devices wirelessly creates so called RF-energy harvesting IoT networks. In particular, there is a hybrid access point (HAP) that provides energy in an on-demand manner to RF-energy harvesting devices. These devices then collect data and transmit it to the HAP. In this respect, a key issue is ensuring devices have a high number of successful transmissions. There are a number of issues to consider when scheduling the transmissions of devices in the said network. First, the channel gain to/from devices varies over time. This means the efficiency to deliver energy to devices and to transmit the same amount of data is different over time. Second, during channel access, devices are not aware of the energy level of other devices nor whether they will transmit data. Third, devices have non-causal knowledge of their energy arrivals and channel gain information. Consequently, they do not know whether they should delay their transmissions in hope of better channel conditions or less contention in future time slots or doing so would result in energy overflow

Energy-Efficient NOMA Enabled Heterogeneous Cloud Radio Access Networks

Heterogeneous cloud radio access networks (H-CRANs) are envisioned to be promising in the fifth generation (5G) wireless networks. H-CRANs enable users to enjoy diverse services with high energy efficiency, high spectral efficiency, and low-cost operation, which are achieved by using cloud computing and virtualization techniques. However, H-CRANs face many technical challenges due to massive user connectivity, increasingly severe spectrum scarcity and energy-constrained devices. These challenges may significantly decrease the quality of service of users if not properly tackled. Non-orthogonal multiple access (NOMA) schemes exploit non-orthogonal resources to provide services for multiple users and are receiving increasing attention for their potential of improving spectral and energy efficiency in 5G networks. In this article a framework for energy-efficient NOMA H-CRANs is presented. The enabling technologies for NOMA H-CRANs are surveyed. Challenges to implement these technologies and open issues are discussed. This article also presents the performance evaluation on energy efficiency of H-CRANs with NOMA.Comment: This work has been accepted by IEEE Network. Pages 18, Figure

Resource Allocation for NOMA-based LPWA Networks Powered by Energy Harvesting

In this paper, we explore perpetual, scalable, Low-powered Wide-area networks (LPWA). Specifically we focus on the uplink transmissions of non-orthogonal multiple access (NOMA)-based LPWA networks consisting of multiple self-powered nodes and a NOMA-based single gateway. The self-powered LPWA nodes use the "harvest-then-transmit" protocol where they harvest energy from ambient sources (solar and radio frequency signals), then transmit their signals. The main features of the studied LPWA network are different transmission times-on-air, multiple uplink transmission attempts, and duty cycle restrictions. The aim of this work is to maximize the time-averaged sum of the uplink transmission rates by optimizing the transmission time-on-air allocation, the energy harvesting time allocation and the power allocation; subject to a maximum transmit power and to the availability of the harvested energy. We propose a low complex solution which decouples the optimization problem into three sub-problems: we assign the LPWA node transmission times (using either the fair or unfair approaches), we optimize the energy harvesting (EH) times using a one-dimensional search method, and optimize the transmit powers using a concave-convex (CCCP) procedure. In the simulation results, we focus on Long Range (LoRa) networks as a practical example LPWA network. We validate our proposed solution and we observe a $15\%$ performance improvement when using NOMA

IEEE Access Special Section Editorial: Wirelessly Powered Networks, and Technologies

Wireless Power Transfer (WPT) is, by definition, a process that occurs in any system where electrical energy is transmitted from a power source to a load without the connection of electrical conductors. WPT is the driving technology that will enable the next stage in the current consumer electronics revolution, including battery-less sensors, passive RF identification (RFID), passive wireless sensors, the Internet of Things and 5G, and machine-to-machine solutions. WPT-enabled devices can be powered by harvesting energy from the surroundings, including electromagnetic (EM) energy, leading to a new communication networks paradigm, the Wirelessly Powered Networks

Optimizing resource allocation in eh-enabled internet of things

Internet of Things (IoT) aims to bridge everyday physical objects via the Internet. Traditional energy-constrained wireless devices are powered by fixed energy sources like batteries, but they may require frequent battery replacements or recharging. Wireless Energy Harvesting (EH), as a promising solution, can potentially eliminate the need of recharging or replacing the batteries. Unlike other types of green energy sources, wireless EH does not depend on nature and is thus a reliable source of energy for charging devices. Meanwhile, the rapid growth of IoT devices and wireless applications is likely to demand for more operating frequency bands. Although the frequency spectrum is currently scarce, owing to inefficient conventional regulatory policies, a considerable amount of the radio spectrum is greatly underutilized. Cognitive radio (CR) can be exploited to mitigate the spectrum scarcity problem of IoT applications by leveraging the spectrum holes. Therefore, transforming the IoT network into a cognitive based IoT network is essential to utilizing the available spectrum opportunistically. To address the two aforementioned issues, a novel model is proposed to leverage wireless EH and CR for IoT. In particular, the sum rate of users is maximized for a CR-based IoT network enabled with wireless EH. Users operate in a time switching fashion, and each time slot is partitioned into three non-overlapping parts devoted for EH, spectrum sensing and data transmission. There is a trade-off among the lengths of these three operations and thus the time slot structure is to be optimized. The general problem of joint resource allocation and EH optimization is formulated as a mixed integer nonlinear programming task which is NP-hard and intractable. Therefore, a sub-channel allocation scheme is first proposed to approximately satisfy users rate requirements and remove the integer constraints. In the second step, the general optimization problem is reduced to a convex optimization task. Another optimization framework is also designed to capture a fundamental tradeoff between energy efficiency (EE) and spectral efficiency for an EH-enabled IoT network. In particular, an EE maximization problem is formulated by taking into consideration of user buffer occupancy, data rate fairness, energy causality constraints and interference constraints. Then, a low complexity heuristic algorithm is proposed to solve the resource allocation and EE optimization problem. The proposed algorithm is shown to be capable of achieving a near optimal solution with polynomial complexity. To support Machine Type Communications (MTC) in next generation mobile networks, NarrowBand-IoT (NB-IoT) has emerged as a promising solution to provide extended coverage and low energy consumption for low cost MTC devices. However, the existing orthogonal multiple access scheme in NB-IoT cannot provide connectivity for a massive number of MTC devices. In parallel with the development of NB-IoT, Non-Orthogonal Multiple Access (NOMA), introduced for the fifth generation wireless networks, is deemed to significantly improve the network capacity by providing massive connectivity through sharing the same spectral resources. To leverage NOMA in the context of NB-IoT, a power domain NOMA scheme is proposed with user clustering for an NB-IoT system. In particular, the MTC devices are assigned to different ranks within the NOMA clusters where they transmit over the same frequency resources. Then, an optimization problem is formulated to maximize the total throughput of the network by optimizing the resource allocation of MTC devices and NOMA clustering while satisfying the transmission power and quality of service requirements. Furthermore, an efficient heuristic algorithm is designed to solve the proposed optimization problem by jointly optimizing NOMA clustering and resource allocation of MTC devices

Jointly Active and Passive Beamforming Designs for IRS-Empowered WPCN

This paper studies an intelligent reflecting surface (IRS)-empowered wireless powered communication network (WPCN) in Internet of Things (IoT) networks. In particular, a power station (PS) with multiple antennas uses energy beamforming to enable wireless charging to multiple IoT devices, in the downlink wireless energy transfer (WET) phase; then, during the uplink wireless information transfer (WIT) phase, these IoT devices utilise the harvested energy to concurrently transmit their individual information signal to a multi-antenna access point (AP), which equips with multi-user decomposition (MUD) techniques to reconstruct the IoT devices’ signal. An IRS is deployed to improve the energy collection and information transmission capabilities in the WET and WIT phases, respectively. To examine the performance of the system under study, We maximize the sum throughput with the aim of jointly designing the optimal solutions for the active PS energy beamforming, AP receive beamforming, passive IRS beamforming, and time scheduling. Due to the multiple coupled variables, the resulting formulation is non-convex, and a two-level scheme to solve the problem is proposed. At the outer level, a one-dimensional (1-D) search method is applied to find the optimal time scheduling, while at the inner level, an iterative block coordinate descent (BCD) algorithm is proposed to design the optimal receive beamforming, energy beamforming, and IRS phase shifts. In particular, the receive beamforming part is designed by considering the equivalence between sum rate maximisation and sum mean square error (MSE) minimisation, thereby deriving a closed-form solution. Furthermore, we alternately optimize the energy beamforming and IRS phase shifts using Lagrange dual transformation (LDT), quadratic transformation (QT), and alternating direction method of multipliers (ADMM) methods. Finally, numerical results are presented to showcase the performance of the proposed solution and highlight its advant..