Deep reinforcement learning-based resource allocation strategy for energy harvesting-powered cognitive machine-to-machine networks

Machine-to-Machine (M2M) communication is a promising technology that may realize the Internet of Things (IoTs) in future networks. However, due to the features of massive devices and concurrent access requirement, it will cause performance degradation and enormous energy consumption. Energy Harvesting-Powered Cognitive M2M Networks (EH-CMNs) as an attractive solution is capable of alleviating the escalating spectrum deficient to guarantee the Quality of Service (QoS) meanwhile decreasing the energy consumption to achieve Green Communication (GC) became an important research topic. In this paper, we investigate the resource allocation problem for EH-CMNs underlaying cellular uplinks. We aim to maximize the energy efficiency of EH-CMNs with consideration of the QoS of Human-to-Human (H2H) networks and the available energy in EH-devices. In view of the characteristic of EH-CMNs, we formulate the problem to be a decentralized Discrete-time and Finite-state Markov Decision Process (DFMDP), in which each device acts as agent and effectively learns from the environment to make allocation decision without the complete and global network information. Owing to the complexity of the problem, we propose a Deep Reinforcement Learning (DRL)-based algorithm to solve the problem. Numerical results validate that the proposed scheme outperforms other schemes in terms of average energy efficiency with an acceptable convergence speed

Resource Allocation Challenges and Strategies for RF-Energy Harvesting Networks Supporting QoS

This paper specifically addresses the resource allocation challenges encountered in wireless sensor networks that incorporate RF energy harvesting capabilities, commonly referred to as RF-energy harvesting networks (RF-EHNs). RF energy harvesting and transmission techniques bring substantial advantages for applications requiring Quality of Service (QoS) support, as they enable proactive replenishment of  wireless devices. We commence by providing an overview of RF-EHNs, followed by an in-depth examination of the resource allocation challenges associated with this technology. In addition, we present a case study that focuses on the design of an efficient operating strategy for RF-EHN receivers. Our investigation highlights the critical aspects of service differentiation and QoS support, which have received limited attention in previous research. Besides, we explore previously unexplored areas within these domains

Computation energy efficiency maximization for a NOMA-based WPT-MEC network

Emerging smart Internet-of-Things (IoT) applications are increasingly relying on mobile-edge computing (MEC) networks, where the energy efficiency (EE) of computation is one of the most pertaining issues. In this article, considering the limited computation capacity at the MEC server and a practical nonlinear energy harvesting (EH) model for IoT devices, we propose a scheme to maximize the system computation EE (CEE) of a wireless power transfer (WPT) enabled nonorthogonal multiple access (NOMA)-based MEC network by jointly optimizing the computing frequencies and execution time of the MEC server and the IoT devices, the offloading time, the EH time and the transmit power of each IoT device, as well as the transmit power of the power beacon (PB). We formulate the joint optimization into a nonlinear fractional programming problem and devise a Dinkelbach-based iterative algorithm to solve it. By means of convex theory, we derive closed-form expressions for parts of the optimal solutions, which reveal several instrumental insights into the maximization of the system CEE. In particular, the system CEE increases as the optimal computing frequencies of both the IoT devices and the MEC server decrease, and the system CEE is maximized when the MEC server and the IoT devices use the maximum allowed time to complete their computing tasks. Simulation results demonstrate the superiority of the proposed scheme over benchmark schemes in terms of system CEE