Stacked Auto Encoder Based Deep Reinforcement Learning for Online Resource Scheduling in Large-Scale MEC Networks

An online resource scheduling framework is proposed for minimizing the sum of weighted task latency for all the Internet-of-Things (IoT) users, by optimizing offloading decision, transmission power, and resource allocation in the large-scale mobile-edge computing (MEC) system. Toward this end, a deep reinforcement learning (DRL)-based solution is proposed, which includes the following components. First, a related and regularized stacked autoencoder (2r-SAE) with unsupervised learning is applied to perform data compression and representation for high-dimensional channel quality information (CQI) data, which can reduce the state space for DRL. Second, we present an adaptive simulated annealing approach (ASA) as the action search method of DRL, in which an adaptive h -mutation is used to guide the search direction and an adaptive iteration is proposed to enhance the search efficiency during the DRL process. Third, a preserved and prioritized experience replay (2p-ER) is introduced to assist the DRL to train the policy network and find the optimal offloading policy. The numerical results are provided to demonstrate that the proposed algorithm can achieve near-optimal performance while significantly decreasing the computational time compared with existing benchmarks

Intelligent Reflecting Surface Aided Multigroup Multicast MISO Communication Systems

Intelligent reflecting surface (IRS) has recently been envisioned to offer unprecedented massive multiple-input multiple-output (MIMO)-like gains by deploying large-scale and low-cost passive reflection elements. By adjusting the reflection coefficients, the IRS can change the phase shifts on the impinging electromagnetic waves so that it can smartly reconfigure the signal propagation environment and enhance the power of the desired received signal or suppress the interference signal. In this paper, we consider downlink multigroup multicast communication systems assisted by an IRS. We aim for maximizing the sum rate of all the multicasting groups by the joint optimization of the precoding matrix at the base station (BS) and the reflection coefficients at the IRS under both the power and unit-modulus constraint. To tackle this non-convex problem, we propose two efficient algorithms. Specifically, a concave lower bound surrogate objective function has been derived firstly, based on which two sets of variables can be updated alternately by solving two corresponding second-order cone programming (SOCP) problems.Then, in order to reduce the computational complexity, we further adopt the majorization—minimization (MM) method for each set of variables at every iteration, and obtain the closed form solutions under loose surrogate objective functions. Finally, the simulation results demonstrate the benefits of the introduced IRS and the effectiveness of our proposed algorithms

Joint Transmit Power and Placement Optimization for URLLC-enabled UAV Relay Systems

This letter considers an unmanned aerial vehicle (UAV)-enabled relay communication system for delivering latency-critical messages with ultra-high reliability, where the relay is operating under amplifier-and-forward (AF) mode. We aim to jointly optimize the UAV location and power to minimize decoding error probability while guaranteeing the latency constraints. Both the free-space channel model and three-dimensional (3-D) channel model are considered. For the first model, we propose a low-complexity iterative algorithm to solve the problem, while globally optimal solution is derived for the case when the signal-to-noise ratio (SNR) is extremely high. For the second model, we also propose a low-complexity iterative algorithm to solve the problem. Simulation results confirm the performance advantages of our proposed algorithms