Joint Trajectory and Passive Beamforming Design for Intelligent Reflecting Surface-Aided UAV Communications: A Deep Reinforcement Learning Approach

In this paper, the intelligent reflecting surface (IRS)-assisted unmanned aerial vehicle (UAV) communication system is studied, where an UAV is deployed to serve the user equipments (UEs) with the assistance of multiple IRSs mounted on several buildings to enhance the communication quality between UAV and UEs. We aim to maximize the overall weighted data rate and geographical fairness of all the UEs via jointly optimizing the UAV's trajectory and the phase shifts of reflecting elements of IRSs. Since the system is complex and the environment is dynamic, it is challenging to derive low-complexity algorithms by using conventional optimization methods. To address this issue, we first propose a deep Q-network (DQN)-based low-complex solution by discretizing the trajectory and phase shift, which is suitable for practical systems with discrete phase-shift control. Furthermore, we propose a deep deterministic policy gradient (DDPG)-based solution to tackle the case with continuous trajectory and phase shift design. The experimental results prove that the proposed solutions achieve better performance compared to other traditional benchmarks.Comment: 12 pages, 13 figure

Multiple Access in Aerial Networks: From Orthogonal and Non-Orthogonal to Rate-Splitting

Recently, interest on the utilization of unmanned aerial vehicles (UAVs) has aroused. Specifically, UAVs can be used in cellular networks as aerial users for delivery, surveillance, rescue search, or as an aerial base station (aBS) for communication with ground users in remote uncovered areas or in dense environments requiring prompt high capacity. Aiming to satisfy the high requirements of wireless aerial networks, several multiple access techniques have been investigated. In particular, space-division multiple access(SDMA) and power-domain non-orthogonal multiple access (NOMA) present promising multiplexing gains for aerial downlink and uplink. Nevertheless, these gains are limited as they depend on the conditions of the environment. Hence, a generalized scheme has been recently proposed, called rate-splitting multiple access (RSMA), which is capable of achieving better spectral efficiency gains compared to SDMA and NOMA. In this paper, we present a comprehensive survey of key multiple access technologies adopted for aerial networks, where aBSs are deployed to serve ground users. Since there have been only sporadic results reported on the use of RSMA in aerial systems, we aim to extend the discussion on this topic by modelling and analyzing the weighted sum-rate performance of a two-user downlink network served by an RSMA-based aBS. Finally, related open issues and future research directions are exposed.Comment: 16 pages, 6 figures, submitted to IEEE Journa

Energy-efficient non-orthogonal multiple access for wireless communication system

Non-orthogonal multiple access (NOMA) has been recognized as a potential solution for enhancing the throughput of next-generation wireless communications. NOMA is a potential option for 5G networks due to its superiority in providing better spectrum efficiency (SE) compared to orthogonal multiple access (OMA). From the perspective of green communication, energy efficiency (EE) has become a new performance indicator. A systematic literature review is conducted to investigate the available energy efficient approach researchers have employed in NOMA. We identified 19 subcategories related to EE in NOMA out of 108 publications where 92 publications are from the IEEE website. To help the reader comprehend, a summary for each category is explained and elaborated in detail. From the literature review, it had been observed that NOMA can enhance the EE of wireless communication systems. At the end of this survey, future research particularly in machine learning algorithms such as reinforcement learning (RL) and deep reinforcement learning (DRL) for NOMA are also discussed

Energy-Efficient Communication Design in UAV Enabled WPCN Using Dome Packing Method in Water Distribution System

The water distribution system has deployed several low-power IoT devices on an uneven surface where battery power is a major concern. Therefore, this paper focuses on using a UAV-enabled wireless powered communication network capable of directing energy to a target location and using it for communication, thereby reducing battery issues. In this paper, a static optimization was applied to find the initial height values using 3D clustering and beamforming method and dynamic optimization using extremum seeking method was applied to find the optimized height. The optimized height values were calculated and Travelling Salesman Problem (TSP) was applied to create the trajectory of the UAV. The overall energy consumption of the UAV was minimized by integrating dynamic optimization and dome packing method, which can find an optimal position and trajectory where the UAV will be hovering to direct energy and collect data. Moreover, we also minimized the total flight time of the UAV

A Comprehensive Overview on 5G-and-Beyond Networks with UAVs: From Communications to Sensing and Intelligence

Due to the advancements in cellular technologies and the dense deployment of cellular infrastructure, integrating unmanned aerial vehicles (UAVs) into the fifth-generation (5G) and beyond cellular networks is a promising solution to achieve safe UAV operation as well as enabling diversified applications with mission-specific payload data delivery. In particular, 5G networks need to support three typical usage scenarios, namely, enhanced mobile broadband (eMBB), ultra-reliable low-latency communications (URLLC), and massive machine-type communications (mMTC). On the one hand, UAVs can be leveraged as cost-effective aerial platforms to provide ground users with enhanced communication services by exploiting their high cruising altitude and controllable maneuverability in three-dimensional (3D) space. On the other hand, providing such communication services simultaneously for both UAV and ground users poses new challenges due to the need for ubiquitous 3D signal coverage as well as the strong air-ground network interference. Besides the requirement of high-performance wireless communications, the ability to support effective and efficient sensing as well as network intelligence is also essential for 5G-and-beyond 3D heterogeneous wireless networks with coexisting aerial and ground users. In this paper, we provide a comprehensive overview of the latest research efforts on integrating UAVs into cellular networks, with an emphasis on how to exploit advanced techniques (e.g., intelligent reflecting surface, short packet transmission, energy harvesting, joint communication and radar sensing, and edge intelligence) to meet the diversified service requirements of next-generation wireless systems. Moreover, we highlight important directions for further investigation in future work.Comment: Accepted by IEEE JSA