Power allocation and energy cooperation for UAV-enabled MmWave networks: A Multi-Agent Deep Reinforcement Learning approach

Unmanned Aerial Vehicle (UAV)-assisted cellular networks over the millimeter-wave (mmWave) frequency band can meet the requirements of a high data rate and flexible coverage in next-generation communication networks. However, higher propagation loss and the use of a large number of antennas in mmWave networks give rise to high energy consumption and UAVs are constrained by their low-capacity onboard battery. Energy harvesting (EH) is a viable solution to reduce the energy cost of UAV-enabled mmWave networks. However, the random nature of renewable energy makes it challenging to maintain robust connectivity in UAV-assisted terrestrial cellular networks. Energy cooperation allows UAVs to send their excessive energy to other UAVs with reduced energy. In this paper, we propose a power allocation algorithm based on energy harvesting and energy cooperation to maximize the throughput of a UAV-assisted mmWave cellular network. Since there is channel-state uncertainty and the amount of harvested energy can be treated as a stochastic process, we propose an optimal multi-agent deep reinforcement learning algorithm (DRL) named Multi-Agent Deep Deterministic Policy Gradient (MADDPG) to solve the renewable energy resource allocation problem for throughput maximization. The simulation results show that the proposed algorithm outperforms the Random Power (RP), Maximal Power (MP) and value-based Deep Q-Learning (DQL) algorithms in terms of network throughput.This work was supported by the Agencia Estatal de Investigación of Ministerio de Ciencia e Innovación of Spain under project PID2019-108713RB-C51 MCIN/AEI /10.13039/501100011033Postprint (published version

Joint altitude and hybrid beamspace precoding optimization for UAV-enabled multiuser mmWave MIMO System

The combination of unmanned aerial vehicles (UAVs) and millimeter wave (mmWave) multiple-input multiple-out (MIMO) system is regarded as a key enabling technology for beyond 5G networks, as it provides high data rate aerial links. However, establishing UAV-enabled mmWave MIMO communication is quite challenging due to the high hardware cost in terms of radio frequency (RF) chains. As a cost-effective alternative, a beamspace precoding with discrete lens arrays (DLA) architecture has received considerable attention. However, the underlying optimal design in beamspace precoding has not been fully exploited in UAV-enabled communication scenario. In this paper, the joint design of the UAV's altitude and hybrid beamspace precoding is proposed for the UAV-enabled multiuser MIMO system, in which the DLA is exploited to reduce the number of the RF chain. In the proposed scheme, the optimization problem is formulated as a minimum weighted mean squared error (MWMSE) method. Then an efficient algorithm with the penalty dual decomposition (PDD) is proposed that aims to jointly optimize the altitude of UAV, beam selection and digital precoding matrices. Simulation results confirm the comparable performance of the proposed scheme and perform close to full-digital beamforming in terms of achievable spectral efficiency

Hover or Perch: Comparing Capacity of Airborne and Landed Millimeter-Wave UAV Cells

On-demand deployments of millimeter-wave (mmWave) access points (APs) carried by unmanned aerial vehicles (UAVs) are considered today as a potential solution to enhance the performance of 5G+ networks. The battery lifetime of modern UAVs, though, limits the flight times in such systems. In this letter, we evaluate a feasible deployment alternative for temporary capacity boost in the areas with highly fluctuating user demands. The approach is to land UAV-based mmWave APs on the nearby buildings instead of hovering over the area. Within the developed mathematical framework, we compare the system-level performance of airborne and landed deployments by taking into account the full operation cycle of the employed drones. Our numerical results demonstrate that the choice of the UAV deployment option is determined by an interplay of the separation distance between the service area and the UAV charging station, drone battery lifetime, and the number of aerial APs in use. The presented methodology and results can support efficient on-demand deployments of UAV-based mmWave APs in prospective 5G+ networks.Comment: Accepted to IEEE Wireless Communications Letters on July 20, 2020. Copyright may be transferred without further notice after which this version may become non-availabl

RIS-Aided Cell-Free Massive MIMO Systems for 6G: Fundamentals, System Design, and Applications

An introduction of intelligent interconnectivity for people and things has posed higher demands and more challenges for sixth-generation (6G) networks, such as high spectral efficiency and energy efficiency, ultra-low latency, and ultra-high reliability. Cell-free (CF) massive multiple-input multiple-output (mMIMO) and reconfigurable intelligent surface (RIS), also called intelligent reflecting surface (IRS), are two promising technologies for coping with these unprecedented demands. Given their distinct capabilities, integrating the two technologies to further enhance wireless network performances has received great research and development attention. In this paper, we provide a comprehensive survey of research on RIS-aided CF mMIMO wireless communication systems. We first introduce system models focusing on system architecture and application scenarios, channel models, and communication protocols. Subsequently, we summarize the relevant studies on system operation and resource allocation, providing in-depth analyses and discussions. Following this, we present practical challenges faced by RIS-aided CF mMIMO systems, particularly those introduced by RIS, such as hardware impairments and electromagnetic interference. We summarize corresponding analyses and solutions to further facilitate the implementation of RIS-aided CF mMIMO systems. Furthermore, we explore an interplay between RIS-aided CF mMIMO and other emerging 6G technologies, such as next-generation multiple-access (NGMA), simultaneous wireless information and power transfer (SWIPT), and millimeter wave (mmWave). Finally, we outline several research directions for future RIS-aided CF mMIMO systems.Comment: 30 pages, 15 figure

Contextual Beamforming: Exploiting Location and AI for Enhanced Wireless Telecommunication Performance

The pervasive nature of wireless telecommunication has made it the foundation for mainstream technologies like automation, smart vehicles, virtual reality, and unmanned aerial vehicles. As these technologies experience widespread adoption in our daily lives, ensuring the reliable performance of cellular networks in mobile scenarios has become a paramount challenge. Beamforming, an integral component of modern mobile networks, enables spatial selectivity and improves network quality. However, many beamforming techniques are iterative, introducing unwanted latency to the system. In recent times, there has been a growing interest in leveraging mobile users' location information to expedite beamforming processes. This paper explores the concept of contextual beamforming, discussing its advantages, disadvantages and implications. Notably, the study presents an impressive 53% improvement in signal-to-noise ratio (SNR) by implementing the adaptive beamforming (MRT) algorithm compared to scenarios without beamforming. It further elucidates how MRT contributes to contextual beamforming. The importance of localization in implementing contextual beamforming is also examined. Additionally, the paper delves into the use of artificial intelligence schemes, including machine learning and deep learning, in implementing contextual beamforming techniques that leverage user location information. Based on the comprehensive review, the results suggest that the combination of MRT and Zero forcing (ZF) techniques, alongside deep neural networks (DNN) employing Bayesian Optimization (BO), represents the most promising approach for contextual beamforming. Furthermore, the study discusses the future potential of programmable switches, such as Tofino, in enabling location-aware beamforming

IRS-assisted UAV Communications: A Comprehensive Review

Intelligent reflecting surface (IRS) can smartly adjust the wavefronts in terms of phase, frequency, amplitude and polarization via passive reflections and without any need of radio frequency (RF) chains. It is envisaged as an emerging technology which can change wireless communication to improve both energy and spectrum efficiencies with low energy consumption and low cost. It can intelligently configure the wireless channels through a massive number of cost effective passive reflecting elements to improve the system performance. Similarly, unmanned aerial vehicle (UAV) communication has gained a viable attention due to flexible deployment, high mobility and ease of integration with several technologies. However, UAV communication is prone to security issues and obstructions in real-time applications. Recently, it is foreseen that UAV and IRS both can integrate together to attain unparalleled capabilities in difficult scenarios. Both technologies can ensure improved performance through proactively altering the wireless propagation using smart signal reflections and maneuver control in three dimensional (3D) space. IRS can be integrated in both aerial and terrene environments to reap the benefits of smart reflections. This study briefly discusses UAV communication, IRS and focuses on IRS-assisted UAC communications. It surveys the existing literature on this emerging research topic and highlights several promising technologies which can be implemented in IRS-assisted UAV communication. This study also presents several application scenarios and open research challenges. This study goes one step further to elaborate research opportunities to design and optimize wireless systems with low energy footprint and at low cost. Finally, we shed some light on future research aspects for IRS-assisted UAV communication