Efficient radio resource management for future generation heterogeneous wireless networks

The heterogeneous deployment of small cells (e.g., femtocells) in the coverage area of the traditional macrocells is a cost-efficient solution to provide network capacity, indoor coverage and green communications towards sustainable environments in the future fifth generation (5G) wireless networks. However, the unplanned and ultra-dense deployment of femtocells with their uncoordinated operations will result in technical challenges such as severe interference, a significant increase in total energy consumption, unfairness in radio resource sharing and inadequate quality of service provisioning. Therefore, there is a need to develop efficient radio resource management algorithms that will address the above-mentioned technical challenges. The aim of this thesis is to develop and evaluate new efficient radio resource management algorithms that will be implemented in cognitive radio enabled femtocells to guarantee the economical sustainability of broadband wireless communications and users' quality of service in terms of throughput and fairness. Cognitive Radio (CR) technology with the Dynamic Spectrum Access (DSA) and stochastic process are the key technologies utilized in this research to increase the spectrum efficiency and energy efficiency at limited interference. This thesis essentially investigates three research issues relating to the efficient radio resource management: Firstly, a self-organizing radio resource management algorithm for radio resource allocation and interference management is proposed. The algorithm considers the effect of imperfect spectrum sensing in detecting the available transmission opportunities to maximize the throughput of femtocell users while keeping interference below pre-determined thresholds and ensuring fairness in radio resource sharing among users. Secondly, the effect of maximizing the energy efficiency and the spectrum efficiency individually on radio resource management is investigated. Then, an energy-efficient radio resource management algorithm and a spectrum-efficient radio resource management algorithm are proposed for green communication, to improve the probabilities of spectrum access and further increase the network capacity for sustainable environments. Also, a joint maximization of the energy efficiency and spectrum efficiency of the overall networks is considered since joint optimization of energy efficiency and spectrum efficiency is one of the goals of 5G wireless networks. Unfortunately, maximizing the energy efficiency results in low performance of the spectrum efficiency and vice versa. Therefore, there is an investigation on how to balance the trade-off that arises when maximizing both the energy efficiency and the spectrum efficiency simultaneously. Hence, a joint energy efficiency and spectrum efficiency trade-off algorithm is proposed for radio resource allocation in ultra-dense heterogeneous networks based on orthogonal frequency division multiple access. Lastly, a joint radio resource allocation with adaptive modulation and coding scheme is proposed to minimize the total transmit power across femtocells by considering the location and the service requirements of each user in the network. The performance of the proposed algorithms is evaluated by simulation and numerical analysis to demonstrate the impact of ultra-dense deployment of femtocells on the macrocell networks. The results show that the proposed algorithms offer improved performance in terms of throughput, fairness, power control, spectrum efficiency and energy efficiency. Also, the proposed algorithms display excellent performance in dynamic wireless environments

Reinforcement Learning in Self Organizing Cellular Networks

Self-organization is a key feature as cellular networks densify and become more heterogeneous, through the additional small cells such as pico and femtocells. Self- organizing networks (SONs) can perform self-configuration, self-optimization, and self-healing. These operations can cover basic tasks such as the configuration of a newly installed base station, resource management, and fault management in the network. In other words, SONs attempt to minimize human intervention where they use measurements from the network to minimize the cost of installation, configuration, and maintenance of the network. In fact, SONs aim to bring two main factors in play: intelligence and autonomous adaptability. One of the main requirements for achieving such goals is to learn from sensory data and signal measurements in networks. Therefore, machine learning techniques can play a major role in processing underutilized sensory data to enhance the performance of SONs. In the first part of this dissertation, we focus on reinforcement learning as a viable approach for learning from signal measurements. We develop a general framework in heterogeneous cellular networks agnostic to the learning approach. We design multiple reward functions and study different effects of the reward function, Markov state model, learning rate, and cooperation methods on the performance of reinforcement learning in cellular networks. Further, we look into the optimality of reinforcement learning solutions and provide insights into how to achieve optimal solutions. In the second part of the dissertation, we propose a novel architecture based on spatial indexing for system-evaluation of heterogeneous 5G cellular networks. We develop an open-source platform based on the proposed architecture that can be used to study large scale directional cellular networks. The proposed platform is used for generating training data sets of accurate signal-to-interference-plus-noise-ratio (SINR) values in millimeter-wave communications for machine learning purposes. Then, with taking advantage of the developed platform, we look into dense millimeter-wave networks as one of the key technologies in 5G cellular networks. We focus on topology management of millimeter-wave backhaul networks and study and provide multiple insights on the evaluation and selection of proper performance metrics in dense millimeter-wave networks. Finally, we finish this part by proposing a self-organizing solution to achieve k-connectivity via reinforcement learning in the topology management of wireless networks

Review on Radio Resource Allocation Optimization in LTE/LTE-Advanced using Game Theory

Recently, there has been a growing trend toward ap-plying game theory (GT) to various engineering fields in order to solve optimization problems with different competing entities/con-tributors/players. Researches in the fourth generation (4G) wireless network field also exploited this advanced theory to overcome long term evolution (LTE) challenges such as resource allocation, which is one of the most important research topics. In fact, an efficient de-sign of resource allocation schemes is the key to higher performance. However, the standard does not specify the optimization approach to execute the radio resource management and therefore it was left open for studies. This paper presents a survey of the existing game theory based solution for 4G-LTE radio resource allocation problem and its optimization

Green Networking in Cellular HetNets: A Unified Radio Resource Management Framework with Base Station ON/OFF Switching

In this paper, the problem of energy efficiency in cellular heterogeneous networks (HetNets) is investigated using radio resource and power management combined with the base station (BS) ON/OFF switching. The objective is to minimize the total power consumption of the network while satisfying the quality of service (QoS) requirements of each connected user. We consider the case of co-existing macrocell BS, small cell BSs, and private femtocell access points (FAPs). Three different network scenarios are investigated, depending on the status of the FAPs, i.e., HetNets without FAPs, HetNets with closed FAPs, and HetNets with semi-closed FAPs. A unified framework is proposed to simultaneously allocate spectrum resources to users in an energy efficient manner and switch off redundant small cell BSs. The high complexity dual decomposition technique is employed to achieve optimal solutions for the problem. A low complexity iterative algorithm is also proposed and its performances are compared to those of the optimal technique. The particularly interesting case of semi-closed FAPs, in which the FAPs accept to serve external users, achieves the highest energy efficiency due to increased degrees of freedom. In this paper, a cooperation scheme between FAPs and mobile operator is also investigated. The incentives for FAPs, e.g., renewable energy sharing and roaming prices, enabling cooperation are discussed to be considered as a useful guideline for inter-operator agreements.Comment: 15 pages, 9 Figures, IEEE Transactions on Vehicular Technology 201