A Novel Multiobjective Cell Switch-Off Framework for Cellular Networks

Cell Switch-Off (CSO) is recognized as a promising approach to reduce the energy consumption in next-generation cellular networks. However, CSO poses serious challenges not only from the resource allocation perspective but also from the implementation point of view. Indeed, CSO represents a difficult optimization problem due to its NP-complete nature. Moreover, there are a number of important practical limitations in the implementation of CSO schemes, such as the need for minimizing the real-time complexity and the number of on-off/off-on transitions and CSO-induced handovers. This article introduces a novel approach to CSO based on multiobjective optimization that makes use of the statistical description of the service demand (known by operators). In addition, downlink and uplink coverage criteria are included and a comparative analysis between different models to characterize intercell interference is also presented to shed light on their impact on CSO. The framework distinguishes itself from other proposals in two ways: 1) The number of on-off/off-on transitions as well as handovers are minimized, and 2) the computationally-heavy part of the algorithm is executed offline, which makes its implementation feasible. The results show that the proposed scheme achieves substantial energy savings in small cell deployments where service demand is not uniformly distributed, without compromising the Quality-of-Service (QoS) or requiring heavy real-time processing

A Tutorial on Clique Problems in Communications and Signal Processing

Since its first use by Euler on the problem of the seven bridges of K\"onigsberg, graph theory has shown excellent abilities in solving and unveiling the properties of multiple discrete optimization problems. The study of the structure of some integer programs reveals equivalence with graph theory problems making a large body of the literature readily available for solving and characterizing the complexity of these problems. This tutorial presents a framework for utilizing a particular graph theory problem, known as the clique problem, for solving communications and signal processing problems. In particular, the paper aims to illustrate the structural properties of integer programs that can be formulated as clique problems through multiple examples in communications and signal processing. To that end, the first part of the tutorial provides various optimal and heuristic solutions for the maximum clique, maximum weight clique, and $k$-clique problems. The tutorial, further, illustrates the use of the clique formulation through numerous contemporary examples in communications and signal processing, mainly in maximum access for non-orthogonal multiple access networks, throughput maximization using index and instantly decodable network coding, collision-free radio frequency identification networks, and resource allocation in cloud-radio access networks. Finally, the tutorial sheds light on the recent advances of such applications, and provides technical insights on ways of dealing with mixed discrete-continuous optimization problems

Sustainable optimizing WMN performance through meta-heuristic TDMA link scheduling and routing

Wireless mesh networks (WMNs) have become a popular solution for expanding internet service and communication in both urban and rural areas. However, the performance of WMNs depends on generating optimized time-division multiple access (TDMA) schedules, which distribute time into a list of slots called superframes. This study proposes novel meta-heuristic algorithms to generate TDMA link schedules in WMNs using two different interference/constraint models: multi-transmit-receive (MTR) and full-duplex (FD). The objectives of this study are to optimize the TDMA frame for packet transmission, satisfy the constraints, and minimize the end-to-end delay. The significant contributions of this study are: (1) proposing effective and efficient heuristic solutions to solve the NP-complete problem of generating optimal TDMA link schedules in WMNs; (2) investigating the new FD interference model to improve the network capacity above the physical layer. To achieve these objectives and contributions, the study uses two popular meta-heuristics, the artificial bee colony (ABC) and/or genetic algorithm (GA), to solve the known NP-complete problems of joint scheduling, power control, and rate control. The results of this study show that the proposed algorithms can generate optimized TDMA link schedules for both MTR and FD models. The joint routing and scheduling approach further minimizes end-to-end delay while maintaining the schedule's minimum length and/or maximum capacity. The proposed solution outperforms the existing solutions in terms of the number of active links, end-to-end delay, and network capacity. The research aims to improve the efficiency and effectiveness of WMNs in most applications that require high throughput and fast response time

Optimisation of Mobile Communication Networks - OMCO NET

The mini conference “Optimisation of Mobile Communication Networks” focuses on advanced methods for search and optimisation applied to wireless communication networks. It is sponsored by Research & Enterprise Fund Southampton Solent University. The conference strives to widen knowledge on advanced search methods capable of optimisation of wireless communications networks. The aim is to provide a forum for exchange of recent knowledge, new ideas and trends in this progressive and challenging area. The conference will popularise new successful approaches on resolving hard tasks such as minimisation of transmit power, cooperative and optimal routing

Benefits and limits of machine learning for the implicit coordination on SON functions

Bedingt durch die Einführung neuer Netzfunktionen in den Mobilfunknetzen der nächsten Generation, z. B. Slicing oder Mehrantennensysteme, sowie durch die Koexistenz mehrerer Funkzugangstechnologien, werden die Optimierungsaufgaben äußerst komplex und erhöhen die OPEX (OPerational EXpenditures). Um den Nutzern Dienste mit wettbewerbsfähiger Dienstgüte (QoS) zu bieten und gleichzeitig die Betriebskosten niedrig zu halten, wurde von den Standardisierungsgremien das Konzept des selbstorganisierenden Netzes (SON) eingeführt, um das Netzmanagement um eine Automatisierungsebene zu erweitern. Es wurden dafür mehrere SON-Funktionen (SFs) vorgeschlagen, um einen bestimmten Netzbereich, wie Abdeckung oder Kapazität, zu optimieren. Bei dem konventionellen Entwurf der SFs wurde jede Funktion als Regler mit geschlossenem Regelkreis konzipiert, der ein lokales Ziel durch die Einstellung bestimmter Netzwerkparameter optimiert. Die Beziehung zwischen mehreren SFs wurde dabei jedoch bis zu einem gewissen Grad vernachlässigt. Daher treten viele widersprüchliche Szenarien auf, wenn mehrere SFs in einem mobilen Netzwerk instanziiert werden. Solche widersprüchlichen Funktionen in den Netzen verschlechtern die QoS der Benutzer und beeinträchtigen die Signalisierungsressourcen im Netz. Es wird daher erwartet, dass eine existierende Koordinierungsschicht (die auch eine Entität im Netz sein könnte) die Konflikte zwischen SFs lösen kann. Da diese Funktionen jedoch eng miteinander verknüpft sind, ist es schwierig, ihre Interaktionen und Abhängigkeiten in einer abgeschlossenen Form zu modellieren. Daher wird maschinelles Lernen vorgeschlagen, um eine gemeinsame Optimierung eines globalen Leistungsindikators (Key Performance Indicator, KPI) so voranzubringen, dass die komplizierten Beziehungen zwischen den Funktionen verborgen bleiben. Wir nennen diesen Ansatz: implizite Koordination. Im ersten Teil dieser Arbeit schlagen wir eine zentralisierte, implizite und auf maschinellem Lernen basierende Koordination vor und wenden sie auf die Koordination zweier etablierter SFs an: Mobility Robustness Optimization (MRO) und Mobility Load Balancing (MLB). Anschließend gestalten wir die Lösung dateneffizienter (d. h. wir erreichen die gleiche Modellleistung mit weniger Trainingsdaten), indem wir eine geschlossene Modellierung einbetten, um einen Teil des optimalen Parametersatzes zu finden. Wir nennen dies einen "hybriden Ansatz". Mit dem hybriden Ansatz untersuchen wir den Konflikt zwischen MLB und Coverage and Capacity Optimization (CCO) Funktionen. Dann wenden wir ihn auf die Koordinierung zwischen MLB, Inter-Cell Interference Coordination (ICIC) und Energy Savings (ES) Funktionen an. Schließlich stellen wir eine Möglichkeit vor, MRO formal in den hybriden Ansatz einzubeziehen, und zeigen, wie der Rahmen erweitert werden kann, um anspruchsvolle Netzwerkszenarien wie Ultra-Reliable Low Latency Communications (URLLC) abzudecken.Due to the introduction of new network functionalities in next-generation mobile networks, e.g., slicing or multi-antenna systems, as well as the coexistence of multiple radio access technologies, the optimization tasks become extremely complex, increasing the OPEX (OPerational EXpenditures). In order to provide services to the users with competitive Quality of Service (QoS) while keeping low operational costs, the Self-Organizing Network (SON) concept was introduced by the standardization bodies to add an automation layer to the network management. Thus, multiple SON functions (SFs) were proposed to optimize a specific network domain, like coverage or capacity. The conventional design of SFs conceived each function as a closed-loop controller optimizing a local objective by tuning specific network parameters. However, the relationship among multiple SFs was neglected to some extent. Therefore, many conflicting scenarios appear when multiple SFs are instantiated in a mobile network. Having conflicting functions in the networks deteriorates the users’ QoS and affects the signaling resources in the network. Thus, it is expected to have a coordination layer (which could also be an entity in the network), conciliating the conflicts between SFs. Nevertheless, due to interleaved linkage among those functions, it is complex to model their interactions and dependencies in a closed form. Thus, machine learning is proposed to drive a joint optimization of a global Key Performance Indicator (KPI), hiding the intricate relationships between functions. We call this approach: implicit coordination. In the first part of this thesis, we propose a centralized, fully-implicit coordination approach based on machine learning (ML), and apply it to the coordination of two well-established SFs: Mobility Robustness Optimization (MRO) and Mobility Load Balancing (MLB). We find that this approach can be applied as long as the coordination problem is decomposed into three functional planes: controllable, environmental, and utility planes. However, the fully-implicit coordination comes at a high cost: it requires a large amount of data to train the ML models. To improve the data efficiency of our approach (i.e., achieving good model performance with less training data), we propose a hybrid approach, which mixes ML with closed-form models. With the hybrid approach, we study the conflict between MLB and Coverage and Capacity Optimization (CCO) functions. Then, we apply it to the coordination among MLB, Inter-Cell Interference Coordination (ICIC), and Energy Savings (ES) functions. With the hybrid approach, we find in one shot, part of the parameter set in an optimal manner, which makes it suitable for dynamic scenarios in which fast response is expected from a centralized coordinator. Finally, we present a manner to formally include MRO in the hybrid approach and show how the framework can be extended to cover challenging network scenarios like Ultra-Reliable Low Latency Communications (URLLC)

Design of static intercell interference coordination schemes for realistic lte-based cellular networks

Today, 3.5 and 4G systems including Long Term Evolution (LTE) and LTE-Advanced (LTE-A) support packet-based services and provide mobile broadband access for bandwidth-hungry applications. In this context of fast evolution, new and challenging technical issues must be e ectively addressed. The nal target is to achieve a signi cant step forward toward the improvement of the Quality of Experience (QoE). To that end, interference management has been recognized by the industry as a key enabler for cellular technologies based on OFDMA. Indeed, with a low frequency reuse factor, intercell interference (ICI) becomes a major concern since the Quality of Service (QoS) is not uniformly delivered across the network, it remarkably depends on user position. Hence, cell edge performance is an important issue in LTE and LTE-A. Intercell Interference Coordination (ICIC) encompasses strategies whose goal is to keep ICI at cell edges as low as possible. This alleviates the aforementioned situation. For this reason, the novelties presented in this Ph.D. thesis include not only developments of static ICIC mechanisms for data and control channels, but also e orts towards further improvements of the energy e ciency perspective. Based on a comprehensive review of the state of the art, a set of research opportunities were identi ed. To be precise, the need for exible performance evaluation methods and optimization frameworks for static ICIC strategies. These mechanisms are grouped in two families: the schemes that de ne constraints on the frequency domain and the ones that propose adjustments on the power levels. Thus, Soft- and Fractional Frequency Reuse (SFR and FFR, respectively) are identi ed as the base of the vast majority of static ICIC proposals. Consequently, during the rst part of this Ph.D. thesis, interesting insights into the operation of SFR and FFR were identi ed beyond well-known facts. These studies allow for the development of a novel statistical framework to evaluate the performance of these schemes in realistic deployments. As a result of the analysis, the poor performance of classic con gurations of SFR and FFR in real-world contexts is shown, and hence, the need for optimization is established. In addition, the importance of the interworking between static ICIC schemes and other network functionalities such as CSI feedback has also been identi ed. Therefore, novel CSI feedback schemes, suitable to operate in conjunction with SFR and FFR, have been developed. These mechanisms exploit the resource allocation pattern of these static ICIC techniques in order to improve the accuracy of the CSI feedback process. The second part is focused on the optimization of SFR and FFR. The use of multiobjective techniques is investigated as a tool to achieve e ective network-speci c optimization. The approach o ers interesting advantages. On the one hand, it allows for simultaneous optimization of several con icting criteria. On the other hand, the multiobjective nature results in outputs composed of several high quality (Pareto e cient) network con gurations, all of them featuring a near-optimal tradeo between the performance criteria. Multiobjective evolutionary algorithms allow employing complex mathematical structures without the need for relaxation, thus capturing accurately the system behavior in terms of ICI. The multiobjective optimization formulation of the problem aims at achieving e ective adjustment of the operational parameters of SFR and FFR both at cell level and network-wide. Moreover, the research was successfully extended to the control channels, both the PDCCH and ePDCCH. Finally, in an e ort to further improve the network energy e ciency (an aspect always considered throughout the thesis), the framework of Cell Switch O (CSO), having close connections with ICIC, is also introduced. By means of the proposed method, signi cant improvements with respect to traditional approaches, baseline con gurations, and previous proposals can be achieved. The gains are obtained in terms of energy consumption, network capacity, and cell edge performance.Actualmente los sistemas 3.5 y 4G tales como Long Term Evolution (LTE) y LTE-Advanced (LTE-A) soportan servicios basados en paquetes y proporcionan acceso de banda ancha m ovil para aplicaciones que requieren elevadas tasas de transmisi on. En este contexto de r apida evoluci on, aparecen nuevos retos t ecnicos que deben ser resueltos e cientemente. El objetivo ultimo es conseguir un salto cualitativo importante en la experiencia de usuario (QoE). Con tal n, un factor clave que ha sido reconocido en las redes celulares basadas en Orthogonal Frequency- Division Multiple Access (OFDMA) es la gesti on de interferencias. De hecho, la utilizaci on de un factor de reuso bajo permite una elevada e ciencia espectral pero a costa de una distribuci on de la calidad de servicio (QoS) que no es uniforme en la red, depende de la posici on del usuario. Por lo tanto, el rendimiento en los l mites de la celda se ve muy penalizado y es un problema importante a resolver en LTE y LTE-A. La coordinaci on de interferencias entre celdas (ICIC, del ingl es Intercell Interfe- rence Coordination) engloba las estrategias cuyo objetivo es mantener la interferencia intercelular (ICI) lo m as baja posible en los bordes de celda. Esto permite aliviar la situaci on antes mencionada. La contribuci on presentada en esta tesis doctoral incluye el dise~no de nuevos mecanismos de ICIC est atica para los canales de datos y control, as como tambi en mejoras desde el punto de vista de e ciencia energ etica. A partir de una revisi on completa del estado del arte, se identi caron una serie de retos abiertos que requer an esfuerzos de investigaci on. En concreto, la necesidad de m etodos de evaluaci on exibles y marcos de optimizaci on de las estrategias de ICIC est aticas. Estos mecanismos se agrupan en dos familias: los esquemas que de nen restricciones sobre el dominio de la frecuencia y los que proponen ajustes en los niveles de potencia. Es decir, la base de la gran mayor a de propuestas ICIC est aticas son la reutilizaci on de frecuencias de tipo soft y fraccional (SFR y FFR, respectivamente). De este modo, durante la primera parte de esta tesis doctoral, se han estudiado los aspectos m as importantes del funcionamiento de SFR y FFR, haciendo especial enfasis en las conclusiones que van m as all a de las bien conocidas. Ello ha permitido introducir un nuevo marco estad stico para evaluar el funcionamiento de estos sistemas en condiciones de despliegue reales. Como resultado de estos an alisis, se muestra el pobre desempe~no de SFR y FFR en despliegues reales cuando funcionan con sus con guraciones cl asicas y se establece la necesidad de optimizaci on. Tambi en se pone de mani esto la importancia del funcionamiento conjunto entre esquemas ICIC est aticos y otras funcionalidades de la red radio, tales como la informaci on que env an los usuarios sobre el estado de su canal downlink (feedback del CSI, del ingl es Channel State Information). De este modo, se han propuesto diferentes esquemas de feedback apropiados para trabajar conjuntamente con SFR y FFR. Estos mecanismos explotan el patr on de asignaci on de recursos que se utiliza en ICIC est atico para mejorar la precisi on del proceso. La segunda parte se centra en la optimizaci on de SFR y FFR. Se ha investigado el uso de t ecnicas multiobjetivo como herramienta para lograr una optimizaci on e caz, que es espec ca para cada red. El enfoque ofrece ventajas interesantes, por un lado, se permite la optimizaci on simult anea de varios criterios contradictorios. Por otro lado, la naturaleza multiobjetivo implica obtener como resultado con guraciones de red de elevada calidad (Pareto e cientes), todas ellas con un equilibrio casi- optimo entre las diferentes m etricas de rendimiento. Los algoritmos evolucionarios multiobjetivo permiten la utilizaci on de estructuras matem aticas complejas sin necesidad de relajar el problema, de este modo capturan adecuadamente su comportamiento en t erminos de ICI. La formulaci on multiobjetivo consigue un ajuste efectivo de los par ametros operacionales de SFR y FFR, tanto a nivel de celda como a nivel de red. Adem as, la investigaci on se extiende con resultados satisfactorios a los canales de control, PDCCH y ePDCCH. Finalmente, en un esfuerzo por mejorar la e ciencia energ etica de la red (un aspecto siempre considerado a lo largo de la tesis), se introduce en el an alisis global el apagado inteligente de celdas, estrategia con estrechos v nculos con ICIC. A trav es del m etodo propuesto, se obtienen mejoras signi cativas con respecto a los enfoques tradicionales y propuestas previas. Las ganancias se obtienen en t erminos de consumo energ etico, capacidad de la red, y rendimiento en el l mite de las celdas.Actualment els sistemes 3.5 i 4G tals com Long Term Evolution (LTE) i LTE- Advanced (LTE-A) suporten serveis basats en paquets i proporcionen acc es de banda ampla m obil per a aplicacions que requereixen elevades taxes de transmissi o. En aquest context de r apida evoluci o, apareixen nous reptes t ecnics que han de ser resolts e cientment. L'objectiu ultim es aconseguir un salt qualitatiu important en l'experi encia d'usuari (QoE). Amb tal , un factor clau que ha estat reconegut a les xarxes cel lulars basades en Orthogonal Frequency-Division Multiple Access (OFDMA) es la gesti o d'interfer encies. De fet, la utilizaci o d'un factor de re us baix permet una elevada e ci encia espectral per o a costa d'una distribuci o de la qualitat de servei (QoS) que no es uniforme a la xarxa, dep en de la posici o de l'usuari. Per tant, el rendiment en els l mits de la cel la es veu molt penalitzat i es un problema important a resoldre en LTE i LTE-A. La coordinaci o d'interfer encies entre cel les (ICIC, de l'angl es Intercell Interfe- rence Coordination) engloba les estrat egies que tenen com a objectiu mantenir la interfer encia intercel lular (ICI) el m es baixa possible en les vores de la cel la. Aix o permet alleujar la situaci o abans esmentada. La contribuci o presentada en aquesta tesi doctoral inclou el disseny de nous mecanismes de ICIC est atica per als canals de dades i control, aix com tamb e millores des del punt de vista d'e ci encia energ etica. A partir d'una revisi o completa de l'estat de l'art, es van identi car una s erie de reptes oberts que requerien esfor cos de recerca. En concret, la necessitat de m etodes d'avaluaci o exibles i marcs d'optimitzaci o de les estrat egies de ICIC est atiques. Aquests mecanismes s'agrupen en dues fam lies: els esquemes que de neixen restriccions sobre el domini de la freq u encia i els que proposen ajustos en els nivells de pot encia. Es a dir, la base de la gran majoria de propostes ICIC est atiques s on la reutilitzaci o de freq u encies de tipus soft i fraccional (SFR i FFR, respectivament). D'aquesta manera, durant la primera part d'aquesta tesi doctoral, s'han estudiat els aspectes m es importants del funcionament de SFR i FFR, fent especial emfasi en les conclusions que van m es enll a de les ben conegudes. Aix o ha perm es introduir un nou marc estad stic per avaluar el funcionament d'aquests sistemes en condicions de desplegament reals. Com a resultat d'aquestes an alisis, es mostra el pobre acompliment de SFR i FFR en desplegaments reals quan funcionen amb les seves con guracions cl assiques i s'estableix la necessitat d'optimitzaci o. Tamb e es posa de manifest la import ancia del funcionament conjunt entre esquemes ICIC est atics i altres funcionalitats de la xarxa radio, tals com la informaci o que envien els usuaris sobre l'estat del seu canal downlink (feedback del CSI, de l'angl es Channel State Information). D'aquesta manera, s'han proposat diferents esquemes de feedback apropiats per treballar conjuntament amb SFR i FFR. Aquests mecanismes exploten el patr o d'assignaci o de recursos que s'utilitza en ICIC est atic per millorar la precisi o del proc es. La segona part se centra en l'optimitzaci o de SFR i FFR. S'ha investigat l' us de t ecniques multiobjectiu com a eina per aconseguir una optimitzaci o e ca c, que es espec ca per a cada xarxa. L'enfocament ofereix avantatges interessants, d'una banda, es permet l'optimitzaci o simult ania de diversos criteris contradictoris. D'altra banda, la naturalesa multiobjectiu implica obtenir com resultat con guracions de xarxa d'elevada qualitat (Pareto e cients), totes elles amb un equilibri gaireb e optim entre les diferents m etriques de rendiment. Els algorismes evolucionaris multiobjectiu permeten la utilitzaci o d'estructures matem atiques complexes sense necessitat de relaxar el problema, d'aquesta manera capturen adequadament el seu comportament en termes de ICI. La formulaci o multiobjectiu aconsegueix un ajust efectiu dels par ametres operacionals de SFR i FFR, tant a nivell de cel la com a nivell de xarxa. A m es, la recerca s'est en amb resultats satisfactoris als canals de control, PDCCH i ePDCCH. Finalment, en un esfor c per millorar l'e ci encia energ etica de la xarxa (un aspecte sempre considerat al llarg de la tesi), s'introdueix en l'an alisi global l'apagat intel ligent de cel les, estrat egia amb estrets vincles amb ICIC. Mitjan cant el m etode proposat, s'obtenen millores signi catives pel que fa als enfocaments tradicionals i propostes pr evies. Els guanys s'obtenen en termes de consum energ etic, capacitat de la xarxa, i rendiment en el l mit de les cel les

A Comparative Study of Resource Allocation Schemes in Heterogeneous Cellular Networks on the Downlink

Network densification through heterogeneous networks (HetNets) is considered as a promising paradigm to address the ever increasing mobile users’ data demands in 5G networks. A HetNet consists of macro cells (each with a macro base station) overlaid with a number of small cells (each with a low-power base station) and has been shown to significantly improve the network capacity when supported by carefully designed radio resource management (RRM) techniques. RRM is typically studied via a joint optimisation problem over three network processes, namely, resource allocation (RA), user association (UA) and user scheduling (US), and is the focus of this thesis. Our first objective is to characterise the optimal HetNet performance by jointly optimising these three processes through a unified framework under different channel deployment scenarios. Towards this, we focus on two RA schemes, namely, partially shared deployment (PSD) and co-channel deployment with almost blank subframes (ABS), proposed by 3GPP for future HetNets. In the first part of the thesis, we revisit a unified optimisation framework under PSD that allows us to configure the network parameters (e.g., number of channels per-cell and power per-channel) and allocate optimal throughputs to users in a fair manner. The framework under consideration is based on a snapshot model where, in each snapshot, the number of users and channel gains are assumed to be fixed and known. Although the previous study on this framework provides many interesting engineering insights, it is primarily based on two wrong assumptions in terms of channel modelling and US which we correct in our work. We also revisit a similar framework but under ABS and conduct a thorough comparative study between ABS and PSD. We first show that the U+03B1-fair scheduling problem under ABS is generally much more involved than that under PSD for U+03B1 U+2260 1. To verify whether the US complexities involved from deploying ABS are justifiable, we compare the throughput performance of the two schemes under a static setting, where the number of users in each snapshot is assumed to be fixed. Our results indicate that PSD outperforms ABS for different choices of U+03B1-fair and under different HetNet configurations. In the second part of the thesis, we further study our frameworks under a dynamic setting and continue our comparisons between the two RA schemes under different service-time models. The dynamic setting, as well as reaffirming the upper-hand of PSD, provides a number of new insights, most importantly the fact that the conventional physical-layer based UA schemes do not always work well. Motivated by this observation, we further explore the problem of UA under PSD with the objective of improving an existing online UA scheme. We show that when users are periodically triggered to re-associate (on an individual basis), the online UA scheme can significantly improve the system performance

Sustainable scheduling policies for radio access networks based on LTE technology

A thesis submitted to the University of Bedfordshire in partial fulfilment of the requirements for the degree of Doctor of PhilosophyIn the LTE access networks, the Radio Resource Management (RRM) is one of the most important modules which is responsible for handling the overall management of radio resources. The packet scheduler is a particular sub-module which assigns the existing radio resources to each user in order to deliver the requested services in the most efficient manner. Data packets are scheduled dynamically at every Transmission Time Interval (TTI), a time window used to take the user’s requests and to respond them accordingly. The scheduling procedure is conducted by using scheduling rules which select different users to be scheduled at each TTI based on some priority metrics. Various scheduling rules exist and they behave differently by balancing the scheduler performance in the direction imposed by one of the following objectives: increasing the system throughput, maintaining the user fairness, respecting the Guaranteed Bit Rate (GBR), Head of Line (HoL) packet delay, packet loss rate and queue stability requirements. Most of the static scheduling rules follow the sequential multi-objective optimization in the sense that when the first targeted objective is satisfied, then other objectives can be prioritized. When the targeted scheduling objective(s) can be satisfied at each TTI, the LTE scheduler is considered to be optimal or feasible. So, the scheduling performance depends on the exploited rule being focused on particular objectives. This study aims to increase the percentage of feasible TTIs for a given downlink transmission by applying a mixture of scheduling rules instead of using one discipline adopted across the entire scheduling session. Two types of optimization problems are proposed in this sense: Dynamic Scheduling Rule based Sequential Multi-Objective Optimization (DSR-SMOO) when the applied scheduling rules address the same objective and Dynamic Scheduling Rule based Concurrent Multi-Objective Optimization (DSR-CMOO) if the pool of rules addresses different scheduling objectives. The best way of solving such complex optimization problems is to adapt and to refine scheduling policies which are able to call different rules at each TTI based on the best matching scheduler conditions (states). The idea is to develop a set of non-linear functions which maps the scheduler state at each TTI in optimal distribution probabilities of selecting the best scheduling rule. Due to the multi-dimensional and continuous characteristics of the scheduler state space, the scheduling functions should be approximated. Moreover, the function approximations are learned through the interaction with the RRM environment. The Reinforcement Learning (RL) algorithms are used in this sense in order to evaluate and to refine the scheduling policies for the considered DSR-SMOO/CMOO optimization problems. The neural networks are used to train the non-linear mapping functions based on the interaction among the intelligent controller, the LTE packet scheduler and the RRM environment. In order to enhance the convergence in the feasible state and to reduce the scheduler state space dimension, meta-heuristic approaches are used for the channel statement aggregation. Simulation results show that the proposed aggregation scheme is able to outperform other heuristic methods. When the aggregation scheme of the channel statements is exploited, the proposed DSR-SMOO/CMOO problems focusing on different objectives which are solved by using various RL approaches are able to: increase the mean percentage of feasible TTIs, minimize the number of TTIs when the RL approaches punish the actions taken TTI-by-TTI, and minimize the variation of the performance indicators when different simulations are launched in parallel. This way, the obtained scheduling policies being focused on the multi-objective criteria are sustainable. Keywords: LTE, packet scheduling, scheduling rules, multi-objective optimization, reinforcement learning, channel, aggregation, scheduling policies, sustainable

Towards UAV Assisted 5G Public Safety Network

Ensuring ubiquitous mission-critical public safety communications (PSC) to all the first responders in the public safety network is crucial at an emergency site. The first responders heavily rely on mission-critical PSC to save lives, property, and national infrastructure during a natural or human-made emergency. The recent advancements in LTE/LTE-Advanced/5G mobile technologies supported by unmanned aerial vehicles (UAV) have great potential to revolutionize PSC. However, limited spectrum allocation for LTE-based PSC demands improved channel capacity and spectral efficiency. An additional challenge in designing an LTE-based PSC network is achieving at least 95% coverage of the geographical area and human population with broadband rates. The coverage requirement and efficient spectrum use in the PSC network can be realized through the dense deployment of small cells (both terrestrial and aerial). However, there are several challenges with the dense deployment of small cells in an air-ground heterogeneous network (AG-HetNet). The main challenges which are addressed in this research work are integrating UAVs as both aerial user and aerial base-stations, mitigating inter-cell interference, capacity and coverage enhancements, and optimizing deployment locations of aerial base-stations. First, LTE signals were investigated using NS-3 simulation and software-defined radio experiment to gain knowledge on the quality of service experienced by the user equipment (UE). Using this understanding, a two-tier LTE-Advanced AG-HetNet with macro base-stations and unmanned aerial base-stations (UABS) is designed, while considering time-domain inter-cell interference coordination techniques. We maximize the capacity of this AG-HetNet in case of a damaged PSC infrastructure by jointly optimizing the inter-cell interference parameters and UABS locations using a meta-heuristic genetic algorithm (GA) and the brute-force technique. Finally, considering the latest specifications in 3GPP, a more realistic three-tier LTE-Advanced AG-HetNet is proposed with macro base-stations, pico base-stations, and ground UEs as terrestrial nodes and UABS and aerial UEs as aerial nodes. Using meta-heuristic techniques such as GA and elitist harmony search algorithm based on the GA, the critical network elements such as energy efficiency, inter-cell interference parameters, and UABS locations are all jointly optimized to maximize the capacity and coverage of the AG-HetNet