A survey of machine learning techniques applied to self organizing cellular networks

In this paper, a survey of the literature of the past fifteen years involving Machine Learning (ML) algorithms applied to self organizing cellular networks is performed. In order for future networks to overcome the current limitations and address the issues of current cellular systems, it is clear that more intelligence needs to be deployed, so that a fully autonomous and flexible network can be enabled. This paper focuses on the learning perspective of Self Organizing Networks (SON) solutions and provides, not only an overview of the most common ML techniques encountered in cellular networks, but also manages to classify each paper in terms of its learning solution, while also giving some examples. The authors also classify each paper in terms of its self-organizing use-case and discuss how each proposed solution performed. In addition, a comparison between the most commonly found ML algorithms in terms of certain SON metrics is performed and general guidelines on when to choose each ML algorithm for each SON function are proposed. Lastly, this work also provides future research directions and new paradigms that the use of more robust and intelligent algorithms, together with data gathered by operators, can bring to the cellular networks domain and fully enable the concept of SON in the near future

SymbioCity: Smart Cities for Smarter Networks

The "Smart City" (SC) concept revolves around the idea of embodying cutting-edge ICT solutions in the very fabric of future cities, in order to offer new and better services to citizens while lowering the city management costs, both in monetary, social, and environmental terms. In this framework, communication technologies are perceived as subservient to the SC services, providing the means to collect and process the data needed to make the services function. In this paper, we propose a new vision in which technology and SC services are designed to take advantage of each other in a symbiotic manner. According to this new paradigm, which we call "SymbioCity", SC services can indeed be exploited to improve the performance of the same communication systems that provide them with data. Suggestive examples of this symbiotic ecosystem are discussed in the paper. The dissertation is then substantiated in a proof-of-concept case study, where we show how the traffic monitoring service provided by the London Smart City initiative can be used to predict the density of users in a certain zone and optimize the cellular service in that area.Comment: 14 pages, submitted for publication to ETT Transactions on Emerging Telecommunications Technologie

Coordinating Coupled Self-Organized Network Functions in Cellular Radio Networks

Nutzer der Mobilfunknetze wünschen und fordern eine Steigerung des Datendurchsatzes, die zur Erhöhung der Netzlast führt. Besonders seit der Einführung von LTE erhöht sich daher die Anzahl und Dichte der Zellen in Mobilfunknetzen. Dies führt zusätzlich zur Zunahme der Investitions- und Betriebskosten, sowie einer höheren Komplexität des Nerzbetriebs. Der Einsatz selbstorganisierter Netze (SONs) wird vorgeschlagen, um diese drei Herausforderungen zu bewältigen. Einige SON-Funktionen (SF) wurden sowohl von Seiten der Netzbetreiber als auch von den Standardisierungsgremien vorgeschlagen. Eine SF repräsentiert hierbei eine Netzfunktion, die automatisiert werden kann. Ein Beispiel ist die Optimierung der Robustheit des Netzes (Mobility Robustness Optimization, MRO) oder der Lastausgleich zwischen Funkzellen (Mobility Load Balancing, MLB). Die unterschiedlichen SON-Funktionen werden innerhalb eines Mobilfunknetzes eingesetzt, wobei sie dabei häufig gleiche oder voneinander abhängige Parameter optimieren. Zwangsläufig treten daher beim Einsatz paralleler SON-Funktionen Konflikte auf, die Mechanismen erfordern, um diese Konflikte aufzulösen oder zu minimieren. In dieser Dissertation werden Lösungen aufgezeigt und untersucht, um die Koordination der SON-Funktionen zu automatisieren und, soweit möglich, gleichmä{\ss}ig zu verteilen. Im ersten Teil werden grundsätzliche Entwürfe für SFs evaluiert, um die SON-Koordination zu vereinfachen. Basierend auf der Beobachtung, dass die Steurung der SON-Funktion sich ähnlich dem generischen Q-Learning Problem verhält, werden die SFs als Q-Learning-Agenten entworfen. Dieser Ansatz wurde mit sehr positiven Ergebnissen auf zwei SFs (MRO und MLB) angewandt. Die als Q-Learning-Agenten entworfenen SFs werden für zwei unterschiedliche Ansätze der SON-Koordination evaluiert. Beide Koordinierungsansätze betrachten dabei die SON-Umgebung als ein Multi-Agenten-System. Der erste Ansatz basierend auf einer räumlich-zeitlichen Entkoppelung separiert die Ausführung von SF-Instanzen sowohl räumlich als auch zeitlich, um die Konflikte zwischen den SF-Instanzen zu minimieren. Der zweite Ansatz wendet kooperatives Lernen in Multi-Agenten-Systemen als automatisierten Lösungsansatz zur SON-Koordination an. Die einzelnen SF-Instanzen lernen anhand von Utility-Werten, die sowohl die eigenen Metriken als auch die Metriken der Peer-SF-Instanzen auswerten. Die Intention dabei ist, durch die erlernte Zustands-Aktions-Strategie Aktionen auszuführen, die das beste Resultat für die aktive SF, aber auch die geringste Auswirkung auf Peer-SFs gewährleisten. In der Evaluation des MRO-MLB-Konflikts zeigten beide Koordinierungsansätze sehr gute Resultate.Owing to increase in desired user throughput and to the subsequent increase in network traffic, the number and density of cells in cellular networks have increased, especially starting with LTE. This directly translates into higher capital and operational expenses as well as increased complexity of network operation. To counter all three challenges, Self-Organized Networks (SON) have been proposed. A number of SON Functions (SFs) have been defined both from the network operator community as well as from the standardization bodies. In this respect, a SF represents a network function that can be automated e.g. Mobility Robustness Optimization (MRO) or Mobility Load balancing (MLB). The different SFs operate on the same radio network, in many cases adjusting the same or related parameters. Conflicts are as such bound to occur during the parallel operation of such SFs and mechanisms are required to resolve or minimize the conflicts. This thesis studies the solutions through which SON functions can be coordinated in an automated and preferably distributed manner. In the first part we evaluate the design principles of SFs that aim at easing the coordination. With the observation that the SON control loop is similar to a generic Q-learning problem, we propose designing SFs as Q-learning agents. This framework is applied to two SFs (MRO and MLB) with very positive results. Given the designed QL based SFs, we then evaluate two SON coordination approaches that consider the SON environment as a Multi-Agent System (MAS). The first approach based on Spatial-Temporal Decoupling (STD) separates the execution of SF instances in space and time so as to minimize the conflicts among instances. The second approach applies multi-agent cooperative learning for an automated solution towards SON coordination. In this case individual SF instances learn based on utilities that aggregate their own metrics as well as the metrics of peer SF instances. The intention in this case is to ensure that the learned state-action policy functions apply actions that guarantee the best result for the active SF but also have the least effect on the peer SFs. Both coordination approaches have been evaluated with very positive results in simulations that consider the MRO - MLB conflict

A survey of self organisation in future cellular networks

This article surveys the literature over the period of the last decade on the emerging field of self organisation as applied to wireless cellular communication networks. Self organisation has been extensively studied and applied in adhoc networks, wireless sensor networks and autonomic computer networks; however in the context of wireless cellular networks, this is the first attempt to put in perspective the various efforts in form of a tutorial/survey. We provide a comprehensive survey of the existing literature, projects and standards in self organising cellular networks. Additionally, we also aim to present a clear understanding of this active research area, identifying a clear taxonomy and guidelines for design of self organising mechanisms. We compare strength and weakness of existing solutions and highlight the key research areas for further development. This paper serves as a guide and a starting point for anyone willing to delve into research on self organisation in wireless cellular communication networks

Benefits and limits of machine learning for the implicit coordination on SON functions

Bedingt durch die Einführung neuer Netzfunktionen in den Mobilfunknetzen der nächsten Generation, z. B. Slicing oder Mehrantennensysteme, sowie durch die Koexistenz mehrerer Funkzugangstechnologien, werden die Optimierungsaufgaben äußerst komplex und erhöhen die OPEX (OPerational EXpenditures). Um den Nutzern Dienste mit wettbewerbsfähiger Dienstgüte (QoS) zu bieten und gleichzeitig die Betriebskosten niedrig zu halten, wurde von den Standardisierungsgremien das Konzept des selbstorganisierenden Netzes (SON) eingeführt, um das Netzmanagement um eine Automatisierungsebene zu erweitern. Es wurden dafür mehrere SON-Funktionen (SFs) vorgeschlagen, um einen bestimmten Netzbereich, wie Abdeckung oder Kapazität, zu optimieren. Bei dem konventionellen Entwurf der SFs wurde jede Funktion als Regler mit geschlossenem Regelkreis konzipiert, der ein lokales Ziel durch die Einstellung bestimmter Netzwerkparameter optimiert. Die Beziehung zwischen mehreren SFs wurde dabei jedoch bis zu einem gewissen Grad vernachlässigt. Daher treten viele widersprüchliche Szenarien auf, wenn mehrere SFs in einem mobilen Netzwerk instanziiert werden. Solche widersprüchlichen Funktionen in den Netzen verschlechtern die QoS der Benutzer und beeinträchtigen die Signalisierungsressourcen im Netz. Es wird daher erwartet, dass eine existierende Koordinierungsschicht (die auch eine Entität im Netz sein könnte) die Konflikte zwischen SFs lösen kann. Da diese Funktionen jedoch eng miteinander verknüpft sind, ist es schwierig, ihre Interaktionen und Abhängigkeiten in einer abgeschlossenen Form zu modellieren. Daher wird maschinelles Lernen vorgeschlagen, um eine gemeinsame Optimierung eines globalen Leistungsindikators (Key Performance Indicator, KPI) so voranzubringen, dass die komplizierten Beziehungen zwischen den Funktionen verborgen bleiben. Wir nennen diesen Ansatz: implizite Koordination. Im ersten Teil dieser Arbeit schlagen wir eine zentralisierte, implizite und auf maschinellem Lernen basierende Koordination vor und wenden sie auf die Koordination zweier etablierter SFs an: Mobility Robustness Optimization (MRO) und Mobility Load Balancing (MLB). Anschließend gestalten wir die Lösung dateneffizienter (d. h. wir erreichen die gleiche Modellleistung mit weniger Trainingsdaten), indem wir eine geschlossene Modellierung einbetten, um einen Teil des optimalen Parametersatzes zu finden. Wir nennen dies einen "hybriden Ansatz". Mit dem hybriden Ansatz untersuchen wir den Konflikt zwischen MLB und Coverage and Capacity Optimization (CCO) Funktionen. Dann wenden wir ihn auf die Koordinierung zwischen MLB, Inter-Cell Interference Coordination (ICIC) und Energy Savings (ES) Funktionen an. Schließlich stellen wir eine Möglichkeit vor, MRO formal in den hybriden Ansatz einzubeziehen, und zeigen, wie der Rahmen erweitert werden kann, um anspruchsvolle Netzwerkszenarien wie Ultra-Reliable Low Latency Communications (URLLC) abzudecken.Due to the introduction of new network functionalities in next-generation mobile networks, e.g., slicing or multi-antenna systems, as well as the coexistence of multiple radio access technologies, the optimization tasks become extremely complex, increasing the OPEX (OPerational EXpenditures). In order to provide services to the users with competitive Quality of Service (QoS) while keeping low operational costs, the Self-Organizing Network (SON) concept was introduced by the standardization bodies to add an automation layer to the network management. Thus, multiple SON functions (SFs) were proposed to optimize a specific network domain, like coverage or capacity. The conventional design of SFs conceived each function as a closed-loop controller optimizing a local objective by tuning specific network parameters. However, the relationship among multiple SFs was neglected to some extent. Therefore, many conflicting scenarios appear when multiple SFs are instantiated in a mobile network. Having conflicting functions in the networks deteriorates the users’ QoS and affects the signaling resources in the network. Thus, it is expected to have a coordination layer (which could also be an entity in the network), conciliating the conflicts between SFs. Nevertheless, due to interleaved linkage among those functions, it is complex to model their interactions and dependencies in a closed form. Thus, machine learning is proposed to drive a joint optimization of a global Key Performance Indicator (KPI), hiding the intricate relationships between functions. We call this approach: implicit coordination. In the first part of this thesis, we propose a centralized, fully-implicit coordination approach based on machine learning (ML), and apply it to the coordination of two well-established SFs: Mobility Robustness Optimization (MRO) and Mobility Load Balancing (MLB). We find that this approach can be applied as long as the coordination problem is decomposed into three functional planes: controllable, environmental, and utility planes. However, the fully-implicit coordination comes at a high cost: it requires a large amount of data to train the ML models. To improve the data efficiency of our approach (i.e., achieving good model performance with less training data), we propose a hybrid approach, which mixes ML with closed-form models. With the hybrid approach, we study the conflict between MLB and Coverage and Capacity Optimization (CCO) functions. Then, we apply it to the coordination among MLB, Inter-Cell Interference Coordination (ICIC), and Energy Savings (ES) functions. With the hybrid approach, we find in one shot, part of the parameter set in an optimal manner, which makes it suitable for dynamic scenarios in which fast response is expected from a centralized coordinator. Finally, we present a manner to formally include MRO in the hybrid approach and show how the framework can be extended to cover challenging network scenarios like Ultra-Reliable Low Latency Communications (URLLC)

User Association in 5G Networks: A Survey and an Outlook

26 pages; accepted to appear in IEEE Communications Surveys and Tutorial

Optimization of Mobility Parameters using Fuzzy Logic and Reinforcement Learning in Self-Organizing Networks

In this thesis, several optimization techniques for next-generation wireless networks are proposed to solve different problems in the field of Self-Organizing Networks and heterogeneous networks. The common basis of these problems is that network parameters are automatically tuned to deal with the specific problem. As the set of network parameters is extremely large, this work mainly focuses on parameters involved in mobility management. In addition, the proposed self-tuning schemes are based on Fuzzy Logic Controllers (FLC), whose potential lies in the capability to express the knowledge in a similar way to the human perception and reasoning. In addition, in those cases in which a mathematical approach has been required to optimize the behavior of the FLC, the selected solution has been Reinforcement Learning, since this methodology is especially appropriate for learning from interaction, which becomes essential in complex systems such as wireless networks. Taking this into account, firstly, a new Mobility Load Balancing (MLB) scheme is proposed to solve persistent congestion problems in next-generation wireless networks, in particular, due to an uneven spatial traffic distribution, which typically leads to an inefficient usage of resources. A key feature of the proposed algorithm is that not only the parameters are optimized, but also the parameter tuning strategy. Secondly, a novel MLB algorithm for enterprise femtocells scenarios is proposed. Such scenarios are characterized by the lack of a thorough deployment of these low-cost nodes, meaning that a more efficient use of radio resources can be achieved by applying effective MLB schemes. As in the previous problem, the optimization of the self-tuning process is also studied in this case. Thirdly, a new self-tuning algorithm for Mobility Robustness Optimization (MRO) is proposed. This study includes the impact of context factors such as the system load and user speed, as well as a proposal for coordination between the designed MLB and MRO functions. Fourthly, a novel self-tuning algorithm for Traffic Steering (TS) in heterogeneous networks is proposed. The main features of the proposed algorithm are the flexibility to support different operator policies and the adaptation capability to network variations. Finally, with the aim of validating the proposed techniques, a dynamic system-level simulator for Long-Term Evolution (LTE) networks has been designed