A survey of machine learning techniques applied to self organizing cellular networks

In this paper, a survey of the literature of the past fifteen years involving Machine Learning (ML) algorithms applied to self organizing cellular networks is performed. In order for future networks to overcome the current limitations and address the issues of current cellular systems, it is clear that more intelligence needs to be deployed, so that a fully autonomous and flexible network can be enabled. This paper focuses on the learning perspective of Self Organizing Networks (SON) solutions and provides, not only an overview of the most common ML techniques encountered in cellular networks, but also manages to classify each paper in terms of its learning solution, while also giving some examples. The authors also classify each paper in terms of its self-organizing use-case and discuss how each proposed solution performed. In addition, a comparison between the most commonly found ML algorithms in terms of certain SON metrics is performed and general guidelines on when to choose each ML algorithm for each SON function are proposed. Lastly, this work also provides future research directions and new paradigms that the use of more robust and intelligent algorithms, together with data gathered by operators, can bring to the cellular networks domain and fully enable the concept of SON in the near future

Detection and compensation methods for self-healing in self-organizing networks

Uno de los elementos clave en la definición de los recientes estándares de comunicaciones móviles del 3rd Generation Partnership Project (3GPP), LTE (Long Term Evolution) y LTEAdvanced, es la consideración de funciones que se puedan ejecutar de manera automática. Este tipo de redes se conocen como redes Auto-Organizadas (Self-Organizing Networks, SON). Las funciones SON permiten hacer frente al importante incremento en tamaño y complejidad que han experimentado las redes de comunicaciones móviles en los últimos años. El número de usuarios es cada vez mayor y los servicios requieren gran cantidad de recursos y altas tasas de transmisión por lo que la gestión de estas redes se está convirtiendo en una tarea cada vez más compleja. Además, cuando las redes de quinta generación (5G) se implanten, la complejidad y el coste asociado a estas nuevas redes será todavía mayor. En este contexto, las funciones SON resultan imprescindibles para llevar a cabo la gestión de estas redes tan complejas. El objetivo de SON es definir un conjunto de funcionalidades que permitan automatizar la gestión de las redes móviles. Mediante la automatización de las tareas de gestión y optimización es posible reducir los gastos de operación y capital (OPEX y CAPEX). Las funciones SON se clasifican en tres grupos: Auto- Configuración, Auto-Optimización y Auto-Curación. Las funciones de Auto-Configuración tienen como objetivo la definición de los distintos parámetros de configuración durante la fase de planificación de una red o después de la introducción de un nuevo elemento en una red ya desplegada. Las funciones de Auto-Optimización pretenden modificar los parámetros de configuración de una red para maximizar el rendimiento de la misma y adaptarse a distintos escenarios. Las funciones de Auto- Curación tienen como objetivo detectar y diagnosticar posibles fallos en la red que afecten al funcionamiento de la misma de manera automática. Cuando un fallo es detectado en una celda este puede ser recuperado (función de recuperación) o compensado (función de compensación). Uno de los principales desafíos relacionado con las funciones SON es el desarrollo de métodos eficientes para la automatización de las tareas de optimización y mantenimiento de una red móvil. En este sentido, la comunidad científica ha centrado su interés en la definición de métodos de Auto-Configuración y Auto-Optimización siendo las funciones de Auto-Curación las menos exploradas. Por esta razón, no es fácil encontrar algoritmos de detección y compensación realmente eficientes. Muchos estudios presentan métodos de detección y compensación que producen buenos resultados pero a costa de una gran complejidad. Además, en muchos casos, los algoritmos de detección y compensación se presentan como solución general para distintos tipos de fallo lo que hace que disminuya la efectividad. Por otro lado, la investigación ha estado tradicionalmente enfocada a la búsqueda de soluciones SON basadas en modelos analíticos o simulados. Sin embargo, el principal desafío ahora está relacionado con la explotación de datos reales disponibles con el objetivo de crear una base del conocimiento útil que maximice el funcionamiento de las actuales soluciones SON. Esto es especialmente interesante en el área de las funciones de Auto-Curación. En este contexto, la disponibilidad de un histórico de datos es crucial para entender cómo funciona la red en condiciones normales o cuando se producen fallos y como estos fallos afectan a la calidad de servicio experimentada por los usuarios. El principal objetivo de esta tesis es el desarrollo de algoritmos eficientes de detección y compensación de fallos en redes móviles. En primer lugar, se propone un método de detección de celdas caídas basado en estadísticas de traspasos. Una de las principales características de este algoritmo es que su simplicidad permite detectar celdas caídas en cualquier red inmediatamente después de acceder a los indicadores de funcionamiento de la misma. En segundo lugar, una parte importante de la tesis está centrada en la función de compensación. Por un lado, se propone una novedosa metodología de compensación de celdas caídas. Este nuevo método permite adaptar la compensación a la degradación específica provocada por la celda caída. Una vez que se detecta un problema de celda caída, se realiza un análisis de la degradación producida por este fallo en las celdas vecinas. A continuación, diferentes algoritmos de compensación se aplican a las distintas celdas vecinas en función del tipo de degradación detectado. En esta tesis se ha llevado a cabo un estudio de esta fase de análisis utilizando datos de una red real actualmente en uso. Por otro lado, en esta tesis también se propone un método de compensación que considera un fallo diferente al de celda caída. En concreto, se propone un método de compensación para un fallo de cobertura débil basado en modificaciones del margen de traspaso. Por último, aunque es interesante evaluar los métodos propuestos en redes reales, no siempre es posible. Los operadores suelen ser reacios a probar métodos que impliquen cambios en los parámetros de configuración de los elementos de la red. Por esta razón, una parte de esta tesis ha estado centrada en la implementación de un simulador dinámico de nivel de sistema que permita la evaluación de los métodos propuestos

A New Paradigm for Proactive Self-Healing in Future Self-Organizing Mobile Cellular Networks

Mobile cellular network operators spend nearly a quarter of their revenue on network management and maintenance. Remarkably, a significant proportion of that budget is spent on resolving outages that degrade or disrupt cellular services. Historically, operators have mainly relied on human expertise to identify, diagnose and resolve such outages while also compensating for them in the short-term. However, with ambitious quality of experience expectations from 5th generation and beyond mobile cellular networks spurring research towards technologies such as ultra-dense heterogeneous networks and millimeter wave spectrum utilization, discovering and compensating coverage lapses in future networks will be a major challenge. Numerous studies have explored heuristic, analytical and machine learning-based solutions to autonomously detect, diagnose and compensate cell outages in legacy mobile cellular networks, a branch of research known as self-healing. This dissertation focuses on self-healing techniques for future mobile cellular networks, with special focus on outage detection and avoidance components of self-healing. Network outages can be classified into two primary types: 1) full and 2) partial. Full outages result from failed soft or hard components of network entities while partial outages are generally a consequence of parametric misconfiguration. To this end, chapter 2 of this dissertation is dedicated to a detailed survey of research on detecting, diagnosing and compensating full outages as well as a detailed analysis of studies on proactive outage avoidance schemes and their challenges. A key observation from the analysis of the state-of-the-art outage detection techniques is their dependence on full network coverage data, susceptibility to noise or randomness in the data and inability to characterize outages in both spacial domain and temporal domain. To overcome these limitations, chapters 3 and 4 present two unique and novel outage detection techniques. Chapter 3 presents an outage detection technique based on entropy field decomposition which combines information field theory and entropy spectrum pathways theory and is robust to noise variance. Chapter 4 presents a deep learning neural network algorithm which is robust to data sparsity and compares it with entropy field decomposition and other state-of-the-art machine learning-based outage detection algorithms including support vector machines, K-means clustering, independent component analysis and deep auto-encoders. Based on the insights obtained regarding the impact of partial outages, chapter 5 presents a complete framework for 5th generation and beyond mobile cellular networks that is designed to avoid partial outages caused by parametric misconfiguration. The power of the proposed framework is demonstrated by leveraging it to design a solution that tackles one of the most common problems associated with ultra-dense heterogeneous networks, namely imbalanced load among small and macro cells, and poor resource utilization as a consequence. The optimization problem is formulated as a function of two hard parameters namely antenna tilt and transmit power, and a soft parameter, cell individual offset, that affect the coverage, capacity and load directly. The resulting solution is a combination of the otherwise conflicting coverage and capacity optimization and load balancing self-organizing network functions

Context-Aware Self-Healing for Small Cell Networks

These can be an invaluable source of information for the management of the network, in a way that we have denominated as context-aware SON, which is the approach proposed in this thesis. To develop this concept, the thesis follows a top-down approach. Firstly, the characteristics of the cellular deployments are assessed, especially for indoor small cell networks. In those scenarios, the need for context-aware SON is evaluated and considered indispensable. Secondly, a new cellular architecture is defined to integrate both context information and SON mechanisms in the management plane of the mobile network. Thus, the specifics of making context an integral part of cellular OAM/SON are defined. Also, the real-world implementation of the architecture is proposed. Thirdly, from the established general SON architecture, a logical self-healing framework is defined to support the context-aware healing mechanisms to be developed. Fourthly, different self-healing algorithms are defined depending on the failures to be managed and the conditions of the considered scenario. The mechanisms are based on probabilistic analysis, making use of both context and network data for detection and diagnosis of cellular issues. The conditions for the implementation of these methods are assessed. Their applicability is evaluated by means of simulators and testbed trials. The results show important improvements in performance and capabilities in comparison to previous methods, demonstrating the relevance of the proposed approach.The last years have seen a continuous increase in the use of mobile communications. To cope with the growing traffic, recently deployed technologies have deepened the adoption of small cells (low powered base stations) to serve areas with high demand or coverage issues, where macrocells can be both unsuccessful or inefficient. Also, new cellular and non-cellular technologies (e.g. WiFi) coexist with legacy ones, including also multiple deployment schemes (macrocell, small cells), in what is known as heterogeneous networks (HetNets). Due to the huge complexity of HetNets, their operation, administration and management (OAM) became increasingly difficult. To overcome this, the NGMN Alliance and the 3GPP defined the Self-Organizing Network (SON) paradigm, aiming to automate the OAM procedures to reduce their costs and increase the resulting performance. One key focus of SON is the self-healing of the network, covering the automatic detection of problems, the diagnosis of their causes, their compensation and their recovery. Until recently, SON mechanisms have been solely based on the analysis of alarms and performance indicators. However, on the one hand, this approach has become very limited given the complexity of the scenarios, and particularly in indoor cellular environments. Here, the deployment of small cells, their coexistence with multiple telecommunications systems and the nature of those environments (in terms of propagation, coverage overlapping, fast demand changes and users' mobility) introduce many challenges for classic SON. On the other hand, modern user equipment (e.g. smartphones), equipped with powerful processors, sensors and applications, generate a huge amount of context information. Context refers to those variables not directly associated with the telecommunication service, but with the terminals and their environment. This includes the user's position, applications, social data, etc

Optimization of Mobility Parameters using Fuzzy Logic and Reinforcement Learning in Self-Organizing Networks

In this thesis, several optimization techniques for next-generation wireless networks are proposed to solve different problems in the field of Self-Organizing Networks and heterogeneous networks. The common basis of these problems is that network parameters are automatically tuned to deal with the specific problem. As the set of network parameters is extremely large, this work mainly focuses on parameters involved in mobility management. In addition, the proposed self-tuning schemes are based on Fuzzy Logic Controllers (FLC), whose potential lies in the capability to express the knowledge in a similar way to the human perception and reasoning. In addition, in those cases in which a mathematical approach has been required to optimize the behavior of the FLC, the selected solution has been Reinforcement Learning, since this methodology is especially appropriate for learning from interaction, which becomes essential in complex systems such as wireless networks. Taking this into account, firstly, a new Mobility Load Balancing (MLB) scheme is proposed to solve persistent congestion problems in next-generation wireless networks, in particular, due to an uneven spatial traffic distribution, which typically leads to an inefficient usage of resources. A key feature of the proposed algorithm is that not only the parameters are optimized, but also the parameter tuning strategy. Secondly, a novel MLB algorithm for enterprise femtocells scenarios is proposed. Such scenarios are characterized by the lack of a thorough deployment of these low-cost nodes, meaning that a more efficient use of radio resources can be achieved by applying effective MLB schemes. As in the previous problem, the optimization of the self-tuning process is also studied in this case. Thirdly, a new self-tuning algorithm for Mobility Robustness Optimization (MRO) is proposed. This study includes the impact of context factors such as the system load and user speed, as well as a proposal for coordination between the designed MLB and MRO functions. Fourthly, a novel self-tuning algorithm for Traffic Steering (TS) in heterogeneous networks is proposed. The main features of the proposed algorithm are the flexibility to support different operator policies and the adaptation capability to network variations. Finally, with the aim of validating the proposed techniques, a dynamic system-level simulator for Long-Term Evolution (LTE) networks has been designed

Methods for Self-Healing based on traces and unsupervised learning in Self-Organizing Networks

With the advent of Long-Term Evolution (LTE) networks and the spread of a highly varied range of services, mobile operators are increasingly aware of the need to strengthen their maintenance and operational tasks in order to ensure a quality and positive user experience. Furthermore, the co- existence of multiple Radio Access Technologies (RAT), the increase in the traffic demand and the need to provide a great variety of services are steering the cellular network toward a new scenario where management tasks are becoming increasingly complex. As a result, mobile operators are focusing their efforts to deal with the maintenance of their networks without increasing either operational expenditures (OPEX) or capital expenditures (CAPEX). In this context, it is becoming necessary to effectively automate the management tasks through the concept of the Self-Organizing Networks (SON). In particular, SON functions cover three different areas: Self-Configuration, Self-Optimization and Self- Healing. Self-Configuration automates the deployment of new network elements and their parameter configuration. Self-Optimization is in charge of modifying the configuration of the parameters in order to enhance user experience. Finally, Self-Healing aims reduce the impact that failures and services degradation have on the end-user. To that end, Self-Healing (SH) systems monitor the network elements through several alarms, measurements and indicators in order to detect outage and degraded cells, then, diagnose the cause of their problem and, finally, execute the compensation or recovery actions. Even though mobile networks are become more prone to failures due to their huge increase in complexity, the automation of the troubleshooting tasks through the SH functionality has not been fully realized. Traditionally, both the research and the development of SON networks have been related to Self-Configuration and Self-Optimization. This has been mainly due to the challenges that need to be faced when SH systems are studied and implemented. This is especially relevant in the case of fault diagnosis. However, mobile operators are paying increasingly more attention to self-healing systems, which entails creating options to face those challenges that allow the development of SH functions. On the one hand, currently, the diagnosis continues to be manually done since it requires considerable hard-earned experience in order to be able to effectively identify the fault cause. In particular, troubleshooting experts thoroughly analyze the performance of the degraded network elements by means of measurements and indicators in order to identify the cause of the detected anomalies and symptoms. Therefore, automating the diagnosis tasks means knowing what specific performance indicators have to be analyzed and how to map the identified symptoms with the associate fault cause. This knowledge is acquired over time and it is characterized by being operator-specific based on their policies and network features. Furthermore, troubleshooting experts typically solve the failures in a network without either documenting the troubleshooting process or recording the analyzed indicators along with the label of the identified fault cause. In addition, because there is no specific regulation on documentation, the few documented faults are neither properly defined nor described in a standard way (e.g. the same fault cause may be appointed with different labels), making it even more difficult to automate the extraction of the expert knowledge. As a result, this a lack of documentation and lack of historical reported faults makes automation of diagnosis process more challenging. On the other hand, when the exact root cause cannot be remotely identified through the statistical information gathered at cell level, drive test are scheduled for further information. These drive tests aim to monitor mobile network performance by using vehicles to personally measure the radio interface quality along a predefined route. In particular, the troubleshooting experts use specialized test equipment in order to manually collect user-level measurements. Consequently, drive test entail a hefty expense for mobile operators, since it involves considerable investment in time and costly resources (such as personal, vehicles and complex test equipment). In this context, the Third Generation Partnership Project (3GPP) has standardized the automatic collection of field measurements (e.g. signaling messages, radio measurements and location information) through the mobile traces features and its extended functionality, the Minimization of Drive Tests (MDT). In particular, those features allow to automatically monitor the network performance in detail, reaching areas that cannot be covered by drive testing (e.g. indoor or private zones). Thus, mobile traces are regarded as an important enabler for SON since they avoid operators to rely on those expensive drive tests while, at the same time, provide greater details than the traditional cell-level indicators. As a result, enhancing the SH functionalities through the mobile traces increases the potential cost savings and the granularity of the analysis. Hence, in this thesis, several solutions are proposed to overcome the limitations that prevent the development of SH with special emphasis on the diagnosis phase. To that end, the lack of historical labeled databases has been addressed in two main ways. First, unsupervised techniques have been used to automatically design diagnosis system from real data without requiring either documentation or historical reports about fault cases. Second, a group of significant faults have been modeled and implemented in a dynamic system level simulator in order to generate an artificial labeled database, which is extremely important in evaluating and comparing the proposed solutions with the state-of- the-art algorithm. Then, the diagnosis of those faults that cannot be identified through the statistical performance indicators gathered at cell level is automated by the analysis of the mobile traces avoiding the costly drive test. In particular, in this thesis, the mobile traces have been used to automatically identify the cause of each unexpected user disconnection, to geo-localize RF problems that affect the cell performance and to identify the impact of a fault depending on the availability of legacy systems (e.g. Third Generation, 3G). Finally, the proposed techniques have been validated using real and simulated LTE data by analyzing its performance and comparing it with reference mechanisms

Next-Generation Self-Organizing Networks through a Machine Learning Approach

Fecha de lectura de Tesis Doctoral: 17 Diciembre 2018.Para reducir los costes de gestión de las redes celulares, que, con el tiempo, aumentaban en complejidad, surgió el concepto de las redes autoorganizadas, o self-organizing networks (SON). Es decir, la automatización de las tareas de gestión de una red celular para disminuir los costes de infraestructura (CAPEX) y de operación (OPEX). Las tareas de las SON se dividen en tres categorías: autoconfiguración, autooptimización y autocuración. El objetivo de esta tesis es la mejora de las funciones SON a través del desarrollo y uso de herramientas de aprendizaje automático (machine learning, ML) para la gestión de la red. Por un lado, se aborda la autocuración a través de la propuesta de una novedosa herramienta para una diagnosis automática (RCA), consistente en la combinación de múltiples sistemas RCA independientes para el desarrollo de un sistema compuesto de RCA mejorado. A su vez, para aumentar la precisión de las herramientas de RCA mientras se reducen tanto el CAPEX como el OPEX, en esta tesis se proponen y evalúan herramientas de ML de reducción de dimensionalidad en combinación con herramientas de RCA. Por otro lado, en esta tesis se estudian las funcionalidades multienlace dentro de la autooptimización y se proponen técnicas para su gestión automática. En el campo de las comunicaciones mejoradas de banda ancha, se propone una herramienta para la gestión de portadoras radio, que permite la implementación de políticas del operador, mientras que, en el campo de las comunicaciones vehiculares de baja latencia, se propone un mecanismo multicamino para la redirección del tráfico a través de múltiples interfaces radio. Muchos de los métodos propuestos en esta tesis se han evaluado usando datos provenientes de redes celulares reales, lo que ha permitido demostrar su validez en entornos realistas, así como su capacidad para ser desplegados en redes móviles actuales y futuras

User mobility prediction and management using machine learning

The next generation mobile networks (NGMNs) are envisioned to overcome current user mobility limitations while improving the network performance. Some of the limitations envisioned for mobility management in the future mobile networks are: addressing the massive traffic growth bottlenecks; providing better quality and experience to end users; supporting ultra high data rates; ensuring ultra low latency, seamless handover (HOs) from one base station (BS) to another, etc. Thus, in order for future networks to manage users mobility through all of the stringent limitations mentioned, artificial intelligence (AI) is deemed to play a key role automating end-to-end process through machine learning (ML). The objectives of this thesis are to explore user mobility predictions and management use-cases using ML. First, background and literature review is presented which covers, current mobile networks overview, and ML-driven applications to enable user’s mobility and management. Followed by the use-cases of mobility prediction in dense mobile networks are analysed and optimised with the use of ML algorithms. The overall framework test accuracy of 91.17% was obtained in comparison to all other mobility prediction algorithms through artificial neural network (ANN). Furthermore, a concept of mobility prediction-based energy consumption is discussed to automate and classify user’s mobility and reduce carbon emissions under smart city transportation achieving 98.82% with k-nearest neighbour (KNN) classifier as an optimal result along with 31.83% energy savings gain. Finally, context-aware handover (HO) skipping scenario is analysed in order to improve over all quality of service (QoS) as a framework of mobility management in next generation networks (NGNs). The framework relies on passenger mobility, trains trajectory, travelling time and frequency, network load and signal ratio data in cardinal directions i.e, North, East, West, and South (NEWS) achieving optimum result of 94.51% through support vector machine (SVM) classifier. These results were fed into HO skipping techniques to analyse, coverage probability, throughput, and HO cost. This work is extended by blockchain-enabled privacy preservation mechanism to provide end-to-end secure platform throughout train passengers mobility