A survey of machine learning techniques applied to self organizing cellular networks

In this paper, a survey of the literature of the past fifteen years involving Machine Learning (ML) algorithms applied to self organizing cellular networks is performed. In order for future networks to overcome the current limitations and address the issues of current cellular systems, it is clear that more intelligence needs to be deployed, so that a fully autonomous and flexible network can be enabled. This paper focuses on the learning perspective of Self Organizing Networks (SON) solutions and provides, not only an overview of the most common ML techniques encountered in cellular networks, but also manages to classify each paper in terms of its learning solution, while also giving some examples. The authors also classify each paper in terms of its self-organizing use-case and discuss how each proposed solution performed. In addition, a comparison between the most commonly found ML algorithms in terms of certain SON metrics is performed and general guidelines on when to choose each ML algorithm for each SON function are proposed. Lastly, this work also provides future research directions and new paradigms that the use of more robust and intelligent algorithms, together with data gathered by operators, can bring to the cellular networks domain and fully enable the concept of SON in the near future

Definition and specification of connectivity and QoE/QoS management mechanisms – final report

This document summarizes the WP5 work throughout the project, describing its functional architecture and the solutions that implement the WP5 concepts on network control and orchestration. For this purpose, we defined 3 innovative controllers that embody the network slicing and multi tenancy: SDM-C, SDM-X and SDM-O. The functionalities of each block are detailed with the interfaces connecting them and validated through exemplary network processes, highlighting thus 5G NORMA innovations. All the proposed modules are designed to implement the functionality needed to provide the challenging KPIs required by future 5G networks while keeping the largest possible compatibility with the state of the art

Self-organization for 5G and beyond mobile networks using reinforcement learning

The next generations of mobile networks 5G and beyond, must overcome current networks limitations as well as improve network performance. Some of the requirements envisioned for future mobile networks are: addressing the massive growth required in coverage, capacity and traffic; providing better quality of service and experience to end users; supporting ultra high data rates and reliability; ensuring latency as low as one millisecond, among others. Thus, in order for future networks to enable all of these stringent requirements, a promising concept has emerged, self organising networks (SONs). SONs consist of making mobile networks more adaptive and autonomous and are divided in three main branches, depending on their use-cases, namely: self-configuration, self-optimisation, and self-healing. SON is a very promising and broad concept, and in order to enable it, more intelligence needs to be embedded in the mobile network. As such, one possible solution is the utilisation of machine learning (ML) algorithms. ML has many branches, such as supervised, unsupervised and Reinforcement Learning (RL), and all can be used in different SON use-cases. The objectives of this thesis are to explore different RL techniques in the context of SONs, more specifically in self-optimization use-cases. First, the use-case of user-cell association in future heterogeneous networks is analysed and optimised. This scenario considers not only Radio Access Network (RAN) constraints, but also in terms of the backhaul. Based on this, a distributed solution utilizing RL is proposed and compared with other state-of-the-art methods. Results show that the proposed RL algorithm outperforms current ones and is able to achieve better user satisfaction, while minimizing the number of users in outage. Another objective of this thesis is the evaluation of Unmanned Aerial vehicles (UAVs) to optimize cellular networks. It is envisioned that UAVs can be utilized in different SON use-cases and integrated with RL algorithms to determine their optimal 3D positions in space according to network constraints. As such, two different mobile network scenarios are analysed, one emergency and a pop-up network. The emergency scenario considers that a major natural disaster destroyed most of the ground network infrastructure and the goal is to provide coverage to the highest number of users possible using UAVs as access points. The second scenario simulates an event happening in a city and, because of the ground network congestion, network capacity needs to be enhanced by the deployment of aerial base stations. For both scenarios different types of RL algorithms are considered and their complexity and convergence are analysed. In both cases it is shown that UAVs coupled with RL are capable of solving network issues in an efficient and quick manner. Thus, due to its ability to learn from interaction with an environment and from previous experience, without knowing the dynamics of the environment, or relying on previously collected data, RL is considered as a promising solution to enable SON

Contributions to Vehicular Communications Systems and Schemes

La dernière décennie a marqué une grande hausse des applications véhiculaires comme une nouvelle source de revenus et un facteur de distinction dans l'industrie des véhicules. Ces applications véhiculaires sont classées en deux groupes : les applications de sécurité et les applications d'info divertissement. Le premier groupe inclue le changement intelligent de voie, l'avertissement de dangers de routes et la prévention coopérative de collision qui comprend la vidéo sur demande (VoD), la diffusion en direct, la diffusion de météo et de nouvelles et les jeux interactifs. Cependant, Il est à noter que d'une part, les applications véhiculaires d'info divertissement nécessitent une bande passante élevée et une latence relativement faible ; D'autre part, les applications de sécurité requièrent exigent un délai de bout en bout très bas et un canal de communication fiable pour la livraison des messages d'urgence. Pour satisfaire le besoin en applications efficaces, les fabricants de véhicules ainsi que la communauté académique ont introduit plusieurs applications à l’intérieur de véhicule et entre véhicule et véhicule (V2V). Sauf que, l'infrastructure du réseau sans fil n'a pas été conçue pour gérer les applications de véhicules, en raison de la haute mobilité des véhicules, de l'imprévisibilité du comportement des conducteurs et des modèles de trafic dynamiques. La relève est l'un des principaux défis des réseaux de véhicules, car la haute mobilité exige au réseau sans fil de faire la relève en un très court temps. De plus, l'imprévisibilité du comportement du conducteur cause l'échec des protocoles proactifs traditionnels de relève, car la prédiction du prochain routeur peut changer en fonction de la décision du conducteur. Aussi, le réseau de véhicules peut subir une mauvaise qualité de service dans les régions de relève en raison d'obstacles naturels, de véhicules de grande taille ou de mauvaises conditions météorologiques. Cette thèse se concentre sur la relève dans l'environnement des véhicules et son effet sur les applications véhiculaires. Nous proposons des solutions pratiques pour les réseaux actuellement déployés, principalement les réseaux LTE, l'infrastructure véhicule à véhicule (V2V) ainsi que les outils efficaces d’émulateurs de relèves dans les réseaux véhiculaires.----------ABSTRACT: The last decade marked the rise of vehicular applications as a new source of revenue and a key differentiator in the vehicular industry. Vehicular Applications are classified into safety and infotainment applications. The former include smart lane change, road hazard warning, and cooperative collision avoidance; however, the latter include Video on Demand (VoD), live streaming, weather and news broadcast, and interactive games. On one hand, infotainment vehicular applications require high bandwidth and relatively low latency; on the other hand, safety applications requires a very low end to end delay and a reliable communication channel to deliver emergency messages. To satisfy the thirst for practical applications, vehicle manufacturers along with research institutes introduced several in-vehicle and Vehicle to Vehicle (V2V) applications. However, the wireless network infrastructure was not designed to handle vehicular applications, due to the high mobility of vehicles, unpredictability of drivers’ behavior, and dynamic traffic patterns. Handoff is one of the main challenges of vehicular networks since the high mobility puts pressure on the wireless network to finish the handoff within a short period. Moreover, the unpredictability of driver behavior causes the traditional proactive handoff protocols to fail, since the prediction of the next router may change based on the driver’s decision. Moreover, the vehicular network may suffer from bad Quality of Service (QoS) in the regions of handoff due to natural obstacles, large vehicles, or weather conditions. This thesis focuses on the handoff on the vehicular environment and its effect on the vehicular applications. We consider practical solutions for the currently deployed networks mainly Long Term Evolution (LTE) networks, the Vehicle to Vehicle (V2V) infrastructure, and the tools that can be used effectively to emulate handoff on the vehicular networks

Network-aware video streaming for future media Internet

272 p

Enhanced mobility management mechanisms for 5G networks

Many mechanisms that served the legacy networks till now, are being identified as being grossly sub-optimal for 5G networks. The reason being, the increased complexity of the 5G networks compared previous legacy systems. One such class of mechanisms, important for any wireless standard, is the Mobility Management (MM) mechanisms. MM mechanismsensure the seamless connectivity and continuity of service for a user when it moves away from the geographic location where it initially got attached to the network. In this thesis, we firstly present a detailed state of the art on MM mechanisms. Based on the 5G requirements as well as the initial discussions on Beyond 5G networks, we provision a gap analysis for the current technologies/solutions to satisfy the presented requirements. We also define the persistent challenges that exist concerning MM mechanisms for 5G and beyond networks. Based on these challenges, we define the potential solutions and a novel framework for the 5G and beyond MM mechanisms. This framework specifies a set of MM mechanisms at the access, core and the extreme edge network (users/devices) level, that will help to satisfy the requirements for the 5G and beyond MM mechanisms. Following this, we present an on demand MM service concept. Such an on-demand feature provisions the necessary reliability, scalability and flexibility to the MM mechanisms. It's objective is to ensure that appropriate resources and mobility contexts are defined for users who will have heterogeneous mobility profiles, versatile QoS requirements in a multi-RAT network. Next, in this thesis we tackle the problem of core network signaling that occurs during MM in 5G/4G networks. A novel handover signaling mechanism has been developed, which eliminates unnecessary handshakes during the handover preparation phase, while allowing the transition to future softwarized network architectures. We also provide a handover failure aware handover preparation phase signaling process. We then utilize operator data and a realistic network deployment to perform a comparative analysis of the proposed strategy and the 3GPP handover signaling strategy on a network wide deployment scenario. We show the benefits of our strategy in terms of latency of handover process, and the transmission and processing cost incurred. Lastly, a novel user association and resource allocation methodology, namely AURA-5G, has been proposed. AURA-5G addresses scenarios wherein applications with heterogeneous requirements, i.e., enhanced Mobile Broadband (eMBB) and massive Machine Type Communications (mMTC), are present simultaneously. Consequently, a joint optimization process for performing the user association and resource allocation while being cognizant of heterogeneous application requirements, has been performed. We capture the peculiarities of this important mobility management process through the various constraints, such as backhaul requirements, dual connectivity options, available access resources, minimum rate requirements, etc., that we have imposed on a Mixed Integer Linear Program (MILP). The objective function of this established MILP problem is to maximize the total network throughput of the eMBB users, while satisfying the minimum requirements of the mMTC and eMBB users defined in a given scenario. Through numerical evaluations we show that our approach outperforms the baseline user association scenario significantly. Moreover, we have presented a system fairness analysis, as well as a novel fidelity and computational complexity analysis for the same, which express the utility of our methodology given the myriad network scenarios.Muchos mecanismos que sirvieron en las redes actuales, se están identificando como extremadamente subóptimos para las redes 5G. Esto es debido a la mayor complejidad de las redes 5G. Un tipo de mecanismo importante para cualquier estándar inalámbrico, consiste en el mecanismo de gestión de la movilidad (MM). Los mecanismos MM aseguran la conectividad sin interrupciones y la continuidad del servicio para un usuario cuando éste se aleja de la ubicación geográfica donde inicialmente se conectó a la red. En esta tesis, presentamos, en primer lugar, un estado del arte detallado de los mecanismos MM. Bas ándonos en los requisitos de 5G, así como en las discusiones iniciales sobre las redes Beyond 5G, proporcionamos un análisis de las tecnologías/soluciones actuales para satisfacer los requisitos presentados. También definimos los desafíos persistentes que existen con respecto a los mecanismos MM para redes 5G y Beyond 5G. En base a estos desafíos, definimos las posibles soluciones y un marco novedoso para los mecanismos 5G y Beyond 5G de MM. Este marco especifica un conjunto de mecanismos MM a nivel de red acceso, red del núcleo y extremo de la red (usuarios/dispositivos), que ayudarán a satisfacer los requisitos para los mecanismos MM 5G y posteriores. A continuación, presentamos el concepto de servicio bajo demanda MM. Tal característica proporciona la confiabilidad, escalabilidad y flexibilidad necesarias para los mecanismos MM. Su objetivo es garantizar que se definan los recursos y contextos de movilidad adecuados para los usuarios que tendrán perfiles de movilidad heterogéneos, y requisitos de QoS versátiles en una red multi-RAT. Más adelante, abordamos el problema de la señalización de la red troncal que ocurre durante la gestión de la movilidad en redes 5G/4G. Se ha desarrollado un nuevo mecanismo de señalización de handover, que elimina los intercambios de mensajes innecesarios durante la fase de preparación del handover, al tiempo que permite la transición a futuras arquitecturas de red softwarizada. Utilizamos los datos de operadores y consideramos un despliegue de red realista para realizar un análisis comparativo de la estrategia propuesta y la estrategia de señalización de 3GPP. Mostramos los beneficios de nuestra estrategia en términos de latencia del proceso de handover y los costes de transmisión y procesado. Por último, se ha propuesto una nueva asociación de usuarios y una metodología de asignación de recursos, i.e, AURA-5G. AURA-5G aborda escenarios en los que las aplicaciones con requisitos heterogéneos, i.e., enhanced Mobile Broadband (eMBB) y massive Machine Type Communications (mMTC), están presentes simultáneamente. En consecuencia, se ha llevado a cabo un proceso de optimización conjunta para realizar la asociación de usuarios y la asignación de recursos mientras se tienen en cuenta los requisitos de aplicaciónes heterogéneas. Capturamos las peculiaridades de este importante proceso de gestión de la movilidad a través de las diversas restricciones impuestas, como son los requisitos de backhaul, las opciones de conectividad dual, los recursos de la red de acceso disponibles, los requisitos de velocidad mínima, etc., que hemos introducido en un Mixed Integer Linear Program (MILP). La función objetivo de este problema MILP es maximizar el rendimiento total de la red de los usuarios de eMBB, y a la vez satisfacer los requisitos mínimos de los usuarios de mMTC y eMBB definidos en un escenario dado. A través de evaluaciones numéricas, mostramos que nuestro enfoque supera significativamente el escenario de asociación de usuarios de referencia. Además, hemos presentado un análisis de la justicia del sistema, así como un novedoso análisis de fidelidad y complejidad computacional para el mismo, que expresa la utilidad de nuestra metodología.Postprint (published version

Enhanced mobility management mechanisms for 5G networks

Many mechanisms that served the legacy networks till now, are being identified as being grossly sub-optimal for 5G networks. The reason being, the increased complexity of the 5G networks compared previous legacy systems. One such class of mechanisms, important for any wireless standard, is the Mobility Management (MM) mechanisms. MM mechanismsensure the seamless connectivity and continuity of service for a user when it moves away from the geographic location where it initially got attached to the network. In this thesis, we firstly present a detailed state of the art on MM mechanisms. Based on the 5G requirements as well as the initial discussions on Beyond 5G networks, we provision a gap analysis for the current technologies/solutions to satisfy the presented requirements. We also define the persistent challenges that exist concerning MM mechanisms for 5G and beyond networks. Based on these challenges, we define the potential solutions and a novel framework for the 5G and beyond MM mechanisms. This framework specifies a set of MM mechanisms at the access, core and the extreme edge network (users/devices) level, that will help to satisfy the requirements for the 5G and beyond MM mechanisms. Following this, we present an on demand MM service concept. Such an on-demand feature provisions the necessary reliability, scalability and flexibility to the MM mechanisms. It's objective is to ensure that appropriate resources and mobility contexts are defined for users who will have heterogeneous mobility profiles, versatile QoS requirements in a multi-RAT network. Next, in this thesis we tackle the problem of core network signaling that occurs during MM in 5G/4G networks. A novel handover signaling mechanism has been developed, which eliminates unnecessary handshakes during the handover preparation phase, while allowing the transition to future softwarized network architectures. We also provide a handover failure aware handover preparation phase signaling process. We then utilize operator data and a realistic network deployment to perform a comparative analysis of the proposed strategy and the 3GPP handover signaling strategy on a network wide deployment scenario. We show the benefits of our strategy in terms of latency of handover process, and the transmission and processing cost incurred. Lastly, a novel user association and resource allocation methodology, namely AURA-5G, has been proposed. AURA-5G addresses scenarios wherein applications with heterogeneous requirements, i.e., enhanced Mobile Broadband (eMBB) and massive Machine Type Communications (mMTC), are present simultaneously. Consequently, a joint optimization process for performing the user association and resource allocation while being cognizant of heterogeneous application requirements, has been performed. We capture the peculiarities of this important mobility management process through the various constraints, such as backhaul requirements, dual connectivity options, available access resources, minimum rate requirements, etc., that we have imposed on a Mixed Integer Linear Program (MILP). The objective function of this established MILP problem is to maximize the total network throughput of the eMBB users, while satisfying the minimum requirements of the mMTC and eMBB users defined in a given scenario. Through numerical evaluations we show that our approach outperforms the baseline user association scenario significantly. Moreover, we have presented a system fairness analysis, as well as a novel fidelity and computational complexity analysis for the same, which express the utility of our methodology given the myriad network scenarios.Muchos mecanismos que sirvieron en las redes actuales, se están identificando como extremadamente subóptimos para las redes 5G. Esto es debido a la mayor complejidad de las redes 5G. Un tipo de mecanismo importante para cualquier estándar inalámbrico, consiste en el mecanismo de gestión de la movilidad (MM). Los mecanismos MM aseguran la conectividad sin interrupciones y la continuidad del servicio para un usuario cuando éste se aleja de la ubicación geográfica donde inicialmente se conectó a la red. En esta tesis, presentamos, en primer lugar, un estado del arte detallado de los mecanismos MM. Bas ándonos en los requisitos de 5G, así como en las discusiones iniciales sobre las redes Beyond 5G, proporcionamos un análisis de las tecnologías/soluciones actuales para satisfacer los requisitos presentados. También definimos los desafíos persistentes que existen con respecto a los mecanismos MM para redes 5G y Beyond 5G. En base a estos desafíos, definimos las posibles soluciones y un marco novedoso para los mecanismos 5G y Beyond 5G de MM. Este marco especifica un conjunto de mecanismos MM a nivel de red acceso, red del núcleo y extremo de la red (usuarios/dispositivos), que ayudarán a satisfacer los requisitos para los mecanismos MM 5G y posteriores. A continuación, presentamos el concepto de servicio bajo demanda MM. Tal característica proporciona la confiabilidad, escalabilidad y flexibilidad necesarias para los mecanismos MM. Su objetivo es garantizar que se definan los recursos y contextos de movilidad adecuados para los usuarios que tendrán perfiles de movilidad heterogéneos, y requisitos de QoS versátiles en una red multi-RAT. Más adelante, abordamos el problema de la señalización de la red troncal que ocurre durante la gestión de la movilidad en redes 5G/4G. Se ha desarrollado un nuevo mecanismo de señalización de handover, que elimina los intercambios de mensajes innecesarios durante la fase de preparación del handover, al tiempo que permite la transición a futuras arquitecturas de red softwarizada. Utilizamos los datos de operadores y consideramos un despliegue de red realista para realizar un análisis comparativo de la estrategia propuesta y la estrategia de señalización de 3GPP. Mostramos los beneficios de nuestra estrategia en términos de latencia del proceso de handover y los costes de transmisión y procesado. Por último, se ha propuesto una nueva asociación de usuarios y una metodología de asignación de recursos, i.e, AURA-5G. AURA-5G aborda escenarios en los que las aplicaciones con requisitos heterogéneos, i.e., enhanced Mobile Broadband (eMBB) y massive Machine Type Communications (mMTC), están presentes simultáneamente. En consecuencia, se ha llevado a cabo un proceso de optimización conjunta para realizar la asociación de usuarios y la asignación de recursos mientras se tienen en cuenta los requisitos de aplicaciónes heterogéneas. Capturamos las peculiaridades de este importante proceso de gestión de la movilidad a través de las diversas restricciones impuestas, como son los requisitos de backhaul, las opciones de conectividad dual, los recursos de la red de acceso disponibles, los requisitos de velocidad mínima, etc., que hemos introducido en un Mixed Integer Linear Program (MILP). La función objetivo de este problema MILP es maximizar el rendimiento total de la red de los usuarios de eMBB, y a la vez satisfacer los requisitos mínimos de los usuarios de mMTC y eMBB definidos en un escenario dado. A través de evaluaciones numéricas, mostramos que nuestro enfoque supera significativamente el escenario de asociación de usuarios de referencia. Además, hemos presentado un análisis de la justicia del sistema, así como un novedoso análisis de fidelidad y complejidad computacional para el mismo, que expresa la utilidad de nuestra metodología

A survey on hybrid beamforming techniques in 5G : architecture and system model perspectives

The increasing wireless data traffic demands have driven the need to explore suitable spectrum regions for meeting the projected requirements. In the light of this, millimeter wave (mmWave) communication has received considerable attention from the research community. Typically, in fifth generation (5G) wireless networks, mmWave massive multiple-input multiple-output (MIMO) communications is realized by the hybrid transceivers which combine high dimensional analog phase shifters and power amplifiers with lower-dimensional digital signal processing units. This hybrid beamforming design reduces the cost and power consumption which is aligned with an energy-efficient design vision of 5G. In this paper, we track the progress in hybrid beamforming for massive MIMO communications in the context of system models of the hybrid transceivers' structures, the digital and analog beamforming matrices with the possible antenna configuration scenarios and the hybrid beamforming in heterogeneous wireless networks. We extend the scope of the discussion by including resource management issues in hybrid beamforming. We explore the suitability of hybrid beamforming methods, both, existing and proposed till first quarter of 2017, and identify the exciting future challenges in this domain