Optimizing the delivery of multimedia over mobile networks

Mención Internacional en el título de doctorThe consumption of multimedia content is moving from a residential environment to mobile phones. Mobile data traffic, driven mostly by video demand, is increasing rapidly and wireless spectrum is becoming a more and more scarce resource. This makes it highly important to operate mobile networks efficiently. To tackle this, recent developments in anticipatory networking schemes make it possible to to predict the future capacity of mobile devices and optimize the allocation of the limited wireless resources. Further, optimizing Quality of Experience—smooth, quick, and high quality playback—is more difficult in the mobile setting, due to the highly dynamic nature of wireless links. A key requirement for achieving, both anticipatory networking schemes and QoE optimization, is estimating the available bandwidth of mobile devices. Ideally, this should be done quickly and with low overhead. In summary, we propose a series of improvements to the delivery of multimedia over mobile networks. We do so, be identifying inefficiencies in the interconnection of mobile operators with the servers hosting content, propose an algorithm to opportunistically create frequent capacity estimations suitable for use in resource optimization solutions and finally propose another algorithm able to estimate the bandwidth class of a device based on minimal traffic in order to identify the ideal streaming quality its connection may support before commencing playback. The main body of this thesis proposes two lightweight algorithms designed to provide bandwidth estimations under the high constraints of the mobile environment, such as and most notably the usually very limited traffic quota. To do so, we begin with providing a thorough overview of the communication path between a content server and a mobile device. We continue with analysing how accurate smartphone measurements can be and also go in depth identifying the various artifacts adding noise to the fidelity of on device measurements. Then, we first propose a novel lightweight measurement technique that can be used as a basis for advanced resource optimization algorithms to be run on mobile phones. Our main idea leverages an original packet dispersion based technique to estimate per user capacity. This allows passive measurements by just sampling the existing mobile traffic. Our technique is able to efficiently filter outliers introduced by mobile network schedulers and phone hardware. In order to asses and verify our measurement technique, we apply it to a diverse dataset generated by both extensive simulations and a week-long measurement campaign spanning two cities in two countries, different radio technologies, and covering all times of the day. The results demonstrate that our technique is effective even if it is provided only with a small fraction of the exchanged packets of a flow. The only requirement for the input data is that it should consist of a few consecutive packets that are gathered periodically. This makes the measurement algorithm a good candidate for inclusion in OS libraries to allow for advanced resource optimization and application-level traffic scheduling, based on current and predicted future user capacity. We proceed with another algorithm that takes advantage of the traffic generated by short-lived TCP connections, which form the majority of the mobile connections, to passively estimate the currently available bandwidth class. Our algorithm is able to extract useful information even if the TCP connection never exits the slow start phase. To the best of our knowledge, no other solution can operate with such constrained input. Our estimation method is able to achieve good precision despite artifacts introduced by the slow start behavior of TCP, mobile scheduler and phone hardware. We evaluate our solution against traces collected in 4 European countries. Furthermore, the small footprint of our algorithm allows its deployment on resource limited devices. Finally, in an attempt to face the rapid traffic increase, mobile application developers outsource their cloud infrastructure deployment and content delivery to cloud computing services and content delivery networks. Studying how these services, which we collectively denote Cloud Service Providers (CSPs), perform over Mobile Network Operators (MNOs) is crucial to understanding some of the performance limitations of today’s mobile apps. To that end, we perform the first empirical study of the complex dynamics between applications, MNOs and CSPs. First, we use real mobile app traffic traces that we gathered through a global crowdsourcing campaign to identify the most prevalent CSPs supporting today’s mobile Internet. Then, we investigate how well these services interconnect with major European MNOs at a topological level, and measure their performance over European MNO networks through a month-long measurement campaign on the MONROE mobile broadband testbed. We discover that the top 6 most prevalent CSPs are used by 85% of apps, and observe significant differences in their performance across different MNOs due to the nature of their services, peering relationships with MNOs, and deployment strategies. We also find that CSP performance in MNOs is affected by inflated path length, roaming, and presence of middleboxes, but not influenced by the choice of DNS resolver. We also observe that the choice of operator’s Point of Presence (PoP) may inflate by at least 20% the delay towards popular websites.This work has been supported by IMDEA Networks Institute.Programa Oficial de Doctorado en Ingeniería TelemáticaPresidente: Ahmed Elmokashfi.- Secretario: Rubén Cuevas Rumín.- Vocal: Paolo Din

Long Term Evolution-Advanced and Future Machine-to-Machine Communication

Long Term Evolution (LTE) has adopted Orthogonal Frequency Division Multiple Access (OFDMA) and Single Carrier Frequency Division Multiple Access (SC-FDMA) as the downlink and uplink transmission schemes respectively. Quality of Service (QoS) provisioning is one of the primary objectives of wireless network operators. In LTE-Advanced (LTE-A), several additional new features such as Carrier Aggregation (CA) and Relay Nodes (RNs) have been introduced by the 3rd Generation Partnership Project (3GPP). These features have been designed to deal with the ever increasing demands for higher data rates and spectral efficiency. The RN is a low power and low cost device designed for extending the coverage and enhancing spectral efficiency, especially at the cell edge. Wireless networks are facing a new challenge emerging on the horizon, the expected surge of the Machine-to-Machine (M2M) traffic in cellular and mobile networks. The costs and sizes of the M2M devices with integrated sensors, network interfaces and enhanced power capabilities have decreased significantly in recent years. Therefore, it is anticipated that M2M devices might outnumber conventional mobile devices in the near future. 3GPP standards like LTE-A have primarily been developed for broadband data services with mobility support. However, M2M applications are mostly based on narrowband traffic. These standards may not achieve overall spectrum and cost efficiency if they are utilized for serving the M2M applications. The main goal of this thesis is to take the advantage of the low cost, low power and small size of RNs for integrating M2M traffic into LTE-A networks. A new RN design is presented for aggregating and multiplexing M2M traffic at the RN before transmission over the air interface (Un interface) to the base station called eNodeB. The data packets of the M2M devices are sent to the RN over the Uu interface. Packets from different devices are aggregated at the Packet Data Convergence Protocol (PDCP) layer of the Donor eNodeB (DeNB) into a single large IP packet instead of several small IP packets. Therefore, the amount of overhead data can be significantly reduced. The proposed concept has been developed in the LTE-A network simulator to illustrate the benefits and advantages of the M2M traffic aggregation and multiplexing at the RN. The potential gains of RNs such as coverage enhancement, multiplexing gain, end-to-end delay performance etc. are illustrated with help of simulation results. The results indicate that the proposed concept improves the performance of the LTE-A network with M2M traffic. The adverse impact of M2M traffic on regular LTE-A traffic such as voice and file transfer is minimized. Furthermore, the cell edge throughput and QoS performance are enhanced. Moreover, the results are validated with the help of an analytical model

Capacity Enhancement Approaches for Long Term Evolution networks: Capacity Enhancement-Inspired Self-Organized Networking to Enhance Capacity and Fairness of Traffic in Long Term Evolution Networks by Utilising Dynamic Mobile Base-Stations

The long-term evolution (LTE) network has been proposed to provide better network capacity than the earlier 3G network. Driven by the market, the conventional LTE (3G) network standard could not achieve the expectations of the international mobile telecommunications advanced (IMT-Advanced) standard. To satisfy this gap, the LTE-Advanced was introduced with additional network functionalities to meet up with the IMT-Advanced Standard. In addition, due to the need to minimize operational expenditure (OPEX) and reduce human interventions, the wireless cellular networks are required to be self-aware, self-reconfigurable, self-adaptive and smart. An example of such network involves transceiver base stations (BTSs) within a self-organizing network (SON). Besides these great breakthroughs, the conventional LTE and LTE-Advanced networks have not been designed with the intelligence of scalable capacity output especially in sudden demographic changes, namely during events of football, malls, worship centres or during religious and cultural festivals. Since most of these events cannot be predicted, modern cellular networks must be scalable in terms of capacity and coverage in such unpredictable demographic surge. Thus, the use of dynamic BTSs is proposed to be used in modern and future cellular networks for crowd and demographic change managements. Dynamic BTSs are complements of the capability of SONs to search, determine and deploy less crowded/idle BTSs to densely crowded cells for scalable capacity management. The mobile BTSs will discover areas of dark coverages and fill-up the gap in terms of providing cellular services. The proposed network relieves the LTE network from overloading thus reducing packet loss, delay and improves fair load sharing. In order to trail the best (least) path, a bio-inspired optimization algorithm based on swarm-particle optimization is proposed over the dynamic BTS network. It uses the ant-colony optimization algorithm (ACOA) to find the least path. A comparison between an optimized path and the un-optimized path showed huge gain in terms of delay, fair load sharing and the percentage of packet loss

Quality of service aware data dissemination in vehicular Ad Hoc networks

Des systèmes de transport intelligents (STI) seront éventuellement fournis dans un proche avenir pour la sécurité et le confort des personnes lors de leurs déplacements sur les routes. Les réseaux ad-hoc véhiculaires (VANETs) représentent l'élément clé des STI. Les VANETs sont formés par des véhicules qui communiquent entre eux et avec l'infrastructure. En effet, les véhicules pourront échanger des messages qui comprennent, par exemple, des informations sur la circulation routière, les situations d'urgence et les divertissements. En particulier, les messages d'urgence sont diffusés par des véhicules en cas d'urgence (p.ex. un accident de voiture); afin de permettre aux conducteurs de réagir à temps (p.ex., ralentir), les messages d'urgence doivent être diffusés de manière fiable dans un délai très court. Dans les VANETs, il existe plusieurs facteurs, tels que le canal à pertes, les terminaux cachés, les interférences et la bande passante limitée, qui compliquent énormément la satisfaction des exigences de fiabilité et de délai des messages d'urgence. Dans cette thèse, en guise de première contribution, nous proposons un schéma de diffusion efficace à plusieurs sauts, appelé Dynamic Partitioning Scheme (DPS), pour diffuser les messages d'urgence. DPS calcule les tailles de partitions dynamiques et le calendrier de transmission pour chaque partition; à l'intérieur de la zone arrière de l'expéditeur, les partitions sont calculées de sorte qu'en moyenne chaque partition contient au moins un seul véhicule; l'objectif est de s'assurer que seul un véhicule dans la partition la plus éloignée (de l'expéditeur) est utilisé pour diffuser le message, jusqu'au saut suivant; ceci donne lieu à un délai d'un saut plus court. DPS assure une diffusion rapide des messages d'urgence. En outre, un nouveau mécanisme d'établissement de liaison, qui utilise des tonalités occupées, est proposé pour résoudre le problème du problème de terminal caché. Dans les VANETs, la Multidiffusion, c'est-à-dire la transmission d'un message d'une source à un nombre limité de véhicules connus en tant que destinations, est très importante. Par rapport à la diffusion unique, avec Multidiffusion, la source peut simultanément prendre en charge plusieurs destinations, via une arborescence de multidiffusion, ce qui permet d'économiser de la bande passante et de réduire la congestion du réseau. Cependant, puisque les VANETs ont une topologie dynamique, le maintien de la connectivité de l'arbre de multidiffusion est un problème majeur. Comme deuxième contribution, nous proposons deux approches pour modéliser l'utilisation totale de bande passante d'une arborescence de multidiffusion: (i) la première approche considère le nombre de segments de route impliqués dans l'arbre de multidiffusion et (ii) la seconde approche considère le nombre d'intersections relais dans l'arbre de multidiffusion. Une heuristique est proposée pour chaque approche. Pour assurer la qualité de service de l'arbre de multidiffusion, des procédures efficaces sont proposées pour le suivi des destinations et la surveillance de la qualité de service des segments de route. Comme troisième contribution, nous étudions le problème de la congestion causée par le routage du trafic de données dans les VANETs. Nous proposons (1) une approche de routage basée sur l’infonuagique qui, contrairement aux approches existantes, prend en compte les chemins de routage existants qui relaient déjà les données dans les VANETs. Les nouvelles demandes de routage sont traitées de sorte qu'aucun segment de route ne soit surchargé par plusieurs chemins de routage croisés. Au lieu d'acheminer les données en utilisant des chemins de routage sur un nombre limité de segments de route, notre approche équilibre la charge des données en utilisant des chemins de routage sur l'ensemble des tronçons routiers urbains, dans le but d'empêcher, dans la mesure du possible, les congestions locales dans les VANETs; et (2) une approche basée sur le réseau défini par logiciel (SDN) pour surveiller la connectivité VANET en temps réel et les délais de transmission sur chaque segment de route. Les données de surveillance sont utilisées en entrée de l'approche de routage.Intelligent Transportation Systems (ITS) will be eventually provided in the near future for both safety and comfort of people during their travel on the roads. Vehicular ad-hoc Networks (VANETs), represent the key component of ITS. VANETs consist of vehicles that communicate with each other and with the infrastructure. Indeed, vehicles will be able to exchange messages that include, for example, information about road traffic, emergency situations, and entertainment. Particularly, emergency messages are broadcasted by vehicles in case of an emergency (e.g., car accident); in order to allow drivers to react in time (e.g., slow down), emergency messages must be reliably disseminated with very short delay. In VANETs, there are several factors, such as lossy channel, hidden terminals, interferences and scarce bandwidth, which make satisfying reliability and delay requirements of emergency messages very challenging. In this thesis, as the first contribution, we propose a reliable time-efficient and multi-hop broadcasting scheme, called Dynamic Partitioning Scheme (DPS), to disseminate emergency messages. DPS computes dynamic partition sizes and the transmission schedule for each partition; inside the back area of the sender, the partitions are computed such that in average each partition contains at least a single vehicle; the objective is to ensure that only a vehicle in the farthest partition (from the sender) is used to disseminate the message, to next hop, resulting in shorter one hop delay. DPS ensures fast dissemination of emergency messages. Moreover, a new handshaking mechanism, that uses busy tones, is proposed to solve the problem of hidden terminal problem. In VANETs, Multicasting, i.e. delivering a message from a source to a limited known number of vehicles as destinations, is very important. Compared to Unicasting, with Multicasting, the source can simultaneously support multiple destinations, via a multicast tree, saving bandwidth and reducing overall communication congestion. However, since VANETs have a dynamic topology, maintaining the connectivity of the multicast tree is a major issue. As the second contribution, we propose two approaches to model total bandwidth usage of a multicast tree: (i) the first approach considers the number of road segments involved in the multicast tree and (ii) the second approach considers the number of relaying intersections involved in the multicast tree. A heuristic is proposed for each approach. To ensure QoS of the multicasting tree, efficient procedures are proposed for tracking destinations and monitoring QoS of road segments. As the third contribution, we study the problem of network congestion in routing data traffic in VANETs. We propose (1) a Cloud-based routing approach that, in opposition to existing approaches, takes into account existing routing paths which are already relaying data in VANETs. New routing requests are processed such that no road segment gets overloaded by multiple crossing routing paths. Instead of routing over a limited set of road segments, our approach balances the load of communication paths over the whole urban road segments, with the objective to prevent, whenever possible, local congestions in VANETs; and (2) a Software Defined Networking (SDN) based approach to monitor real-time VANETs connectivity and transmission delays on each road segment. The monitoring data is used as input to the routing approach

Assessment and Real Time Implementation of Wireless Communications Systems and Applications in Transportation Systems

Programa Oficial de Doutoramento en Tecnoloxías da Información e das Comunicacións en Redes Móbiles. 5029V01[Resumo] Os sistemas de comunicación sen fíos de cuarta e quinta xeración (4G e 5G) utilizan unha capa física (PHY) baseada en modulacións multiportadora para a transmisión de datos cun gran ancho de banda. Este tipo de modulacións proporcionan unha alta eficiencia espectral á vez que permiten corrixir de forma sinxela os efectos da canle radio. Estes sistemas utilizan OFDMA como mecanismo para a repartición dos recursos radio dispoñibles entre os diferentes usuarios. Este repartimento realízase asignando un subconxunto de subportadoras a cada usuario nun instante de tempo determinado. Isto aporta unha gran flexibilidade ó sistema que lle permite adaptarse tanto ós requisitos de calidade de servizo dos usuarios como ó estado da canle radio. A capa de acceso ó medio (MAC) destes sistemas encárgase de configurar os diversos parámetros proporcionados pola capa física OFDMA, ademais de xestionar os diversos fluxos de información de cada usuario, transformando os paquetes de capas superiores en paquetes da capa física. Neste traballo estúdase o deseño e implementación das capas MAC e PHY de sistemas de comunicación 4G ademais da súa aplicabilidade en sistemas de transporte ferroviarios. Por unha parte, abórdase o deseño e implementación en tempo real do estándar WiMAX. Estúdanse os mecanismos necesarios para establecer comunicacións bidireccionais entre unha estación base e múltiples dispositivos móbiles. Ademais, estúdase como realizar esta implementación nunha arquitectura hardware baseada en DSPs e FPGAs, na que se implementan as capas MAC e PHY. Dado que esta arquitectura ten uns recursos computacionais limitados, tamén se estudan as necesidades de cada módulo do sistema para poder garantir o funcionamento en tempo real do sistema completo. Por outra parte, tamén se estuda a aplicabilidade dos sistemas 4G a sistemas de transporte públicos. Os sistemas de comunicacións e sinalización son unha parte vital para os sistemas de transporte ferroviario e metro. As comunicacións sen fíos utilizadas por estes sistemas deben ser robustas e proporcionar unha alta fiabilidade para permitir a supervisión, control e seguridade do tráfico ferroviario. Para levar a cabo esta avaliación de viabilidade realízanse simulacións de redes de comunicacións LTE en contornos de transporte ferroviarios, comprobando o cumprimento dos requisitos de fiabilidade e seguridade. Realízanse diferentes simulacións do sistema de comunicacións para poder ser avaliadas e seleccionar a configuración e arquitectura do sistema máis axeitada en función do escenario considerado. Tamén se efectúan simulacións de redes baseadas en Wi-Fi, dado que é a solución máis utilizada nos metros, para confrontar os resultados cos obtidos para LTE. Para que os resultados das simulacións sexan realistas débense empregar modelos de propagación radio axeitados. Nas simulacións utilízanse tanto modelos deterministas como modelos baseados nos resultados de campañas de medida realizadas nestes escenarios. Nas simulacións empréganse os diferentes fluxos de información destes escenarios para comprobar que se cumpren os requisitos de calidade de servicio (QoS). Por exemplo, os fluxos críticos para o control ferroviario, como European Train Control System (ETCS) ou Communication-Based Train Control (CBTC), necesitan unha alta fiabilidade e un retardo mínimo nas comunicacións para garantir o correcto funcionamento do sistema.[Resumen] Los sistemas de comunicación inalámbricos de cuarta y quinta generación (4G y 5G) utilizan una capa física (PHY) basada en modulaciones multiportadora para la transmisión de datos con un gran ancho de banda. Este tipo de modulaciones han demostrado tener una alta eficiencia espectral a la vez que permiten corregir de forma sencilla los efectos del canal radio. Estos sistemas utilizan OFDMA como mecanismo para el reparto de los recursos radio disponibles entre los diferentes usuarios. Este reparto se realiza asignando un subconjunto de subportadoras a cada usuario en un instante de tiempo determinado. Esto aporta una gran flexibilidad al sistema que le permite adaptarse tanto a los requisitos de calidad de servicio de los usuarios como al estado del canal radio. La capa de acceso al medio (MAC) de estos sistemas se encarga de configurar los diversos parámetros proporcionados por la capa física OFDMA, además de gestionar los diversos flujos de información de cada usuario, transformando los paquetes de capas superiores en paquetes de la capa física. En este trabajo se estudia el diseño e implementación de las capas MAC y PHY de sistemas de comunicación 4G además de su aplicabilidad en sistemas de transporte ferroviarios. Por una parte, se aborda el diseño e implementación en tiempo real del estándar WiMAX. Se estudian los mecanismos necesarios para establecer comunicaciones bidireccionales entre una estación base y múltiples dispositivos móviles. Además, se estudia cómo realizar esta implementación en una arquitectura hardware basada en DSPs y FPGAs, en la que se implementan las capas MAC y PHY. Dado que esta arquitectura tiene unos recursos computacionales limitados, también se estudian las necesidades de cada módulo del sistema para poder garantizar el funcionamiento en tiempo real del sistema completo. Por otra parte, también se estudia la aplicabilidad de los sistemas 4G a sistemas de transporte públicos. Los sistemas de comunicaciones y señalización son una parte vital para los sistemas de transporte ferroviario y metro. Las comunicaciones inalámbricas utilizadas por estos sistemas deben ser robustas y proporcionar una alta fiabilidad para permitir la supervisión, control y seguridad del tráfico ferroviario. Para llevar a cabo esta evaluación de viabilidad se realizan simulaciones de redes de comunicaciones LTE en entornos de transporte ferroviarios, comprobando si se cumplen los requisitos de fiabilidad y seguridad. Se realizan diferentes simulaciones del sistema de comunicaciones para poder ser evaluados y seleccionar la configuración y arquitectura del sistema más adecuada en función del escenario planteado. También se efectúan simulaciones de redes basadas en Wi-Fi, dado que es la solución más utilizada en los metros, para comparar los resultados con los obtenidos para LTE. Para que los resultados de las simulaciones sean realistas se deben utilizar modelos de propagación radio apropiados. En las simulaciones se utilizan tanto modelos deterministas como modelos basados en los resultados de campañas de medida realizadas en estos escenarios. En las simulaciones se utilizan los diferentes flujos de información de estos escenarios para comprobar que se cumplen sus requisitos de calidad de servicio. Por ejemplo, los flujos críticos para el control ferroviario, como European Train Control System (ETCS) o Communication-Based Train Control (CBTC), necesitan una alta fiabilidad y un retardo bajo en las comunicaciones para garantizar el correcto funcionamiento del sistema.[Abstract] The fourth and fifth generation wireless communication systems (4G and 5G) use a physical layer (PHY) based on multicarrier modulations for data transmission using high bandwidth. This type of modulations has shown to provide high spectral efficiency while allowing low complexity radio channel equalization. These systems use OFDMA as a mechanism for distributing the available radio resources among different users. This allocation is done by assigning a subset of subcarriers to each user in a given instant of time. This provides great flexibility to the system that allows it to adapt to both the quality of service requirements of users and the radio channel state. The media access layer (MAC) of these systems is in charge of configuring the multiple OFDMA PHY layer parameters, in addition to managing the data flows of each user, transforming the higher layer packets into PHY layer packets. This work studies the design and implementation of MAC and PHY layers of 4G communication systems as well as their applicability in rail transport systems. On the one hand, the design and implementation in real time of the WiMAX standard is addressed. The required mechanisms to establish bidirectional communications between a base station and several mobile devices are also evaluated. Moreover, a MAC layer and PHY layer implementation is presented, using a hardware architecture based in DSPs and FPGAs. Since this architecture has limited computational resources, the requirements of each processing block of the system are also studied in order to guarantee the real time operation of the complete system. On the other hand, the applicability of 4G systems to public transportation systems is also studied. Communications and signaling systems are a vital part of rail and metro transport systems. The wireless communications used by these systems must be robust and provide high reliability to enable the supervision, control and safety of rail traffic. To carry out this feasibility assessment, LTE communications network simulations are performed in rail transport environments to verify that reliability and safety requirements are met. Several simulations are carried out in order to evaluate the system performance and select the most appropriate system configuration in each case. Simulations of Wi-Fi based networks are also carried out, since it is the most used solution in subways, to compare the results with those obtained for LTE. To perform the simulations correctly, appropriate radio propagation models must be used. Both deterministic models and models based on the results of measurement campaigns in these scenarios are used in the simulations. The simulations use the different information flows present in the railway transportation systems to verify that its quality of service requirements are met. For example, critical flows for railway control, such as the European Train Control System (ETCS) or Communication-Based Train Control (CBTC), require high reliability and low delay communications to ensure the proper functioning of the system

Samoorganizirajuće mreže: Podržano učenje za optimizaciju LTE mobilnosti

With the evolution of broadband mobile networks towards LTE and beyond, the support for the Internet and Internet based services is growing. Self Organizing Network (SON) functionalities intend to optimize the network performance for the improved user experience while at the same time reducing the network operational cost. This paper proposes a Reinforcement Learning (RL) based framework to improve throughput of the mobile users. The problem of spectral efficiency maximization is modeled as co-operative Multi-Agent control problem between the neighbouring eNodeBs (eNBs). Each eNB has an associated agent that dynamically changes the outgoing Handover Margin (HM) to its neighbouring cells. The agent uses the RL technique of Fuzzy Q-Learning (FQL) to learn the optimal mobility parameter i.e., HM value. The learning framework is designed to operate in an environment with the variations in traffic, user positions and propagation conditions. Simulation results have shown the proposed approach improves the network capacity and user experiences in terms of throughput.Razvoj širokopojasne mobilne mreže prema LTE mrežama uvjetuje pojačani rast internetskih servisa i usluga. Samoorganizirajuće mreže namijenjene su optimizaciji performansi mreže s ciljem poboljšanja korisnikovog zadovoljstva i smanjenja troškova rada. U radu se predlaže pristup zasnovan na podržanom učenju kako bi se popravila propusnost mobilnog korisnika. Problem maksimizacije spektralne učinkovitosti modelira se kao kooperativni više agentski problem upravljanje između susjednih čvorova (eNBs). Svaki čvor ima pridruženog agenta koji dinamički mijenja marginu primopredaje prema susjednim ćelijama. Agent koristi tehniku neizrazitog Q učenja (FQL) kako bi naučio optimizirati parametre mreže. Učenje je organizirano za rad u uvjetima raznovrsnog prometa, korisničkih položaja i uvjeta propagacije. Simulacijski rezultati pokazuju kako predloženi pristup poboljšava kapacitet mreže i korisnički doživljaj u smislu propusnosti mreže

A deep Q-network-based algorithm for multi-connectivity optimization in heterogeneous cellular-networks †

The use of multi-connectivity has become a useful tool to manage the traffic in heterogeneous cellular network deployments, since it allows a device to be simultaneously connected to multiple cells. The proper exploitation of this technique requires to adequately configure the traffic sent through each cell depending on the experienced conditions. This motivates this work, which tackles the problem of how to optimally split the traffic among the cells when the multi-connectivity feature is used. To this end, the paper proposes the use of a deep reinforcement learning solution based on a Deep Q-Network (DQN) in order to determine the amount of traffic of a device that needs to be delivered through each cell, making the decision as a function of the current traffic and radio conditions. The obtained results show a near-optimal performance of the DQN-based solution with an average difference of only 3.9% in terms of reward with respect to the optimum strategy. Moreover, the solution clearly outperforms a reference scheme based on Signal to Interference Noise Ratio (SINR) with differences of up to 50% in terms of reward and up to 166% in terms of throughput for certain situations. Overall, the presented results show the promising performance of the DQN-based approach that establishes a basis for further research in the topic of multi-connectivity and for the application of this type of techniques in other problems of the radio access networkThis paper is part of ARTIST project (ref. PID2020-115104RB-I00) funded by MCIN/AEI/10.13039/501100011033. The work is also funded by the Spanish Ministry of Science and Innovation under grant ref. PRE2018-084691.Peer ReviewedPostprint (published version

SDN-based Flexible Resource Management and Service-Oriented Virtualization for 5G Mobile Networks and Beyond

This thesis examines how Software Defined Network (SDN) and Network Virtualization (NV) technologies can make 5G and beyond mobile networks more flexible, scalable and programmable to support the performance demands of the emerging heterogeneous applications. In this direction, concepts like mobile network slicing, multi-tenancy, and multi-connectivity have been investigated and their performance is analyzed. The SDN paradigm is used to enable flexible resource allocation to the end users, improve network resource utilization and avoid or rapidly solve the network congestion problems. The proposed network architectures are 3rd Generation Partnership Project (3GPP) standards compliant and integrate Open Network Foundation (ONF) SDN specifications to ensure seamless interoperability between different standards and backward/forward compatibility. Novel mechanisms and algorithms to efficiently manage the resources of evolving 5G Time-Division Duplex (TDD) networks in a flexible manner are introduced. These mechanisms enable formation of virtual cells on-demand which allows diverse resource utilization from multiple eNBs to the users. Within the scope of this thesis, SDN-based frameworks to enhance the QoE of end user applications considering Time Division-Long Term Evolution (TD-LTE) small cells have also been developed and network resource sharing scenarios with Frequency-Division Duplex (FDD)/TDD coexistence has been studied. In addition, this thesis also proposes and investigates a novel service-oriented network slicing concept for evolving 5G TDD networks which involve traffic prediction mechanisms and includes user mobility. An analytical model is also introduced that formulates the network slice resource allocation as a weighted optimization problem. The evaluations of the proposed solutions are performed using 3GPP standard compliant simulation settings. The proposed solutions have been compared with the state-of-the art schemes and the performance gains offered by the proposed solutions have been demonstrated. Performance is evaluated considering metrics such as throughput, delay, network resource utilization etc. The Mean Opinion Score (MOS) metric is used for evaluating the Quality of Experience (QoE) for end-user applications. With the help of SDN-based network management algorithms investigated in this work, it is shown how 5G+ networks can be managed efficiently, while at the same time provide enhanced flexibility and programmability to improve the performance of diverse applications and services delivered over the network to the end users