Thirty Years of Machine Learning: The Road to Pareto-Optimal Wireless Networks

Future wireless networks have a substantial potential in terms of supporting a broad range of complex compelling applications both in military and civilian fields, where the users are able to enjoy high-rate, low-latency, low-cost and reliable information services. Achieving this ambitious goal requires new radio techniques for adaptive learning and intelligent decision making because of the complex heterogeneous nature of the network structures and wireless services. Machine learning (ML) algorithms have great success in supporting big data analytics, efficient parameter estimation and interactive decision making. Hence, in this article, we review the thirty-year history of ML by elaborating on supervised learning, unsupervised learning, reinforcement learning and deep learning. Furthermore, we investigate their employment in the compelling applications of wireless networks, including heterogeneous networks (HetNets), cognitive radios (CR), Internet of things (IoT), machine to machine networks (M2M), and so on. This article aims for assisting the readers in clarifying the motivation and methodology of the various ML algorithms, so as to invoke them for hitherto unexplored services as well as scenarios of future wireless networks.Comment: 46 pages, 22 fig

Traffic offloading in future, heterogeneous mobile networks

The rise of third-party content providers and the introduction of numerous applications has been driving the growth of mobile data traffic in the past few years. In order to tackle this challenge, Mobile Network Operators (MNOs) aim to increase their networks' capacity by expanding their infrastructure, deploying more Base Stations (BSs). Particularly, the creation of Heterogeneous Networks (HetNets) and the application of traffic offloading through the dense deployment of low-power BSs, the small cells (SCs), is one promising solution to address the aforementioned explosive data traffic increase. Due to their financial implementation requirements, which could not be met by the MNOs, the emergence of third parties that deploy small cell networks creates new business opportunities. Thus, the investigation of frameworks that facilitate the implementation of outsourced traffic offloading, the collaboration and the transactions among MNOs and third-party small cell owners, as well as the provision of participation incentives for all stakeholders is essential for the deployment of the necessary new infrastructure and capacity expansion. The aforementioned emergence of third-party content providers and their applications not only drives the increase in mobile data traffic, but also create new Quality of Service (QoS) as well as Quality of Experience (QoE) requirements that the MNOs need to guarantee for the satisfaction of their subscribers. Moreover, even though the MNOs accommodate this traffic, they do not get any monetary compensation or subsidization for the required capacity expansion. On the contrary, their revenues reduce continuously. To that end, it is necessary to research and design network and economic functionalities adapted to the new requirements, such as QoE-aware Radio Resource Management and Dynamic Pricing (DP) strategies, which both guarantee the subscriber satisfaction and maximization the MNO profit (to compensate the diminished MNOs' revenues and the increasing deployment investment). Following a thorough investigation of the state-of-the-art, a set of research directions were identified. This dissertation consists of contributions on network sharing and outsourced traffic offloading for the capacity enhancement of MNO networks, and the design of network and economic functions for the sustainable deployment and use of the densely constructed HetNets. The contributions of this thesis are divided into two main parts, as described in the following. The first part of the thesis introduces an innovative approach on outsourced traffic offloading, where we present a framework for the Multi-Operator Radio Access Network (MORAN) sharing. The proposed framework is based on an auction scheme used by a monopolistic Small Cell Operator (SCO), through which he leases his SC infrastructure to MNOs. As the lack of information on the future offered load and the auction strategies creates uncertainty for the MNOs, we designed a learning mechanism that assists the MNOs in their bid-placing decisions. Our simulations show that our proposal almost maximizes the social welfare, satisfying the involved stakeholders and providing them with participation incentives. The second part of the thesis researches the use of network and economic functions for MNO profit maximization, while guaranteeing the users' satisfaction. Particularly, we designed a model that accommodates a plethora of services with various QoS and QoE requirements, as well as diverse pricing, that is, various service prices and different charging schemes. In this model, we proposed QoE-aware user association, resource allocation and joint resource allocation and dynamic pricing algorithms, which exploit the QoE-awareness and the network's economic aspects, such as the profit. Our simulations have shown that our proposals gain substantial more profit compared to traditional and state-of-the-art solutions, while providing a similar or even better network performance.El aumento de los proveedores de contenido de terceros y la introducción de numerosas aplicaciones ha impulsado el crecimiento del tráfico de datos en redes móviles en los últimos años. Para hacer frente a este desafío, los operadores de redes móviles (Mobile Network Operators, MNOs) apuntan a aumentar la capacidad de sus redes mediante la expansión de su infraestructura y el despliegue de más estaciones base (BS). Particularmente, la creación de Redes Heterogéneas (Heterogenous Networks, HetNets) y la aplicación de descarga de tráfico a través del despliegue denso de BSs de baja potencia, las células pequeñas (small cells, SCs), es una solución prometedora para abordar el aumento del tráfico de datos explosivos antes mencionado. Debido a sus requisitos de implementación financiera, que los MNO no pudieron cumplir, la aparición de terceros que implementan redes de células pequeñas crea nuevas oportunidades comerciales. Por lo tanto, la investigación de marcos que faciliten la implementación de la descarga tercerizada de tráfico, la colaboración y las transacciones entre MNOs y terceros propietarios de células pequeñas, así como la provisión de incentivos de participación para todas las partes interesadas esencial para el despliegue de la nueva infraestructura necesaria y la expansión de la capacidad. La aparición antes mencionada de proveedores de contenido de terceros y sus aplicaciones no solo impulsa el aumento del tráfico de datos móviles, sino también crea nuevos requisitos de calidad de servicio (Quality of Service, QoS) y calidad de la experiencia (Quality of Experience, QoE) que los operadores de redes móviles deben garantizar para la satisfacción de sus suscriptores. Además, a pesar de que los operadores de redes móviles adaptan este tráfico, no obtienen ninguna compensación monetaria o subsidio por la expansión de capacidad requerida. Por el contrario, sus ingresos se reducen continuamente. Para ello, es necesario investigar y diseñar funcionalidades económicas y de red adaptadas a los nuevos requisitos, tales como las estrategias QoE-conscientes de gestión de recursos de radio y de precios dinámicos (Dynamic Pricing, DP), que garantizan la satisfacción del abonado y la maximización de la ganancia de operador móvil (para compensar los ingresos de los MNOs disminuidos y la creciente inversión de implementación). Después de una investigación exhaustiva del estado del arte, se identificaron un conjunto de direcciones de investigación. Esta disertación consiste en contribuciones sobre el uso compartido de redes y la descarga tercerizada de tráfico para la mejora de la capacidad de redes MNO, y el diseño de funciones económicas y de red para el despliegue y uso sostenible de las HetNets densamente construidas. Las contribuciones de esta tesis se dividen en dos partes principales, como se describe a continuación. La primera parte de la tesis presenta un enfoque innovador sobre la descarga subcontratada de tráfico, en el que presentamos un marco para el uso compartido de la red de acceso de radio de múltiples operadores (Multi-Operator RAN, MORAN). El marco propuesto se basa en un esquema de subasta utilizado por un operador monopólico de celda pequeña (Small Cell Operator, SCO), a través del cual arrienda su infraestructura SC a MNOs. Como la falta de información sobre la futura carga de red y las estrategias de subasta creaban incertidumbre para los MNO, diseñamos un mecanismo de aprendizaje que asiste a los MNO en sus decisiones de colocación de pujas. Nuestras simulaciones muestran que nuestra propuesta casi maximiza el bienestar social, satisfaciendo a las partes interesadas involucradas y proporcionándoles incentivos de participación. La segunda parte de la tesis investiga el uso de las funciones económicas y de red para la maximización de los beneficios de los MNOs, al tiempo que garantiza la satisfacción de los usuarios. Particularmente, diseñamos un modelo que acomoda una gran cantidad de servicios con diversos requisitos de QoS y QoE, tanto como diversos precios, es decir, varios precios de servicio y diferentes esquemas de cobro. En este modelo, propusimos algoritmos QoE-conscientes para asociación de usuarios, asignación de recursos y conjunta asignación de recursos y de fijación dinámica de precios, que explotan la conciencia de QoE y los aspectos económicos de la red, como la ganancia. Nuestras simulaciones han demostrado que nuestras propuestas obtienen un beneficio sustancial en comparación con las soluciones tradicionales y del estado del arte, a la vez que proporcionan un rendimiento de red similar o incluso mejor.Postprint (published version

A dynamic access point allocation algorithm for dense wireless LANs using potential game

This work introduces an innovative Access Point (AP) allocation algorithm for dense Wi-Fi networks, which relies on a centralised potential game developed in a Software-Defined Wireless Networking (SDWN)-based framework. The proposed strategy optimises the allocation of the Wi-Fi stations (STAs) to APs and allows their dynamic reallocation according to possible changes in the capacity of the Wi-Fi network. This paper illustrates the design of the proposed framework based on SDWN and the implementation of the potential game-based algorithm, which includes two possible strategies. The main novel contribution of this work is that the algorithm allows us to efficiently reallocate the STAs by considering external interference, which can negatively affect the capacities of the APs handled by the SDWN controller. Moreover, the paper provides a detailed performance analysis of the algorithm, which describes the significant improvements achieved with respect to the state of the art. Specifically, the results have been compared against the AP selection considered by the IEEE 802.11 standards and another centralised algorithm dealing with the same problem, in terms of the data bit rate provided to the STAs, their dissatisfaction and Quality of Experience (QoE). Finally, the paper analyses the trade-off between efficient performance and the computational complexity achieved by the strategies implemented in the proposed algorithm

5G and beyond networks

This chapter investigates the Network Layer aspects that will characterize the merger of the cellular paradigm and the IoT architectures, in the context of the evolution towards 5G-and-beyond, including some promising emerging services as Unmanned Aerial Vehicles or Base Stations, and V2X communications

Planning and dynamic spectrum management in heterogeneous mobile networks with QoE optimization

The radio and network planning and optimisation are continuous processes that do not end after the network has been launched. To achieve the best trade-offs, especially between quality and costs, operators make use of several coverage and capacity enhancement methods. The research from this thesis proposes methods such as the implementation of cell zooming and Relay Stations (RSs) with dynamic sleep modes and Carrier Aggregation (CA) for coverage and capacity enhancements. Initially, a survey is presented on ubiquitous mesh networks implementation scenarios and an updated characterization of requirements for services and applications is proposed. The performance targets for the key parameters, delay, delay variation, information loss and throughput have been addressed for all types of services. Furthermore, with the increased competition, mobile operator’s success does not only depend on how good the offered Quality of Service (QoS) is, but also if it meets the end user’s expectations, i.e., Quality of Experience (QoE). In this context, a model for the mapping between QoS parameters and QoE has been proposed for multimedia traffic. The planning and optimization of fixed Worldwide Interoperability for Microwave Access (WiMAX) networks with RSs in conjunction with cell zooming has been addressed. The challenging case of a propagation measurement-based scenario in the hilly region of Covilhã has been considered. A cost/revenue function has been developed by taking into account the cost of building and maintaining the infrastructure with the use of RSs. This part of the work also investigates the energy efficiency and economic implications of the use of power saving modes for RSs in conjunction with cell zooming. Assuming that the RSs can be switched-off or zoomed out to zero in periods when the traffic exchange is low, such as nights and weekends, it has been shown that energy consumption may be reduced whereas cellular coverage and capacity, as well as economic performance may be improved. An integrated Common Radio Resource Management (iCRRM) entity is proposed that implements inter-band CA by performing scheduling between two Long Term Evolution – Advanced (LTE-A) Component Carriers (CCs). Considering the bandwidths available in Portugal, the 800 MHz and 2.6 GHz CCs have been considered whilst mobile video traffic is addressed. Through extensive simulations it has been found that the proposed multi-band schedulers overcome the capacity of LTE systems without CA. Result shown a clear improvement of the QoS, QoE and economic trade-off with CA