Thirty Years of Machine Learning: The Road to Pareto-Optimal Wireless Networks

Future wireless networks have a substantial potential in terms of supporting a broad range of complex compelling applications both in military and civilian fields, where the users are able to enjoy high-rate, low-latency, low-cost and reliable information services. Achieving this ambitious goal requires new radio techniques for adaptive learning and intelligent decision making because of the complex heterogeneous nature of the network structures and wireless services. Machine learning (ML) algorithms have great success in supporting big data analytics, efficient parameter estimation and interactive decision making. Hence, in this article, we review the thirty-year history of ML by elaborating on supervised learning, unsupervised learning, reinforcement learning and deep learning. Furthermore, we investigate their employment in the compelling applications of wireless networks, including heterogeneous networks (HetNets), cognitive radios (CR), Internet of things (IoT), machine to machine networks (M2M), and so on. This article aims for assisting the readers in clarifying the motivation and methodology of the various ML algorithms, so as to invoke them for hitherto unexplored services as well as scenarios of future wireless networks.Comment: 46 pages, 22 fig

Enhancing the coexistence of LTE and Wi-Fi in unlicensed spectrum through convolutional neural networks

Over the last years, the ever-growing wireless traffic has pushed the mobile community to investigate solutions that can assist in more efficient management of the wireless spectrum. Towards this direction, the long-term evolution (LIE) operation in the unlicensed spectrum has been proposed. Targeting a global solution that respects the regional requirements, 3GPP announced the standard of LIE licensed assisted access (LAA). However, LIE LAA may result in unfair coexistence with Wi-Fi, especially when Wi-Fi does not use frame aggregation. Targeting a technique that enables fair channel access, the mLTE-U scheme has been proposed. According to mLTE-U, LTE uses a variable transmission opportunity, followed by a variable muting period that can be exploited by other networks to transmit. For the selection of the appropriate mLTE-U configuration, information about the dynamically changing wireless environment is required. To this end, this paper proposes a convolutional neural network (CNN) that is trained to perform identification of LIE and Wi-Fi transmissions. In addition, it can identify the hidden terminal effect caused by multiple LTE transmissions, multiple Wi-Fi transmissions, or concurrent LIE and Wi-Fi transmissions. The designed CNN has been trained and validated using commercial off-the-shelf LIE and Wi-Fi hardware equipment and for two wireless signal representations, namely, in-phase and quadrature samples and frequency domain representation through fast Fourier transform. The classification accuracy of the two resulting CNNs is tested for different signal to noise ratio values. The experimentation results show that the data representation affects the accuracy of CNN. The obtained information from CNN can be exploited by the mLTE-U scheme in order to provide fair coexistence between the two wireless technologies

Unmanned Aerial Vehicle (UAV)-Enabled Wireless Communications and Networking

The emerging massive density of human-held and machine-type nodes implies larger traffic deviatiolns in the future than we are facing today. In the future, the network will be characterized by a high degree of flexibility, allowing it to adapt smoothly, autonomously, and efficiently to the quickly changing traffic demands both in time and space. This flexibility cannot be achieved when the network’s infrastructure remains static. To this end, the topic of UAVs (unmanned aerial vehicles) have enabled wireless communications, and networking has received increased attention. As mentioned above, the network must serve a massive density of nodes that can be either human-held (user devices) or machine-type nodes (sensors). If we wish to properly serve these nodes and optimize their data, a proper wireless connection is fundamental. This can be achieved by using UAV-enabled communication and networks. This Special Issue addresses the many existing issues that still exist to allow UAV-enabled wireless communications and networking to be properly rolled out

Cellular and Wi-Fi technologies evolution: from complementarity to competition

This PhD thesis has the characteristic to span over a long time because while working on it, I was working as a research engineer at CTTC with highly demanding development duties. This has delayed the deposit more than I would have liked. On the other hand, this has given me the privilege of witnessing and studying how wireless technologies have been evolving over a decade from 4G to 5G and beyond. When I started my PhD thesis, IEEE and 3GPP were defining the two main wireless technologies at the time, Wi-Fi and LTE, for covering two substantially complementary market targets. Wi-Fi was designed to operate mostly indoor, in unlicensed spectrum, and was aimed to be a simple and cheap technology. Its primary technology for coexistence was based on the assumption that the spectrum on which it was operating was for free, and so it was designed with interference avoidance through the famous CSMA/CA protocol. On the other hand, 3GPP was designing technologies for licensed spectrum, a costly kind of spectrum. As a result, LTE was designed to take the best advantage of it while providing the best QoE in mainly outdoor scenarios. The PhD thesis starts in this context and evolves with these two technologies. In the first chapters, the thesis studies radio resource management solutions for standalone operation of Wi-Fi in unlicensed and LTE in licensed spectrum. We anticipated the now fundamental machine learning trend by working on machine learning-based radio resource management solutions to improve LTE and Wi-Fi operation in their respective spectrum. We pay particular attention to small cell deployments aimed at improving the spectrum efficiency in licensed spectrum, reproducing small range scenarios typical of Wi-Fi settings. IEEE and 3GPP followed evolving the technologies over the years: Wi-Fi has grown into a much more complex and sophisticated technology, incorporating the key features of cellular technologies, like HARQ, OFDMA, MU-MIMO, MAC scheduling and spatial reuse. On the other hand, since Release 13, cellular networks have also been designed for unlicensed spectrum. As a result, the two last chapters of this thesis focus on coexistence scenarios, in which LTE needs to be designed to coexist with Wi-Fi fairly, and NR, the radio access for 5G, with Wi-Fi in 5 GHz and WiGig in 60 GHz. Unlike LTE, which was adapted to operate in unlicensed spectrum, NR-U is natively designed with this feature, including its capability to operate in unlicensed in a complete standalone fashion, a fundamental new milestone for cellular. In this context, our focus of analysis changes. We consider that these two technological families are no longer targeting complementarity but are now competing, and we claim that this will be the trend for the years to come. To enable the research in these multi-RAT scenarios, another fundamental result of this PhD thesis, besides the scientific contributions, is the release of high fidelity models for LTE and NR and their coexistence with Wi-Fi and WiGig to the ns-3 open-source community. ns-3 is a popular open-source network simulator, with the characteristic to be multi-RAT and so naturally allows the evaluation of coexistence scenarios between different technologies. These models, for which I led the development, are by academic citations, the most used open-source simulation models for LTE and NR and havereceived fundings from industry (Ubiquisys, WFA, SpiderCloud, Interdigital, Facebook) and federal agencies (NIST, LLNL) over the years.Aquesta tesi doctoral té la característica d’allargar-se durant un llarg període de temps ja que mentre treballava en ella, treballava com a enginyera investigadora a CTTC amb tasques de desenvolupament molt exigents. Això ha endarrerit el dipositar-la més del que m’hagués agradat. D’altra banda, això m’ha donat el privilegi de ser testimoni i estudiar com han evolucionat les tecnologies sense fils durant més d’una dècada des del 4G fins al 5G i més enllà. Quan vaig començar la tesi doctoral, IEEE i 3GPP estaven definint les dues tecnologies sense fils principals en aquell moment, Wi-Fi i LTE, que cobreixen dos objectius de mercat substancialment complementaris. Wi-Fi va ser dissenyat per funcionar principalment en interiors, en espectre sense llicència, i pretenia ser una tecnologia senzilla i barata. La seva tecnologia primària per a la convivència es basava en el supòsit que l’espectre en el que estava operant era de franc, i, per tant, es va dissenyar simplement evitant interferències a través del famós protocol CSMA/CA. D’altra banda, 3GPP estava dissenyant tecnologies per a espectres amb llicència, un tipus d’espectre costós. Com a resultat, LTE està dissenyat per treure’n el màxim profit alhora que proporciona el millor QoE en escenaris principalment a l’aire lliure. La tesi doctoral comença amb aquest context i evoluciona amb aquestes dues tecnologies. En els primers capítols, estudiem solucions de gestió de recursos de radio per a operacions en espectre de Wi-Fi sense llicència i LTE amb llicència. Hem anticipat l’actual tendència fonamental d’aprenentatge automàtic treballant solucions de gestió de recursos de radio basades en l’aprenentatge automàtic per millorar l’LTE i Wi-Fi en el seu espectre respectiu. Prestem especial atenció als desplegaments de cèl·lules petites destinades a millorar la eficiència d’espectre llicenciat, reproduint escenaris de petit abast típics de la configuració Wi-Fi. IEEE i 3GPP van seguir evolucionant les tecnologies al llarg dels anys: El Wi-Fi s’ha convertit en una tecnologia molt més complexa i sofisticada, incorporant les característiques clau de les tecnologies cel·lulars, com ara HARQ i la reutilització espacial. D’altra banda, des de la versió 13, també s’han dissenyat xarxes cel·lulars per a espectre sense llicència. Com a resultat, els dos darrers capítols d’aquesta tesi es centren en aquests escenaris de convivència, on s’ha de dissenyar LTE per conviure amb la Wi-Fi de manera justa, i NR, l’accés a la radio per a 5G amb Wi-Fi a 5 GHz i WiGig a 60 GHz. A diferència de LTE, que es va adaptar per funcionar en espectre sense llicència, NR-U està dissenyat de forma nativa amb aquesta característica, inclosa la seva capacitat per operar sense llicència de forma autònoma completa, una nova fita fonamental per al mòbil. En aquest context, el nostre focus d’anàlisi canvia. Considerem que aquestes dues famílies de tecnologia ja no estan orientades cap a la complementarietat, sinó que ara competeixen, i afirmem que aquesta serà el tendència per als propers anys. Per permetre la investigació en aquests escenaris multi-RAT, un altre resultat fonamental d’aquesta tesi doctoral, a més de les aportacions científiques, és l’alliberament de models d’alta fidelitat per a LTE i NR i la seva coexistència amb Wi-Fi a la comunitat de codi obert ns-3. ns-3 és un popular simulador de xarxa de codi obert, amb la característica de ser multi-RAT i, per tant, permet l’avaluació de manera natural d’escenaris de convivència entre diferents tecnologies. Aquests models, pels quals he liderat el desenvolupament, són per cites acadèmiques, els models de simulació de codi obert més utilitzats per a LTE i NR i que han rebut finançament de la indústria (Ubiquisys, WFA, SpiderCloud, Interdigital, Facebook) i agències federals (NIST, LLNL) al llarg dels anys.Esta tesis doctoral tiene la característica de extenderse durante mucho tiempo porque mientras trabajaba en ella, trabajaba como ingeniera de investigación en CTTC con tareas de desarrollo muy exigentes. Esto ha retrasado el depósito más de lo que me hubiera gustado. Por otro lado, gracias a ello, he tenido el privilegio de presenciar y estudiar como las tecnologías inalámbricas han evolucionado durante una década, de 4G a 5G y más allá. Cuando comencé mi tesis doctoral, IEEE y 3GPP estaban definiendo las dos principales tecnologías inalámbricas en ese momento, Wi-Fi y LTE, cumpliendo dos objetivos de mercado sustancialmente complementarios. Wi-Fi fue diseñado para funcionar principalmente en interiores, en un espectro sin licencia, y estaba destinado a ser una tecnología simple y barata. Su tecnología primaria para la convivencia se basaba en el supuesto en que el espectro en el que estaba operando era gratis, y así fue diseñado simplemente evitando interferencias a través del famoso protocolo CSMA/CA. Por otro lado, 3GPP estaba diseñando tecnologías para espectro con licencia, un tipo de espectro costoso. Como resultado, LTE está diseñado para aprovechar el espectro al máximo proporcionando al mismo tiempo el mejor QoE en escenarios principalmente al aire libre. La tesis doctoral parte de este contexto y evoluciona con estas dos tecnologías. En los primeros capítulos, estudiamos las soluciones de gestión de recursos de radio para operación en espectro Wi-Fi sin licencia y LTE con licencia. Anticipamos la tendencia ahora fundamental de aprendizaje automático trabajando en soluciones de gestión de recursos de radio para mejorar LTE y funcionamiento deWi-Fi en su respectivo espectro. Prestamos especial atención a las implementaciones de células pequeñas destinadas a mejorar la eficiencia de espectro licenciado, reproduciendo los típicos escenarios de rango pequeño de la configuración Wi-Fi. IEEE y 3GPP siguieron evolucionando las tecnologías a lo largo de los años: Wi-Fi se ha convertido en una tecnología mucho más compleja y sofisticada, incorporando las características clave de las tecnologías celulares, como HARQ, OFDMA, MU-MIMO, MAC scheduling y la reutilización espacial. Por otro lado, desde la Release 13, también se han diseñado redes celulares para espectro sin licencia. Como resultado, los dos últimos capítulos de esta tesis se centran en estos escenarios de convivencia, donde LTE debe diseñarse para coexistir con Wi-Fi de manera justa, y NR, el acceso por radio para 5G con Wi-Fi en 5 GHz y WiGig en 60 GHz. A diferencia de LTE, que se adaptó para operar en espectro sin licencia, NR-U está diseñado de forma nativa con esta función, incluyendo su capacidad para operar sin licencia de forma completamente independiente, un nuevo hito fundamental para los celulares. En este contexto, cambia nuestro enfoque de análisis. Consideramos que estas dos familias tecnológicas ya no tienen como objetivo la complementariedad, sino que ahora están compitiendo, y afirmamos que esta será la tendencia para los próximos años. Para permitir la investigación en estos escenarios de múltiples RAT, otro resultado fundamental de esta tesis doctoral, además de los aportes científicos, es el lanzamiento de modelos de alta fidelidad para LTE y NR y su coexistencia con Wi-Fi y WiGig a la comunidad de código abierto de ns-3. ns-3 es un simulador popular de red de código abierto, con la característica de ser multi-RAT y así, naturalmente, permite la evaluación de escenarios de convivencia entre diferentes tecnologías. Estos modelos, para los cuales lideré el desarrollo, son por citas académicas, los modelos de simulación de código abierto más utilizados para LTE y NR y han recibido fondos de la industria (Ubiquisys, WFA, SpiderCloud, Interdigital, Facebook) y agencias federales (NIST, LLNL) a lo largo de los años.Postprint (published version

Improving next-generation wireless network performance and reliability with deep learning

A rudimentary question whether machine learning in general, or deep learning in particular, could add to the well-established field of wireless communications, which has been evolving for close to a century, is often raised. While the use of deep learning based methods is likely to help build intelligent wireless solutions, this use becomes particularly challenging for the lower layers in the wireless communication stack. The introduction of the fifth generation of wireless communications (5G) has triggered the demand for “network intelligence” to support its promises for very high data rates and extremely low latency. Consequently, 5G wireless operators are faced with the challenges of network complexity, diversification of services, and personalized user experience. Industry standards have created enablers (such as the network data analytics function), but these enablers focus on post-mortem analysis at higher stack layers and have a periodicity in the time scale of seconds (or larger). The goal of this dissertation is to show a solution for these challenges and how a data-driven approach using deep learning could add to the field of wireless communications. In particular, I propose intelligent predictive and prescriptive abilities to boost reliability and eliminate performance bottlenecks in 5G cellular networks and beyond, show contributions that justify the value of deep learning in wireless communications across several different layers, and offer in-depth analysis and comparisons with baselines and industry standards. First, to improve multi-antenna network reliability against wireless impairments with power control and interference coordination for both packetized voice and beamformed data bearers, I propose the use of a joint beamforming, power control, and interference coordination algorithm based on deep reinforcement learning. This algorithm uses a string of bits and logic operations to enable simultaneous actions to be performed by the reinforcement learning agent. Consequently, a joint reward function is also proposed. I compare the performance of my proposed algorithm with the brute force approach and show that similar performance is achievable but with faster run-time as the number of transmit antennas increases. Second, in enhancing the performance of coordinated multipoint, I propose the use of deep learning binary classification to learn a surrogate function to trigger a second transmission stream instead of depending on the popular signal to interference plus noise measurement quantity. This surrogate function improves the users' sum-rate through focusing on pre-logarithmic terms in the sum-rate formula, which have larger impact on this rate. Third, performance of band switching can be improved without the need for a full channel estimation. My proposal of using deep learning to classify the quality of two frequency bands prior to granting the band switching leads to a significant improvement in users' throughput. This is due to the elimination of the industry standard measurement gap requirement—a period of silence where no data is sent to the users so they could measure the frequency bands before switching. In this dissertation, a group of algorithms for wireless network performance and reliability for downlink are proposed. My results show that the introduction of user coordinates enhance the accuracy of the predictions made with deep learning. Also, the choice of signal to interference plus noise ratio as the optimization objective may not always be the best choice to improve user throughput rates. Further, exploiting the spatial correlation of channels in different frequency bands can improve certain network procedures without the need for perfect knowledge of the per-band channel state information. Hence, an understanding of these results help develop novel solutions to enhancing these wireless networks at a much smaller time scale compared to the industry standards todayElectrical and Computer Engineerin

Cognitive Radio Connectivity for Railway Transportation Networks

Reliable wireless networks for high speed trains require a significant amount of data communications for enabling safety features such as train collision avoidance and railway management. Cognitive radio integrates heterogeneous wireless networks that will be deployed in order to achieve intelligent communications in future railway systems. One of the primary technical challenges in achieving reliable communications for railways is the handling of high mobility environments involving trains, which includes significant Doppler shifts in the transmission as well as severe fading scenarios that makes it difficult to estimate wireless spectrum utilization. This thesis has two primary contributions: (1) The creation of a Heterogeneous Cooperative Spectrum Sensing (CSS) prototype system, and (2) the derivation of a Long Term Evolution for Railways (LTE-R) system performance analysis. The Heterogeneous CSS prototype system was implemented using Software-Defined Radios (SDRs) possessing different radio configurations. Both soft and hard-data fusion schemes were used in order to compare the signal source detection performance in real-time fading scenarios. For future smart railways, one proposed solution for enabling greater connectivity is to access underutilized spectrum as a secondary user via the dynamic spectrum access (DSA) paradigm. Since it will be challenging to obtain an accurate estimate of incumbent users via a single-sensor system within a real-world fading environment, the proposed cooperative spectrum sensing approach is employed instead since it can mitigate the effects of multipath and shadowing by utilizing the spatial and temporal diversity of a multiple radio network. Regarding the LTE-R contribution of this thesis, the performance analysis of high speed trains (HSTs) in tunnel environments would provide valuable insights with respect to the smart railway systems operating in high mobility scenarios in drastically impaired channels

Channel parameter tuning in a hybrid Wi-Fi-Dynamic Spectrum Access Wireless Mesh Network

This work addresses Channel Assignment in a multi-radio multi-channel (MRMC) Wireless Mesh Network (WMN) using both Wi-Fi and Dynamic Spectrum Access (DSA) spectrum bands and standards. This scenario poses new challenges because nodes are spread out geographically so may have differing allowed channels and experience different levels of external interference in different channels. A solution must meet two conflicting requirements simultaneously: 1) avoid or minimise interference within the network and from external interference sources, and 2) maintain connectivity within the network. These two requirements must be met while staying within the link constraints and the radio interface constraints, such as only assigning as many channels to a node as it has radios. This work's original contribution to the field is a unified framework for channel optimisation and assignment in a WMN that uses both DSA and traditional Wi-Fi channels for interconnectivity. This contribution is realised by providing and analysing the performance of near-optimal Channel Assignment (CA) solutions using metaheuristic algorithms for the MRMC WMNs using DSA bands. We have created a simulation framework for evaluating the algorithms. The performance of Simulated Annealing, Genetic Algorithm, Differential Evolution, and Particle Swarm Optimisation algorithms have been analysed and compared for the CA optimisation problem. We introduce a novel algorithm, used alongside the metaheuristic optimisation algorithms, to generate feasible candidate CA solutions. Unlike previous studies, this sensing and CA work takes into account the requirement to use a Geolocation Spectrum Database (GLSD) to get the allowed channels, in addition to using spectrum sensing to identify and estimate the cumulative severity of both internal and external interference sources. External interference may be caused by other secondary users (SUs) in the vicinity or by primary transmitters of the DSA band whose emissions leak into adjacent channels, next-toadjacent, or even into further channels. We use signal-to-interference-plus-noise ratio (SINR) as the optimisation objective. This incorporates any possible source or type of interference and makes our method agnostic to the protocol or technology of the interfering devices while ensuring that the received signal level is high enough for connectivity to be maintained on as many links as possible. To support our assertion that SINR is a reasonable criterion on which to base the optimisation, we have carried out extensive outdoor measurements in both line-of-sight and wooded conditions in the television white space (TVWS) DSA band and the 5 GHz Wi-Fi band. These measurements show that SINR is useful as a performance measure, especially when the interference experienced on a link is high. Our statistical analysis shows that SINR effectively differentiates the performance of different channels and that SINR is well correlated with throughput and is thus a good predictor of end-user experience, despite varying conditions. We also identify and analyse the idle times created by Carrier Sense Multiple Access with Collision Avoidance (CSMA/CA) contention-based Medium Access Control (MAC) operations and propose the use of these idle times for spectrum sensing to measure the SINR on possible channels. This means we can perform spectrum sensing with zero spectrum sensing delay experienced by the end user. Unlike previous work, this spectrum sensing is transparent and can be performed without causing any disruption to the normal data transmission of the network. We conduct Markov chain analysis to find the expected length of time of a sensing window. We also derive an efficient minimum variance unbiased estimator of the interference plus noise and show how the SINR can be found using this estimate. Our estimation is more granular, accurate, and appropriate to the problem of Secondary User (SU)-SU coexistence than the binary hypothesis testing methods that are most common in the literature. Furthermore, we construct confidence intervals based on the probability density function derived for the observations. This leads to finding and showing the relationships between the number of sampling windows and sampling time, the interference power, and the achievable confidence interval width. While our results coincide with (and thus are confirmed by) some key previous recommendations, ours are more precise, granular, and accurate and allow for application to a wider range of operating conditions. Finally, we present alterations to the IEEE 802.11k protocol to enable the reporting of spectrum sensing results to the fusion or gateway node and algorithms for distributing the Channel Assignment once computed. We analyse the convergence rate of the proposed procedures and find that high network availability can be maintained despite the temporary loss of connectivity caused by the channel switching procedure. This dissertation consolidates the different activities required to improve the channel parameter settings of a multi-radio multi-channel DSA-WMN. The work facilitates the extension of Internet connectivity to the unconnected or unreliably connected in rural or peri-urban areas in a more cost-effective way, enabling more meaningful and affordable access technologies. It also empowers smaller players to construct better community networks for sharing local content. This technology can have knock-on effects of improved socio-economic conditions for the communities that use it