Thirty Years of Machine Learning: The Road to Pareto-Optimal Wireless Networks

Future wireless networks have a substantial potential in terms of supporting a broad range of complex compelling applications both in military and civilian fields, where the users are able to enjoy high-rate, low-latency, low-cost and reliable information services. Achieving this ambitious goal requires new radio techniques for adaptive learning and intelligent decision making because of the complex heterogeneous nature of the network structures and wireless services. Machine learning (ML) algorithms have great success in supporting big data analytics, efficient parameter estimation and interactive decision making. Hence, in this article, we review the thirty-year history of ML by elaborating on supervised learning, unsupervised learning, reinforcement learning and deep learning. Furthermore, we investigate their employment in the compelling applications of wireless networks, including heterogeneous networks (HetNets), cognitive radios (CR), Internet of things (IoT), machine to machine networks (M2M), and so on. This article aims for assisting the readers in clarifying the motivation and methodology of the various ML algorithms, so as to invoke them for hitherto unexplored services as well as scenarios of future wireless networks.Comment: 46 pages, 22 fig

Artificial neural networks for location estimation and co-cannel interference suppression in cellular networks

This thesis reports on the application of artificial neural networks to two important problems encountered in cellular communications, namely, location estimation and co-channel interference suppression. The prediction of a mobile location using propagation path loss (signal strength) is a very difficult and complex task. Several techniques have been proposed recently mostly based on linearized, geometrical and maximum likelihood methods. An alternative approach based on artificial neural networks is proposed in this thesis which offers the advantages of increased flexibility to adapt to different environments and high speed parallel processing. Location estimation provides users of cellular telephones with information about their location. Some of the existing location estimation techniques such as those used in GPS satellite navigation systems require non-standard features, either from the cellular phone or the cellular network. However, it is possible to use the existing GSM technology for location estimation by taking advantage of the signals transmitted between the phone and the network. This thesis proposes the application of neural networks to predict the location coordinates from signal strength data. New multi-layered perceptron and radial basis function based neural networks are employed for the prediction of mobile locations using signal strength measurements in a simulated COST-231 metropolitan environment. In addition, initial preliminary results using limited available real signal-strength measurements in a metropolitan environment are also reported comparing the performance of the neural predictors with a conventional linear technique. The results indicate that the neural predictors can be trained to provide a near perfect mapping using signal strength measurements from two or more base stations. The second application of neural networks addressed in this thesis, is concerned with adaptive equalization, which is known to be an important technique for combating distortion and Inter-Symbol Interference (ISI) in digital communication channels. However, many communication systems are also impaired by what is known as co-channel interference (CCI). Many digital communications systems such as digital cellular radio (DCR) and dual polarized micro-wave radio, for example, employ frequency re-usage and often exhibit performance limitation due to co-channel interference. The degradation in performance due to CCI is more severe than due to ISI. Therefore, simple and effective interference suppression techniques are required to mitigate the interference for a high-quality signal reception. The current work briefly reviews the application of neural network based non-linear adaptive equalizers to the problem of combating co-channel interference, without a priori knowledge of the channel or co-channel orders. A realistic co-channel system is used as a case study to demonstrate the superior equalization capability of the functional-link neural network based Decision Feedback Equalizer (DFE) compared to other conventional linear and neural network based non-linear adaptive equalizers.This project was funded by Solectron (Scotland) Ltd

Optimizing Taxi Carpool Policies via Reinforcement Learning and Spatio-Temporal Mining

In this paper, we develop a reinforcement learning (RL) based system to learn an effective policy for carpooling that maximizes transportation efficiency so that fewer cars are required to fulfill the given amount of trip demand. For this purpose, first, we develop a deep neural network model, called ST-NN (Spatio-Temporal Neural Network), to predict taxi trip time from the raw GPS trip data. Secondly, we develop a carpooling simulation environment for RL training, with the output of ST-NN and using the NYC taxi trip dataset. In order to maximize transportation efficiency and minimize traffic congestion, we choose the effective distance covered by the driver on a carpool trip as the reward. Therefore, the more effective distance a driver achieves over a trip (i.e. to satisfy more trip demand) the higher the efficiency and the less will be the traffic congestion. We compared the performance of RL learned policy to a fixed policy (which always accepts carpool) as a baseline and obtained promising results that are interpretable and demonstrate the advantage of our RL approach. We also compare the performance of ST-NN to that of state-of-the-art travel time estimation methods and observe that ST-NN significantly improves the prediction performance and is more robust to outliers.Comment: Accepted at IEEE International Conference on Big Data 2018. arXiv admin note: text overlap with arXiv:1710.0435

Modelling cellphone trace travel mode with neural networks using transit smartcard and home interview survey data

This study proposes a framework to impute travel mode for trips identified from cellphone traces by developing a deep neural network model. In our framework, we use the trips from a home interview survey and transit smartcard data, for which the travel mode is known, to create a set of artificial pseudo-cellphone traces. The generated artificial pseudo-cellphone traces with known mode are then used to train a deep neural network classifier. We further apply the trained model to infer travel modes for the cellphone traces from cellular network data. The empirical case study region is Montevideo, Uruguay, where high-quality data are available for all three types of data used in the analysis: a large dataset of cellphone traces, a large dataset of public transit smartcard transactions, and a small household travel survey. The results can be used to create an enhanced representation of origin-destination trip-making in the region by time of day and travel mode