Thirty Years of Machine Learning: The Road to Pareto-Optimal Wireless Networks

Future wireless networks have a substantial potential in terms of supporting a broad range of complex compelling applications both in military and civilian fields, where the users are able to enjoy high-rate, low-latency, low-cost and reliable information services. Achieving this ambitious goal requires new radio techniques for adaptive learning and intelligent decision making because of the complex heterogeneous nature of the network structures and wireless services. Machine learning (ML) algorithms have great success in supporting big data analytics, efficient parameter estimation and interactive decision making. Hence, in this article, we review the thirty-year history of ML by elaborating on supervised learning, unsupervised learning, reinforcement learning and deep learning. Furthermore, we investigate their employment in the compelling applications of wireless networks, including heterogeneous networks (HetNets), cognitive radios (CR), Internet of things (IoT), machine to machine networks (M2M), and so on. This article aims for assisting the readers in clarifying the motivation and methodology of the various ML algorithms, so as to invoke them for hitherto unexplored services as well as scenarios of future wireless networks.Comment: 46 pages, 22 fig

Markov Decision Processes with Applications in Wireless Sensor Networks: A Survey

Wireless sensor networks (WSNs) consist of autonomous and resource-limited devices. The devices cooperate to monitor one or more physical phenomena within an area of interest. WSNs operate as stochastic systems because of randomness in the monitored environments. For long service time and low maintenance cost, WSNs require adaptive and robust methods to address data exchange, topology formulation, resource and power optimization, sensing coverage and object detection, and security challenges. In these problems, sensor nodes are to make optimized decisions from a set of accessible strategies to achieve design goals. This survey reviews numerous applications of the Markov decision process (MDP) framework, a powerful decision-making tool to develop adaptive algorithms and protocols for WSNs. Furthermore, various solution methods are discussed and compared to serve as a guide for using MDPs in WSNs

NOMA based resource allocation and mobility enhancement framework for IoT in next generation cellular networks

With the unprecedented technological advances witnessed in the last two decades, more devices are connected to the internet, forming what is called internet of things (IoT). IoT devices with heterogeneous characteristics and quality of experience (QoE) requirements may engage in dynamic spectrum market due to scarcity of radio resources. We propose a framework to efficiently quantify and supply radio resources to the IoT devices by developing intelligent systems. The primary goal of the paper is to study the characteristics of the next generation of cellular networks with non-orthogonal multiple access (NOMA) to enable connectivity to clustered IoT devices. First, we demonstrate how the distribution and QoE requirements of IoT devices impact the required number of radio resources in real time. Second, we prove that using an extended auction algorithm by implementing a series of complementary functions, enhance the radio resource utilization efficiency. The results show substantial reduction in the number of sub-carriers required when compared to conventional orthogonal multiple access (OMA) and the intelligent clustering is scalable and adaptable to the cellular environment. Ability to move spectrum usages from one cluster to other clusters after borrowing when a cluster has less user or move out of the boundary is another soft feature that contributes to the reported radio resource utilization efficiency. Moreover, the proposed framework provides IoT service providers cost estimation to control their spectrum acquisition to achieve required quality of service (QoS) with guaranteed bit rate (GBR) and non-guaranteed bit rate (Non-GBR)

Optimizing resource allocation in eh-enabled internet of things

Internet of Things (IoT) aims to bridge everyday physical objects via the Internet. Traditional energy-constrained wireless devices are powered by fixed energy sources like batteries, but they may require frequent battery replacements or recharging. Wireless Energy Harvesting (EH), as a promising solution, can potentially eliminate the need of recharging or replacing the batteries. Unlike other types of green energy sources, wireless EH does not depend on nature and is thus a reliable source of energy for charging devices. Meanwhile, the rapid growth of IoT devices and wireless applications is likely to demand for more operating frequency bands. Although the frequency spectrum is currently scarce, owing to inefficient conventional regulatory policies, a considerable amount of the radio spectrum is greatly underutilized. Cognitive radio (CR) can be exploited to mitigate the spectrum scarcity problem of IoT applications by leveraging the spectrum holes. Therefore, transforming the IoT network into a cognitive based IoT network is essential to utilizing the available spectrum opportunistically. To address the two aforementioned issues, a novel model is proposed to leverage wireless EH and CR for IoT. In particular, the sum rate of users is maximized for a CR-based IoT network enabled with wireless EH. Users operate in a time switching fashion, and each time slot is partitioned into three non-overlapping parts devoted for EH, spectrum sensing and data transmission. There is a trade-off among the lengths of these three operations and thus the time slot structure is to be optimized. The general problem of joint resource allocation and EH optimization is formulated as a mixed integer nonlinear programming task which is NP-hard and intractable. Therefore, a sub-channel allocation scheme is first proposed to approximately satisfy users rate requirements and remove the integer constraints. In the second step, the general optimization problem is reduced to a convex optimization task. Another optimization framework is also designed to capture a fundamental tradeoff between energy efficiency (EE) and spectral efficiency for an EH-enabled IoT network. In particular, an EE maximization problem is formulated by taking into consideration of user buffer occupancy, data rate fairness, energy causality constraints and interference constraints. Then, a low complexity heuristic algorithm is proposed to solve the resource allocation and EE optimization problem. The proposed algorithm is shown to be capable of achieving a near optimal solution with polynomial complexity. To support Machine Type Communications (MTC) in next generation mobile networks, NarrowBand-IoT (NB-IoT) has emerged as a promising solution to provide extended coverage and low energy consumption for low cost MTC devices. However, the existing orthogonal multiple access scheme in NB-IoT cannot provide connectivity for a massive number of MTC devices. In parallel with the development of NB-IoT, Non-Orthogonal Multiple Access (NOMA), introduced for the fifth generation wireless networks, is deemed to significantly improve the network capacity by providing massive connectivity through sharing the same spectral resources. To leverage NOMA in the context of NB-IoT, a power domain NOMA scheme is proposed with user clustering for an NB-IoT system. In particular, the MTC devices are assigned to different ranks within the NOMA clusters where they transmit over the same frequency resources. Then, an optimization problem is formulated to maximize the total throughput of the network by optimizing the resource allocation of MTC devices and NOMA clustering while satisfying the transmission power and quality of service requirements. Furthermore, an efficient heuristic algorithm is designed to solve the proposed optimization problem by jointly optimizing NOMA clustering and resource allocation of MTC devices

Next Generation M2M Cellular Networks: Challenges and Practical Considerations

In this article, we present the major challenges of future machine-to-machine (M2M) cellular networks such as spectrum scarcity problem, support for low-power, low-cost, and numerous number of devices. As being an integral part of the future Internet-of-Things (IoT), the true vision of M2M communications cannot be reached with conventional solutions that are typically cost inefficient. Cognitive radio concept has emerged to significantly tackle the spectrum under-utilization or scarcity problem. Heterogeneous network model is another alternative to relax the number of covered users. To this extent, we present a complete fundamental understanding and engineering knowledge of cognitive radios, heterogeneous network model, and power and cost challenges in the context of future M2M cellular networks