Thirty Years of Machine Learning: The Road to Pareto-Optimal Wireless Networks

Future wireless networks have a substantial potential in terms of supporting a broad range of complex compelling applications both in military and civilian fields, where the users are able to enjoy high-rate, low-latency, low-cost and reliable information services. Achieving this ambitious goal requires new radio techniques for adaptive learning and intelligent decision making because of the complex heterogeneous nature of the network structures and wireless services. Machine learning (ML) algorithms have great success in supporting big data analytics, efficient parameter estimation and interactive decision making. Hence, in this article, we review the thirty-year history of ML by elaborating on supervised learning, unsupervised learning, reinforcement learning and deep learning. Furthermore, we investigate their employment in the compelling applications of wireless networks, including heterogeneous networks (HetNets), cognitive radios (CR), Internet of things (IoT), machine to machine networks (M2M), and so on. This article aims for assisting the readers in clarifying the motivation and methodology of the various ML algorithms, so as to invoke them for hitherto unexplored services as well as scenarios of future wireless networks.Comment: 46 pages, 22 fig

E2BNAR: Energy Efficient Backup Node Assisted Routing for Wireless Sensor Networks

In Wireless Sensor Networks (WSNs), each sensor node can only use so much power before recharging. If energy is depleted too quickly, nodes will fail one by one, bringing down the network as a whole. To this end, a design is needed to reduce the burden on the sensor nodes' power supplies while extending the network's useful life. This paper proposes a new approach, called Energy Efficient Backup Node Assisted Routing, to accomplish this (E2BNAR). Each primary node in the network has a group of backup nodes to ensure the network continues functioning. Assuming that the sensor nodes are capable of energy harvesting, E2BNAR finds the best backup node by analyzing the statistical relationship between energy harvesting and consumption rates. Periodically, residual energy is used to analyze the current energy consumption rate. When evaluating performance, several different indicators are taken into account. These include the Packet Delivery Ratio, Throughput, Average Energy Consumption, and Number of Awakened Sensor Nodes. Through analysis and experimentation in several settings, the proposed method's efficacy has been established

DESIGN AND OPTIMIZATION OF SIMULTANEOUS WIRELESS INFORMATION AND POWER TRANSFER SYSTEMS

The recent trends in the domain of wireless communications indicate severe upcoming challenges, both in terms of infrastructure as well as design of novel techniques. On the other hand, the world population keeps witnessing or hearing about new generations of mobile/wireless technologies within every half to one decade. It is certain the wireless communication systems have enabled the exchange of information without any physical cable(s), however, the dependence of the mobile devices on the power cables still persist. Each passing year unveils several critical challenges related to the increasing capacity and performance needs, power optimization at complex hardware circuitries, mobility of the users, and demand for even better energy efficiency algorithms at the wireless devices. Moreover, an additional issue is raised in the form of continuous battery drainage at these limited-power devices for sufficing their assertive demands. In this regard, optimal performance at any device is heavily constrained by either wired, or an inductive based wireless recharging of the equipment on a continuous basis. This process is very inconvenient and such a problem is foreseen to persist in future, irrespective of the wireless communication method used. Recently, a promising idea for simultaneous wireless radio-frequency (RF) transmission of information and energy came into spotlight during the last decade. This technique does not only guarantee a more flexible recharging alternative, but also ensures its co-existence with any of the existing (RF-based) or alternatively proposed methods of wireless communications, such as visible light communications (VLC) (e.g., Light Fidelity (Li-Fi)), optical communications (e.g., LASER-equipped communication systems), and far-envisioned quantum-based communication systems. In addition, this scheme is expected to cater to the needs of many current and future technologies like wearable devices, sensors used in hazardous areas, 5G and beyond, etc. This Thesis presents a detailed investigation of several interesting scenarios in this direction, specifically concerning design and optimization of such RF-based power transfer systems. The first chapter of this Thesis provides a detailed overview of the considered topic, which serves as the foundation step. The details include the highlights about its main contributions, discussion about the adopted mathematical (optimization) tools, and further refined minutiae about its organization. Following this, a detailed survey on the wireless power transmission (WPT) techniques is provided, which includes the discussion about historical developments of WPT comprising its present forms, consideration of WPT with wireless communications, and its compatibility with the existing techniques. Moreover, a review on various types of RF energy harvesting (EH) modules is incorporated, along with a brief and general overview on the system modeling, the modeling assumptions, and recent industrial considerations. Furthermore, this Thesis work has been divided into three main research topics, as follows. Firstly, the notion of simultaneous wireless information and power transmission (SWIPT) is investigated in conjunction with the cooperative systems framework consisting of single source, multiple relays and multiple users. In this context, several interesting aspects like relay selection, multi-carrier, and resource allocation are considered, along with problem formulations dealing with either maximization of throughput, maximization of harvested energy, or both. Secondly, this Thesis builds up on the idea of transmit precoder design for wireless multigroup multicasting systems in conjunction with SWIPT. Herein, the advantages of adopting separate multicasting and energy precoder designs are illustrated, where we investigate the benefits of multiple antenna transmitters by exploiting the similarities between broadcasting information and wirelessly transferring power. The proposed design does not only facilitates the SWIPT mechanism, but may also serve as a potential candidate to complement the separate waveform designing mechanism with exclusive RF signals meant for information and power transmissions, respectively. Lastly, a novel mechanism is developed to establish a relationship between the SWIPT and cache-enabled cooperative systems. In this direction, benefits of adopting the SWIPT-caching framework are illustrated, with special emphasis on an enhanced rate-energy (R-E) trade-off in contrast to the traditional SWIPT systems. The common notion in the context of SWIPT revolves around the transmission of information, and storage of power. In this vein, the proposed work investigates the system wherein both information and power can be transmitted and stored. The Thesis finally concludes with insights on the future directions and open research challenges associated with the considered framework

Architecture design for disaster resilient management network using D2D technology

Huge damages from natural disasters, such as earthquakes, floods, landslide, tsunamis, have been reported in recent years, claiming many lives, rendering millions homeless and causing huge financial losses worldwide. The lack of effective communication between the public rescue/safety agencies, rescue teams, first responders and trapped survivors/victims makes the situation even worse. Factors like dysfunctional communication networks, limited communications capacity, limited resources/services, data transformation and effective evaluation, energy, and power deficiency cause unnecessary hindrance in rescue and recovery services during a disaster. The new wireless communication technologies are needed to enhance life-saving capabilities and rescue services. In general, in order to improve societal resilience towards natural catastrophes and develop effective communication infrastructure, innovative approaches need to be initiated to provide improved quality, better connectivity in the events of natural and human disasters. In this thesis, a disaster resilient network architecture is proposed and analysed using multi-hop communications, clustering, energy harvesting, throughput optimization, reliability enhancement, adaptive selection, and low latency communications. It also examines the importance of mode selection, power management, frequency and time resource allocation to realize the promises of Long-term Evolution (LTE) Device to Device (D2D) communication. In particular, to support resilient and energy efficient communication in disaster-affected areas. This research is examined by thorough and vigorous simulations and validated through mathematical modelling. Overall, the impact of this research is twofold: i) it provides new technologies for effective inter- and intra-agency coordination system during a disaster event by establishing a stronger and resilient communication; and ii) It offers a potential solution for stakeholders such as governments, rescue teams, and general public with new informed information on how to establish effective policies to cope with challenges before, during and after the disaster events

Reinforcement Learning Based Resource Allocation for Energy-Harvesting-Aided D2D Communications in IoT Networks

It is anticipated that mobile data traffic and the demand for higher data rates will increase dramatically as a result of the explosion of wireless devices, such as the Internet of Things (IoT) and machine-to-machine communication. There are numerous location-based peer-to-peer services available today that allow mobile users to communicate directly with one another, which can help offload traffic from congested cellular networks. In cellular networks, Device-to-Device (D2D) communication has been introduced to exploit direct links between devices instead of transmitting through a the Base Station (BS). However, it is critical to note that D2D and IoT communications are hindered heavily by the high energy consumption of mobile devices and IoT devices. This is because their battery capacity is restricted. There may be a way for energy-constrained wireless devices to extend their lifespan by drawing upon reusable external sources of energy such as solar, wind, vibration, thermoelectric, and radio frequency (RF) energy in order to overcome the limited battery problem. Such approaches are commonly referred to as Energy Harvesting (EH) There is a promising approach to energy harvesting that is called Simultaneous Wireless Information and Power Transfer (SWIPT). Due to the fact that wireless users are on the rise, it is imperative that resource allocation techniques be implemented in modern wireless networks. This will facilitate cooperation among users for limited resources, such as time and frequency bands. As well as ensuring that there is an adequate supply of energy for reliable and efficient communication, resource allocation also provides a roadmap for each individual user to follow in order to consume the right amount of energy. In D2D networks with time, frequency, and power constraints, significant computing power is generally required to achieve a joint resource management design. Thus the purpose of this study is to develop a resource allocation scheme that is based on spectrum sharing and enables low-cost computations for EH-assisted D2D and IoT communication. Until now, there has been no study examining resource allocation design for EH-enabled IoT networks with SWIPT-enabled D2D schemes that utilize learning techniques and convex optimization. In most of the works, optimization and iterative approaches with a high level of computational complexity have been used which is not feasible in many IoT applications. In order to overcome these obstacles, a learning-based resource allocation mechanism based on the SWIPT scheme in IoT networks is proposed, where users are able to harvest energy from different sources. The system model consists of multiple IoT users, one BS, and multiple D2D pairs in EH-based IoT networks. As a means of developing an energy-efficient system, we consider the SWIPT scheme with D2D pairs employing the time switching method (TS) to capture energy from the environment, whereas IoT users employ the power splitting method (PS) to harvest energy from the BS. A mixed-integer nonlinear programming (MINLP) approach is presented for the solution of the Energy Efficiency (EE) problem by jointly optimizing subchannel allocation, power-splitting factor, power, and time together. As part of the optimization approach, the original EE optimization problem is decomposed into three subproblems, namely: (a) subchannel assignment and power splitting factor, (b) power allocation, and (c) time allocation. In order to solve the subproblem assignment problem, which involves discrete variables, the Q-learning approach is employed. Due to the large size of the overall problem and the continuous nature of certain variables, it is impractical to optimize all variables by using the learning technique. Instead dealing for the continuous variable problems, namely power and time allocation, the original non-convex problem is first transformed into a convex one, then the Majorization-Minimization (MM) approach is applied as well as the Dinkelbach. The performance of the proposed joint Q-learning and optimization algorithm has been evaluated in detail. In particular, the solution was compared with a linear EH model, as well as two heuristic algorithms, namely the constrained allocation algorithm and the random allocation algorithm, in order to determine its performance. The results indicate that the technique is superior to conventional approaches. For example, it can be seen that for the distance of $d = 10$ m, our proposed algorithm leads to EE improvement when compared to the method such as prematching algorithm, constrained allocation, and random allocation methods by about 5.26\%, 110.52\%, and 143.90\%, respectively. Considering the simulation results, the proposed algorithm is superior to other methods in the literature. Using spectrum sharing and harvesting energy from D2D and IoT devices achieves impressive EE gains. This superior performance can be seen both in terms of the average and sum EEs, as well as when compared to other baseline schemes