Online Learning for Offloading and Autoscaling in Energy Harvesting Mobile Edge Computing

Mobile edge computing (a.k.a. fog computing) has recently emerged to enable in-situ processing of delay-sensitive applications at the edge of mobile networks. Providing grid power supply in support of mobile edge computing, however, is costly and even infeasible (in certain rugged or under-developed areas), thus mandating on-site renewable energy as a major or even sole power supply in increasingly many scenarios. Nonetheless, the high intermittency and unpredictability of renewable energy make it very challenging to deliver a high quality of service to users in energy harvesting mobile edge computing systems. In this paper, we address the challenge of incorporating renewables into mobile edge computing and propose an efficient reinforcement learning-based resource management algorithm, which learns on-the-fly the optimal policy of dynamic workload offloading (to the centralized cloud) and edge server provisioning to minimize the long-term system cost (including both service delay and operational cost). Our online learning algorithm uses a decomposition of the (offline) value iteration and (online) reinforcement learning, thus achieving a significant improvement of learning rate and run-time performance when compared to standard reinforcement learning algorithms such as Q-learning. We prove the convergence of the proposed algorithm and analytically show that the learned policy has a simple monotone structure amenable to practical implementation. Our simulation results validate the efficacy of our algorithm, which significantly improves the edge computing performance compared to fixed or myopic optimization schemes and conventional reinforcement learning algorithms.Comment: arXiv admin note: text overlap with arXiv:1701.01090 by other author

Energy sustainable paradigms and methods for future mobile networks: A survey

In this survey, we discuss the role of energy in the design of future mobile networks and, in particular, we advocate and elaborate on the use of energy harvesting (EH) hardware as a means to decrease the environmental footprint of 5G technology. To take full advantage of the harvested (renewable) energy, while still meeting the quality of service required by dense 5G deployments, suitable management techniques are here reviewed, highlighting the open issues that are still to be solved to provide eco-friendly and cost-effective mobile architectures. Several solutions have recently been proposed to tackle capacity, coverage and efficiency problems, including: C-RAN, Software Defined Networking (SDN) and fog computing, among others. However, these are not explicitly tailored to increase the energy efficiency of networks featuring renewable energy sources, and have the following limitations: (i) their energy savings are in many cases still insufficient and (ii) they do not consider network elements possessing energy harvesting capabilities. In this paper, we systematically review existing energy sustainable paradigms and methods to address points (i) and (ii), discussing how these can be exploited to obtain highly efficient, energy self-sufficient and high capacity networks. Several open issues have emerged from our review, ranging from the need for accurate energy, transmission and consumption models, to the lack of accurate data traffic profiles, to the use of power transfer, energy cooperation and energy trading techniques. These challenges are here discussed along with some research directions to follow for achieving sustainable 5G systems.Comment: Accepted by Elsevier Computer Communications, 21 pages, 9 figure

Next-Generation Environment-Aware Cellular Networks: Modern Green Techniques and Implementation Challenges

Over the last decade, mobile communications have been witnessing a noteworthy increase of data traffic demand that is causing an enormous energy consumption in cellular networks. The reduction of their fossil fuel consumption in addition to the huge energy bills paid by mobile operators is considered as the most important challenges for the next-generation cellular networks. Although most of the proposed studies were focusing on individual physical layer power optimizations, there is a growing necessity to meet the green objective of fifth-generation cellular networks while respecting the user's quality of service. This paper investigates four important techniques that could be exploited separately or together in order to enable wireless operators achieve

The design and optimization of cooperative mobile edge

As the world is charging towards the Internet of Things (IoT) era, an enormous amount of sensors will be rapidly empowered with internet connectivity. Besides the fact that the end devices are getting more diverse, some of them are also becoming more powerful, such that they can function as standalone mobile computing units with multiple wireless network interfaces. At the network end, various facilities are also pushed to the mobile edge to foster internet connections. Distributed small scale cloud resources and green energy harvesters can be directly attached to the deployed heterogeneous base stations. Different from the traditional wireless access networks, where the only dynamics come from the user mobility, the evolving mobile edge will be operated in the constantly changing and volatile environment. The harvested green energy will be highly dependent on the available energy sources, and the dense deployment of a variety of wireless access networks will result in intense radio resource contention. Consequently, the wireless networks are facing great challenges in terms of capacity, latency, energy/spectrum efficiency, and security. Equivalently, balancing the dynamic network resource demand and supply is essential to the smooth network operation. Leveraging the broadcasting nature of wireless data transmission, network nodes can cooperate with each other by either allowing users to connect with multiple base stations simultaneously or offloading user workloads to neighboring base stations. Moreover, grid facilitated and radio frequency signal enabled renewable energy sharing among network nodes are introduced in this dissertation. In particular, the smart grid can transfer the green energy harvested by each individual network node from one place to another. The network node can also transmit energy from one to another using radio frequency energy transfer. This dissertation addresses the cooperative network resource management to improve the energy efficiency of the mobile edge. First, the energy efficient cooperative data transmission scheme is designed to cooperatively allocate the radio resources of the wireless networks, including spectrum and power, to the mobile users. Then, the cooperative data transmission and wireless energy sharing scheme is designed to optimize both the energy and data transmission in the network. Finally, the cooperative data transmission and wired energy sharing scheme is designed to optimize the energy flow within the smart grid and the data transmission in the network. As future work, how to motivate multiple parties to cooperate and how to guarantee the security of the cooperative mobile edge is discussed. On one hand, the incentive scheme for each individual network node with distributed storage and computing resources is designed to improve network performance in terms of latency. On the other hand, how to leverage network cooperation to balance the tradeoff between efficiency (energy efficiency and latency) and security (confidentiality and privacy) is expounded

Energy Harvesting and Energy Storage Systems

This book discuss the recent developments in energy harvesting and energy storage systems. Sustainable development systems are based on three pillars: economic development, environmental stewardship, and social equity. One of the guiding principles for finding the balance between these pillars is to limit the use of non-renewable energy sources