A review on green caching strategies for next generation communication networks

© 2020 IEEE. In recent years, the ever-increasing demand for networking resources and energy, fueled by the unprecedented upsurge in Internet traffic, has been a cause for concern for many service providers. Content caching, which serves user requests locally, is deemed to be an enabling technology in addressing the challenges offered by the phenomenal growth in Internet traffic. Conventionally, content caching is considered as a viable solution to alleviate the backhaul pressure. However, recently, many studies have reported energy cost reductions contributed by content caching in cache-equipped networks. The hypothesis is that caching shortens content delivery distance and eventually achieves significant reduction in transmission energy consumption. This has motivated us to conduct this study and in this article, a comprehensive survey of the state-of-the-art green caching techniques is provided. This review paper extensively discusses contributions of the existing studies on green caching. In addition, the study explores different cache-equipped network types, solution methods, and application scenarios. We categorically present that the optimal selection of the caching nodes, smart resource management, popular content selection, and renewable energy integration can substantially improve energy efficiency of the cache-equipped systems. In addition, based on the comprehensive analysis, we also highlight some potential research ideas relevant to green content caching

MDP-Based Scheduling Design for Mobile-Edge Computing Systems with Random User Arrival

In this paper, we investigate the scheduling design of a mobile-edge computing (MEC) system, where the random arrival of mobile devices with computation tasks in both spatial and temporal domains is considered. The binary computation offloading model is adopted. Every task is indivisible and can be computed at either the mobile device or the MEC server. We formulate the optimization of task offloading decision, uplink transmission device selection and power allocation in all the frames as an infinite-horizon Markov decision process (MDP). Due to the uncertainty in device number and location, conventional approximate MDP approaches to addressing the curse of dimensionality cannot be applied. A novel low-complexity sub-optimal solution framework is then proposed. We first introduce a baseline scheduling policy, whose value function can be derived analytically. Then, one-step policy iteration is adopted to obtain a sub-optimal scheduling policy whose performance can be bounded analytically. Simulation results show that the gain of the sub-optimal policy over various benchmarks is significant.Comment: 6 pages, 3 figures; accepted by Globecom 2019; title changed to better describe the work, introduction condensed, typos correcte

Reinforcement learning for proactive content caching in wireless networks

Proactive content caching (PC) at the edge of wireless networks, that is, at the base stations (BSs) and/or user equipments (UEs), is a promising strategy to successfully handle the ever-growing mobile data traffic and to improve the quality-of-service for content delivery over wireless networks. However, factors such as limitations in storage capacity, time-variations in wireless channel conditions as well as in content demand profile pose challenges that need to be addressed in order to realise the benefits of PC at the wireless edge. This thesis aims to develop PC solutions that address these challenges. We consider PC directly at UEs equipped with finite capacity cache memories. This consideration is done within the framework of a dynamic system, where mobile users randomly request contents from a non-stationary content library; new contents are added to the library over time and each content may remain in the library for a random lifetime within which it may be requested. Contents are delivered through wireless channels with time-varying quality, and any time contents are transmitted, a transmission cost associated with the number of bits downloaded and the channel quality of the receiving user(s) at that time is incurred by the system. We formulate each considered problem as a Markov decision process with the objective of minimising the long term expected average cost on the system. We then use reinforcement learning (RL) to solve this highly challenging problem with a prohibitively large state and action spaces. In particular, we employ policy approximation techniques for compact representation of complex policy structures, and policy gradient RL methods to train the system. In a single-user problem setting that we consider, we show the optimality of a threshold-based PC scheme that is adaptive to system dynamics. We use this result to characterise and design a multicast-aware PC scheme, based on deep RL framework, when we consider a multi-user problem setting. We perform extensive numerical simulations of the schemes we propose. Our results show not only significant improvements against the state-of-the-art reactive content delivery approaches, but also near-optimality of the proposed RL solutions based on comparisons with some lower bounds.Open Acces

Towards Smart Vehicular Environments via Deep Learning and Emerging Technologies

Intelligent Transportation Systems (ITS) embrace smart vehicular environments through a fully connected paradigm known as vehicular networks. Vehicular networks allow automobiles to stay online and connected with their surroundings while travelling. In that sense, vehicular networks enable various activities; for example, autonomous driving, road surveillance, data collection, content delivery, and many others. This leads to more efficient, safer, and comfort driving experiences and opens up new opportunities for many business sectors. As such, the networking industry and academia have shown great interests in advancing vehicular networks and leveraging relevant services. In this dissertation, several vehicular network problems are addressed along with proposing novel ideas and utilizing effective solutions. As opposed to stationary or slow moving communications, vehicular networks experience more challenging environment as a result of vehicle mobility. Consequently, vehicular networks suffer from ever-changing topology, short contact times, and intractable propagation environments. In particular, this dissertation presents six works that participate in supplementing the literature as follows. First, a content delivery framework in the context of vehicular network is studied where digital contents are generated by different content providers (CP) and have distinct values. To this end, a prefetching technique along with vehicle to vehicle (V2V) and vehicle to infrastructure (V2I) communications are used to enable fast content delivery. Furthermore, a pricing model is proposed to deal with contents' values to attain a satisfactory Quality of Experience (QoE). Second, a more advanced system model is discussed to cache contents with the assistance of vehicles and to enable a disconnected and fixed Road-Side Unit (RSU) to participate in providing content delivery services. The changing popularity of contents is investigated besides accounting for the limited RSU cache capabilities. Third, the stationary RSU proposed in the second work is replaced by a more flexible infrastructure, namely an aerial RSU mounted on an unmanned aerial vehicle (UAV). The mobility of the UAV and its constrained energy capacity are analyzed and Deep Reinforcement Learning is incorporated to aid in solving the challenges in leveraging UAVs. Fourth, the previous two studies are integrated by investigating the collaboration between a UAV and terrestrial RSUs in delivering large-size contents. A strategy to fill up the UAV cache is also suggested via mulling contents over vehicles. Fifth, the complexity of vehicular urban environments is addressed. In particular, the problem of disconnected areas in vehicular environments due to the appearance of high-rise buildings and other obstacles is studied. In details, a Reconfigurable Intelligent Surface (RIS) is exploited to provide indirect links between the RSU and vehicles travelling through such areas. Our sixth and final contribution deals with time-constrained Internet of Things (IoT) devices (IoTD) supporting ITS networks. In this regard, a UAV is dispatched to collect their data timely and fully while being assisted by a RIS to improve the wireless channel quality. In the end, this dissertation provides discussions that highlight open research directions worth of further investigations