212,782 research outputs found
Online Service Migration in Edge Computing with Incomplete Information: A Deep Recurrent Actor-Critic Method
Multi-access Edge Computing (MEC) is an emerging computing paradigm that
extends cloud computing to the network edge (e.g., base stations, MEC servers)
to support resource-intensive applications on mobile devices. As a crucial
problem in MEC, service migration needs to decide where to migrate user
services for maintaining high Quality-of-Service (QoS), when users roam between
MEC servers with limited coverage and capacity. However, finding an optimal
migration policy is intractable due to the highly dynamic MEC environment and
user mobility. Many existing works make centralized migration decisions based
on complete system-level information, which can be time-consuming and suffer
from the scalability issue with the rapidly increasing number of mobile users.
To address these challenges, we propose a new learning-driven method, namely
Deep Recurrent Actor-Critic based service Migration (DRACM), which is
user-centric and can make effective online migration decisions given incomplete
system-level information. Specifically, the service migration problem is
modeled as a Partially Observable Markov Decision Process (POMDP). To solve the
POMDP, we design an encoder network that combines a Long Short-Term Memory
(LSTM) and an embedding matrix for effective extraction of hidden information.
We then propose a tailored off-policy actor-critic algorithm with a clipped
surrogate objective for efficient training. Results from extensive experiments
based on real-world mobility traces demonstrate that our method consistently
outperforms both the heuristic and state-of-the-art learning-driven algorithms,
and achieves near-optimal results on various MEC scenarios
Online Service Migration in Mobile Edge with Incomplete System Information:A Deep Recurrent Actor-Critic Learning Approach
Multi-access Edge Computing (MEC) is an emerging computing paradigm that extends cloud computing to the network edge to support resource-intensive applications on mobile devices. As a crucial problem in MEC, service migration needs to decide how to migrate user services for maintaining the Quality-of-Service when users roam between MEC servers with limited coverage and capacity. However, finding an optimal migration policy is intractable due to the dynamic MEC environment and user mobility. Many existing studies make centralized migration decisions based on complete system-level information, which is time-consuming and also lacks desirable scalability. To address these challenges, we propose a novel learning-driven method, which is user-centric and can make effective online migration decisions by utilizing incomplete system-level information. Specifically, the service migration problem is modeled as a Partially Observable Markov Decision Process (POMDP). To solve the POMDP, we design a new encoder network that combines a Long Short-Term Memory (LSTM) and an embedding matrix for effective extraction of hidden information, and further propose a tailored off-policy actor-critic algorithm for efficient training. The extensive experimental results based on real-world mobility traces demonstrate that this new method consistently outperforms both the heuristic and state-of-the-art learning-driven algorithms and can achieve near-optimal results on various MEC scenarios
Learning and Reasoning Strategies for User Association in Ultra-dense Small Cell Vehicular Networks
Recent vehicular ad hoc networks research has been focusing on providing intelligent transportation services by employing information and communication technologies on road transport. It has been understood that advanced demands such as reliable connectivity, high user throughput, and ultra-low latency required by these services cannot be met using traditional communication technologies.
Consequently, this thesis reports on the application of artificial intelligence to user association as a technology enabler in ultra-dense small cell vehicular networks. In particular, the work focuses on mitigating mobility-related concerns and networking issues at different mobility levels by employing diverse heuristic as well as reinforcement learning (RL) methods.
Firstly, driven by rapid fluctuations in the network topology and the radio environment, a conventional, three-step sequence user association policy is designed to highlight and explore the impact of vehicle speed and different performance indicators on network quality of service (QoS) and user experience. Secondly, inspired by control-theoretic models and dynamic programming, a real-time controlled feedback user association approach is proposed. The algorithm adapts to the changing vehicular environment by employing derived network performance information as a heuristic, resulting in improved network performance. Thirdly, a sequence of novel RL based user association algorithms are developed that employ variable learning rate, variable rewards function and adaptation of the control feedback framework to improve the initial and steady-state learning performance. Furthermore, to accelerate the learning process and enhance the adaptability and robustness of the developed RL algorithms, heuristically accelerated RL and case-based transfer learning methods are employed.
A comprehensive, two-tier, event-based, system level simulator which is an integration of a dynamic vehicular network, a highway, and an ultra-dense small cell network is developed. The model has enabled the analysis of user mobility effects on the network performance across different mobility levels as well as served as a firm foundation for the evaluation of the empirical properties of the investigated approaches
A Framework for Integrating Transportation Into Smart Cities
In recent years, economic, environmental, and political forces have quickly given rise to “Smart Cities” -- an array of strategies that can transform transportation in cities. Using a multi-method approach to research and develop a framework for smart cities, this study provides a framework that can be employed to: Understand what a smart city is and how to replicate smart city successes; The role of pilot projects, metrics, and evaluations to test, implement, and replicate strategies; and Understand the role of shared micromobility, big data, and other key issues impacting communities.
This research provides recommendations for policy and professional practice as it relates to integrating transportation into smart cities
Mobility Study for Named Data Networking in Wireless Access Networks
Information centric networking (ICN) proposes to redesign the Internet by
replacing its host-centric design with information-centric design.
Communication among entities is established at the naming level, with the
receiver side (referred to as the Consumer) acting as the driving force behind
content delivery, by interacting with the network through Interest message
transmissions. One of the proposed advantages for ICN is its support for
mobility, by de-coupling applications from transport semantics. However, so
far, little research has been conducted to understand the interaction between
ICN and mobility of consuming and producing applications, in protocols purely
based on information-centric principles, particularly in the case of NDN. In
this paper, we present our findings on the mobility-based performance of Named
Data Networking (NDN) in wireless access networks. Through simulations, we show
that the current NDN architecture is not efficient in handling mobility and
architectural enhancements needs to be done to fully support mobility of
Consumers and Producers.Comment: to appear in IEEE ICC 201
- …