11,129 research outputs found
Thirty Years of Machine Learning: The Road to Pareto-Optimal Wireless Networks
Future wireless networks have a substantial potential in terms of supporting
a broad range of complex compelling applications both in military and civilian
fields, where the users are able to enjoy high-rate, low-latency, low-cost and
reliable information services. Achieving this ambitious goal requires new radio
techniques for adaptive learning and intelligent decision making because of the
complex heterogeneous nature of the network structures and wireless services.
Machine learning (ML) algorithms have great success in supporting big data
analytics, efficient parameter estimation and interactive decision making.
Hence, in this article, we review the thirty-year history of ML by elaborating
on supervised learning, unsupervised learning, reinforcement learning and deep
learning. Furthermore, we investigate their employment in the compelling
applications of wireless networks, including heterogeneous networks (HetNets),
cognitive radios (CR), Internet of things (IoT), machine to machine networks
(M2M), and so on. This article aims for assisting the readers in clarifying the
motivation and methodology of the various ML algorithms, so as to invoke them
for hitherto unexplored services as well as scenarios of future wireless
networks.Comment: 46 pages, 22 fig
CoLight: Learning Network-level Cooperation for Traffic Signal Control
Cooperation among the traffic signals enables vehicles to move through
intersections more quickly. Conventional transportation approaches implement
cooperation by pre-calculating the offsets between two intersections. Such
pre-calculated offsets are not suitable for dynamic traffic environments. To
enable cooperation of traffic signals, in this paper, we propose a model,
CoLight, which uses graph attentional networks to facilitate communication.
Specifically, for a target intersection in a network, CoLight can not only
incorporate the temporal and spatial influences of neighboring intersections to
the target intersection, but also build up index-free modeling of neighboring
intersections. To the best of our knowledge, we are the first to use graph
attentional networks in the setting of reinforcement learning for traffic
signal control and to conduct experiments on the large-scale road network with
hundreds of traffic signals. In experiments, we demonstrate that by learning
the communication, the proposed model can achieve superior performance against
the state-of-the-art methods.Comment: 10 pages. Proceedings of the 28th ACM International on Conference on
Information and Knowledge Management. ACM, 201
Recommended from our members
Developing an Adaptive Strategy for Connected Eco-Driving Under Uncertain Traffic and Signal Conditions
The Eco-Approach and Departure (EAD) application has been proved to be environmentally efficient for a Connected and Automated Vehicles (CAVs) system. In the real-world traffic, traffic conditions and signal timings are usually dynamic and uncertain due to mixed vehicle types, various driving behaviors and limited sensing range, which is challenging in EAD development. This research proposes an adaptive strategy for connected eco-driving towards a signalized intersection under real world conditions. Stochastic graph models are built to link the vehicle and external (e.g., traffic, signal) data and dynamic programing is applied to identify the optimal speed for each vehicle-state efficiently. From energy perspective, adaptive strategy using traffic data could double the effective sensor range in eco-driving. A hybrid reinforcement learning framework is also developed for EAD in mixed traffic condition using both short-term benefit and long-term benefit as the action reward. Micro-simulation is conducted in Unity to validate the method, showing over 20% energy saving.View the NCST Project Webpag
A Survey on Graph Neural Networks in Intelligent Transportation Systems
Intelligent Transportation System (ITS) is vital in improving traffic
congestion, reducing traffic accidents, optimizing urban planning, etc.
However, due to the complexity of the traffic network, traditional machine
learning and statistical methods are relegated to the background. With the
advent of the artificial intelligence era, many deep learning frameworks have
made remarkable progress in various fields and are now considered effective
methods in many areas. As a deep learning method, Graph Neural Networks (GNNs)
have emerged as a highly competitive method in the ITS field since 2019 due to
their strong ability to model graph-related problems. As a result, more and
more scholars pay attention to the applications of GNNs in transportation
domains, which have shown excellent performance. However, most of the research
in this area is still concentrated on traffic forecasting, while other ITS
domains, such as autonomous vehicles and urban planning, still require more
attention. This paper aims to review the applications of GNNs in six
representative and emerging ITS domains: traffic forecasting, autonomous
vehicles, traffic signal control, transportation safety, demand prediction, and
parking management. We have reviewed extensive graph-related studies from 2018
to 2023, summarized their methods, features, and contributions, and presented
them in informative tables or lists. Finally, we have identified the challenges
of applying GNNs to ITS and suggested potential future directions
Human Motion Trajectory Prediction: A Survey
With growing numbers of intelligent autonomous systems in human environments,
the ability of such systems to perceive, understand and anticipate human
behavior becomes increasingly important. Specifically, predicting future
positions of dynamic agents and planning considering such predictions are key
tasks for self-driving vehicles, service robots and advanced surveillance
systems. This paper provides a survey of human motion trajectory prediction. We
review, analyze and structure a large selection of work from different
communities and propose a taxonomy that categorizes existing methods based on
the motion modeling approach and level of contextual information used. We
provide an overview of the existing datasets and performance metrics. We
discuss limitations of the state of the art and outline directions for further
research.Comment: Submitted to the International Journal of Robotics Research (IJRR),
37 page
Multi-Agent Reinforcement Learning for Connected and Automated Vehicles Control: Recent Advancements and Future Prospects
Connected and automated vehicles (CAVs) have emerged as a potential solution
to the future challenges of developing safe, efficient, and eco-friendly
transportation systems. However, CAV control presents significant challenges,
given the complexity of interconnectivity and coordination required among the
vehicles. To address this, multi-agent reinforcement learning (MARL), with its
notable advancements in addressing complex problems in autonomous driving,
robotics, and human-vehicle interaction, has emerged as a promising tool for
enhancing the capabilities of CAVs. However, there is a notable absence of
current reviews on the state-of-the-art MARL algorithms in the context of CAVs.
Therefore, this paper delivers a comprehensive review of the application of
MARL techniques within the field of CAV control. The paper begins by
introducing MARL, followed by a detailed explanation of its unique advantages
in addressing complex mobility and traffic scenarios that involve multiple
agents. It then presents a comprehensive survey of MARL applications on the
extent of control dimensions for CAVs, covering critical and typical scenarios
such as platooning control, lane-changing, and unsignalized intersections. In
addition, the paper provides a comprehensive review of the prominent simulation
platforms used to create reliable environments for training in MARL. Lastly,
the paper examines the current challenges associated with deploying MARL within
CAV control and outlines potential solutions that can effectively overcome
these issues. Through this review, the study highlights the tremendous
potential of MARL to enhance the performance and collaboration of CAV control
in terms of safety, travel efficiency, and economy
Big data analytics:Computational intelligence techniques and application areas
Big Data has significant impact in developing functional smart cities and supporting modern societies. In this paper, we investigate the importance of Big Data in modern life and economy, and discuss challenges arising from Big Data utilization. Different computational intelligence techniques have been considered as tools for Big Data analytics. We also explore the powerful combination of Big Data and Computational Intelligence (CI) and identify a number of areas, where novel applications in real world smart city problems can be developed by utilizing these powerful tools and techniques. We present a case study for intelligent transportation in the context of a smart city, and a novel data modelling methodology based on a biologically inspired universal generative modelling approach called Hierarchical Spatial-Temporal State Machine (HSTSM). We further discuss various implications of policy, protection, valuation and commercialization related to Big Data, its applications and deployment
- …