4,293 research outputs found
Towards Optimally Decentralized Multi-Robot Collision Avoidance via Deep Reinforcement Learning
Developing a safe and efficient collision avoidance policy for multiple
robots is challenging in the decentralized scenarios where each robot generate
its paths without observing other robots' states and intents. While other
distributed multi-robot collision avoidance systems exist, they often require
extracting agent-level features to plan a local collision-free action, which
can be computationally prohibitive and not robust. More importantly, in
practice the performance of these methods are much lower than their centralized
counterparts.
We present a decentralized sensor-level collision avoidance policy for
multi-robot systems, which directly maps raw sensor measurements to an agent's
steering commands in terms of movement velocity. As a first step toward
reducing the performance gap between decentralized and centralized methods, we
present a multi-scenario multi-stage training framework to find an optimal
policy which is trained over a large number of robots on rich, complex
environments simultaneously using a policy gradient based reinforcement
learning algorithm. We validate the learned sensor-level collision avoidance
policy in a variety of simulated scenarios with thorough performance
evaluations and show that the final learned policy is able to find time
efficient, collision-free paths for a large-scale robot system. We also
demonstrate that the learned policy can be well generalized to new scenarios
that do not appear in the entire training period, including navigating a
heterogeneous group of robots and a large-scale scenario with 100 robots.
Videos are available at https://sites.google.com/view/drlmac
An orchestrator for networked control systems and its application to collision avoidance in multiple mobile robots.
Networked Control System (NCS) consists of controlled distributed nodes while an Orchestrator functions as a central coordinator for controlling the distributed tasks. The NCSs have challenges of coordination and right execution sequencing of operations. This paper proposes a framework named Controlled Orchestrator (COrch) for coordinating and sequencing the tasks of NCSs. An experiment was performed with three robotic vehicles that are considered as individual control system. Furthermore, the proposed orchestrator COrch decided the sequencing of operations of the robots while performing obstacle avoidance task for spatially distributed robots in parallel. COrch is used to control this task by utilizing the concept of Remote Method Invocation (RMI) and multithreading. RMI is used to prepare the software for controlling the robots at remote end while multithreading is used to perform parallel and synchronize execution of multiple robots. The remote end software generates signals for sequential, parallel and hybrid mode execution
Cloud-Based Centralized/Decentralized Multi-Agent Optimization with Communication Delays
We present and analyze a computational hybrid architecture for performing
multi-agent optimization. The optimization problems under consideration have
convex objective and constraint functions with mild smoothness conditions
imposed on them. For such problems, we provide a primal-dual algorithm
implemented in the hybrid architecture, which consists of a decentralized
network of agents into which centralized information is occasionally injected,
and we establish its convergence properties. To accomplish this, a central
cloud computer aggregates global information, carries out computations of the
dual variables based on this information, and then distributes the updated dual
variables to the agents. The agents update their (primal) state variables and
also communicate among themselves with each agent sharing and receiving state
information with some number of its neighbors. Throughout, communications with
the cloud are not assumed to be synchronous or instantaneous, and communication
delays are explicitly accounted for in the modeling and analysis of the system.
Experimental results are presented to support the theoretical developments
made.Comment: 8 pages, 4 figure
Performance evaluation of a distributed integrative architecture for robotics
The eld of robotics employs a vast amount of coupled sub-systems. These need to interact
cooperatively and concurrently in order to yield the desired results. Some hybrid algorithms
also require intensive cooperative interactions internally. The architecture proposed lends it-
self amenable to problem domains that require rigorous calculations that are usually impeded
by the capacity of a single machine, and incompatibility issues between software computing
elements. Implementations are abstracted away from the physical hardware for ease of de-
velopment and competition in simulation leagues. Monolithic developments are complex, and
the desire for decoupled architectures arises. Decoupling also lowers the threshold for using
distributed and parallel resources. The ability to re-use and re-combine components on de-
mand, therefore is essential, while maintaining the necessary degree of interaction. For this
reason we propose to build software components on top of a Service Oriented Architecture
(SOA) using Web Services. An additional bene t is platform independence regarding both
the operating system and the implementation language. The robot soccer platform as well
as the associated simulation leagues are the target domain for the development. Furthermore
are machine vision and remote process control related portions of the architecture currently
in development and testing for industrial environments. We provide numerical data based on
the Python frameworks ZSI and SOAPpy undermining the suitability of this approach for the
eld of robotics. Response times of signi cantly less than 50 ms even for fully interpreted,
dynamic languages provides hard information showing the feasibility of Web Services based
SOAs even in time critical robotic applications
- …