Multi-Robot Systems: Challenges, Trends and Applications

This book is a printed edition of the Special Issue entitled “Multi-Robot Systems: Challenges, Trends, and Applications” that was published in Applied Sciences. This Special Issue collected seventeen high-quality papers that discuss the main challenges of multi-robot systems, present the trends to address these issues, and report various relevant applications. Some of the topics addressed by these papers are robot swarms, mission planning, robot teaming, machine learning, immersive technologies, search and rescue, and social robotics

Deployment of Heterogeneous Swarm Robotic Agents Using a Task-Oriented Utility-Based Algorithm

In a swarm robotic system, the desired collective behavior emerges from local decisions made by robots, themselves, according to their environment. Swarm robotics is an emerging area that has attracted many researchers over the last few years. It has been proven that a single robot with multiple capabilities cannot complete an intended job within the same time frame as that of multiple robotic agents. A swarm of robots, each one with its own capabilities, are more flexible, robust, and cost-effective than an individual robot. As a result of a comprehensive investigation of the current state of swarm robotic research, this dissertation demonstrates how current swarm deployment systems lack the ability to coordinate heterogeneous robotic agents. Moreover, this dissertation's objective shall define the starting point of potential algorithms that lead to the development of a new software environment interface. This interface will assign a set of collaborative tasks to the swarm system without being concerned about the underlying hardware of the heterogeneous robotic agents. The ultimate goal of this research is to develop a task-oriented software application that facilitates the rapid deployment of multiple robotic agents. The task solutions are created at run-time, and executed by the agents in a centralized or decentralized fashion. Tasks are fractioned into smaller sub-tasks which are, then, assigned to the optimal number of robots using a novel Robot Utility Based Task Assignment (RUTA) algorithm. The system deploys these robots using it's application program interfaces (API's) and uploads programs that are integrated with a small routine code. The embedded routine allows robots to configure solutions when the decentralized approach is adopted. In addition, the proposed application also offers customization of robotic platforms by simply defining the available sensing and actuation devices. Another objective of the system is to improve code and component reusability to reduce efforts in deploying tasks to swarm robotic agents. Usage of the proposed framework prevents the need to redesign or rewrite programs should any changes take place in the robot's platform

General Concepts for Human Supervision of Autonomous Robot Teams

For many dangerous, dirty or dull tasks like in search and rescue missions, deployment of autonomous teams of robots can be beneficial due to several reasons. First, robots can replace humans in the workspace. Second, autonomous robots reduce the workload of a human compared to teleoperated robots, and therefore multiple robots can in principle be supervised by a single human. Third, teams of robots allow distributed operation in time and space. This thesis investigates concepts of how to efficiently enable a human to supervise and support an autonomous robot team, as common concepts for teleoperation of robots do not apply because of the high mental workload. The goal is to find a way in between the two extremes of full autonomy and pure teleoperation, by allowing to adapt the robots’ level of autonomy to the current situation and the needs of the human supervisor. The methods presented in this thesis make use of the complementary strengths of humans and robots, by letting the robots do what they are good at, while the human should support the robots in situations that correspond to the human strengths. To enable this type of collaboration between a human and a robot team, the human needs to have an adequate knowledge about the current state of the robots, the environment, and the mission. For this purpose, the concept of situation overview (SO) has been developed in this thesis, which is composed of the two components robot SO and mission SO. Robot SO includes information about the state and activities of each single robot in the team, while mission SO deals with the progress of the mission and the cooperation between the robots. For obtaining SO a new event-based communication concept is presented in this thesis, that allows the robots to aggregate information into discrete events using methods from complex event processing. The quality and quantity of the events that are actually sent to the supervisor can be adapted during runtime by defining positive and negative policies for (not) sending events that fulfill specific criteria. This reduces the required communication bandwidth compared to sending all available data. Based on SO, the supervisor is enabled to efficiently interact with the robot team. Interactions can be initiated either by the human or by the robots. The developed concept for robot-initiated interactions is based on queries, that allow the robots to transfer decisions to another process or the supervisor. Various modes for answering the queries, ranging from fully autonomous to pure human decisions, allow to adapt the robots’ level of autonomy during runtime. Human-initiated interactions are limited to high-level commands, whereas interactions on the action level (e. g., teleoperation) are avoided, to account for the specific strengths of humans and robots. These commands can in principle be applied to quite general classes of task allocation methods for autonomous robot teams, e. g., in terms of specific restrictions, which are introduced into the system as constraints. In that way, the desired allocations emerge implicitly because of the introduced constraints, and the task allocation method does not need to be aware of the human supervisor in the loop. This method is applicable to different task allocation approaches, e. g., instantaneous or time-extended task assignments, and centralized or distributed algorithms. The presented methods are evaluated by a number of different experiments with physical and simulated scenarios from urban search and rescue as well as robot soccer, and during robot competitions. The results show that with these methods a human supervisor can significantly improve the robot team performance

Spatial representation for planning and executing robot behaviors in complex environments

Robots are already improving our well-being and productivity in different applications such as industry, health-care and indoor service applications. However, we are still far from developing (and releasing) a fully functional robotic agent that can autonomously survive in tasks that require human-level cognitive capabilities. Robotic systems on the market, in fact, are designed to address specific applications, and can only run pre-defined behaviors to robustly repeat few tasks (e.g., assembling objects parts, vacuum cleaning). They internal representation of the world is usually constrained to the task they are performing, and does not allows for generalization to other scenarios. Unfortunately, such a paradigm only apply to a very limited set of domains, where the environment can be assumed to be static, and its dynamics can be handled before deployment. Additionally, robots configured in this way will eventually fail if their "handcrafted'' representation of the environment does not match the external world. Hence, to enable more sophisticated cognitive skills, we investigate how to design robots to properly represent the environment and behave accordingly. To this end, we formalize a representation of the environment that enhances the robot spatial knowledge to explicitly include a representation of its own actions. Spatial knowledge constitutes the core of the robot understanding of the environment, however it is not sufficient to represent what the robot is capable to do in it. To overcome such a limitation, we formalize SK4R, a spatial knowledge representation for robots which enhances spatial knowledge with a novel and "functional" point of view that explicitly models robot actions. To this end, we exploit the concept of affordances, introduced to express opportunities (actions) that objects offer to an agent. To encode affordances within SK4R, we define the "affordance semantics" of actions that is used to annotate an environment, and to represent to which extent robot actions support goal-oriented behaviors. We demonstrate the benefits of a functional representation of the environment in multiple robotic scenarios that traverse and contribute different research topics relating to: robot knowledge representations, social robotics, multi-robot systems and robot learning and planning. We show how a domain-specific representation, that explicitly encodes affordance semantics, provides the robot with a more concrete understanding of the environment and of the effects that its actions have on it. The goal of our work is to design an agent that will no longer execute an action, because of mere pre-defined routine, rather, it will execute an actions because it "knows'' that the resulting state leads one step closer to success in its task

Motion Primitives and Planning for Robots with Closed Chain Systems and Changing Topologies

When operating in human environments, a robot should use predictable motions that allow humans to trust and anticipate its behavior. Heuristic search-based planning offers predictable motions and guarantees on completeness and sub-optimality of solutions. While search-based planning on motion primitive-based (lattice-based) graphs has been used extensively in navigation, application to high-dimensional state-spaces has, until recently, been thought impractical. This dissertation presents methods we have developed for applying these graphs to mobile manipulation, specifically for systems which contain closed chains. The formation of closed chains in tasks that involve contacts with the environment may reduce the number of available degrees-of-freedom but adds complexity in terms of constraints in the high-dimensional state-space. We exploit the dimensionality reduction inherent in closed kinematic chains to get efficient search-based planning. Our planner handles changing topologies (switching between open and closed-chains) in a single plan, including what transitions to include and when to include them. Thus, we can leverage existing results for search-based planning for open chains, combining open and closed chain manipulation planning into one framework. Proofs regarding the framework are introduced for the application to graph-search and its theoretical guarantees of optimality. The dimensionality-reduction is done in a manner that enables finding optimal solutions to low-dimensional problems which map to correspondingly optimal full-dimensional solutions. We apply this framework to planning for opening and navigating through non-spring and spring-loaded doors using a Willow Garage PR2. The framework motivates our approaches to the Atlas humanoid robot from Boston Dynamics for both stationary manipulation and quasi-static walking, as a closed chain is formed when both feet are on the ground

On the development and enhancement of artificial intelligence algorithms for swarm robots in real world applications

Swarm robotics is an area where using artificial intelligence (AI) can show a great deal of improvement. Obstacle avoidance, object detection, mapping and navigation are some the major algorithms required for successful execution of various tasks in the field of robotics. There is a challenge in applying these algorithms in a manner that swarm robots can use effectively. These five areas can be further researched to provide a platform for real world applications. This research aims to tackle the challenges involved in applying the aforementioned algorithms to swarm robotics and comparing the results with single robot systems. These techniques can be optimized by leveraging the advantage of swarm robots communication and scalability. The proposed algorithms were tested and validated using swarm robots along with profiling and simulations. For obstacle avoidance, two algorithms were devoloped. The first used a novel and modified force field method and the second used artificial neural networks (ANN). The results showed that the modified force field method performed better for static environments while ANNs worked better for dynamic environments. For object detection, the proposed algorithm uses an image classifier developed using ANN. The image classifier was trained to identify blocks of various colours using a convolutional neural network technique. This algorithm was then applied to swarm robotics using two proposed methods and results showed that multiple robots viewing objects from different angles provided better results as compared to single robot systems. This was validated with a 97% accuracy. In two dimension (2D) mapping, the proposed algorithm was developed using simultaneous localization and mapping (SLAM). The results showed that a single robot can require upto 3.5x more time for covering a given area compared to a swarm size of ten robots. This research shows a great deal of contribution in applying swarm robotics for surveilance purposes by showcasing the ability for swarm robotics to coordinate and execute the required task in an efficient time frame. The proposed three-dimension (3D) mapping algorithm used octomaps and occupancy grids to map out an image taken from a camera mounted on swarm robots. The images were obtained from various angles using multiple swarm robots. AI algorithms with a focus on swarm robotics are developed and enhanced for real world applications including fire-fighting, surveillance, fault analysis and construction. Results showed that swarm robots were able to complete a given task by up to six times faster as compared to a single robot. The overall contribution of this research lays a platform for further applications by showcasing the effectiveness of robotic algorithms in a swarm robot environment.Heriot-Watt University Fee Scholarshi

Automation and Robotics: Latest Achievements, Challenges and Prospects

This SI presents the latest achievements, challenges and prospects for drives, actuators, sensors, controls and robot navigation with reverse validation and applications in the field of industrial automation and robotics. Automation, supported by robotics, can effectively speed up and improve production. The industrialization of complex mechatronic components, especially robots, requires a large number of special processes already in the pre-production stage provided by modelling and simulation. This area of research from the very beginning includes drives, process technology, actuators, sensors, control systems and all connections in mechatronic systems. Automation and robotics form broad-spectrum areas of research, which are tightly interconnected. To reduce costs in the pre-production stage and to reduce production preparation time, it is necessary to solve complex tasks in the form of simulation with the use of standard software products and new technologies that allow, for example, machine vision and other imaging tools to examine new physical contexts, dependencies and connections