Challenges and Solutions for Autonomous Robotic Mobile Manipulation for Outdoor Sample Collection

In refinery, petrochemical, and chemical plants, process technicians collect uncontaminated samples to be analyzed in the quality control laboratory all time and all weather. This traditionally manual operation not only exposes the process technicians to hazardous chemicals, but also imposes an economical burden on the management. The recent development in mobile manipulation provides an opportunity to fully automate the operation of sample collection. This paper reviewed the various challenges in sample collection in terms of navigation of the mobile platform and manipulation of the robotic arm from four aspects, namely mobile robot positioning/attitude using global navigation satellite system (GNSS), vision-based navigation and visual servoing, robotic manipulation, mobile robot path planning and control. This paper further proposed solutions to these challenges and pointed the main direction of development in mobile manipulation

Fault-tolerant formation driving mechanism designed for heterogeneous MAVs-UGVs groups

A fault-tolerant method for stabilization and navigation of 3D heterogeneous formations is proposed in this paper. The presented Model Predictive Control (MPC) based approach enables to deploy compact formations of closely cooperating autonomous aerial and ground robots in surveillance scenarios without the necessity of a precise external localization. Instead, the proposed method relies on a top-view visual relative localization provided by the micro aerial vehicles flying above the ground robots and on a simple yet stable visual based navigation using images from an onboard monocular camera. The MPC based schema together with a fault detection and recovery mechanism provide a robust solution applicable in complex environments with static and dynamic obstacles. The core of the proposed leader-follower based formation driving method consists in a representation of the entire 3D formation as a convex hull projected along a desired path that has to be followed by the group. Such an approach provides non-collision solution and respects requirements of the direct visibility between the team members. The uninterrupted visibility is crucial for the employed top-view localization and therefore for the stabilization of the group. The proposed formation driving method and the fault recovery mechanisms are verified by simulations and hardware experiments presented in the paper

Koordinirano slijeđenje putanje za mobilne robote zasnovano na strategiji virtualne strukture i modelsko prediktivnom upravljanju

In this paper, we propose a novel coordinated path following controller based on  model predictive control (MPC) for mobile robots. The strategy is based on a virtual structure approach where the entire formation is considered as a rigid body and the control laws for a virtual leader vehicle and for actual follower robots are optimized by considering the dynamics of the virtual structure and the desired motion of each vehicle. Besides, we also fulfill time convergence for trajectory tracking by integrating an additional penalty term into our model predictive control scheme. However, the major concern in the use of model predictive control is whether such an open-loop control scheme can guarantee system stability. In this case, we apply the idea of a contractive constraint to guarantee the stability of our MPC framework. Although our approach is centralized, numerous simulation scenarios have been conducted to illustrate its effectiveness and its superior performance for a small group of mobile robots. Furthermore, we show that path following control can offer a number of advantages over its trajectory tracking counterpart.U ovome članku predlaže se novi algoritam upravljanja koordiniranim slijeđenjem putanje za mobilne robote zasnovan na modelsko prediktivnom upravljanju. Strategija se zasniva na pristupu s virtualnom strukturom gdje se cijela formacija robota smatra krutim tijelom, dok se za virtualno vodeće vozilo i za slijedeće robote optimiziraju zakoni upravljanja vodeći računa o dinamici virtualne strukture i željenom gibanju svakog od vozila. Također, algoritam ispunjava uvjet vremena konvergencije radi praćenja trajektorija na način da integrira dodatani član unutar algoritma modelsko prediktivnog upravljanja. Međutim, koristeći modelsko prediktivno upravljanje postavlja se pitanje može li ovakav pristup u otvorenom upravljačkom krugu jamčiti stabilnost. Radi toga, primijenjuje se ideja sužavajućeg ograničenja radi jamčenja stabilnosti predloženog riješenja. Iako je predloženi pristup centraliziran, provedeni su brojni simulacijski eksperimenti kako bi se ilustrirala učinkovitost i superiorno vladanje na primjeru male grupe mobilnih robota. Nadalje, pokazuje se da upravljanje slijeđenjem putanje pruža brojne prednosti u usporedbi s praćenjem trajektorije

Cooperative Carrying Control for Mobile Robots in Indoor Scenario

openIn recent years, there has been a growing interest in designing multi-robot systems to provide cost-effective, fault-tolerant and reliable solutions to a variety of automated applications. In particular, from an industrial perspective, cooperative carrying techniques based on Reinforcement Learning (RL) gained a strong interest. Compared to a single robot system, this approach improves the system’s robustness and manipulation dexterity in the transportation of large objects. However, in the current state of the art, the environments’ dynamism and re-training procedure represent a considerable limitation for most of the existing cooperative carrying RL-based solutions. In this thesis, we employ the Value Propagation Networks (VPN) algorithm for cooperative multi-robot transport scenarios. We extend and test the Delta-Q cooperation metric to V-value-based agents, and we investigate path generation algorithms and trajectory tracking controllers for differential drive robots. Moreover, we explore localization algorithms in order to take advantage of range sensors and mitigate the drift errors of wheel odometry, and we conduct experiments to derive key performance indicators of range sensors' precision. Lastly, we perform realistic industrial indoor simulations using Robot Operating System (ROS) and Gazebo 3D visualization tool, including physical objects and 6G communication constraints. Our results showed that the proposed VPN-based algorithm outperforms the current state-of-the-art since the trajectory planning and dynamic obstacle avoidance are performed in real-time, without re-training the model, and under constant 6G network coverage.In recent years, there has been a growing interest in designing multi-robot systems to provide cost-effective, fault-tolerant and reliable solutions to a variety of automated applications. In particular, from an industrial perspective, cooperative carrying techniques based on Reinforcement Learning (RL) gained a strong interest. Compared to a single robot system, this approach improves the system’s robustness and manipulation dexterity in the transportation of large objects. However, in the current state of the art, the environments’ dynamism and re-training procedure represent a considerable limitation for most of the existing cooperative carrying RL-based solutions. In this thesis, we employ the Value Propagation Networks (VPN) algorithm for cooperative multi-robot transport scenarios. We extend and test the Delta-Q cooperation metric to V-value-based agents, and we investigate path generation algorithms and trajectory tracking controllers for differential drive robots. Moreover, we explore localization algorithms in order to take advantage of range sensors and mitigate the drift errors of wheel odometry, and we conduct experiments to derive key performance indicators of range sensors' precision. Lastly, we perform realistic industrial indoor simulations using Robot Operating System (ROS) and Gazebo 3D visualization tool, including physical objects and 6G communication constraints. Our results showed that the proposed VPN-based algorithm outperforms the current state-of-the-art since the trajectory planning and dynamic obstacle avoidance are performed in real-time, without re-training the model, and under constant 6G network coverage

Reactive Control Of Autonomous Dynamical Systems

This thesis mainly consists of five independent papers concerning the reactive control design of autonomous mobile robots in the context of target tracking and cooperative formation keeping with obstacle avoidance in the static/dynamic environment. Technical contents of this thesis are divided into three parts. The first part consists of the first two papers, which consider the target-tracking and obstacle avoidance in the static environment. Especially, in the static environment, a fundamental issue of reactive control design is the local minima problem(LMP) inherent in the potential field methods(PFMs). Through introducing a state-dependent planned goal, the first paper proposes a switching control strategy to tackle this problem. The control law for the planned goal is presented. When trapped into local minima, the robot can escape from local minima by following the planned goal. The proposed control law also takes into account the presence of possible saturation constraints. In addition, a time-varying continuous control law is proposed in the second paper to tackle this problem. Challenges of finding continuous control solutions of LMP are discussed and explicit design strategies are then proposed. The second part of this thesis deals with target-tracking and obstacle avoidance in the dynamic environment. In the third paper, a reactive control design is presented for omnidirectional mobile robots with limited sensor range to track targets while avoiding static and moving obstacles in a dynamically evolving environment. Towards this end, a multiiii objective control problem is formulated and control is synthesized by generating a potential field force for each objective and combining them through analysis and design. Different from standard potential field methods, the composite potential field described in this paper is time-varying and planned to account for moving obstacles and vehicle motion. In order to accommodate a larger class of mobile robots, the fourth paper proposes a reactive control design for unicycle-type mobile robots. With the relative motion among the mobile robot, targets, and obstacles being formulated in polar coordinates, kinematic control laws achieving target-tracking and obstacle avoidance are synthesized using Lyapunov based technique, and more importantly, the proposed control laws also take into account possible kinematic control saturation constraints. The third part of this thesis investigates the cooperative formation control with collision avoidance. In the fifth paper, firstly, the target tracking and collision avoidance problem for a single agent is studied. Instead of directly extending the single agent controls to the multiagents case, the single agent controls are incorporated with the cooperative control design presented in [1]. The proposed decentralized control is reactive, considers the formation feedback and changes in the communication networks. The proposed control is based on a potential field method, its inherent oscillation problem is also studied to improve group transient performance

Analysis of multi-agent systems under varying degrees of trust, cooperation, and competition

Multi-agent systems rely heavily on coordination and cooperation to achieve a variety of tasks. It is often assumed that these agents will be fully cooperative, or have reliable and equal performance among group members. Instead, we consider cooperation as a spectrum of possible interactions, ranging from performance variations within the group to adversarial agents. This thesis examines several scenarios where cooperation and performance are not guaranteed. Potential applications include sensor coverage, emergency response, wildlife management, tracking, and surveillance. We use geometric methods, such as Voronoi tessellations, for design insight and Lyapunov-based stability theory to analyze our proposed controllers. Performance is verified through simulations and experiments on a variety of ground and aerial robotic platforms. First, we consider the problem of Voronoi-based coverage control, where a group of robots must spread out over an environment to provide coverage. Our approach adapts online to sensing and actuation performance variations with the group. The robots have no prior knowledge of their relative performance, and in a distributed fashion, compensate by assigning weaker robots a smaller portion of the environment. Next, we consider the problem of multi-agent herding, akin to shepherding. Here, a group of dog-like robots must drive a herd of non-cooperative sheep-like agents around the environment. Our key insight in designing the control laws for the herders is to enforce geometrical relationships that allow for the combined system dynamics to reduce to a single nonholonomic vehicle. We also investigate the cooperative pursuit of an evader by a group of quadrotors in an environment with no-fly zones. While the pursuers cannot enter the no-fly zones, the evader moves freely through the zones to avoid capture. Using tools for Voronoi-based coverage control, we provide an algorithm to distribute the pursuers around the zone's boundary and minimize capture time once the evader emerges. Finally, we present an algorithm for the guaranteed capture of multiple evaders by one or more pursuers in a bounded, convex environment. The pursuers utilize properties of the evader's Voronoi cell to choose a control strategy that minimizes the safe-reachable area of the evader, which in turn leads to the evader's capture