Unmanned Ground Vehicle navigation and coverage hole patching in Wireless Sensor Networks

This dissertation presents a study of an Unmanned Ground Vehicle (UGV) navigation and coverage hole patching in coordinate-free and localization-free Wireless Sensor Networks (WSNs). Navigation and coverage maintenance are related problems since coverage hole patching requires effective navigation in the sensor network environment. A coordinate-free and localization-free WSN that is deployed in an ad-hoc fashion and does not assume the availability of GPS information is considered. The system considered is decentralized and can be self-organized in an event-driven manner where no central controller or global map is required. A single-UGV, single-destination navigation problem is addressed first. The UGV is equipped with a set of wireless listeners that determine the slope of a navigation potential field generated by the wireless sensor and actuator network. The navigation algorithm consists of sensor node level-number assignment that is determined based on a hop-distance from the network destination node and UGV navigation through the potential field created by triplets of actuators in the network. A multi-UGV, multi-destination navigation problem requires a path-planning and task allocation process. UGVs inform the network about their proposed destinations, and the network provides feedback if conflicts are found. Sensor nodes store, share, and communicate to UGVs in order to allocate the navigation tasks. A special case of a single-UGV, multi-destination navigation problem that is equivalent to the well-known Traveling Salesman Problem is discussed. The coverage hole patching process starts after a UGV reaches the hole boundary. For each hole boundary edge, a new node is added along its perpendicular bisector, and the entire hole is patched by adding nodes around the hole boundary edges. The communication complexity and present simulation examples and experimental results are analyzed. Then, a Java-based simulation testbed that is capable of simulating both the centralized and distributed sensor and actuator network algorithms is developed. The laboratory experiment demonstrates the navigation algorithm (single-UGV, single-destination) using Cricket wireless sensors and an actuator network and Pioneer 3-DX robot

NeBula: TEAM CoSTAR’s robotic autonomy solution that won phase II of DARPA subterranean challenge

This paper presents and discusses algorithms, hardware, and software architecture developed by the TEAM CoSTAR (Collaborative SubTerranean Autonomous Robots), competing in the DARPA Subterranean Challenge. Specifically, it presents the techniques utilized within the Tunnel (2019) and Urban (2020) competitions, where CoSTAR achieved second and first place, respectively. We also discuss CoSTAR’s demonstrations in Martian-analog surface and subsurface (lava tubes) exploration. The paper introduces our autonomy solution, referred to as NeBula (Networked Belief-aware Perceptual Autonomy). NeBula is an uncertainty-aware framework that aims at enabling resilient and modular autonomy solutions by performing reasoning and decision making in the belief space (space of probability distributions over the robot and world states). We discuss various components of the NeBula framework, including (i) geometric and semantic environment mapping, (ii) a multi-modal positioning system, (iii) traversability analysis and local planning, (iv) global motion planning and exploration behavior, (v) risk-aware mission planning, (vi) networking and decentralized reasoning, and (vii) learning-enabled adaptation. We discuss the performance of NeBula on several robot types (e.g., wheeled, legged, flying), in various environments. We discuss the specific results and lessons learned from fielding this solution in the challenging courses of the DARPA Subterranean Challenge competition.Peer ReviewedAgha, A., Otsu, K., Morrell, B., Fan, D. D., Thakker, R., Santamaria-Navarro, A., Kim, S.-K., Bouman, A., Lei, X., Edlund, J., Ginting, M. F., Ebadi, K., Anderson, M., Pailevanian, T., Terry, E., Wolf, M., Tagliabue, A., Vaquero, T. S., Palieri, M., Tepsuporn, S., Chang, Y., Kalantari, A., Chavez, F., Lopez, B., Funabiki, N., Miles, G., Touma, T., Buscicchio, A., Tordesillas, J., Alatur, N., Nash, J., Walsh, W., Jung, S., Lee, H., Kanellakis, C., Mayo, J., Harper, S., Kaufmann, M., Dixit, A., Correa, G. J., Lee, C., Gao, J., Merewether, G., Maldonado-Contreras, J., Salhotra, G., Da Silva, M. S., Ramtoula, B., Fakoorian, S., Hatteland, A., Kim, T., Bartlett, T., Stephens, A., Kim, L., Bergh, C., Heiden, E., Lew, T., Cauligi, A., Heywood, T., Kramer, A., Leopold, H. A., Melikyan, H., Choi, H. C., Daftry, S., Toupet, O., Wee, I., Thakur, A., Feras, M., Beltrame, G., Nikolakopoulos, G., Shim, D., Carlone, L., & Burdick, JPostprint (published version

Multi-Robot Systems: Challenges, Trends and Applications

This book is a printed edition of the Special Issue entitled “Multi-Robot Systems: Challenges, Trends, and Applications” that was published in Applied Sciences. This Special Issue collected seventeen high-quality papers that discuss the main challenges of multi-robot systems, present the trends to address these issues, and report various relevant applications. Some of the topics addressed by these papers are robot swarms, mission planning, robot teaming, machine learning, immersive technologies, search and rescue, and social robotics

Scalable Learning In Distributed Robot Teams

Mobile robots are already in use for mapping, agriculture, entertainment, and the delivery of goods and people. As robotic systems continue to become more affordable, large numbers of mobile robots may be deployed concurrently to accomplish tasks faster and more efficiently. Practical deployments of very large teams will require scalable algorithms to enable the distributed cooperation of autonomous agents. This thesis focuses on the three main algorithmic obstacles to the scalability of robot teams: coordination, control, and communication. To address these challenges, we design graph-based abstractions that allow us to apply Graph Neural Networks (GNNs).First, a team of robots must continually coordinate to divide up mission requirements among all agents. We focus on the case studies of exploration and coverage to develop a spatial GNN controller that can coordinate a team of dozens of agents as they visit thousands of landmarks. A routing problem of this size is intractable for existing optimization-based approaches. Second, a robot in a team must be able to execute the trajectory that will accomplish its given sub-task. In large teams with high densities of robots, planning and execution of safe, collision-free trajectories requires the joint optimization over all agent trajectories, which may be impractical in large teams. We present two approaches to scalable control: a) a controller for flocking that uses delayed communication formalized via a GNN; and b) an inverse optimal planning method that learns from real air traffic data. Third, robot teams may need to operate in harsh environments without existing communication infrastructure, requiring the formation of ad-hoc networks to exchange information. Many algorithms for control of multi-robot teams operate under the assumption that low-latency, global state information necessary to coordinate agent actions can readily be disseminated among the team. Our approach leverages GNNs to control the connectivity within the ad-hoc network and to provide the data distribution infrastructure necessary for countless multi-robot algorithms. Finally, this thesis develops a framework for distributed learning to be used when centralized information is unavailable during training. Our approach allows robots to train controllers independently and then share their experiences by composing multiple models represented in a Reproducing Kernel Hilbert Space

NeBula: Team CoSTAR's robotic autonomy solution that won phase II of DARPA Subterranean Challenge

This paper presents and discusses algorithms, hardware, and software architecture developed by the TEAM CoSTAR (Collaborative SubTerranean Autonomous Robots), competing in the DARPA Subterranean Challenge. Specifically, it presents the techniques utilized within the Tunnel (2019) and Urban (2020) competitions, where CoSTAR achieved second and first place, respectively. We also discuss CoSTAR¿s demonstrations in Martian-analog surface and subsurface (lava tubes) exploration. The paper introduces our autonomy solution, referred to as NeBula (Networked Belief-aware Perceptual Autonomy). NeBula is an uncertainty-aware framework that aims at enabling resilient and modular autonomy solutions by performing reasoning and decision making in the belief space (space of probability distributions over the robot and world states). We discuss various components of the NeBula framework, including (i) geometric and semantic environment mapping, (ii) a multi-modal positioning system, (iii) traversability analysis and local planning, (iv) global motion planning and exploration behavior, (v) risk-aware mission planning, (vi) networking and decentralized reasoning, and (vii) learning-enabled adaptation. We discuss the performance of NeBula on several robot types (e.g., wheeled, legged, flying), in various environments. We discuss the specific results and lessons learned from fielding this solution in the challenging courses of the DARPA Subterranean Challenge competition.The work is partially supported by the Jet Propulsion Laboratory, California Institute of Technology, under a contract with the National Aeronautics and Space Administration (80NM0018D0004), and Defense Advanced Research Projects Agency (DARPA)

Interactive Execution Monitoring of Agent Teams

There is an increasing need for automated support for humans monitoring the activity of distributed teams of cooperating agents, both human and machine. We characterize the domain-independent challenges posed by this problem, and describe how properties of domains influence the challenges and their solutions. We will concentrate on dynamic, data-rich domains where humans are ultimately responsible for team behavior. Thus, the automated aid should interactively support effective and timely decision making by the human. We present a domain-independent categorization of the types of alerts a plan-based monitoring system might issue to a user, where each type generally requires different monitoring techniques. We describe a monitoring framework for integrating many domain-specific and task-specific monitoring techniques and then using the concept of value of an alert to avoid operator overload. We use this framework to describe an execution monitoring approach we have used to implement Execution Assistants (EAs) in two different dynamic, data-rich, real-world domains to assist a human in monitoring team behavior. One domain (Army small unit operations) has hundreds of mobile, geographically distributed agents, a combination of humans, robots, and vehicles. The other domain (teams of unmanned ground and air vehicles) has a handful of cooperating robots. Both domains involve unpredictable adversaries in the vicinity. Our approach customizes monitoring behavior for each specific task, plan, and situation, as well as for user preferences. Our EAs alert the human controller when reported events threaten plan execution or physically threaten team members. Alerts were generated in a timely manner without inundating the user with too many alerts (less than 10 percent of alerts are unwanted, as judged by domain experts)

Developing an Integrated Guidance and Control System for Reactive Free-Flyer Maneuvering

The use of highly autonomous free-flying spacecraft has been investigated for potential utility in future human spaceflight endeavors. In general, ’free-flyer’ robots are small, self-sufficient spacecraft that operate near the exterior of larger space structures, such as the International Space Station, and are designed to provide support during various operations. Free-flyer designs and concepts often include a large degree of autonomy to provide mission support with little operational overhead. One of the building blocks of autonomous free-flyer behavior is safe and reliable point-to-point maneuvering during proximity operations. This thesis explores the development and simulation of an integrated guidance and control (G&C) system to enable safe free-flyer point-to-point maneuvering in proximity to larger space structures, including the avoidance of collision and jet plume impingement. The foundation for this system is an existing trajectory planning method introduced by Roger [1]. This method represents the free-space as a discrete harmonic potential field and uses the resulting field gradient as a condition for generating collision-free trajectories that efficiently account for natural dynamics. A real-time guidance process is built around this method that can manage an internal model of the environment based upon obstacle mapping data and react quickly to dynamic obstacles. A linear-programming jet selection technique is implemented to fulfill six DOF velocity impulse commands using a free-flyer’s RCS propulsion system, and additionally is augmented to include jet plume impingement avoidance functionality. Finally, an attitude con-troller process was developed and implemented to enable the free-flyer to reach and track a desired attitude during translational maneuvers. To verify the system’s capabilities, a test-bed simulation was developed using the SpaceCRAFT platform, specifically utilizing it’s modular, asynchronous architecture. In a set of four maneuver-ing tests set in distinct obstacle environments, the G&C system demonstrated the ability to maneuver the free-flyer to the goal state along collision-free trajectories. In three of the test cases, the plume avoidance strategy results in a large reduction in the accumulated plume cost (36-54%). Overall, these simulation results demonstrate that the system enabled point-to-point maneuvering for a reference free-flyer design, and support its feasibility and practicality. This work represents a somewhat unique approach to free-flyer autonomous maneuvering in that it departs from a trajectory planning, or offline-online paradigm. Instead, this approach relies on the refinement of an internal model of the environment and the resulting potential field to per-form reactive path-finding. This approach results in better overall flexibility when the free-flyer lacks knowledge of the position, geometry, and motion of nearby obstacles. In the future, the integration of Simultaneous Localization and Mapping (SLAM) and 3D mapping algorithms will help to further verify the feasibility of this approach. Other future improvements include integrating more robust methods of dynamic obstacle avoidance and automated positioning and scaling of the potential field grid

Multi-Agent Systems

A multi-agent system (MAS) is a system composed of multiple interacting intelligent agents. Multi-agent systems can be used to solve problems which are difficult or impossible for an individual agent or monolithic system to solve. Agent systems are open and extensible systems that allow for the deployment of autonomous and proactive software components. Multi-agent systems have been brought up and used in several application domains