Practical Considerations and Applications for Autonomous Robot Swarms

In recent years, the study of autonomous entities such as unmanned vehicles has begun to revolutionize both military and civilian devices. One important research focus of autonomous entities has been coordination problems for autonomous robot swarms. Traditionally, robot models are used for algorithms that account for the minimum specifications needed to operate the swarm. However, these theoretical models also gloss over important practical details. Some of these details, such as time, have been considered before (as epochs of execution). In this dissertation, we examine these details in the context of several problems and introduce new performance measures to capture practical details. Specifically, we introduce three new metrics: (1) the distance complexity (reflecting power usage and wear-and-tear of robots), (2) the spatial complexity (reflecting the space needed for the algorithm to work), and (3) local computational complexity (reflecting the computational requirements for each robot in the swarm). We apply these metrics in the study of some well-known and important problems, such as Complete Visibility and Arbitrary Pattern Formation. We also introduce and study a new problem, Doorway Egress, that captures the essence of a swarm’s navigation through restricted spaces. First, we examine the distance and spatial complexity used across a class of Complete Visibility algorithms. Second, we provide algorithms for Complete Visibility on an integer plane, including some that are asymptotically optimal in terms of time, distance complexity, and spatial complexity. Third, we introduce the problem of Doorway Egress and provide algorithms for a variety of robot swarm models with various optimalities. Finally, we provide an optimal algorithm for Arbitrary Pattern Formation on the grid

Distributed Systems and Mobile Computing

The book is about Distributed Systems and Mobile Computing. This is a branch of Computer Science devoted to the study of systems whose components are in different physical locations and have limited communication capabilities. Such components may be static, often organized in a network, or may be able to move in a discrete or continuous environment. The theoretical study of such systems has applications ranging from swarms of mobile robots (e.g., drones) to sensor networks, autonomous intelligent vehicles, the Internet of Things, and crawlers on the Web. The book includes five articles. Two of them are about networks: the first one studies the formation of networks by agents that interact randomly and have the ability to form connections; the second one is a study of clustering models and algorithms. The three remaining articles are concerned with autonomous mobile robots operating in continuous space. One article studies the classical gathering problem, where all robots have to reach a common location, and proposes a fast algorithm for robots that are endowed with a compass but have limited visibility. The last two articles deal with the evacuations problem, where two robots have to locate an exit point and evacuate a region in the shortest possible time

Vid2Curve: Simultaneous Camera Motion Estimation and Thin Structure Reconstruction from an RGB Video

Thin structures, such as wire-frame sculptures, fences, cables, power lines, and tree branches, are common in the real world. It is extremely challenging to acquire their 3D digital models using traditional image-based or depth-based reconstruction methods because thin structures often lack distinct point features and have severe self-occlusion. We propose the first approach that simultaneously estimates camera motion and reconstructs the geometry of complex 3D thin structures in high quality from a color video captured by a handheld camera. Specifically, we present a new curve-based approach to estimate accurate camera poses by establishing correspondences between featureless thin objects in the foreground in consecutive video frames, without requiring visual texture in the background scene to lock on. Enabled by this effective curve-based camera pose estimation strategy, we develop an iterative optimization method with tailored measures on geometry, topology as well as self-occlusion handling for reconstructing 3D thin structures. Extensive validations on a variety of thin structures show that our method achieves accurate camera pose estimation and faithful reconstruction of 3D thin structures with complex shape and topology at a level that has not been attained by other existing reconstruction methods.Comment: Accepted by SIGGRAPH 202

Placement and motion planning algorithms for robotic sensing systems

University of Minnesota Ph.D. dissertation. October 2014. Major: Computer Science. Advisor: Prof. Ibrahim Volkan Isler. I computer file (PDF); xxiii, 226 pages.Recent technological advances are making it possible to build teams of sensors and robots that can sense data from hard-to-reach places at unprecedented spatio-temporal scales. Robotic sensing systems hold the potential to revolutionize a diverse collection of applications such as agriculture, environmental monitoring, climate studies, security and surveillance in the near future. In order to make full use of this technology, it is crucial to complement it with efficient algorithms that plan for the sensing in these systems. In this dissertation, we develop new sensor planning algorithms and present prototype robotic sensing systems.In the first part of this dissertation, we study two problems on placing stationary sensors to cover an environment. Our objective is to place the fewest number of sensors required to ensure that every point in the environment is covered. In the first problem, we say a point is covered if it is seen by sensors from all orientations. The environment is represented as a polygon and the sensors are modeled as omnidirectional cameras. Our formulation, which builds on the well-known art gallery problem, is motivated by practical applications such as visual inspection and video-conferencing where seeing objects from all sides is crucial. In the second problem, we study how to deploy bearing sensors in order to localize a target in the environment. The sensors measure noisy bearings towards the target which can be combined to localize the target. The uncertainty in localization is a function of the placement of the sensors relative to the target. For both problems we present (i) lower bounds on the number of sensors required for an optimal algorithm, and (ii) algorithms to place at most a constant times the optimal number of sensors. In the second part of this dissertation, we study motion planning problems for mobile sensors. We start by investigating how to plan the motion of a team of aerial robots tasked with tracking targets that are moving on the ground. We then study various coverage problems that arise in two environmental monitoring applications: using robotic boats to monitor radio-tagged invasive fish in lakes, and using ground and aerial robots for data collection in precision agriculture. We formulate the coverage problems based on constraints observed in practice. We also present the design of prototype robotic systems for these applications. In the final problem, we investigate how to optimize the low-level motion of the robots to minimize their energy consumption and extend the system lifetime.This dissertation makes progress towards building robotic sensing systems along two directions. We present algorithms with strong theoretical performance guarantees, often by proving that our algorithms are optimal or that their costs are at most a constant factor away from the optimal values. We also demonstrate the feasibility and applicability of our results through system implementation and with results from simulations and extensive field experiments

Approximation Algorithms for Geometric Clustering and Touring Problems

Clustering and touring are two fundamental topics in optimization that have been studied extensively and have ``launched a thousand ships''. In this thesis, we study variants of these problems for Euclidean instances, in which clusters often correspond to sensors that are required to cover, measure or localize targets and tours need to visit locations for the purpose of item delivery or data collection. In the first part of the thesis, we focus on the task of sensor placement for environments in which localization is a necessity and in which its quality depends on the relative angle between the target and the pair of sensors observing it. We formulate a new coverage constraint that bounds this angle and consider the problem of placing a small number of sensors that satisfy it in addition to classical ones such as proximity and line-of-sight visibility. We present a general framework that chooses a small number of sensors and approximates the coverage constraint to arbitrary precision. In the second part of the thesis, we consider the task of collecting data from a set of sensors by getting close to them. This corresponds to a well-known generalization of the Traveling Salesman Problem (TSP) called TSP with Neighborhoods, in which we want to compute a shortest tour that visits at least one point from each unit disk centered at a sensor. One approach is based on an observation that relates the optimal solution with the optimal TSP on the sensors. We show that the associated bound can be improved unless we are in certain exceptional circumstances for which we can get better algorithms. Finally, we discuss Maximum Scatter TSP, which asks for a tour that maximizes the length of the shortest edge. While the Euclidean version admits an efficient approximation scheme and the problem is known to be NP-hard in three dimensions or higher, the question of getting a polynomial time algorithm for two dimensions remains open. To this end, we develop a general technique for the case of points concentrated around the boundary of a circle that we believe can be extended to more general cases

Sycamore - 2D/3D Mobile Robots simulation environment

The distributed coordination and control of a team of autonomous mobile robots is a problem widely studied in a variety of fields, such as engineering, artificial intelligence, artificial life, robotics. Generally, in these areas, the problem is studied mostly from a practical point of view. Recently, the study of what can be computed by such team of robots has become increasingly popular in theoretical computer science and especially in distributed computing, where it is now an integral part of the investigations on computability by mobile entities. The autonomous mobile robots model imagines the involved entities being capable of moving, observing the environment and computing. This kind of paradigm often produces complex configurations, for which the mathematical proof of correctness can be found more easily with the help of an empirical approach. This thesis will describe my work on a 2D/3D simulation environment for autonomous mobile robots called Sycamore. The work consisted in the implementation of the simulator and a rich set of plugins for it, followed by the implementation and testing of an algorithm that is solving a problem in the mobile robots theory: "NearGathering". The final part of the work made me design, implement and test a solution for a completely new problem: "Following with directional limited visibility"

{Vid2Curve}: {S}imultaneous Camera Motion Estimation and Thin Structure Reconstruction from an {RGB} Video

Thin structures, such as wire-frame sculptures, fences, cables, power lines, and tree branches, are common in the real world. It is extremely challenging to acquire their 3D digital models using traditional image-based or depth-based reconstruction methods because thin structures often lack distinct point features and have severe self-occlusion. We propose the first approach that simultaneously estimates camera motion and reconstructs the geometry of complex 3D thin structures in high quality from a color video captured by a handheld camera. Specifically, we present a new curve-based approach to estimate accurate camera poses by establishing correspondences between featureless thin objects in the foreground in consecutive video frames, without requiring visual texture in the background scene to lock on. Enabled by this effective curve-based camera pose estimation strategy, we develop an iterative optimization method with tailored measures on geometry, topology as well as self-occlusion handling for reconstructing 3D thin structures. Extensive validations on a variety of thin structures show that our method achieves accurate camera pose estimation and faithful reconstruction of 3D thin structures with complex shape and topology at a level that has not been attained by other existing reconstruction methods

Barrier Coverage with Wireless Sensor Networks

We study the problem of barrier coverage with a wireless sensor network. Each sensor is modelled by a point in the plane and a sensing disk or coverage area centered at the sensor's position. The barriers are usually modelled as a set of line segments on the plane. The barrier coverage problem is to add new sensors or move existing sensors on the barriers such that every point on every barrier is within the coverage area of some sensors. Barrier coverage using sensors has important applications, including intruder detection or monitoring the perimeter of a region. Given a set of barriers and a set of sensors initially located at general positions in the plane, we study three problems for relocatable sensors in the centralized setting: the feasibility problem, and the problems of minimizing the maximum or the average relocation distances of sensors (MinMax and MinSum respectively) for barrier coverage. We show that the MinMax problem is strongly NP-complete when sensors have arbitrary ranges and can move to arbitrary positions on the barrier. We also study the case when sensors are restricted to use perpendicular movement to one of the barriers. We show that when the barriers are parallel, both the MinMax and MinSum problems can be solved in polynomial time. In contrast, we show that even the feasibility problem is strongly NP-complete if two perpendicular barriers are to be covered. For the barrier coverage problem in distributed settings, we give the first distributed local algorithms for fully synchronous unoriented sensors. Our algorithms achieve barrier coverage for a line segment barrier when there are enough sensors to cover the entire barrier. Our first algorithm is oblivious and terminates in n^2 time, whereas our second one uses two bits of memory at each sensor, and takes n steps, which is asymptotically optimal. However, if the sensors are semi-synchronous, and do not share the same orientation, we show that no algorithm exists that always terminates within finite time. Finally, for sensors that share the same orientation we give an algorithm that terminates within finite time, even if all sensors are fully asynchronous. Finally, we study barrier coverage with multi-round random deployment using stationary sensors. We analyze the probability of barrier coverage with uniformly dispersed sensors as a function of parameters such as length of the barrier, the width of the intruder, the sensing range of sensors, as well as the density of deployed sensors. We propose two specific deployment strategies and analyze the expected number of deployment rounds and deployed sensors for each strategy. We present a cost model for multi-round sensor deployments, and for each deployment strategy we find the optimal density of sensors to be deployed in each round that minimizes the total expected cost. Our results are validated by extensive simulations

Fault-tolerant control policies for multi-robot systems

Throughout the past decade, we have witnessed an active interest in distributed motion coordination algorithms for networked mobile autonomous robots. Often, in multi-robot systems, each robot executing a coordination task is a little cost, a disposable autonomous agent that has ad-hoc sensing or communication capability, and limited mobility. Coordination tasks that a group of multiple mobile robots might perform include formation control, rendezvous, distributed estimation, deployment, flocking, etc. Also, there are challenging tasks that are more suitable for a group of mobile robots than an individual robot, such as surveillance, exploration, or hazardous environmental monitoring. The field has been collectively investigated by many researchers in robotics, control, artificial intelligence, and distributed computing. However, relatively little work has been done on developing algorithms to provide resilience to failures that can occur. The problem is extremely difficult to handle in that any partial failure of a robot is not readily detectable. Some failures in robot resources can have an adverse effect on not only the performance of the robot itself, but also other robots, and the collective task performance as well. This study presents the development of fault-tolerant distributed control policies for multi-robot systems. We consider two problems: rendezvous and coverage. For the former, the goal is to bring all robots to a common location, while for the latter the goal is to deploy robots to achieve optimal coverage of an environment. We consider the case in which each robot is an autonomous decision maker that is anonymous (i.e., robots are indistinguishable to one another), memoryless (i.e., each robot makes decisions based upon only its current information), and dimensionless (i.e., collision checking is not considered). Each robot has a limited sensing range and can directly estimate the state of only those robots within that sensing range, which induces a network topology for the multi-robot system. We assume that it is not possible for the fault-free robots to identify the faulty robots (e.g., due to the anonymous property of the robots). For each problem, we provide an efficient computational framework and analysis of algorithms, all of which converge in the face of faulty robots under a few assumptions on the network topology and sensing abilities. A suite of experiments and simulations confirm our theoretical analysis and demonstrate that our proposed algorithms are useful in fault-prone multi-robot systems

Robotics-Assisted Needle Steering for Percutaneous Interventions: Modeling and Experiments

Needle insertion and guidance plays an important role in medical procedures such as brachytherapy and biopsy. Flexible needles have the potential to facilitate precise targeting and avoid collisions during medical interventions while reducing trauma to the patient and post-puncture issues. Nevertheless, error introduced during guidance degrades the effectiveness of the planned therapy or diagnosis. Although steering using flexible bevel-tip needles provides great mobility and dexterity, a major barrier is the complexity of needle-tissue interaction that does not lend itself to intuitive control. To overcome this problem, a robotic system can be employed to perform trajectory planning and tracking by manipulation of the needle base. This research project focuses on a control-theoretic approach and draws on the rich literature from control and systems theory to model needle-tissue interaction and needle flexion and then design a robotics-based strategy for needle insertion/steering. The resulting solutions will directly benefit a wide range of needle-based interventions. The outcome of this computer-assisted approach will not only enable us to perform efficient preoperative trajectory planning, but will also provide more insight into needle-tissue interaction that will be helpful in developing advanced intraoperative algorithms for needle steering. Experimental validation of the proposed methodologies was carried out on a state of-the-art 5-DOF robotic system designed and constructed in-house primarily for prostate brachytherapy. The system is equipped with a Nano43 6-DOF force/torque sensor (ATI Industrial Automation) to measure forces and torques acting on the needle shaft. In our setup, an Aurora electromagnetic tracker (Northern Digital Inc.) is the sensing device used for measuring needle deflection. A multi-threaded application for control, sensor readings, data logging and communication over the ethernet was developed using Microsoft Visual C 2005, MATLAB 2007 and the QuaRC Toolbox (Quanser Inc.). Various artificial phantoms were developed so as to create a realistic medium in terms of elasticity and insertion force ranges; however, they simulated a uniform environment without exhibiting complexities of organic tissues. Experiments were also conducted on beef liver and fresh chicken breast, beef, and ham, to investigate the behavior of a variety biological tissues