Distributed Robotic Vision for Calibration, Localisation, and Mapping

This dissertation explores distributed algorithms for calibration, localisation, and mapping in the context of a multi-robot network equipped with cameras and onboard processing, comparing against centralised alternatives where all data is transmitted to a singular external node on which processing occurs. With the rise of large-scale camera networks, and as low-cost on-board processing becomes increasingly feasible in robotics networks, distributed algorithms are becoming important for robustness and scalability. Standard solutions to multi-camera computer vision require the data from all nodes to be processed at a central node which represents a significant single point of failure and incurs infeasible communication costs. Distributed solutions solve these issues by spreading the work over the entire network, operating only on local calculations and direct communication with nearby neighbours. This research considers a framework for a distributed robotic vision platform for calibration, localisation, mapping tasks where three main stages are identified: an initialisation stage where calibration and localisation are performed in a distributed manner, a local tracking stage where visual odometry is performed without inter-robot communication, and a global mapping stage where global alignment and optimisation strategies are applied. In consideration of this framework, this research investigates how algorithms can be developed to produce fundamentally distributed solutions, designed to minimise computational complexity whilst maintaining excellent performance, and designed to operate effectively in the long term. Therefore, three primary objectives are sought aligning with these three stages

Adaptive sampling in autonomous marine sensor networks

Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy at the Massachusetts Institute of Technology and the Woods Hole Oceanographic Institution June 2006In this thesis, an innovative architecture for real-time adaptive and cooperative control of autonomous sensor platforms in a marine sensor network is described in the context of the autonomous oceanographic network scenario. This architecture has three major components, an intelligent, logical sensor that provides high-level environmental state information to a behavior-based autonomous vehicle control system, a new approach to behavior-based control of autonomous vehicles using multiple objective functions that allows reactive control in complex environments with multiple constraints, and an approach to cooperative robotics that is a hybrid between the swarm cooperation and intentional cooperation approaches. The mobility of the sensor platforms is a key advantage of this strategy, allowing dynamic optimization of the sensor locations with respect to the classification or localization of a process of interest including processes which can be time varying, not spatially isotropic and for which action is required in real-time. Experimental results are presented for a 2-D target tracking application in which fully autonomous surface craft using simulated bearing sensors acquire and track a moving target in open water. In the first example, a single sensor vehicle adaptively tracks a target while simultaneously relaying the estimated track to a second vehicle acting as a classification platform. In the second example, two spatially distributed sensor vehicles adaptively track a moving target by fusing their sensor information to form a single target track estimate. In both cases the goal is to adapt the platform motion to minimize the uncertainty of the target track parameter estimates. The link between the sensor platform motion and the target track estimate uncertainty is fully derived and this information is used to develop the behaviors for the sensor platform control system. The experimental results clearly illustrate the significant processing gain that spatially distributed sensors can achieve over a single sensor when observing a dynamic phenomenon as well as the viability of behavior-based control for dealing with uncertainty in complex situations in marine sensor networks.Supported by the Office of Naval Research, with a 3-year National Defense Science and Engineering Grant Fellowship and research assistantships through the Generic Ocean Array Technology Sonar (GOATS) project, contract N00014-97-1-0202 and contract N00014-05-G-0106 Delivery Order 008, PLUSNET: Persistent Littoral Undersea Surveillance Network

Visual Tracking: From An Individual To Groups Of Animals

This thesis is concerned with the development and application of visual tracking techniques to the domain of animal monitoring. The development and evaluation of a system which uses image analysis to control the robotic placement of a sensor on the back of a feeding pig is presented first. This single-target monitoring application is then followed by the evaluation of suitable techniques for tracking groups of animals, of which the most suitable existing technique is found to be a Markov chain Monte Carlo particle filtering algorithm with a Markov random field motion prior (MCMC MRF, Khan et al. 2004). Finally, a new tracking technique is developed which uses social motion information present in groups of social targets to guide the tracking. This is used in the new Motion Parameter Sharing (MPS) algorithm. MPS is designed to improve the tracking of groups of targets with coordinated motion by incorporating motion information from targets that have been moving in a similar way. Situations where coordinated motion information should improve tracking include animal flocking, people moving as a group or any situation where some targets are moving in a correlated fashion. This new method is tested on a variety of real and artificial data sequences, and its performance compared to that of the MCMC MRF algorithm. The new MPS algorithm is found to outperform the MCMC MRF algorithm during a number of different types of sequences (including during occlusion events and noisy sequences) where correlated motion is present between targets. This improvement is apparent both in the accuracy of target location and robustness of tracking, the latter of which is greatly improved

Visual Tracking: From An Individual To Groups Of Animals

This thesis is concerned with the development and application of visual tracking techniques to the domain of animal monitoring. The development and evaluation of a system which uses image analysis to control the robotic placement of a sensor on the back of a feeding pig is presented first. This single-target monitoring application is then followed by the evaluation of suitable techniques for tracking groups of animals, of which the most suitable existing technique is found to be a Markov chain Monte Carlo particle filtering algorithm with a Markov random field motion prior (MCMC MRF, Khan et al. 2004). Finally, a new tracking technique is developed which uses social motion information present in groups of social targets to guide the tracking. This is used in the new Motion Parameter Sharing (MPS) algorithm. MPS is designed to improve the tracking of groups of targets with coordinated motion by incorporating motion information from targets that have been moving in a similar way. Situations where coordinated motion information should improve tracking include animal flocking, people moving as a group or any situation where some targets are moving in a correlated fashion. This new method is tested on a variety of real and artificial data sequences, and its performance compared to that of the MCMC MRF algorithm. The new MPS algorithm is found to outperform the MCMC MRF algorithm during a number of different types of sequences (including during occlusion events and noisy sequences) where correlated motion is present between targets. This improvement is apparent both in the accuracy of target location and robustness of tracking, the latter of which is greatly improved

Inductive Pattern Formation

With the extended computational limits of algorithmic recursion, scientific investigation is transitioning away from computationally decidable problems and beginning to address computationally undecidable complexity. The analysis of deductive inference in structure-property models are yielding to the synthesis of inductive inference in process-structure simulations. Process-structure modeling has examined external order parameters of inductive pattern formation, but investigation of the internal order parameters of self-organization have been hampered by the lack of a mathematical formalism with the ability to quantitatively define a specific configuration of points. This investigation addressed this issue of quantitative synthesis. Local space was developed by the Poincare inflation of a set of points to construct neighborhood intersections, defining topological distance and introducing situated Boolean topology as a local replacement for point-set topology. Parallel development of the local semi-metric topological space, the local semi-metric probability space, and the local metric space of a set of points provides a triangulation of connectivity measures to define the quantitative architectural identity of a configuration and structure independent axes of a structural configuration space. The recursive sequence of intersections constructs a probabilistic discrete spacetime model of interacting fields to define the internal order parameters of self-organization, with order parameters external to the configuration modeled by adjusting the morphological parameters of individual neighborhoods and the interplay of excitatory and inhibitory point sets. The evolutionary trajectory of a configuration maps the development of specific hierarchical structure that is emergent from a specific set of initial conditions, with nested boundaries signaling the nonlinear properties of local causative configurations. This exploration of architectural configuration space concluded with initial process-structure-property models of deductive and inductive inference spaces. In the computationally undecidable problem of human niche construction, an adaptive-inductive pattern formation model with predictive control organized the bipartite recursion between an information structure and its physical expression as hierarchical ensembles of artificial neural network-like structures. The union of architectural identity and bipartite recursion generates a predictive structural model of an evolutionary design process, offering an alternative to the limitations of cognitive descriptive modeling. The low computational complexity of these models enable them to be embedded in physical constructions to create the artificial life forms of a real-time autonomously adaptive human habitat

PLANNING FOR AUTOMATED OPTICAL MICROMANIPULATION OF BIOLOGICAL CELLS

Optical tweezers (OT) can be viewed as a robot that uses a highly focused laser beam for precise manipulation of biological objects and dielectric beads at micro-scale. Using holographic optical tweezers (HOT) multiple optical traps can be created to allow several operations in parallel. Moreover, due to the non-contact nature of manipulation OT can be potentially integrated with other manipulation techniques (e.g. microfluidics, acoustics, magnetics etc.) to ensure its high throughput. However, biological manipulation using OT suffers from two serious drawbacks: (1) slow manipulation due to manual operation and (2) severe effects on cell viability due to direct exposure of laser. This dissertation explores the problem of autonomous OT based cell manipulation in the light of addressing the two aforementioned limitations. Microfluidic devices are well suited for the study of biological objects because of their high throughput. Integrating microfluidics with OT provides precise position control as well as high throughput. An automated, physics-aware, planning approach is developed for fast transport of cells in OT assisted microfluidic chambers. The heuristic based planner employs a specific cost function for searching over a novel state-action space representation. The effectiveness of the planning algorithm is demonstrated using both simulation and physical experiments in microfluidic-optical tweezers hybrid manipulation setup. An indirect manipulation approach is developed for preventing cells from high intensity laser. Optically trapped inert microspheres are used for manipulating cells indirectly either by gripping or pushing. A novel planning and control approach is devised to automate the indirect manipulation of cells. The planning algorithm takes the motion constraints of the gripper or pushing formation into account to minimize the manipulation time. Two different types of cells (Saccharomyces cerevisiae and Dictyostelium discoideum) are manipulated to demonstrate the effectiveness of the indirect manipulation approach