Bio-inspired vision-based leader-follower formation flying in the presence of delays

Flocking starlings at dusk are known for the mesmerizing and intricate shapes they generate, as well as how fluid these shapes change. They seem to do this effortlessly. Real-life vision-based flocking has not been achieved in micro-UAVs (micro Unmanned Aerial Vehicles) to date. Towards this goal, we make three contributions in this paper: (i) we used a computational approach to develop a bio-inspired architecture for vision-based Leader-Follower formation flying on two micro-UAVs. We believe that the minimal computational cost of the resulting algorithm makes it suitable for object detection and tracking during high-speed flocking; (ii) we show that provided delays in the control loop of a micro-UAV are below a critical value, Kalman filter-based estimation algorithms are not required to achieve Leader-Follower formation flying; (iii) unlike previous approaches, we do not use external observers, such as GPS signals or synchronized communication with flock members. These three contributions could be useful in achieving vision-based flocking in GPS-denied environments on computationally-limited agents

Technical report on Optimization-Based Bearing-Only Visual Homing with Applications to a 2-D Unicycle Model

We consider the problem of bearing-based visual homing: Given a mobile robot which can measure bearing directions with respect to known landmarks, the goal is to guide the robot toward a desired "home" location. We propose a control law based on the gradient field of a Lyapunov function, and give sufficient conditions for global convergence. We show that the well-known Average Landmark Vector method (for which no convergence proof was known) can be obtained as a particular case of our framework. We then derive a sliding mode control law for a unicycle model which follows this gradient field. Both controllers do not depend on range information. Finally, we also show how our framework can be used to characterize the sensitivity of a home location with respect to noise in the specified bearings. This is an extended version of the conference paper [1].Comment: This is an extender version of R. Tron and K. Daniilidis, "An optimization approach to bearing-only visual homing with applications to a 2-D unicycle model," in IEEE International Conference on Robotics and Automation, 2014, containing additional proof

A unified approach to cooperative and non-cooperative sense-and-avoid

Cooperative and non-cooperative Sense-and-Avoid (SAA) capabilities are key enablers for Unmanned Aircraft Vehicle (UAV) to safely and routinely access all classes of airspace. In this paper state-of-the-art cooperative and non-cooperative SAA sensor/system technologies for small-to-medium size UAV are identified and the associated multi-sensor data fusion techniques are introduced. A reference SAA system architecture is presented based on Boolean Decision Logics (BDL) for selecting and sorting non-cooperative and cooperative sensors/systems including both passive and active Forward Looking Sensors (FLS), Traffic Collision Avoidance System (TCAS) and Automatic Dependent Surveillance - Broadcast (ADS-B). After elaborating the SAA system processes, the key mathematical models associated with both non-cooperative and cooperative SAA functions are presented. The analytical models adopted to compute the overall uncertainty volume in the airspace surrounding an intruder are described. Based on these mathematical models, the SAA Unified Method (SUM) for cooperative and non-cooperative SAA is presented. In this unified approach, navigation and tracking errors affecting the measurements are considered and translated to unified range and bearing uncertainty descriptors, which apply both to cooperative and non-cooperative scenarios. Simulation case studies are carried out to evaluate the performance of the proposed SAA approach on a representative host platform (AEROSONDE UAV) and various intruder platforms. Results corroborate the validity of the proposed approach and demonstrate the impact of SUM towards providing a cohesive logical framework for the development of an airworthy SAA capability, which provides a pathway for manned/unmanned aircraft coexistence in all classes of airspace

The Hierarchic treatment of marine ecological information from spatial networks of benthic platforms

Measuring biodiversity simultaneously in different locations, at different temporal scales, and over wide spatial scales is of strategic importance for the improvement of our understanding of the functioning of marine ecosystems and for the conservation of their biodiversity. Monitoring networks of cabled observatories, along with other docked autonomous systems (e.g., Remotely Operated Vehicles [ROVs], Autonomous Underwater Vehicles [AUVs], and crawlers), are being conceived and established at a spatial scale capable of tracking energy fluxes across benthic and pelagic compartments, as well as across geographic ecotones. At the same time, optoacoustic imaging is sustaining an unprecedented expansion in marine ecological monitoring, enabling the acquisition of new biological and environmental data at an appropriate spatiotemporal scale. At this stage, one of the main problems for an effective application of these technologies is the processing, storage, and treatment of the acquired complex ecological information. Here, we provide a conceptual overview on the technological developments in the multiparametric generation, storage, and automated hierarchic treatment of biological and environmental information required to capture the spatiotemporal complexity of a marine ecosystem. In doing so, we present a pipeline of ecological data acquisition and processing in different steps and prone to automation. We also give an example of population biomass, community richness and biodiversity data computation (as indicators for ecosystem functionality) with an Internet Operated Vehicle (a mobile crawler). Finally, we discuss the software requirements for that automated data processing at the level of cyber-infrastructures with sensor calibration and control, data banking, and ingestion into large data portals.Peer ReviewedPostprint (published version

Biologically Inspired Monocular Vision Based Navigation and Mapping in GPS-Denied Environments

This paper presents an in-depth theoretical study of bio-vision inspired feature extraction and depth perception method integrated with vision-based simultaneous localization and mapping (SLAM). We incorporate the key functions of developed visual cortex in several advanced species, including humans, for depth perception and pattern recognition. Our navigation strategy assumes GPS-denied manmade environment consisting of orthogonal walls, corridors and doors. By exploiting the architectural features of the indoors, we introduce a method for gathering useful landmarks from a monocular camera for SLAM use, with absolute range information without using active ranging sensors. Experimental results show that the system is only limited by the capabilities of the camera and the availability of good corners. The proposed methods are experimentally validated by our self-contained MAV inside a conventional building

A Novel Bio-Inspired Insertion Method for Application to Next Generation Percutaneous Surgical Tools

The use of minimally invasive techniques can dramatically improve patient outcome from neurosurgery, with less risk, faster recovery, and better cost effectiveness when compared to conventional surgical intervention. To achieve this, innovative surgical techniques and new surgical instruments have been developed. Nevertheless, the simplest and most common interventional technique for brain surgery is needle insertion for either diagnostic or therapeutic purposes. The work presented in this thesis shows a new approach to needle insertion into soft tissue, focussing on soft tissue-needle interaction by exploiting microtextured topography and the unique mechanism of a reciprocating motion inspired by the ovipositor of certain parasitic wasps. This thesis starts by developing a brain-like phantom which I was shown to have mechanical properties similar to those of neurological tissue during needle insertion. Secondly, a proof-of-concept of the bio-inspired insertion method was undertaken. Based on this finding, the novel method of a multi-part probe able to penetrate a soft substrate by reciprocal motion of each segment is derived. The advantages of the new insertion method were investigated and compared with a conventional needle insertion in terms of needle-tissue interaction. The soft tissue deformation and damage were also measured by exploiting the method of particle image velocimetry. Finally, the thesis proposes the possible clinical application of a biologically-inspired surface topography for deep brain electrode implantation. As an adjunct to this work, the reciprocal insertion method described here fuelled the research into a novel flexible soft tissue probe for percutaneous intervention, which is able to steer along curvilinear trajectories within a compliant medium. Aspects of this multi-disciplinary research effort on steerable robotic surgery are presented, followed by a discussion of the implications of these findings within the context of future work

Monocular Vision SLAM for Indoor Aerial Vehicles

This paper presents a novel indoor navigation and ranging strategy by using a monocular camera. The proposed algorithms are integrated with simultaneous localization and mapping (SLAM) with a focus on indoor aerial vehicle applications. We experimentally validate the proposed algorithms by using a fully self-contained micro aerial vehicle (MAV) with on-board image processing and SLAM capabilities. The range measurement strategy is inspired by the key adaptive mechanisms for depth perception and pattern recognition found in humans and intelligent animals. The navigation strategy assumes an unknown, GPS-denied environment, which is representable via corner-like feature points and straight architectural lines. Experimental results show that the system is only limited by the capabilities of the camera and the availability of good corners