Bioinspired engineering of exploration systems for NASA and DoD

A new approach called bioinspired engineering of exploration systems (BEES) and its value for solving pressing NASA and DoD needs are described. Insects (for example honeybees and dragonflies) cope remarkably well with their world, despite possessing a brain containing less than 0.01% as many neurons as the human brain. Although most insects have immobile eyes with fixed focus optics and lack stereo vision, they use a number of ingenious, computationally simple strategies for perceiving their world in three dimensions and navigating successfully within it. We are distilling selected insect-inspired strategies to obtain novel solutions for navigation, hazard avoidance, altitude hold, stable flight, terrain following, and gentle deployment of payload. Such functionality provides potential solutions for future autonomous robotic space and planetary explorers. A BEES approach to developing lightweight low-power autonomous flight systems should be useful for flight control of such biomorphic flyers for both NASA and DoD needs. Recent biological studies of mammalian retinas confirm that representations of multiple features of the visual world are systematically parsed and processed in parallel. Features are mapped to a stack of cellular strata within the retina. Each of these representations can be efficiently modeled in semiconductor cellular nonlinear network (CNN) chips. We describe recent breakthroughs in exploring the feasibility of the unique blending of insect strategies of navigation with mammalian visual search, pattern recognition, and image understanding into hybrid biomorphic flyers for future planetary and terrestrial applications. We describe a few future mission scenarios for Mars exploration, uniquely enabled by these newly developed biomorphic flyers

Sensing and connection systems for assisted and autonomous driving and unmanned vehicles

The special issue, “Sensors, Wireless Connectivity and Systems for Autonomous Vehicles and Smart Mobility” on MDPI Sensors presents 12 accepted papers, with authors from North America, Asia, Europe and Australia, related to the emerging trends in sensing and navigation systems (i.e., sensors plus related signal processing and understanding techniques in multi-agent and cooperating scenarios) for autonomous vehicles, including also unmanned aerial and underwater ones

Contextually Aware Intelligent Control Agents for Heterogeneous Swarms

An emerging challenge in swarm shepherding research is to design effective and efficient artificial intelligence algorithms that maintain a low-computational ceiling while increasing the swarm's abilities to operate in diverse contexts. We propose a methodology to design a context-aware swarm-control intelligent agent. The intelligent control agent (shepherd) first uses swarm metrics to recognise the type of swarm it interacts with to then select a suitable parameterisation from its behavioural library for that particular swarm type. The design principle of our methodology is to increase the situation awareness (i.e. information contents) of the control agent without sacrificing the low-computational cost necessary for efficient swarm control. We demonstrate successful shepherding in both homogeneous and heterogeneous swarms.Comment: 37 pages, 3 figures, 11 table

Contextually aware intelligent control agents for heterogeneous swarms

An emerging challenge in swarm shepherding research is to design effective and efficient artificial intelligence algorithms that maintain simplicity in their decision models, whilst increasing the swarm’s abilities to operate in diverse contexts. We propose a methodology to design a context-aware swarm control intelligent agent (shepherd). We first use swarm metrics to recognise the type of swarm that the shepherd interacts with, then select a suitable parameterisation from its behavioural library for that particular swarm type. The design principle of our methodology is to increase the situation awareness (i.e. contents) of the control agent without sacrificing the low computational cost necessary for efficient swarm control. We demonstrate successful shepherding in both homogeneous and heterogeneous swarms.</p

Steering herds away from dangers in dynamic environments

Shepherding, the task of guiding a herd of autonomous individuals in a desired direction, is an essential skill to herd animals, enable crowd control and rescue from danger. Equipping robots with the capability of shepherding would allow performing such tasks with increased efficiency and reduced labour costs. So far, only single-robot or centralized multi-robot solutions have been proposed. The former is unable to observe dangers at any place surrounding the herd, and the latter does not generalize to unconstrained environments. Therefore, we propose a decentralized control algorithm for multi-robot shepherding, where the robots maintain a caging pattern around the herd to detect potential nearby dangers. When danger is detected, part of the robot swarm positions itself in order to repel the herd towards a safer region. We study the performance of our algorithm for different collective motion models of the herd. We task the robots to shepherd a herd to safety in two dynamic scenarios: (i) to avoid dangerous patches appearing over time and (ii) to remain inside a safe circular enclosure. Simulations show that the robots are always successful in shepherding when the herd remains cohesive, and enough robots are deployed

Immune systems inspired multi-robot cooperative shepherding

Certain tasks require multiple robots to cooperate in order to solve them. The main problem with multi-robot systems is that they are inherently complex and usually situated in a dynamic environment. Now, biological immune systems possess a natural distributed control and exhibit real-time adaptivity, properties that are required to solve problems in multi-robot systems. In this thesis, biological immune systems and their response to external elements to maintain an organism's health state are researched. The objective of this research is to propose immune-inspired approaches to cooperation, to establish an adaptive cooperation algorithm, and to determine the refinements that can be applied in relation to cooperation. Two immune-inspired models that are based on the immune network theory are proposed, namely the Immune Network T-cell-regulated---with Memory (INT-M) and the Immune Network T-cell-regulated---Cross-Reactive (INT-X) models. The INT-M model is further studied where the results have suggested that the model is feasible and suitable to be used, especially in the multi-robot cooperative shepherding domain. The Collecting task in the RoboShepherd scenario and the application of the INT-M algorithm for multi-robot cooperation are discussed. This scenario provides a highly dynamic and complex situation that has wide applicability in real-world problems. The underlying 'mechanism of cooperation' in the immune inspired model (INT-M) is verified to be adaptive in this chosen scenario. Several multi-robot cooperative shepherding factors are studied and refinements proposed, notably methods used for Shepherds' Approach, Shepherds' Formation and Steering Points' Distance. This study also recognises the importance of flock identification in relation to cooperative shepherding, and the Connected Components Labelling method to overcome the related problem is presented. Further work is suggested on the proposed INT-X model that was not implemented in this study, since it builds on top of the INT-M algorithm and its refinements. This study can also be extended to include other shepherding behaviours, further investigation of other useful features of biological immune systems, and the application of the proposed models to other cooperative tasks

Realistic Physical Simulation and Analysis of Shepherding Algorithms using Unmanned Aerial Vehicles

Advancements in UAV technology have offered promising avenues for wildlife management, specifically in the herding of wild animals. However, existing algorithms frequently simulate two-dimensional scenarios with the unrealistic assumption of continuous knowledge of animal positions or involve the use of a scouting UAV in addition to the herding UAV to localize the position of the animals. Addressing this shortcoming, our research introduces a novel herding strategy using a single UAV, integrating a computer vision algorithm in a three-dimensional simulation through the Gazebo platform with Robot Operating System 2 (ROS2) middleware. The UAV, simulated with a PX4 flight controller, detects animals using ArUco markers and uses their real-time positions to update their last known positions. The performance of our computer-vision-assisted herding algorithm was evaluated in comparison with conventional, position-aware/dual UAV herding strategies. Findings suggest that one of our vision-based strategies exhibits comparable performance to the baseline for smaller populations and loosely packed scenarios, albeit with sporadic herding failures and performance decrement in very tightly packed flocking scenarios and very sparsely distributed flocking scenarios. The proposed algorithm demonstrates potential for future real-world applications, marking a significant stride towards realistic, autonomous wildlife management using UAVs in three-dimensional spaces

Biologically inspired herding of animal groups by robots

A single sheepdog can bring together and manoeuvre hundreds of sheep from one location to another. Engineers and ecologists are fascinated by this sheepdog herding because of the potential it provides for ‘bio-herding’: a biologically inspired herding of animal groups by robots. Although many herding algorithms have been proposed, most are studied via simulation.There are a variety of ecological problems where management of wild animal groups is currently impossible, dangerous and/or costly for humans to manage directly, and which may benefit from bio-herding solutions.Unmanned aerial vehicles (UAVs) now deliver significant benefits to the economy and society. Here, we suggest the use of UAVs for bio-herding. Given their mobility and speed, UAVs can be used in a wide range of environments and interact with animal groups at sea, over the land and in the air.We present a potential roadmap for achieving bio-herding using a pair of UAVs. In our framework, one UAV performs ‘surveillance’ of animal groups, informing the movement of a second UAV that herds them. We highlight the promise and flexibility of a paired UAV approach while emphasising its practical and ethical challenges. We start by describing the types of experiments and data required to understand individual and collective responses to UAVs. Next, we describe how to develop appropriate herding algorithms. Finally, we describe the integration of bio-herding algorithms into software and hardware architecture