Gridbot: An autonomous robot controlled by a Spiking Neural Network mimicking the brain's navigational system

It is true that the "best" neural network is not necessarily the one with the most "brain-like" behavior. Understanding biological intelligence, however, is a fundamental goal for several distinct disciplines. Translating our understanding of intelligence to machines is a fundamental problem in robotics. Propelled by new advancements in Neuroscience, we developed a spiking neural network (SNN) that draws from mounting experimental evidence that a number of individual neurons is associated with spatial navigation. By following the brain's structure, our model assumes no initial all-to-all connectivity, which could inhibit its translation to a neuromorphic hardware, and learns an uncharted territory by mapping its identified components into a limited number of neural representations, through spike-timing dependent plasticity (STDP). In our ongoing effort to employ a bioinspired SNN-controlled robot to real-world spatial mapping applications, we demonstrate here how an SNN may robustly control an autonomous robot in mapping and exploring an unknown environment, while compensating for its own intrinsic hardware imperfections, such as partial or total loss of visual input.Comment: 8 pages, 3 Figures, International Conference on Neuromorphic Systems (ICONS 2018

Neurobiologically Inspired Control of Engineered Flapping Flight

This article presents a new control approach for engineered flapping flight with many interacting degrees of freedom. This paper explores the applications of neurobiologically inspired control systems in the form of Central Pattern Generators (CPG) to generate wing trajectories for potential flapping flight MAVs. We present a rigorous mathematical and control theoretic framework to design complex three dimensional motions of flapping wings. Most flapping flight demonstrators are mechanically limited in generating the wing trajectories. Because CPGs lend themselves to more biological examples of flight, a novel robotic model has been developed to emulate the flight of bats. This model has shoulder and leg joints totaling 10 degrees of freedom for control of wing properties. Results of wind tunnel experiments and numerical simulation of CPG-based flight control validate the effectiveness of the proposed neurobiologically inspired control approach

Neuromorphic Control using Input-Weighted Threshold Adaptation

Neuromorphic processing promises high energy efficiency and rapid response rates, making it an ideal candidate for achieving autonomous flight of resource-constrained robots. It will be especially beneficial for complex neural networks as are involved in high-level visual perception. However, fully neuromorphic solutions will also need to tackle low-level control tasks. Remarkably, it is currently still challenging to replicate even basic low-level controllers such as proportional-integral-derivative (PID) controllers. Specifically, it is difficult to incorporate the integral and derivative parts. To address this problem, we propose a neuromorphic controller that incorporates proportional, integral, and derivative pathways during learning. Our approach includes a novel input threshold adaptation mechanism for the integral pathway. This Input-Weighted Threshold Adaptation (IWTA) introduces an additional weight per synaptic connection, which is used to adapt the threshold of the post-synaptic neuron. We tackle the derivative term by employing neurons with different time constants. We first analyze the performance and limits of the proposed mechanisms and then put our controller to the test by implementing it on a microcontroller connected to the open-source tiny Crazyflie quadrotor, replacing the innermost rate controller. We demonstrate the stability of our bio-inspired algorithm with flights in the presence of disturbances. The current work represents a substantial step towards controlling highly dynamic systems with neuromorphic algorithms, thus advancing neuromorphic processing and robotics. In addition, integration is an important part of any temporal task, so the proposed Input-Weighted Threshold Adaptation (IWTA) mechanism may have implications well beyond control tasks

Neuroinspired control strategies with applications to flapping flight

This dissertation is centered on a theoretical, simulation, and experimental study of control strategies which are inspired by biological systems. Biological systems, along with sufficiently complicated engineered systems, often have many interacting degrees of freedom and need to excite large-displacement oscillations in order to locomote. Combining these factors can make high-level control design difficult. This thesis revolves around three different levels of abstraction, providing tools for analysis and design. First, we consider central pattern generators (CPGs) to control flapping-flight dynamics. The key idea here is dimensional reduction - we want to convert complicated interactions of many degrees of freedom into a handful of parameters which have intuitive connections to the overall system behavior, leaving the control designer unconcerned with the details of particular motions. A rigorous mathematical and control theoretic framework to design complex three-dimensional wing motions is presented based on phase synchronization of nonlinear oscillators. In particular, we show that flapping-flying dynamics without a tail or traditional aerodynamic control surfaces can be effectively controlled by a reduced set of central pattern generator parameters that generate phase-synchronized or symmetry-breaking oscillatory motions of two main wings. Furthermore, by using a Hopf bifurcation, we show that tailless aircraft (inspired by bats) alternating between flapping and gliding can be effectively stabilized by smooth wing motions driven by the central pattern generator network. Results of numerical simulation with a full six-degree-of-freedom flight dynamic model validate the effectiveness of the proposed neurobiologically inspired control approach. Further, we present experimental micro aerial vehicle (MAV) research with low-frequency flapping and articulated wing gliding. The importance of phase difference control via an abstract mathematical model of central pattern generators is confirmed with a robotic bat on a 3-DOF pendulum platform. An aerodynamic model for the robotic bat based on the complex wing kinematics is presented. Closed loop experiments show that control dimension reduction is achievable - unstable longitudinal modes are stabilized and controlled using only two control parameters. A transition of flight modes, from flapping to gliding and vice-versa, is demonstrated within the CPG control scheme. The second major thrust is inspired by this idea that mode switching is useful. Many bats and birds adopt a mixed strategy of flapping and gliding to provide agility when necessary and to increase overall efficiency. This work explores dwell time constraints on switched systems with multiple, possibly disparate invariant limit sets. We show that, under suitable conditions, trajectories globally converge to a superset of the limit sets and then remain in a second, larger superset. We show the effectiveness of the dwell-time conditions by using examples of nonlinear switching limit cycles from our work on flapping flight. This level of abstraction has been found to be useful in many ways, but it also produces its own challenges. For example, we discuss death of oscillation which can occur for many limit-cycle controllers and the difficulty in incorporating fast, high-displacement reflex feedback. This leads us to our third major thrust - considering biologically realistic neuron circuits instead of a limit cycle abstraction. Biological neuron circuits are incredibly diverse in practice, giving us a convincing rationale that they can aid us in our quest for flexibility. Nevertheless, that flexibility provides its own challenges. It is not currently known how most biological neuron circuits work, and little work exists that connects the principles of a neuron circuit to the principles of control theory. We begin the process of trying to bridge this gap by considering the simplest of classical controllers, PD control. We propose a simple two-neuron, two-synapse circuit based on the concept that synapses provide attenuation and a delay. We present a simulation-based method of analysis, including a smoothing algorithm, a steady-state response curve, and a system identification procedure for capturing differentiation. There will never be One True Control Method that will solve all problems. Nature's solution to a diversity of systems and situations is equally diverse. This will inspire many strategies and require a multitude of analysis tools. This thesis is my contribution of a few

Recent advances in evolutionary and bio-inspired adaptive robotics: exploiting embodied dynamics

This paper explores current developments in evolutionary and bio-inspired approaches to autonomous robotics, concentrating on research from our group at the University of Sussex. These developments are discussed in the context of advances in the wider fields of adaptive and evolutionary approaches to AI and robotics, focusing on the exploitation of embodied dynamics to create behaviour. Four case studies highlight various aspects of such exploitation. The first exploits the dynamical properties of a physical electronic substrate, demonstrating for the first time how component-level analog electronic circuits can be evolved directly in hardware to act as robot controllers. The second develops novel, effective and highly parsimonious navigation methods inspired by the way insects exploit the embodied dynamics of innate behaviours. Combining biological experiments with robotic modeling, it is shown how rapid route learning can be achieved with the aid of navigation-specific visual information that is provided and exploited by the innate behaviours. The third study focuses on the exploitation of neuromechanical chaos in the generation of robust motor behaviours. It is demonstrated how chaotic dynamics can be exploited to power a goal-driven search for desired motor behaviours in embodied systems using a particular control architecture based around neural oscillators. The dynamics are shown to be chaotic at all levels in the system, from the neural to the embodied mechanical. The final study explores the exploitation of the dynamics of brain-body-environment interactions for efficient, agile flapping winged flight. It is shown how a multi-objective evolutionary algorithm can be used to evolved dynamical neural controllers for a simulated flapping wing robot with feathered wings. Results demonstrate robust, stable, agile flight is achieved in the face of random wind gusts by exploiting complex asymmetric dynamics partly enabled by continually changing wing and tail morphologies

A Comparison between Frame-based and Event-based Cameras for Flapping-Wing Robot Perception

Perception systems for ornithopters face severe challenges. The harsh vibrations and abrupt movements caused during flapping are prone to produce motion blur and strong lighting condition changes. Their strict restrictions in weight, size, and energy consumption also limit the type and number of sensors to mount onboard. Lightweight traditional cameras have become a standard off-the-shelf solution in many flapping-wing designs. However, bioinspired event cameras are a promising solution for ornithopter perception due to their microsecond temporal resolution, high dynamic range, and low power consumption. This paper presents an experimental comparison between frame-based and an event-based camera. Both technologies are analyzed considering the particular flapping-wing robot specifications and also experimentally analyzing the performance of well-known vision algorithms with data recorded onboard a flapping-wing robot. Our results suggest event cameras as the most suitable sensors for ornithopters. Nevertheless, they also evidence the open challenges for event-based vision on board flapping-wing robots

Biomimetic vision-based collision avoidance system for MAVs.

This thesis proposes a secondary collision avoidance algorithm for micro aerial vehicles based on luminance-difference processing exhibited by the Lobula Giant Movement Detector (LGMD), a wide-field visual neuron located in the lobula layer of a locust’s nervous system. In particular, we address the design, modulation, hardware implementation, and testing of a computationally simple yet robust collision avoidance algorithm based on the novel concept of quadfurcated luminance-difference processing (QLDP). Micro and Nano class of unmanned robots are the primary target applications of this algorithm, however, it could also be implemented on advanced robots as a fail-safe redundant system. The algorithm proposed in this thesis addresses some of the major detection challenges such as, obstacle proximity, collision threat potentiality, and contrast correction within the robot’s field of view, to establish and generate a precise yet simple collision-free motor control command in real-time. Additionally, it has proven effective in detecting edges independent of background or obstacle colour, size, and contour. To achieve this, the proposed QLDP essentially executes a series of image enhancement and edge detection algorithms to estimate collision threat-level (spike) which further determines if the robot’s field of view must be dissected into four quarters where each quadrant’s response is analysed and interpreted against the others to determine the most secure path. Ultimately, the computation load and the performance of the model is assessed against an eclectic set of off-line as well as real-time real-world collision scenarios in order to validate the proposed model’s asserted capability to avoid obstacles at more than 670 mm prior to collision (real-world), moving at 1.2 msˉ¹ with a successful avoidance rate of 90% processing at an extreme frequency of 120 Hz, that is much superior compared to the results reported in the contemporary related literature to the best of our knowledge.MSc by Researc

Learning Autonomous Flight Controllers with Spiking Neural Networks

The ability of a robot to adapt in-mission to achieve an assigned goal is highly desirable. This thesis project places an emphasis on employing learning-based intelligent control methodologies to the development and implementation of an autonomous unmanned aerial vehicle (UAV). Flight control is carried out by evolving spiking neural networks (SNNs) with Hebbian plasticity. The proposed implementation is capable of learning and self-adaptation to model variations and uncertainties when the controller learned in simulation is deployed on a physical platform. Controller development for small multicopters often relies on simulations as an intermediate step, providing cheap, parallelisable, observable and reproducible optimisation with no risk of damage to hardware. Although model-based approaches have been widely utilised in the process of development, loss of performance can be observed on the target platform due to simplification of system dynamics in simulation (e.g., aerodynamics, servo dynamics, sensor uncertainties). Ignorance of these effects in simulation can significantly deteriorate performance when the controller is deployed. Previous approaches often require mathematical or simulation models with a high level of accuracy which can be difficult to obtain. This thesis, on the other hand, attempts to cross the reality gap between a low-fidelity simulation and the real platform. This is done using synaptic plasticity to adapt the SNN controller evolved in simulation to the actual UAV dynamics. The primary contribution of this work is the implementation of a procedural methodology for SNN control that integrates bioinspired learning mechanisms with artificial evolution, with an SNN library package (i.e. eSpinn) developed by the author. Distinct from existing SNN simulators that mainly focus on large-scale neuron interactions and learning mechanisms from a neuroscience perspective, the eSpinn library draws particular attention to embedded implementations on hardware that is applicable for problems in the robotic domain. This C++ software package is not only able to support simulations in the MATLAB and Python environment, allowing rapid prototyping and validation in simulation; but also capable of seamless transition between simulation and deployment on the embedded platforms. This work implements a modified version of the NEAT neuroevolution algorithm and leverages the power of evolutionary computation to discover functional controller compositions and optimise plasticity mechanisms for online adaptation. With the eSpinn software package the development of spiking neurocontrollers for all degrees of freedom of the UAV is demonstrated in simulation. Plastic height control is carried out on a physical hexacopter platform. Through a set of experiments it is shown that the evolved plastic controller can maintain its functionality by self-adapting to model changes and uncertainties that take place after evolutionary training, and consequently exhibit better performance than its non-plastic counterpart

A Furcated Visual Collision Avoidance System for an Autonomous Micro Robot

This paper proposes a secondary reactive collision avoidance system for micro class of robots based on a novel approach known as the Furcated Luminance-Difference Processing (FLDP) inspired by the Lobula Giant Movement Detector, a wide-field visual neuron located in the lobula layer of a locust nervous system. This paper addresses some of the major collision avoidance challenges; obstacle proximity & direction estimation, and operation in GPS-denied environment with irregular lighting. Additionally, it has proven effective in detecting edges independent of background color, size, and contour. The FLDP executes a series of image enhancement and edge detection algorithms to estimate collision threat-level which further determines whether or not the robot’s field of view must be dissected where each section’s response is compared against the others to generate a simple collision-free maneuver. Ultimately, the computation load and the performance of the model is assessed against an eclectic set of off-line as well as real-time real-world collision scenarios validating the proposed model’s asserted capability to avoid obstacles at more than 670 mm prior to collision, moving at 1.2 ms¯¹ with a successful avoidance rate of 90% processing at 120 Hz on a simple single core microcontroller, sufficient to conclude the system’s feasibility for real-time real-world applications that possess fail-safe collision avoidance system

A Survey of Robotics Control Based on Learning-Inspired Spiking Neural Networks

Biological intelligence processes information using impulses or spikes, which makes those living creatures able to perceive and act in the real world exceptionally well and outperform state-of-the-art robots in almost every aspect of life. To make up the deficit, emerging hardware technologies and software knowledge in the fields of neuroscience, electronics, and computer science have made it possible to design biologically realistic robots controlled by spiking neural networks (SNNs), inspired by the mechanism of brains. However, a comprehensive review on controlling robots based on SNNs is still missing. In this paper, we survey the developments of the past decade in the field of spiking neural networks for control tasks, with particular focus on the fast emerging robotics-related applications. We first highlight the primary impetuses of SNN-based robotics tasks in terms of speed, energy efficiency, and computation capabilities. We then classify those SNN-based robotic applications according to different learning rules and explicate those learning rules with their corresponding robotic applications. We also briefly present some existing platforms that offer an interaction between SNNs and robotics simulations for exploration and exploitation. Finally, we conclude our survey with a forecast of future challenges and some associated potential research topics in terms of controlling robots based on SNNs