Neuromorphic Control using Input-Weighted Threshold Adaptation

Neuromorphic processing promises high energy efficiency and rapid response rates, making it an ideal candidate for achieving autonomous flight of resource-constrained robots. It will be especially beneficial for complex neural networks as are involved in high-level visual perception. However, fully neuromorphic solutions will also need to tackle low-level control tasks. Remarkably, it is currently still challenging to replicate even basic low-level controllers such as proportional-integral-derivative (PID) controllers. Specifically, it is difficult to incorporate the integral and derivative parts. To address this problem, we propose a neuromorphic controller that incorporates proportional, integral, and derivative pathways during learning. Our approach includes a novel input threshold adaptation mechanism for the integral pathway. This Input-Weighted Threshold Adaptation (IWTA) introduces an additional weight per synaptic connection, which is used to adapt the threshold of the post-synaptic neuron. We tackle the derivative term by employing neurons with different time constants. We first analyze the performance and limits of the proposed mechanisms and then put our controller to the test by implementing it on a microcontroller connected to the open-source tiny Crazyflie quadrotor, replacing the innermost rate controller. We demonstrate the stability of our bio-inspired algorithm with flights in the presence of disturbances. The current work represents a substantial step towards controlling highly dynamic systems with neuromorphic algorithms, thus advancing neuromorphic processing and robotics. In addition, integration is an important part of any temporal task, so the proposed Input-Weighted Threshold Adaptation (IWTA) mechanism may have implications well beyond control tasks

An Adaptive Control Strategy for Neural Network based Optimal Quadcopter Controllers

Developing optimal controllers for aggressive high-speed quadcopter flight is a major challenge in the field of robotics. Recent work has shown that neural networks trained with supervised learning can achieve real-time optimal control in some specific scenarios. In these methods, the networks (termed G&CNets) are trained to learn the optimal state feedback from a dataset of optimal trajectories. An important problem with these methods is the reality gap encountered in the sim-to-real transfer. In this work, we trained G&CNets for energy-optimal end-to-end control on the Bebop drone and identified the unmodeled pitch moment as the main contributor to the reality gap. To mitigate this, we propose an adaptive control strategy that works by learning from optimal trajectories of a system affected by constant external pitch, roll and yaw moments. In real test flights, this model mismatch is estimated onboard and fed to the network to obtain the optimal rpm command. We demonstrate the effectiveness of our method by performing energy-optimal hover-to-hover flights with and without moment feedback. Finally, we compare the adaptive controller to a state-of-the-art differential-flatness-based controller in a consecutive waypoint flight and demonstrate the advantages of our method in terms of energy optimality and robustness.Comment: 7 pages, 11 figure

End-to-end Reinforcement Learning for Time-Optimal Quadcopter Flight

Aggressive time-optimal control of quadcopters poses a significant challenge in the field of robotics. The state-of-the-art approach leverages reinforcement learning (RL) to train optimal neural policies. However, a critical hurdle is the sim-to-real gap, often addressed by employing a robust inner loop controller -an abstraction that, in theory, constrains the optimality of the trained controller, necessitating margins to counter potential disturbances. In contrast, our novel approach introduces high-speed quadcopter control using end-to-end RL (E2E) that gives direct motor commands. To bridge the reality gap, we incorporate a learned residual model and an adaptive method that can compensate for modeling errors in thrust and moments. We compare our E2E approach against a state-of-the-art network that commands thrust and body rates to an INDI inner loop controller, both in simulated and real-world flight. E2E showcases a significant 1.39-second advantage in simulation and a 0.17-second edge in real-world testing, highlighting end-to-end reinforcement learning's potential. The performance drop observed from simulation to reality shows potential for further improvement, including refining strategies to address the reality gap or exploring offline reinforcement learning with real flight data.Comment: 6 pages, 6 figures, 1 tabl

Energy scavenging from insect flight

This paper reports the design, fabrication and testing of an energy scavenger that generates power from the wing motion of a Green June Beetle (C otinis nitida ) during its tethered flight. The generator utilizes non-resonant piezoelectric bimorphs operated in the d 31 bending mode to convert mechanical vibrations of a beetle into electrical output. The available deflection, force, and power output from oscillatory movements at different locations on a beetle are measured with a meso-scale piezoelectric beam. This way, the optimum location to scavenge energy is determined, and up to ~115 µW total power is generated from body movements. Two initial generator prototypes were fabricated, mounted on a beetle, and harvested 11.5 and 7.5 µW in device volumes of 11.0 and 5.6 mm 3 , respectively, from 85 to 100 Hz wing strokes during the beetle's tethered flight. A spiral generator was designed to maximize the power output by employing a compliant structure in a limited area. The necessary technology needed to fabricate this prototype was developed, including a process to machine high-aspect ratio devices from bulk piezoelectric substrates with minimum damage to the material using a femto-second laser. The fabricated lightweight spiral generators produced 18.5–22.5 µW on a bench-top test setup mimicking beetles' wing strokes. Placing two generators (one on each wing) can result in more than 45 µW of power per insect. A direct connection between the generator and the flight muscles of the insect is expected to increase the final power output by one order of magnitude.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/90804/1/0960-1317_21_9_095016.pd