Optic Flow-Based Nonlinear Control and Sub-optimal Guidance for Lunar Landing

International audience— A sub-optimal guidance and nonlinear control scheme based on Optic Flow (OF) cues ensuring soft lunar land-ing using two minimalistic bio-inspired visual motion sensors is presented here. Unlike most previous approaches, which rely on state estimation techniques and multiple sensor fusion methods, the guidance and control strategy presented here is based on the sole knowledge of a minimum sensor suite (including OF sensors and an IMU). Two different tasks are addressed in this paper: the first one focuses on the computation of an optimal trajectory and the associated control sequences, and the second one focuses on the design and theoretical stability analysis of the closed loop using only OF and IMU measurements as feedback information. Simulations performed on a lunar landing scenario confirm the excellent performances and the robustness to initial uncertainties of the present guidance and control strategy

A two-directional 1-gram visual motion sensor inspired by the fly's eye

International audienceOptic flow based autopilots for Micro-Aerial Vehicles (MAVs) need lightweight, low-power sensors to be able to fly safely through unknown environments. The new tiny 6-pixel visual motion sensor presented here meets these demanding requirements in term of its mass, size and power consumption. This 1-gram, low-power, fly-inspired sensor accurately gauges the visual motion using only this 6-pixel array with two different panoramas and illuminance conditions. The new visual motion sensor's output results from a smart combination of the information collected by several 2-pixel Local Motion Sensors (LMSs), based on the \enquote{time of travel} scheme originally inspired by the common housefly's Elementary Motion Detector (EMD) neurons. The proposed sensory fusion method enables the new visual sensor to measure the visual angular speed and determine the main direction of the visual motion without any prior knowledge. By computing the median value of the output from several LMSs, we also ended up with a more robust, more accurate and more frequently refreshed measurement of the 1-D angular speed

A data-driven approach for fatigue-based individual blade pitch controller selection from wind conditions

International audienceIn a context of wind power production growth, it is necessary to optimize the levelized cost of energy by reducing the wind turbine operation and maintenance costs. This paper addresses these issues through an innovative data-driven approach, applied to individual pitch control and based on wind conditions clustering, from light detection and ranging (LiDAR) wind field reconstruction. A set of controllers is first designed, and a surrogate model is fitted to predict the economic fatigue cost of the wind turbine in closed-loop for each of these controllers, given a cluster of wind conditions. This allows on-line selection of the controller minimizing mechanical fatigue loads among the candidates for each wind condition. Preliminary tests show promising results regarding the effectiveness of this method in reducing wind turbine fatigue when compared to a single optimized individual pitch controller. The main advantages of this approach are to limit the sensitivities to controller tuning procedure and to provide an economically driven control strategy based on fatigue theory that can be effectively adapted to different wind turbine systems

Bio-inspired Landing Approaches and Their Potential Use On Extraterrestrial Bodies

International audienceAutomatic landing on extraterrestrial bodies is still a challenging and hazardous task. Here we propose a new type of autopilot designed to solve landing problems, which is based on neurophysiological, behavioral, and biorobotic findings on flying insects. Flying insects excel in optic flow sensing techniques and cope with highly parallel data at a low energy and computational cost using lightweight dedicated motion processing circuits. In the first part of this paper, we present our biomimetic approach in the context of a lunar landing scenario, assuming a 2-degree-of-freedom spacecraft approaching the moon, which is simulated with the PANGU software. The autopilot we propose relies only on optic flow (OF) and inertial measurements, and aims at regulating the OF generated during the landing approach, by means of a feedback control system whose sensor is an OF sensor. We put forward an estimation method based on a two-sensor setup to accurately estimate the orientation of the lander's velocity vector, which is mandatory to control the lander's pitch in a near optimal way with respect to the fuel consumption. In the second part, we present a lightweight Visual Motion Sensor (VMS) which draws on the results of neurophysiological studies on the insect visual system. The VMS was able to perform local 1-D angular speed measurements in the range 1.5°/s - 25°/s. The sensor was mounted on an 80 kg unmanned helicopter and test-flown outdoors over various fields. The OF measured onboard was shown to match the ground-truth optic flow despite the dramatic disturbances and vibrations experienced by the sensor

Sub-optimal Lunar Landing GNC using Non-gimbaled Bio-inspired Optic Flow Sensors

International audienceAutonomous planetary landing is a critical phase in every exploratory space mission. Autopilots have to be safe, reliable, energy-saving, and as light as possible. The 2-D Guidance Navigation and Control (GNC) strategy presented here makes use of biologically inspired landing processes. Based solely on the relative visual motion known as the Optic Flow (OF) assessed with minimalistic 6-pixel 1-D OF sensors and Inertial Measurement Unit measurements, an optimal reference trajectory in terms of the mass was defined for the approach phase. Linear and nonlinear control laws were then implemented in order to track the optimal trajectory. To deal with the demanding weight constraints, a new method of OF estimation was applied, based on a non-gimbaled OF sensor configuration and a linear least squares algorithm. The promising results obtained with Software-In-the-Loop simulations showed that the present full GNC solution combined with our OF bio-inspired sensors is compatible with soft, fuel-efficient lunar spacecraft landing and might also be used as a backup solution in case of conventional sensor failure

The wave energy converter control competition (WECCCOMP): Wave energy control algorithms compared in both simulation and tank testing

The wave energy control competition established a benchmark problem which was offered as an open challenge to the wave energy system control community. The competition had two stages: In the first stage, competitors used a standard wave energy simulation platform (WEC-Sim) to evaluate their controllers while, in the second stage, competitors were invited to test their controllers in a real-time implementation on a prototype system in a wave tank. The performance function used was based on converted energy across a range of standard sea states, but also included aspects related to economic performance, such as peak/average power, peak force, etc. This paper compares simulated and experimental results and, in particular, examines if the results obtained in a linear system simulation are borne out in reality. Overall, within the scope of the device tested, the range of sea states employed, and the performance metric used, the conclusion is that high-performance WEC controllers work well in practice, with good carry-over from simulation to experimentation. However, the availability of a good WEC mathematical model is deemed to be crucial

Synthèse d’une solution GNC basée sur des capteurs de flux optique bio-inspirés adaptés à la mesure des basses vitesses pour un atterrissage lunaire autonome en douceur

In this PhD thesis, the challenge of autonomous lunar landing was addressed and an innovative method was developed, which provides an alternative to the classical sensor suites based on RADAR, LIDAR and cameras, which tend to be bulky, energyconsuming and expensive.The first part is devoted to the development of a sensor inspired by the fly’s visual sensitivity to optic flow (OF). The OF is an index giving the relative angular velocity of the environment sensed by the retina of a moving insect or robot. In a fixed environment (where there is no external motion), the self-motion of an airborne vehicle generates an OF containing information about its own velocity and attitude and the distance to obstacles. Based on the “Time of Travel” principle we present the results obtained for two versions of 5 LMSs based optic flow sensors.The first one is able to measure accurately the OF in two opposite directions. It was tested in the laboratory and gave satisfying results. The second optic flow sensor operates at low velocities such as those liable to occur during lunar landing was developed.After developing these sensors, their performances were characterized both indoors and outdoors, and lastly, they were tested onboard an 80-kg helicopter flying in an outdoor environment.The Guidance Navigation and Control (GN) system was designed in the second part on the basis of several algorithms, using various tools such as optimal control, nonlinear control design and observation theory. This is a particularly innovative approach, since it makes it possible to perform soft landing on the basis of OF measurements and as less as possible on inertial sensors. The final constraints imposed by our industrial partners were met by mounting several non-gimbaled sensors oriented in different gaze directions on the lander’s structure. Information about the lander’s self-motion presentin the OF measurements is extracted by navigation algorithms, which yield estimates of the ventral OF, expansion OF and pitch angle.It was also established that it is possible to bring the planetary lander gently to the ground by tracking a pre-computed optimal reference trajectory in terms of the lowest possible fuel consumption. Software-in-the-loop simulations were carried out in order to assess the potential of the proposed GNC approach by testing its performances. In these simulations, the sensor firmware was taken into account and virtual images of the lunar surface were used in order to improve the realism of the simulated landings.Dans cette thèse, nous nous intéressons au problème de l’atterrissage lunaire autonome et nous proposons une méthode innovante amenant une alternative à l’utilisation de capteurs classiques qui peuvent se révéler encombrants, énergivores et très onéreux.La première partie est consacrée au développement et à la construction de capteurs de mouvement inspirés de la vision des insectes volants et mesurant le flux optique.Le flux optique correspond à la vitesse angulaire relative de l’environnement mesurée par la rétine d’un agent. Dans un environnement fixe, les mouvements d’un robot génèrent un flux optique contenant des informations essentielles sur le mouvement de ce dernier. En utilisant le principe du « temps de passage », nous présentons les résultats expérimentaux obtenus en extérieur avec deux versions de ces capteurs.Premièrement, un capteur mesurant le flux optique dans les deux directions opposées est développé et testé en laboratoire. Deuxièmement un capteur adapté à la mesure des faibles flux optiques similaires à ceux pouvant être mesurés lors d’un alunissage est développé, caractérisé et enfin testé sur un drone hélicoptère en conditions extérieures.Dans la seconde partie, une méthode permettant de réaliser le guidage, la navigation et la commande (GNC pour Guidance Navigation and Control) du système est proposée. L’innovation réside dans le fait que l’atterrissage en douceur est uniquement assuré par les capteurs de flux optique. L’utilisation des capteurs inertiels est réduite au maximum. Plusieurs capteurs orientés dans différentes directions de visée, et fixés à la structure de l’atterrisseur permettent d’atteindre les conditions finales définies par les partenaires industriels. Les nombreuses informations décrivant la position et l’attitude du système contenues dans le flux optique sont exploitées grâce aux algorithmes de navigation qui permettent d’estimer les flux optiques ventraux et d’expansion ainsi que le tangage.Nous avons également montré qu’il est possible de contrôler l’atterrisseur planétaire en faisant suivre aux flux optiques estimés une consigne optimale au sens de la consommation d’énergie. Les simulations réalisées durant la thèse ont permis de valider le fonctionnement et le potentiel de la solution GNC proposée en intégrant le code du capteur ainsi que des images simulées du sol de la lune

Design of a GNC Solution based on Bio-Inspired Optic Flow Sensors adapted to low speed measurement for an Autonomous Soft Lunar Landing

Dans cette thèse, nous nous intéressons au problème de l’atterrissage lunaire autonome et nous proposons une méthode innovante amenant une alternative à l’utilisation de capteurs classiques qui peuvent se révéler encombrants, énergivores et très onéreux.La première partie est consacrée au développement et à la construction de capteurs de mouvement inspirés de la vision des insectes volants et mesurant le flux optique.Le flux optique correspond à la vitesse angulaire relative de l’environnement mesurée par la rétine d’un agent. Dans un environnement fixe, les mouvements d’un robot génèrent un flux optique contenant des informations essentielles sur le mouvement de ce dernier. En utilisant le principe du « temps de passage », nous présentons les résultats expérimentaux obtenus en extérieur avec deux versions de ces capteurs.Premièrement, un capteur mesurant le flux optique dans les deux directions opposées est développé et testé en laboratoire. Deuxièmement un capteur adapté à la mesure des faibles flux optiques similaires à ceux pouvant être mesurés lors d’un alunissage est développé, caractérisé et enfin testé sur un drone hélicoptère en conditions extérieures.Dans la seconde partie, une méthode permettant de réaliser le guidage, la navigation et la commande (GNC pour Guidance Navigation and Control) du système est proposée. L’innovation réside dans le fait que l’atterrissage en douceur est uniquement assuré par les capteurs de flux optique. L’utilisation des capteurs inertiels est réduite au maximum. Plusieurs capteurs orientés dans différentes directions de visée, et fixés à la structure de l’atterrisseur permettent d’atteindre les conditions finales définies par les partenaires industriels. Les nombreuses informations décrivant la position et l’attitude du système contenues dans le flux optique sont exploitées grâce aux algorithmes de navigation qui permettent d’estimer les flux optiques ventraux et d’expansion ainsi que le tangage.Nous avons également montré qu’il est possible de contrôler l’atterrisseur planétaire en faisant suivre aux flux optiques estimés une consigne optimale au sens de la consommation d’énergie. Les simulations réalisées durant la thèse ont permis de valider le fonctionnement et le potentiel de la solution GNC proposée en intégrant le code du capteur ainsi que des images simulées du sol de la lune.In this PhD thesis, the challenge of autonomous lunar landing was addressed and an innovative method was developed, which provides an alternative to the classical sensor suites based on RADAR, LIDAR and cameras, which tend to be bulky, energy consuming and expensive. The first part is devoted to the development of a sensor inspired by the fly’s visual sensitivity to optic flow (OF). The OF is an index giving the relative angular velocity of the environment sensed by the retina of a moving insect or robot. In a fixed environment (where there is no external motion), the self-motion of an airborne vehicle generates an OF containing information about its own velocity and attitude and the distance to obstacles. Based on the “Time of Travel” principle we present the results obtained for two versions of 5 LMSs based optic flow sensors. The first one is able to measure accurately the OF in two opposite directions. It was tested in the laboratory and gave satisfying results. The second optic flow sensor operates at low velocities such as those liable to occur during lunar landing was developed. After developing these sensors, their performances were characterized both indoors and outdoors, and lastly, they were tested onboard an 80-kg helicopter flying in an outdoor environment. The Guidance Navigation and Control (GNC) system was designed in the second part on the basis of several algorithms, using various tools such as optimal control, nonlinear control design and observation theory. This is a particularly innovative approach, since it makes it possible to perform soft landing on the basis of OF measurements and as less as possible on inertial sensors. The final constraints imposed by our industrial partners were met by mounting several non-gimbaled sensors oriented in different gaze directions on the lander’s structure. Information about the lander’s self-motion present in the OF measurements is extracted by navigation algorithms, which yield estimates of the ventral OF, expansion OF and pitch angle. It was also established that it is possible to bring the planetary lander gently to the ground by tracking a pre-computed optimal reference trajectory in terms of the lowest possible fuel consumption. Software-in-the-loop simulations were carried out in order to assess the potential of the proposed GNC approach by testing its performances. In these simulations, the sensor firmware was taken into account and virtual images of the lunar surface were used in order to improve the realism of the simulated landings

Backup State Observer Based on Optic Flow Applied to Lunar Landing

8 pagesInternational audienceThe observer presented in this paper, which was based on the use of three minimalistic bio-inspired Visual Motion Sensors (VMS) detecting Optic Flow (OF) cues, states was intended as a backup solution in the case of Inertial Measurement Unit (IMU) failure. Contrary to most previous Guidance Navigation and Control (GNC) solutions for planetary landing, which have involved a sensor suite including an IMU, an innovative strategy is presented here for estimating states without any need for inertial measurements, based solely on information about the relative velocity of the images of the surrounding environment. A Linear Parameter Varying (LPV) observer designed on a LPV system linearized around a reference trajectory, estimates: the ventral OF, the expansion OF and the local pitch angle. A previously developed observer was applied here to a larger class of nonlinear systems by making an ingenious change of variable. Simulations performed on a lunar landing scenario yielded satisfactory performance and showed the robustness of the OF based observer to initial uncertainties and measurement noise