Contributions to autonomous robust navigation of mobile robots in industrial applications

151 p.Un aspecto en el que las plataformas móviles actuales se quedan atrás en comparación con el punto que se ha alcanzado ya en la industria es la precisión. La cuarta revolución industrial trajo consigo la implantación de maquinaria en la mayor parte de procesos industriales, y una fortaleza de estos es su repetitividad. Los robots móviles autónomos, que son los que ofrecen una mayor flexibilidad, carecen de esta capacidad, principalmente debido al ruido inherente a las lecturas ofrecidas por los sensores y al dinamismo existente en la mayoría de entornos. Por este motivo, gran parte de este trabajo se centra en cuantificar el error cometido por los principales métodos de mapeado y localización de robots móviles,ofreciendo distintas alternativas para la mejora del posicionamiento.Asimismo, las principales fuentes de información con las que los robots móviles son capaces de realizarlas funciones descritas son los sensores exteroceptivos, los cuales miden el entorno y no tanto el estado del propio robot. Por esta misma razón, algunos métodos son muy dependientes del escenario en el que se han desarrollado, y no obtienen los mismos resultados cuando este varía. La mayoría de plataformas móviles generan un mapa que representa el entorno que les rodea, y fundamentan en este muchos de sus cálculos para realizar acciones como navegar. Dicha generación es un proceso que requiere de intervención humana en la mayoría de casos y que tiene una gran repercusión en el posterior funcionamiento del robot. En la última parte del presente trabajo, se propone un método que pretende optimizar este paso para así generar un modelo más rico del entorno sin requerir de tiempo adicional para ello

DESIGNING AND EVALUATING A PORTABLE LIDAR-BASED SLAM SYSTEM

Mobile Mapping Technology (MMT) has evolved rapidly over the past few decades, especially in using low-cost sensors. This progress is primarily attributed to the appearance of innovative simultaneous localization and mapping (SLAM) algorithms. This article focuses on evaluating the efficiency of a new LiDAR-based portable SLAM system for mapping in dynamic real-world environments. The work proposed a technical solution based on a Livox Avia LiDAR sensor enhanced by gimbal stabilization. The system, named Portable Livox-based Mapping system (PoLiMap), is compared to other similar solutions by acquiring data from various environments, including urban sceneries, underground tunnels and forested areas, and processing them using a modified FAST-LIO-SLAM algorithm. The research presented in the article contributes to the understanding of the capabilities of PoLiMap systems under various conditions and offers significant insight into its potential applications. Accuracy evaluation results prove that the proposed MMT system can successfully tackle various demanding environments and challenge the results of other more costly state-of-the-art portable mobile laser scanning methods

Towards new sensing capabilities for legged locomotion using real-time state estimation with low-cost IMUs

L'estimation en robotique est un sujet important affecté par les compromis entre certains critères majeurs parmi lesquels nous pouvons citer le temps de calcul et la précision. L'importance de ces deux critères dépend de l'application. Si le temps de calcul n'est pas important pour les méthodes hors ligne, il devient critique lorsque l'application doit s'exécuter en temps réel. De même, les exigences de précision dépendent des applications. Les estimateurs EKF sont largement utilisés pour satisfaire les contraintes en temps réel tout en obtenant une estimation avec des précisions acceptables. Les centrales inertielles (Inertial Measurement Unit - IMU) demeurent des capteurs répandus dnas les problèmes d'estimation de trajectoire. Ces capteurs ont par ailleurs la particularité de fournir des données à une fréquence élevée. La principale contribution de cette thèses est une présentation claire de la méthode de préintégration donnant lieu à une meilleure utilisation des centrales inertielles. Nous appliquons cette méthode aux problèmes d'estimation dans les cas de la navigation piétonne et celle des robots humanoïdes. Nous souhaitons par ailleurs montrer que l'estimation en temps réel à l'aide d'une centrale inertielle à faible coût est possible avec des méthodes d'optimisation tout en formulant les problèmes à l'aide d'un modèle graphique bien que ces méthodes soient réputées pour leurs coûts élevés en terme de calculs. Nous étudions également la calibration des centrales inertielles, une étape qui demeure critique pour leurs utilisations. Les travaux réalisés au cours de cette thèse ont été pensés en gardant comme perspective à moyen terme le SLAM visuel-inertiel. De plus, ce travail aborde une autre question concernant les robots à jambes. Contrairement à leur architecture habituelle, pourrions-nous utiliser plusieurs centrales inertielles à faible coût sur le robot pour obtenir des informations précieuses sur le mouvement en cours d'exécution ?Estimation in robotics is an important subject affected by trade-offs between some major critera from which we can cite the computation time and the accuracy. The importance of these two criteria are application-dependent. If the computation time is not important for off-line methods, it becomes critical when the application has to run on real-time. Similarly, accuracy requirements are dependant on the applications. EKF estimators are widely used to satisfy real-time constraints while achieving acceptable accuracies. One sensor widely used in trajectory estimation problems remains the inertial measurement units (IMUs) providing data at a high rate. The main contribution of this thesis is a clear presentation of the preintegration theory yielding in a better use IMUs. We apply this method for estimation problems in both pedestrian and humanoid robots navigation to show that real-time estimation using a low- cost IMU is possible with smoothing methods while formulating the problems with a factor graph. We also investigate the calibration of the IMUs as it is a critical part of those sensors. All the development made during this thesis was thought with a visual-inertial SLAM background as a mid-term perspective. Firthermore, this work tries to rise another question when it comes to legged robots. In opposition to their usual architecture, could we use multiple low- cost IMUs on the robot to get valuable information about the motion being executed

Hybrid Visual-Inertial/Magnetic 3D Pose Estimation for Tracking Poorly-Textured/Textureless Symmetrical Objects

The focus of this research is mainly to develop a visual 3D pose estimation that can be used for many purposes including but not limited to autonomous visual inspection support system. The work overcomes the fundamental problem of region-based pose estimation in tracking poorly-textured/textureless symmetrical objects due to non-unique projection shape given numerous different poses. The work improved the existing state-of-the-art region-based pose estimation, known as Pixel-Wise Posterior 3D Pose estimation (PWP3D), by incorporating with inertial/magnetic orientation estimate. For this purpose, an inertial/magnetic orientation estimate expressed as a full optimisation problem is proposed beforehand. The proposed method, referred to NAG-AHRS, aims to deal better with the non-Gaussian noise and the non-linear model. The NAG-AHRS is then analysed by comparing its output to the motion capture system, as well as benchmarked to five state-of-the-art inertial/magnetic orientation estimates. The experiments show NAG-AHRS outperformed other benchmarking algorithms. Furthermore, NAG-AHRS facilitates the integration to visual-only pose estimation and to develop hybrid visual-inertial/magnetic pose estimation. In contrast with common visual-inertial integration method that has been dominated by Kalman filtering framework, the proposed method integrates visual and inertial/magnetic as a single optimisation problem. The selected optimisation method is Nesterov’s Accelerated Gradient (NAG) descent, hence the proposed method is referred to as PWP3Di-NAG. The developed PWP3Di-NAG algorithm is then validated by comparing its output to the reference pose provided by Aruco marker and at the same time, it is also benchmarked to the original PWP3D algorithm. The validation demonstrated some significant performances improvements. Moreover, integrating visual-inertial as a single optimisation problem requires to transform inertial/magnetic measurements into the object reference frame. The required transformation induces an initialisation stage to accurately estimate the initial pose of the object. A novel framework for serving this purpose that combines region-based and edge-based pose estimation in a particle filtering framework is also proposed. The validation shows that the proposed framework be able to estimate the pose of an object with low pose estimation errors

A survey on real-time 3D scene reconstruction with SLAM methods in embedded systems

The 3D reconstruction of simultaneous localization and mapping (SLAM) is an important topic in the field for transport systems such as drones, service robots and mobile AR/VR devices. Compared to a point cloud representation, the 3D reconstruction based on meshes and voxels is particularly useful for high-level functions, like obstacle avoidance or interaction with the physical environment. This article reviews the implementation of a visual-based 3D scene reconstruction pipeline on resource-constrained hardware platforms. Real-time performances, memory management and low power consumption are critical for embedded systems. A conventional SLAM pipeline from sensors to 3D reconstruction is described, including the potential use of deep learning. The implementation of advanced functions with limited resources is detailed. Recent systems propose the embedded implementation of 3D reconstruction methods with different granularities. The trade-off between required accuracy and resource consumption for real-time localization and reconstruction is one of the open research questions identified and discussed in this paper

Vision-based legged robot navigation: localisation, local planning, learning

The recent advances in legged locomotion control have made legged robots walk up staircases, go deep into underground caves, and walk in the forest. Nevertheless, autonomously achieving this task is still a challenge. Navigating and acomplishing missions in the wild relies not only on robust low-level controllers but also higher-level representations and perceptual systems that are aware of the robot's capabilities. This thesis addresses the navigation problem for legged robots. The contributions are four systems designed to exploit unique characteristics of these platforms, from the sensing setup to their advanced mobility skills over different terrain. The systems address localisation, scene understanding, and local planning, and advance the capabilities of legged robots in challenging environments. The first contribution tackles localisation with multi-camera setups available on legged platforms. It proposes a strategy to actively switch between the cameras and stay localised while operating in a visual teach and repeat context---in spite of transient changes in the environment. The second contribution focuses on local planning, effectively adding a safety layer for robot navigation. The approach uses a local map built on-the-fly to generate efficient vector field representations that enable fast and reactive navigation. The third contribution demonstrates how to improve local planning in natural environments by learning robot-specific traversability from demonstrations. The approach leverages classical and learning-based methods to enable online, onboard traversability learning. These systems are demonstrated via different robot deployments on industrial facilities, underground mines, and parklands. The thesis concludes by presenting a real-world application: an autonomous forest inventory system with legged robots. This last contribution presents a mission planning system for autonomous surveying as well as a data analysis pipeline to extract forestry attributes. The approach was experimentally validated in a field campaign in Finland, evidencing the potential that legged platforms offer for future applications in the wild

Rhoban Football Club: RoboCup Humanoid KidSize 2019 Champion Team Paper

International audienceIn 2019, Rhoban Football Club reached the first place of the KidSize soccer competition for the fourth time and performed the first in-game throw-in in the history of the Humanoid league. Building on our existing code-base, we improved some specific functionalities, introduced new behaviors and experimented with original methods for labeling videos. This paper presents and reviews our latest changes to both software and hardware, highlighting the lessons learned during RoboCup