Bayesian & AI driven Embedded Perception and Decision-making. Application to Autonomous Navigation in Complex, Dynamic, Uncertain and Human-populated Environments.Synoptic of Research Activity, Period 2004-20 and beyond

Robust perception & Decision-making for safe navigation in open and dynamic environments populated by human beings is an open and challenging scientific problem. Traditional approaches do not provide adequate solutions for these problems, mainly because these environments are partially unknown, open and subject to strong constraints to be satisfied (in particular high dynamicity and uncertainty). This means that the proposed solutions have to take simultaneously into account characteristics such as real-time processing, temporary occultation or false detections, dynamic changes in the scene, prediction of the future dynamic behaviors of the surrounding moving entities, continuous assessment of the collision risk, or decision-making for safe navigation. This research report presents how we have addressed this problem over the two last decades, as well as an outline of our Bayesian & IA approach for solving the Embedded Perception and Decision-making problems

Pose Self-Measurement of Noncooperative Spacecraft Based on Solar Panel Triangle Structure

Aiming at the recognition and location of noncooperative spacecraft, this paper presents a monocular vision pose measurement method based on solar triangle structure. First of all, an autonomous recognition algorithm of feature structure based on sliding window Hough transformation (SWHT) and inscribed circle of a triangle is proposed, and the image coordinates of feature points on the triangle can be obtained relying on this algorithm, combined with the P4P algorithm and the structure of spacecraft, calculating the relative pose of target expressed by rotation and translation matrix. The whole algorithm can be loaded into the prewritten onboard program, which will get the autocomplete feature structure extraction and relative pose measurement without human intervention, and this method does not need to mount any markers on the target. Then compare the measured values with the accurate value of the laser tracker, so that a conclusion can be drawn that the maximum position error is lower than 5% and the rotation error is lower than 4%, which meets the requirements of noncooperative spacecraft’s pose measurement for observations, tracking, and docking in the final rendezvous phase

Haptic microrobotic intracellular injection assistance using virtual fixtures

In manual cell injection the operator relies completely on visual information for task feedback and is subject to extended training times as well as poor success rates and repeatability. From this perspective, enhancing human-in-the-loop intracellular injection through haptic interaction offers significant benefits. This paper outlines two haptic virtual fixtures aiming to assist the human operator while performing cell injection. The first haptic virtual fixture is a parabolic force field designed to assist the operator in guiding the micropipette\u27s tip to a desired penetration point on the cell\u27s surface. The second is a planar virtual fixture which attempts to assist the operator from moving the micropipette\u27s tip beyond the deposition target location inside the cell. Preliminary results demonstrate the operation of the haptically assisted microrobotic cell injection system

3D hydrodynamic analysis of a biomimetic robot fish

This paper presents a three-dimensional (3D) computational fluid dynamic simulation of a biomimetic robot fish. Fluent and user-defined function (UDF) is used to define the movement of the robot fish and the Dynamic Mesh is used to mimic the fish swimming in water. Hydrodynamic analysis is done in this paper too. The aim of this study is to get comparative data about hydrodynamic properties of those guidelines to improve the design, remote control and flexibility of the underwater robot fish

Accurate large-scale bearing-only SLAM by map joining

This paper presents a bearing-only SLAM algorithm that generates accurate and consistent maps of large environments by joining a series of small local maps. The local maps are built by least squares optimization with a proper landmark initialization technique. The local maps are then combined to build global map using Iterated Sparse Local Submap Joining Filter (I-SLSJF). The accuracy and consistency of the proposed algorithm is evaluated using simulation data sets. The algorithm is also tested using the DLR-Spatial-Cognition data set and the preprocessed Victoria Park data where the range information is ignored. The global map results are very similar to the result of full least squares optimization starting with very accurate initial values. As I-SLSJF is able to join a given set of local maps and associated uncertainties efficiently without any information loss, these results demonstrate that focusing on generating accurate local maps is a promising direction for solving large-scale bearing-only SLAM problems

Dynamic Trajectory Generation Using Continuous-Curvature Algorithms for Door to Door Assistance Vehicles

International audienceIn this paper, an algorithm for dynamic path generation in urban environments is presented, taking into account structural and sudden changes in straight and bend segments (e.g. roundabouts and intersections). The results present some improvements in path generation (previously hand plotted) considering parametric equations and continuous-curvature algorithms, which guarantees a comfortable lateral acceleration. This work is focused on smooth and safe path generation using road and obstacle detection information. Finally, some simulation results show a good performance of the algorithm using different ranges of urban curves. The main contribution is an Intelligent Trajectory Generator, which considers infrastructure and vehicle information. This method is recently used in the framework of the project CityMobil2, for urban autonomous guidance of Cybercars

Comparative Study of Human Age Estimation with or without Preclassification of Gender and Facial Expression

Age estimation has many useful applications, such as age-based face classification, finding lost children, surveillance monitoring, and face recognition invariant to age progression. Among many factors affecting age estimation accuracy, gender and facial expression can have negative effects. In our research, the effects of gender and facial expression on age estimation using support vector regression (SVR) method are investigated. Our research is novel in the following four ways. First, the accuracies of age estimation using a single-level local binary pattern (LBP) and a multilevel LBP (MLBP) are compared, and MLBP shows better performance as an extractor of texture features globally. Second, we compare the accuracies of age estimation using global features extracted by MLBP, local features extracted by Gabor filtering, and the combination of the two methods. Results show that the third approach is the most accurate. Third, the accuracies of age estimation with and without preclassification of facial expression are compared and analyzed. Fourth, those with and without preclassification of gender are compared and analyzed. The experimental results show the effectiveness of gender preclassification in age estimation

Predicting amount of saleable products using neural network metamodels of casthouses

This study aims at developing abstract metamodels for approximating highly nonlinear relationships within a metal casting plant. Metal casting product quality nonlinearly depends on many controllable and uncontrollable factors. For improving the productivity of the system, it is vital for operation planners to predict in advance the amount of high quality products. Neural networks metamodels are developed and applied in this study for predicting the amount of saleable products. Training of metamodels is done using the Levenberg-Marquardt and Bayesian learning methods. Statistical measures are calculated for the developed metamodels over a grid of neural network structures. Demonstrated results indicate that Bayesian-based neural network metamodels outperform the Levenberg-Marquardt-based metamodels in terms of both prediction accuracy and robustness to the metamodel complexity. In contrast, the latter metamodels are computationally less expensive and generate the results more quickly

A Semantic Labeling of the Environment Based on What People Do

In this work, a system is developed for semantic labeling of locations based on what people do. This system is useful for semantic navigation of mobile robots. The system differentiates environments according to what people do in them. Background sound, number of people in a room and amount of movement of those people are items to be considered when trying to tell if people are doing different actions. These data are sampled, and it is assumed that people behave differently and perform different actions. A support vector machine is trained with the obtained samples, and therefore, it allows one to identify the room. Finally, the results are discussed and support the hypothesis that the proposed system can help to semantically label a room.The research leading to these results has received funding from the RoboCity2030-III-CMproject (Robótica aplicada a la mejora de la calidad de vida de los ciudadanos. fase III; S2013/MIT-2748), funded by Programas de Actividades I+Den la Comunidad de Madrid and cofunded by Structural Funds of the EU and NAVEGASEAUTOCOGNAVproject (DPI2014-53525-C3-3-R), funded by Ministerio de Economía y Competitividad of Spain.The research leading to these results has received funding from the RoboCity2030-III-CMproject (Robótica aplicada a la mejora de la calidad de vida de los ciudadanos. fase III; S2013/MIT-2748), funded by Programas de Actividades I+Den la Comunidad de Madrid and cofunded by Structural Funds of the EU and NAVEGASEAUTOCOGNAVproject (DPI2014-53525-C3-3-R), funded by Ministerio de Economía y Competitividad of Spain

Improved PID controller based on piecewise affine function in data driven control framework

In recent years, with the rapid developments of science and technology, practical applications in various fields such as chemical, machinery, electronics and electricity industries have caused the process to become more complex. This subsequently causes the modelling of the plant using first principles or system identification to become more difficult. In general, the PID controller has been successfully applied in various applications. However, the PID gains which are proportional