Probabilistic movement modeling for intention inference in human-robot interaction.

Intention inference can be an essential step toward efficient humanrobot interaction. For this purpose, we propose the Intention-Driven Dynamics Model (IDDM) to probabilistically model the generative process of movements that are directed by the intention. The IDDM allows to infer the intention from observed movements using Bayes ’ theorem. The IDDM simultaneously finds a latent state representation of noisy and highdimensional observations, and models the intention-driven dynamics in the latent states. As most robotics applications are subject to real-time constraints, we develop an efficient online algorithm that allows for real-time intention inference. Two human-robot interaction scenarios, i.e., target prediction for robot table tennis and action recognition for interactive humanoid robots, are used to evaluate the performance of our inference algorithm. In both intention inference tasks, the proposed algorithm achieves substantial improvements over support vector machines and Gaussian processes.

Action intention recognition for proactive human assistance in domestic environments

The current Master’s Thesis in Automatics, Control and Robotics covers the development and implementation of an Action Intention Recognition algorithm for proactive human assistance in domestic environments. The proposed solution is based on the use of data provided by a real time RGBD Object Recognition process which captures object state changes inside a defined region of interest of the domestic environment setup. A background analysis is performed to analyze state of the art approaches to both real time RGBD object recognition and action intention recognition methods. The preliminary analysis serves as the base for the proposal of a new volume descriptor for object categorization and an improved formalism for Activation Spreading Networks in the context of action intention recognition. Several tests are performed to study the performance of the proposed solution and its results are analyzed to define the conclusions of the project and propose future work. Finally, the project budget and environmental impact as well as the project schedule are presented and briefly discusse

Neurostimulation artifact removal for implantable sensors improves signal clarity and decoding of motor volition

As the demand for prosthetic limbs with reliable and multi-functional control increases, recent advances in myoelectric pattern recognition and implanted sensors have proven considerably advantageous. Additionally, sensory feedback from the prosthesis can be achieved via stimulation of the residual nerves, enabling closed-loop control over the prosthesis. However, this stimulation can cause interfering artifacts in the electromyographic (EMG) signals which deteriorate the reliability and function of the prosthesis. Here, we implement two real-time stimulation artifact removal algorithms, Template Subtraction (TS) and epsilon-Normalized Least Mean Squares (epsilon-NLMS), and investigate their performance in offline and real-time myoelectric pattern recognition in two transhumeral amputees implanted with nerve cuff and EMG electrodes. We show that both algorithms are capable of significantly improving signal-to-noise ratio (SNR) and offline pattern recognition accuracy of artifact-corrupted EMG signals. Furthermore, both algorithms improved real-time decoding of motor intention during active neurostimulation. Although these outcomes are dependent on the user-specific sensor locations and neurostimulation settings, they nonetheless represent progress toward bi-directional neuromusculoskeletal prostheses capable of multifunction control and simultaneous sensory feedback

Bypass Enhancement RGB Stream Model for Pedestrian Action Recognition of Autonomous Vehicles

Pedestrian action recognition and intention prediction is one of the core issues in the field of autonomous driving. In this research field, action recognition is one of the key technologies. A large number of scholars have done a lot of work to im-prove the accuracy of the algorithm for the task. However, there are relatively few studies and improvements in the computational complexity of algorithms and sys-tem real-time. In the autonomous driving application scenario, the real-time per-formance and ultra-low latency of the algorithm are extremely important evalua-tion indicators, which are directly related to the availability and safety of the au-tonomous driving system. To this end, we construct a bypass enhanced RGB flow model, which combines the previous two-branch algorithm to extract RGB feature information and optical flow feature information respectively. In the train-ing phase, the two branches are merged by distillation method, and the bypass enhancement is combined in the inference phase to ensure accuracy. The real-time behavior of the behavior recognition algorithm is significantly improved on the premise that the accuracy does not decrease. Experiments confirm the superiority and effectiveness of our algorithm.Comment: Accepted to ACPR 2019 - Workshop on Computer Vision for Modern Vehicle

Learning Dynamic Systems for Intention Recognition in Human-Robot-Cooperation

This thesis is concerned with intention recognition for a humanoid robot and investigates how the challenges of uncertain and incomplete observations, a high degree of detail of the used models, and real-time inference may be addressed by modeling the human rationale as hybrid, dynamic Bayesian networks and performing inference with these models. The key focus lies on the automatic identification of the employed nonlinear stochastic dependencies and the situation-specific inference

Investigating Initial Driver Intention on Overtaking on Rural Roads

Driver intention recognition is essential to the development of advanced driver assistance systems providing real-time support. Current approaches for the recognition of overtaking intentions focus on drivers’ observable behaviors, neglecting the fact that the intention to overtake a slower lead car emerges earlier than the resulting behavior. This paper aims to distinguish the "intention emerging process", when drivers form the initial intention to overtake, from the "action executing process", when drivers execute the overtaking maneuver. A driving simulator study has been conducted to investigate the influence of the lead vehicle type and lead vehicle speed on initiating driver’ intention on overtaking on rural roads, and the effect of the complexity of the oncoming traffic on executing overtaking. The results show that the initial driver intention to overtake appears much earlier than the execution of the overtaking maneuver. The lead vehicle speed has a significant influence on initial driver intention in the "intention emerging process", while time to overtake increases with the number of the oncoming vehicles in the "action execution process". These results can contribute to the development of models for driver intention recognition by extending the prediction horizon from the recognition to a prediction of driving maneuvers. Document type: Conference objec

Information entropy-based intention prediction of aerial targets under uncertain and incomplete information

© 2020 by authors. To improve the effectiveness of air combat decision-making systems, target intention has been extensively studied. In general, aerial target intention is composed of attack, surveillance, penetration, feint, defense, reconnaissance, cover and electronic interference and it is related to the state of a target in air combat. Predicting the target intention is helpful to know the target actions in advance. Thus, intention prediction has contributed to lay a solid foundation for air combat decision-making. In this work, an intention prediction method is developed, which combines the advantages of the long short-term memory (LSTM) networks and decision tree. The future state information of a target is predicted based on LSTM networks from real-time series data, and the decision tree technology is utilized to extract rules from uncertain and incomplete priori knowledge. Then, the target intention is obtained from the predicted data by applying the built decision tree. With a simulation example, the results show that the proposed method is effective and feasible for state prediction and intention recognition of aerial targets under uncertain and incomplete information. Furthermore, the proposed method can make contributions in providing direction and aids for subsequent attack decision-makin