Learning to Segment and Represent Motion Primitives from Driving Data for Motion Planning Applications

Developing an intelligent vehicle which can perform human-like actions requires the ability to learn basic driving skills from a large amount of naturalistic driving data. The algorithms will become efficient if we could decompose the complex driving tasks into motion primitives which represent the elementary compositions of driving skills. Therefore, the purpose of this paper is to segment unlabeled trajectory data into a library of motion primitives. By applying a probabilistic inference based on an iterative Expectation-Maximization algorithm, our method segments the collected trajectories while learning a set of motion primitives represented by the dynamic movement primitives. The proposed method utilizes the mutual dependencies between the segmentation and representation of motion primitives and the driving-specific based initial segmentation. By utilizing this mutual dependency and the initial condition, this paper presents how we can enhance the performance of both the segmentation and the motion primitive library establishment. We also evaluate the applicability of the primitive representation method to imitation learning and motion planning algorithms. The model is trained and validated by using the driving data collected from the Beijing Institute of Technology intelligent vehicle platform. The results show that the proposed approach can find the proper segmentation and establish the motion primitive library simultaneously

Optical flow sensing and the inverse perception problem for flying bats

The movements of birds, bats, and other flying species are governed by complex sensorimotor systems that allow the animals to react to stationary environmental features as well as to wind disturbances, other animals in nearby airspace, and a wide variety of unexpected challenges. The paper and talk will describe research that analyzes the three-dimensional trajectories of bats flying in a habitat in Texas. The trajectories are computed with stereoscopic methods using data from synchronous thermal videos that were recorded with high temporal and spatial resolution from three viewpoints. Following our previously reported work, we examine the possibility that bat trajectories in this habitat are governed by optical flow sensing that interpolates periodic distance measurements from echolocation. Using an idealized geometry of bat eyes, we introduce the concept of time-to-transit, and recall some research that suggests that this quantity is computed by the animals' visual cortex. Several steering control laws based on time-to-transit are proposed for an idealized flight model, and it is shown that these can be used to replicate the observed flight of what we identify as typical bats. Although the vision-based motion control laws we propose and the protocols for switching between them are quite simple, some of the trajectories that have been synthesized are qualitatively bat-like. Examination of the control protocols that generate these trajectories suggests that bat motions are governed both by their reactions to a subset of key feature points as well by their memories of where these feature points are located

A Comparison Between Coupled and Decoupled Vehicle Motion Controllers Based on Prediction Models

In this work, a comparative study is carried out with two different predictive controllers that consider the longitudinal jerk and steering rate change as additional parameters, as additional parameters, so that comfort constraints can be included. Furthermore, the approaches are designed so that the effect of longitudinal and lateral motion control coupling can be analyzed. This way, the first controller is a longitudinal and lateral coupled MPC approach based on a kinematic model of the vehicle, while the second is a decoupled strategy based on a triple integrator model based on MPC for the longitudinal control and a double proportional curvature control for the lateral motion control. The control architecture and motion planning are exhaustively explained. The comparative study is carried out using a test vehicle, whose dynamics and low-level controllers have been simulated using the realistic simulation environment Dynacar. The performed tests demonstrate the effectiveness of both approaches in speeds higher than 30 km/h, and demonstrate that the coupled strategy provides better performance than the decoupled one. The relevance of this work relies in the contribution of vehicle motion controllers considering the comfort and its advantage over decoupled alternatives for future implementation in real vehicles.This work has been conducted within the ENABLE-S3 project that has received funding from the ECSEL Joint Undertaking under Grant Agreement No 692455. This work was developed at Tecnalia Research & Innovation facilities supporting this research

Animal-Inspired Agile Flight Using Optical Flow Sensing

There is evidence that flying animals such as pigeons, goshawks, and bats use optical flow sensing to enable high-speed flight through forest clutter. This paper discusses the elements of a theory of controlled flight through obstacle fields in which motion control laws are based on optical flow sensing. Performance comparison is made with feedback laws that use distance and bearing measurements, and practical challenges of implementation on an actual robotic air vehicle are described. The related question of fundamental performance limits due to clutter density is addressed.Comment: 20 pages, 7 figure