Stochastic Sampling Simulation for Pedestrian Trajectory Prediction

Urban environments pose a significant challenge for autonomous vehicles (AVs) as they must safely navigate while in close proximity to many pedestrians. It is crucial for the AV to correctly understand and predict the future trajectories of pedestrians to avoid collision and plan a safe path. Deep neural networks (DNNs) have shown promising results in accurately predicting pedestrian trajectories, relying on large amounts of annotated real-world data to learn pedestrian behavior. However, collecting and annotating these large real-world pedestrian datasets is costly in both time and labor. This paper describes a novel method using a stochastic sampling-based simulation to train DNNs for pedestrian trajectory prediction with social interaction. Our novel simulation method can generate vast amounts of automatically-annotated, realistic, and naturalistic synthetic pedestrian trajectories based on small amounts of real annotation. We then use such synthetic trajectories to train an off-the-shelf state-of-the-art deep learning approach Social GAN (Generative Adversarial Network) to perform pedestrian trajectory prediction. Our proposed architecture, trained only using synthetic trajectories, achieves better prediction results compared to those trained on human-annotated real-world data using the same network. Our work demonstrates the effectiveness and potential of using simulation as a substitution for human annotation efforts to train high-performing prediction algorithms such as the DNNs.Comment: 8 pages, 6 figures and 2 table

Stochastic Sampling Simulation for Pedestrian Trajectory Prediction

Urban environments pose a significant challenge for autonomous vehicles (AVs) as they must safely navigate while in close proximity to many pedestrians. It is crucial for the AV to correctly understand and predict the future trajectories of pedestrians to avoid collision and plan a safe path. Deep neural networks (DNNs) have shown promising results in accurately predicting pedestrian trajectories, relying on large amounts of annotated real-world data to learn pedestrian behavior. However, collecting and annotating these large real-world pedestrian datasets is costly in both time and labor. This paper describes a novel method using a stochastic sampling-based simulation to train DNNs for pedestrian trajectory prediction with social interaction. Our novel simulation method can generate vast amounts of automatically-annotated, realistic, and naturalistic synthetic pedestrian trajectories based on small amounts of real annotation. We then use such synthetic trajectories to train an off-the-shelf state-of-the-art deep learning approach Social GAN (Generative Adversarial Network) to perform pedestrian trajectory prediction. Our proposed architecture, trained only using synthetic trajectories, achieves better prediction results compared to those trained on human-annotated real-world data using the same network. Our work demonstrates the effectiveness and potential of using simulation as a substitution for human annotation efforts to train high-performing prediction algorithms such as the DNNs.Comment: 8 pages, 6 figures and 2 table

Real Time Trajectory Prediction Using Deep Conditional Generative Models

Data driven methods for time series forecasting that quantify uncertainty open new important possibilities for robot tasks with hard real time constraints, allowing the robot system to make decisions that trade off between reaction time and accuracy in the predictions. Despite the recent advances in deep learning, it is still challenging to make long term accurate predictions with the low latency required by real time robotic systems. In this paper, we propose a deep conditional generative model for trajectory prediction that is learned from a data set of collected trajectories. Our method uses encoder and decoder deep networks that maps complete or partial trajectories to a Gaussian distributed latent space and back, allowing for fast inference of the future values of a trajectory given previous observations. The encoder and decoder networks are trained using stochastic gradient variational Bayes. In the experiments, we show that our model provides more accurate long term predictions with a lower latency that popular models for trajectory forecasting like recurrent neural networks or physical models based on differential equations. Finally, we test our proposed approach in a robot table tennis scenario to evaluate the performance of the proposed method in a robotic task with hard real time constraints

Generator with Triangulation for Pedestrians Trajectory Prediction

Pedestrian trajectory prediction is a basic task in computer vision field. The prosperity of artificial intelligence makes the automatic drive, human-robot interaction and surveillance video attract a great deal of attention. Generally, researchers always place emphasis on pedestrian trajectory. The focuses of pedestrian trajectory prediction task are motion pattern modelling and spatio-temporal interaction modelling in the current study. In our paper, we present a GAN-based framework to model pedestrian motion pattern. A Delaunay triangulation algorithm is applied to map the pedestrian interaction. From the perspective of space, both the position interaction and motion interaction of pedestrians can be considered. For example, the influence of the movement direction and motion potential energy of pedestrians on the surrounding pedestrians can be modelled

Extreme Gradient Boosting (XGBoost) Model for Vehicle Trajectory Prediction in Connected and Autonomous Vehicle Environment

Connected and autonomous vehicles (CAVs) have the ability to receive information on their leading vehicles through multiple sensors and vehicle-to-vehicle (V2V) technology and then predict their future behaviour thus to improve roadway safety and mobility. This study presents an innovative algorithm for connected and autonomous vehicles to determine their trajectory considering surrounding vehicles. For the first time, the XGBoost model is developed to predict the acceleration rate that the object vehicle should take based on the current status of both the object vehicle and its leading vehicle. Next Generation Simulation (NGSIM) datasets are utilised for training the proposed model. The XGBoost model is compared with the Intelligent Driver Model (IDM), which is a prior state-of-the-art model. Root Mean Square Error (RMSE) and Mean Absolute Error (MAE) are applied to evaluate the two models. The results show that the XGBoost model outperforms the IDM in terms of prediction errors. The analysis of the feature importance reveals that the longitudinal position has the greatest influence on vehicle trajectory prediction results