509 research outputs found
Human Motion Trajectory Prediction: A Survey
With growing numbers of intelligent autonomous systems in human environments,
the ability of such systems to perceive, understand and anticipate human
behavior becomes increasingly important. Specifically, predicting future
positions of dynamic agents and planning considering such predictions are key
tasks for self-driving vehicles, service robots and advanced surveillance
systems. This paper provides a survey of human motion trajectory prediction. We
review, analyze and structure a large selection of work from different
communities and propose a taxonomy that categorizes existing methods based on
the motion modeling approach and level of contextual information used. We
provide an overview of the existing datasets and performance metrics. We
discuss limitations of the state of the art and outline directions for further
research.Comment: Submitted to the International Journal of Robotics Research (IJRR),
37 page
Deep Learning and Statistical Models for Time-Critical Pedestrian Behaviour Prediction
The time it takes for a classifier to make an accurate prediction can be
crucial in many behaviour recognition problems. For example, an autonomous
vehicle should detect hazardous pedestrian behaviour early enough for it to
take appropriate measures. In this context, we compare the switching linear
dynamical system (SLDS) and a three-layered bi-directional long short-term
memory (LSTM) neural network, which are applied to infer pedestrian behaviour
from motion tracks. We show that, though the neural network model achieves an
accuracy of 80%, it requires long sequences to achieve this (100 samples or
more). The SLDS, has a lower accuracy of 74%, but it achieves this result with
short sequences (10 samples). To our knowledge, such a comparison on sequence
length has not been considered in the literature before. The results provide a
key intuition of the suitability of the models in time-critical problems
Dynamic Switching State Systems for Visual Tracking
This work addresses the problem of how to capture the dynamics of maneuvering objects for visual tracking. Towards this end, the perspective of recursive Bayesian filters and the perspective of deep learning approaches for state estimation are considered and their functional viewpoints are brought together
Dynamic Switching State Systems for Visual Tracking
This work addresses the problem of how to capture the dynamics of maneuvering objects for visual tracking. Towards this end, the perspective of recursive Bayesian filters and the perspective of deep learning approaches for state estimation are considered and their functional viewpoints are brought together
Forecasting People Trajectories and Head Poses by Jointly Reasoning on Tracklets and Vislets
In this work, we explore the correlation between people trajectories and
their head orientations. We argue that people trajectory and head pose
forecasting can be modelled as a joint problem. Recent approaches on trajectory
forecasting leverage short-term trajectories (aka tracklets) of pedestrians to
predict their future paths. In addition, sociological cues, such as expected
destination or pedestrian interaction, are often combined with tracklets. In
this paper, we propose MiXing-LSTM (MX-LSTM) to capture the interplay between
positions and head orientations (vislets) thanks to a joint unconstrained
optimization of full covariance matrices during the LSTM backpropagation. We
additionally exploit the head orientations as a proxy for the visual attention,
when modeling social interactions. MX-LSTM predicts future pedestrians location
and head pose, increasing the standard capabilities of the current approaches
on long-term trajectory forecasting. Compared to the state-of-the-art, our
approach shows better performances on an extensive set of public benchmarks.
MX-LSTM is particularly effective when people move slowly, i.e. the most
challenging scenario for all other models. The proposed approach also allows
for accurate predictions on a longer time horizon.Comment: Accepted at IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE
INTELLIGENCE 2019. arXiv admin note: text overlap with arXiv:1805.0065
Dynamic Switching State Systems for Visual Tracking
This work addresses the problem of how to capture the dynamics of maneuvering objects for visual tracking. Towards this end, the perspective of recursive Bayesian filters and the perspective of deep learning approaches for state estimation are considered and their functional viewpoints are brought together
Analysis and Prediction of Pedestrian Crosswalk Behavior during Automated Vehicle Interactions
For safe navigation around pedestrians, automated vehicles (AVs) need to plan their motion by accurately predicting pedestrians’ trajectories over long time horizons.
Current approaches to AV motion planning around crosswalks predict only for short time horizons (1-2 s) and are based on data from pedestrian interactions with human-driven vehicles (HDVs). In this paper, we develop a hybrid systems model that uses pedestrians’ gap acceptance behavior and constant velocity dynamics for long-term pedestrian trajectory prediction when interacting with AVs. Results demonstrate the applicability of the model for long-term (> 5 s) pedestrian trajectory prediction at crosswalks. Further, we compared measures of pedestrian crossing behaviors in the immersive virtual environment (when interacting with AVs) to that in the real world (results of published studies of pedestrians interacting with HDVs), and found similarities between the two. These similarities demonstrate the applicability of the hybrid model of AV interactions developed from an immersive virtual environment (IVE) for real-world scenarios for both AVs and HDVs.Toyota Research Institute (TRI) provided funds to assist the authors with their research, but this article solely reflects the opinions and conclusions of its authors and not TRI or any other Toyota entity. The work was also supported in part by the National Science Foundation and supported in part by the Automotive Research Center at the University of Michigan, with funding from government contract Department of the Army W56HZV- 14-2-0001 through the U.S. Army Tank Automotive Research, Development, and Engineering Center (TARDEC).Peer Reviewedhttps://deepblue.lib.umich.edu/bitstream/2027.42/154053/1/ICRA_2020_Analysis_and_Prediction_of_Pedestrian_Final_revised_03_03_20.pdfDescription of ICRA_2020_Analysis_and_Prediction_of_Pedestrian_Final_revised_03_03_20.pdf : Main fil
- …