35 research outputs found
Deep Learning and Statistical Models for Time-Critical Pedestrian Behaviour Prediction
The time it takes for a classifier to make an accurate prediction can be
crucial in many behaviour recognition problems. For example, an autonomous
vehicle should detect hazardous pedestrian behaviour early enough for it to
take appropriate measures. In this context, we compare the switching linear
dynamical system (SLDS) and a three-layered bi-directional long short-term
memory (LSTM) neural network, which are applied to infer pedestrian behaviour
from motion tracks. We show that, though the neural network model achieves an
accuracy of 80%, it requires long sequences to achieve this (100 samples or
more). The SLDS, has a lower accuracy of 74%, but it achieves this result with
short sequences (10 samples). To our knowledge, such a comparison on sequence
length has not been considered in the literature before. The results provide a
key intuition of the suitability of the models in time-critical problems
Pedestrian Models for Autonomous Driving Part II: High-Level Models of Human Behavior
Abstract—Autonomous vehicles (AVs) must share space with pedestrians, both in carriageway cases such as cars at pedestrian crossings and off-carriageway cases such as delivery vehicles navigating through crowds on pedestrianized high-streets. Unlike static obstacles, pedestrians are active agents with complex, inter- active motions. Planning AV actions in the presence of pedestrians thus requires modelling of their probable future behaviour as well as detecting and tracking them. This narrative review article is Part II of a pair, together surveying the current technology stack involved in this process, organising recent research into a hierarchical taxonomy ranging from low-level image detection to high-level psychological models, from the perspective of an AV designer. This self-contained Part II covers the higher levels of this stack, consisting of models of pedestrian behaviour, from prediction of individual pedestrians’ likely destinations and paths, to game-theoretic models of interactions between pedestrians and autonomous vehicles. This survey clearly shows that, although there are good models for optimal walking behaviour, high-level psychological and social modelling of pedestrian behaviour still remains an open research question that requires many conceptual issues to be clarified. Early work has been done on descriptive and qualitative models of behaviour, but much work is still needed to translate them into quantitative algorithms for practical AV control
Proceedings of the 2018 Joint Workshop of Fraunhofer IOSB and Institute for Anthropomatics, Vision and Fusion Laboratory
The Proceeding of the annual joint workshop of the Fraunhofer IOSB and the Vision and Fusion
Laboratory (IES) 2018 of the KIT contain technical reports of the PhD-stundents on the status of their
research. The discussed topics ranging from computer vision and optical
metrology to network security and machine learning.
This volume provides a comprehensive and up-to-date overview of the research program of the IES
Laboratory and the Fraunhofer IOSB