3,053 research outputs found
Human Motion Trajectory Prediction: A Survey
With growing numbers of intelligent autonomous systems in human environments,
the ability of such systems to perceive, understand and anticipate human
behavior becomes increasingly important. Specifically, predicting future
positions of dynamic agents and planning considering such predictions are key
tasks for self-driving vehicles, service robots and advanced surveillance
systems. This paper provides a survey of human motion trajectory prediction. We
review, analyze and structure a large selection of work from different
communities and propose a taxonomy that categorizes existing methods based on
the motion modeling approach and level of contextual information used. We
provide an overview of the existing datasets and performance metrics. We
discuss limitations of the state of the art and outline directions for further
research.Comment: Submitted to the International Journal of Robotics Research (IJRR),
37 page
Recommended from our members
Explainable and Advisable Learning for Self-driving Vehicles
Deep neural perception and control networks are likely to be a key component of self-driving vehicles. These models need to be explainable - they should provide easy-to-interpret rationales for their behavior - so that passengers, insurance companies, law enforcement, developers, etc., can understand what triggered a particular behavior. Explanations may be triggered by the neural controller, namely introspective explanations, or informed by the neural controller's output, namely rationalizations. Our work has focused on the challenge of generating introspective explanations of deep models for self-driving vehicles. In Chapter 3, we begin by exploring the use of visual explanations. These explanations take the form of real-time highlighted regions of an image that causally influence the network's output (steering control). In the first stage, we use a visual attention model to train a convolution network end-to-end from images to steering angle. The attention model highlights image regions that potentially influence the network's output. Some of these are true influences, but some are spurious. We then apply a causal filtering step to determine which input regions actually influence the output. This produces more succinct visual explanations and more accurately exposes the network's behavior. In Chapter 4, we add an attention-based video-to-text model to produce textual explanations of model actions, e.g. "the car slows down because the road is wet". The attention maps of controller and explanation model are aligned so that explanations are grounded in the parts of the scene that mattered to the controller. We explore two approaches to attention alignment, strong- and weak-alignment. These explainable systems represent an externalization of tacit knowledge. The network's opaque reasoning is simplified to a situation-specific dependence on a visible object in the image. This makes them brittle and potentially unsafe in situations that do not match training data. In Chapter 5, we propose to address this issue by augmenting training data with natural language advice from a human. Advice includes guidance about what to do and where to attend. We present the first step toward advice-giving, where we train an end-to-end vehicle controller that accepts advice. The controller adapts the way it attends to the scene (visual attention) and the control (steering and speed). Further, in Chapter 6, we propose a new approach that learns vehicle control with the help of long-term (global) human advice. Specifically, our system learns to summarize its visual observations in natural language, predict an appropriate action response (e.g. "I see a pedestrian crossing, so I stop"), and predict the controls, accordingly
AutonoVi: Autonomous Vehicle Planning with Dynamic Maneuvers and Traffic Constraints
We present AutonoVi:, a novel algorithm for autonomous vehicle navigation
that supports dynamic maneuvers and satisfies traffic constraints and norms.
Our approach is based on optimization-based maneuver planning that supports
dynamic lane-changes, swerving, and braking in all traffic scenarios and guides
the vehicle to its goal position. We take into account various traffic
constraints, including collision avoidance with other vehicles, pedestrians,
and cyclists using control velocity obstacles. We use a data-driven approach to
model the vehicle dynamics for control and collision avoidance. Furthermore,
our trajectory computation algorithm takes into account traffic rules and
behaviors, such as stopping at intersections and stoplights, based on an
arc-spline representation. We have evaluated our algorithm in a simulated
environment and tested its interactive performance in urban and highway driving
scenarios with tens of vehicles, pedestrians, and cyclists. These scenarios
include jaywalking pedestrians, sudden stops from high speeds, safely passing
cyclists, a vehicle suddenly swerving into the roadway, and high-density
traffic where the vehicle must change lanes to progress more effectively.Comment: 9 pages, 6 figure
The highD Dataset: A Drone Dataset of Naturalistic Vehicle Trajectories on German Highways for Validation of Highly Automated Driving Systems
Scenario-based testing for the safety validation of highly automated vehicles
is a promising approach that is being examined in research and industry. This
approach heavily relies on data from real-world scenarios to derive the
necessary scenario information for testing. Measurement data should be
collected at a reasonable effort, contain naturalistic behavior of road users
and include all data relevant for a description of the identified scenarios in
sufficient quality. However, the current measurement methods fail to meet at
least one of the requirements. Thus, we propose a novel method to measure data
from an aerial perspective for scenario-based validation fulfilling the
mentioned requirements. Furthermore, we provide a large-scale naturalistic
vehicle trajectory dataset from German highways called highD. We evaluate the
data in terms of quantity, variety and contained scenarios. Our dataset
consists of 16.5 hours of measurements from six locations with 110 000
vehicles, a total driven distance of 45 000 km and 5600 recorded complete lane
changes. The highD dataset is available online at: http://www.highD-dataset.comComment: IEEE International Conference on Intelligent Transportation Systems
(ITSC) 201
Impacts of Connected and Automated Vehicles on Energy and Traffic Flow: Optimal Control Design and Verification Through Field Testing
This dissertation assesses eco-driving effectiveness in several key traffic scenarios that include passenger vehicle transportation in highway driving and urban driving that also includes interactions with traffic signals, as well as heavy-duty line-haul truck transportation in highway driving with significant road grade. These studies are accomplished through both traffic microsimulation that propagates individual vehicle interactions to synthesize large-scale traffic patterns that emerge from the eco-driving strategies, and through experimentation in which real prototyped connected and automated vehicles (CAVs) are utilized to directly measure energy benefits from the designed eco-driving control strategies. In particular, vehicle-in-the-loop is leveraged for the CAVs driven on a physical test track to interact with surrounding traffic that is virtually realized through said microsimulation software in real time. In doing so, model predictive control is designed and implemented to create performative eco-driving policies and to select vehicle lane, as well as enforce safety constraints while autonomously driving a real vehicle. Ultimately, eco-driving policies are both simulated and experimentally vetted in a variety of typical driving scenarios to show up to a 50% boost in fuel economy when switching to CAV drivers without compromising traffic flow.
The first part of this dissertation specifically assesses energy efficiency of connected and automated passenger vehicles that exploit intention-sharing sourced from both neighboring vehicles in a highway scene and from traffic lights in an urban scene. Linear model predictive control is implemented for CAV motion planning, whereby chance constraints are introduced to balance between traffic compactness and safety, and integer decision variables are introduced for lane selection and collision avoidance in multi-lane environments. Validation results are shown from both large-scale microsimulation and through experimentation of real prototyped CAVs. The second part of this dissertation then assesses energy efficiency of automated line-haul trucks when tasked to aerodynamically platoon. Nonlinear model predictive control is implemented for motion planning, and simulation and experimentation are conducted for platooning verification under highway conditions with traffic. Then, interaction-aware and intention-sharing cooperative control is further introduced to eliminate experimentally measured platoon disengagements that occur on real highways when using only status-sharing control. Finally, the performance of automated drivers versus human drivers are compared in a point-to-point scenario to verify fundamental eco-driving impacts -- experimentally showing eco-driving to boost energy economy by 11% on average even in simple driving scenarios
- …