Intention-aware Long Horizon Trajectory Prediction of Surrounding Vehicles using Dual LSTM Networks

As autonomous vehicles (AVs) need to interact with other road users, it is of importance to comprehensively understand the dynamic traffic environment, especially the future possible trajectories of surrounding vehicles. This paper presents an algorithm for long-horizon trajectory prediction of surrounding vehicles using a dual long short term memory (LSTM) network, which is capable of effectively improving prediction accuracy in strongly interactive driving environments. In contrast to traditional approaches which require trajectory matching and manual feature selection, this method can automatically learn high-level spatial-temporal features of driver behaviors from naturalistic driving data through sequence learning. By employing two blocks of LSTMs, the proposed method feeds the sequential trajectory to the first LSTM for driver intention recognition as an intermediate indicator, which is immediately followed by a second LSTM for future trajectory prediction. Test results from real-world highway driving data show that the proposed method can, in comparison to state-of-art methods, output more accurate and reasonable estimate of different future trajectories over 5s time horizon with root mean square error (RMSE) for longitudinal and lateral prediction less than 5.77m and 0.49m, respectively.Comment: Published at the 21st International Conference on Intelligent Transportation Systems (ITSC), 201

Improving Autonomous Vehicle Mapping and Navigation in Work Zones Using Crowdsourcing Vehicle Trajectories

Prevalent solutions for Connected and Autonomous vehicle (CAV) mapping include high definition map (HD map) or real-time Simultaneous Localization and Mapping (SLAM). Both methods only rely on vehicle itself (onboard sensors or embedded maps) and can not adapt well to temporarily changed drivable areas such as work zones. Navigating CAVs in such areas heavily relies on how the vehicle defines drivable areas based on perception information. Difficulties in improving perception accuracy and ensuring the correct interpretation of perception results are challenging to the vehicle in these situations. This paper presents a prototype that introduces crowdsourcing trajectories information into the mapping process to enhance CAV's understanding on the drivable area and traffic rules. A Gaussian Mixture Model (GMM) is applied to construct the temporarily changed drivable area and occupancy grid map (OGM) based on crowdsourcing trajectories. The proposed method is compared with SLAM without any human driving information. Our method has adapted well with the downstream path planning and vehicle control module, and the CAV did not violate driving rule, which a pure SLAM method did not achieve.Comment: Presented at TRBAM. Journal version in progres

Interactive Prediction and Planning for Autonomous Driving: from Algorithms to Fundamental Aspects

Inevitably, autonomous vehicles need to interact with other road participants in a variety of highly complex or critical driving scenarios. It is still an extremely challenging task even for the forefront companies or institutes to enable autonomous vehicles to interactively predict the behavior of others, and plan safe and high-quality motions accordingly. The major obstacles are not just originated from prediction and planning algorithms with insufficient performances. Several fundamental problems in the fields of interactive prediction and planning still remain open, such as formulation, representation and evaluation of interactive prediction methods, motion dataset with densely interactive driving behavior, as well as interface of interactive prediction and planning algorithms. The aforementioned fundamental aspects of interactive prediction and planning are addressed in this dissertation along with various kinds of algorithms. First, generic environmental representation for various scenarios with topological decomposition is constructed, and a corresponding planning algorithm is designed by combining graph search and optimization. Hard constraints in optimization-based planners are also incorporated into the training loss of imitation learning so that the policy net can generate safe and feasible motions in highly constrained scenarios. Unified problem formulation and motion representation are designed for different paradigms of interactive predictors such as planning-based prediction (inverse reinforcement learning), as well as probabilistic graphical models (hidden Markov model) and deep neural networks (mixture density network), which are utilized for the prediction/planning interface design and prediction benchmark. A framework combing decision network and graph-search/optimization/sample-based planner is proposed to achieve a driving strategy which is defensive to potential violations of others, but not overly conservatively to threats of low probabilities. Such driving strategy is achieved via experiments based on the aforementioned interactive prediction and planning algorithms with proper interface designed. These predictors are also evaluated from closed loop perspective considering planning fatality when using the prediction results instead of pure data approximation metrics. Finally, INTERACTION (INTERnational, Adversarial and Cooperative moTION) dataset with highly interactive driving scenarios and behavior from international locations is constructed with interaction density metric defined to compare different datasets. The dataset has been utilized for various behavior-related research areas such as prediction, planning, imitation learning and behavior modeling, and is inspiring new research fields such as representation learning, interaction extraction and scenario generation

Reduced Fuel Emissions through Connected Vehicles and Truck Platooning

Vehicle-to-infrastructure (V2I) and vehicle-to-vehicle (V2V) communication enable the sharing, in real time, of vehicular locations and speeds with other vehicles, traffic signals, and traffic control centers. This shared information can help traffic to better traverse intersections, road segments, and congested neighborhoods, thereby reducing travel times, increasing driver safety, generating data for traffic planning, and reducing vehicular pollution. This study, which focuses on vehicular pollution, used an analysis of data from NREL, BTS, and the EPA to determine that the widespread use of V2V-based truck platooning—the convoying of trucks in close proximity to one another so as to reduce air drag across the convoy—could eliminate 37.9 million metric tons of CO2 emissions between 2022 and 2026

Impacts of Connected and Automated Vehicles on Energy and Traffic Flow: Optimal Control Design and Verification Through Field Testing

This dissertation assesses eco-driving effectiveness in several key traffic scenarios that include passenger vehicle transportation in highway driving and urban driving that also includes interactions with traffic signals, as well as heavy-duty line-haul truck transportation in highway driving with significant road grade. These studies are accomplished through both traffic microsimulation that propagates individual vehicle interactions to synthesize large-scale traffic patterns that emerge from the eco-driving strategies, and through experimentation in which real prototyped connected and automated vehicles (CAVs) are utilized to directly measure energy benefits from the designed eco-driving control strategies. In particular, vehicle-in-the-loop is leveraged for the CAVs driven on a physical test track to interact with surrounding traffic that is virtually realized through said microsimulation software in real time. In doing so, model predictive control is designed and implemented to create performative eco-driving policies and to select vehicle lane, as well as enforce safety constraints while autonomously driving a real vehicle. Ultimately, eco-driving policies are both simulated and experimentally vetted in a variety of typical driving scenarios to show up to a 50% boost in fuel economy when switching to CAV drivers without compromising traffic flow. The first part of this dissertation specifically assesses energy efficiency of connected and automated passenger vehicles that exploit intention-sharing sourced from both neighboring vehicles in a highway scene and from traffic lights in an urban scene. Linear model predictive control is implemented for CAV motion planning, whereby chance constraints are introduced to balance between traffic compactness and safety, and integer decision variables are introduced for lane selection and collision avoidance in multi-lane environments. Validation results are shown from both large-scale microsimulation and through experimentation of real prototyped CAVs. The second part of this dissertation then assesses energy efficiency of automated line-haul trucks when tasked to aerodynamically platoon. Nonlinear model predictive control is implemented for motion planning, and simulation and experimentation are conducted for platooning verification under highway conditions with traffic. Then, interaction-aware and intention-sharing cooperative control is further introduced to eliminate experimentally measured platoon disengagements that occur on real highways when using only status-sharing control. Finally, the performance of automated drivers versus human drivers are compared in a point-to-point scenario to verify fundamental eco-driving impacts -- experimentally showing eco-driving to boost energy economy by 11% on average even in simple driving scenarios