Game Theoretic Modeling of Driver and Vehicle Interactions for Verification and Validation of Autonomous Vehicle Control Systems

Autonomous driving has been the subject of increased interest in recent years both in industry and in academia. Serious efforts are being pursued to address legal, technical, and logistical problems and make autonomous cars a viable option for everyday transportation. One significant challenge is the time and effort required for the verification and validation of the decision and control algorithms employed in these vehicles to ensure a safe and comfortable driving experience. Hundreds of thousands of miles of driving tests are required to achieve a well calibrated control system that is capable of operating an autonomous vehicle in an uncertain traffic environment where interactions among multiple drivers and vehicles occur simultaneously. Traffic simulators where these interactions can be modeled and represented with reasonable fidelity can help to decrease the time and effort necessary for the development of the autonomous driving control algorithms by providing a venue where acceptable initial control calibrations can be achieved quickly and safely before actual road tests. In this paper, we present a game theoretic traffic model that can be used to: 1) test and compare various autonomous vehicle decision and control systems and 2) calibrate the parameters of an existing control system. We demonstrate two example case studies, where, in the first case, we test and quantitatively compare two autonomous vehicle control systems in terms of their safety and performance, and, in the second case, we optimize the parameters of an autonomous vehicle control system, utilizing the proposed traffic model and simulation environment. IEE

A Planning Pipeline for Large Multi-Agent Missions

In complex multi-agent applications, human operators are often tasked with planning and managing large heterogeneous teams of humans and autonomous vehicles. Although the use of these autonomous vehicles broadens the scope of meaningful applications, many of their systems remain unintuitive and difficult to master for human operators whose expertise lies in the application domain and not at the platform level. Current research focuses on the development of individual capabilities necessary to plan multi-agent missions of this scope, placing little emphasis on the integration of these components in to a full pipeline. The work presented in this paper presents a complete and user-agnostic planning pipeline for large multiagent missions known as the HOLII GRAILLE. The system takes a holistic approach to mission planning by integrating capabilities in human machine interaction, flight path generation, and validation and verification. Components modules of the pipeline are explored on an individual level, as well as their integration into a whole system. Lastly, implications for future mission planning are discussed

The role of driver models in testing highly-automated driving: a survey [Die Rolle von Fahrermodellen für das Testen hoch-automatisierter Fahrfunktionen: Eine Übersicht]

Eine besondere Herausforderung bei der Entwicklung hoch-automatisierter Fahrfunktionen ist die Validierung dieser Systeme. Ein möglicher Ansatz, den Validierungsaufwand zu meistern, ist der Einsatz von Simulationen. Hierbei können Simulatoren für verschiedene Aspekte des Validierungs-Prozesses verwendet werden. Um verwendbare Ergebnisse zu erhalten, müssen die einzelnen Aspekte der Realität dabei durch entsprechende Modelle abgebildet werden. Basierend auf einer Analyse verschiedener Anwendungsfälle für Simulationen, werden in diesem Beitrag verschiedene Klassen von Modellen für das menschliche Fahrverhalten hinsichtlich ihrer An-wendbarkeit im Rahmen der simulativen Absicherung evaluiert

Game-Theoretic and Set-Based Methods for Safe Autonomous Vehicles on Shared Roads

Autonomous vehicle (AV) technology promises safer, cleaner, and more efficient transportation, as well as improved mobility for the young, elderly, and disabled. One of the biggest challenges of AV technology is the development and high-confidence verification and validation (V&V) of decision and control systems for AVs to safely and effectively operate on roads shared with other road users (including human-driven vehicles). This dissertation investigates game-theoretic and set-based methods to address this challenge. Firstly, this dissertation presents two game-theoretic approaches to modeling the interactions among drivers/vehicles on shared roads. The first approach is based on the "level-k reasoning" human behavioral model and focuses on the representation of heterogeneous driving styles of real-world drivers. The second approach is based on a novel leader-follower game formulation inspired by the "right-of-way" traffic rules and focuses on the modeling of driver intents and their resulting behaviors under such traffic rules and etiquette. Both approaches lead to interpretable and scalable driver/vehicle interaction models. This dissertation then introduces an application of these models to fast and economical virtual V&V of AV control systems. Secondly, this dissertation presents a high-level control framework for AVs to safely and effectively interact with other road users. The framework is based on a constrained partially observable Markov decision process (POMDP) formulation of the AV control problem, which is then solved using a tailored model predictive control algorithm called POMDP-MPC. The major advantages of this control framework include its abilities to handle interaction uncertainties and provide an explicit probabilistic safety guarantee under such uncertainties. Finally, this dissertation introduces the Action Governor (AG), which is a novel add-on scheme to a nominal control loop for formally enforcing pointwise-in-time state and control constraints. The AG operates based on set-theoretic techniques and online optimization. Theoretical properties and computational approaches of the AG for discrete-time linear systems subject to non-convex exclusion-zone avoidance constraints are established. The use of the AG for enhancing AV safety is illustrated through relevant simulation case studies.PHDAerospace EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/167992/1/nanli_1.pd