Methods and models for safety benefit assessment of advanced driver assistance systems in car-to-cyclist conflicts

To help drivers avoid or mitigate the severity of crashes, advanced driver assistance systems (ADAS) can be designed to provide warnings or interventions. Prospective safety assessment of ADAS is important to quantify and optimise their safety benefit. Such safety assessment methods include, for example, virtual simulations and test-track testing.Today, there are many components of virtual safety assessment simulations with models or methods that are missing or can be substantially improved. This is particularly true for simulations assessing ADASs that address crashes involving cyclists—a crash type that is not decreasing at the same rate as the overall number of road crashes in Europe. The specific methodological gaps that this work addresses are: a) computational driver models for car-to-cyclist overtaking, b) algorithms for model fitting and efficient calculation of ADAS intervention time, and c) a method for merging data from different data sources into the safety assessment.Specifically, for a), different driver models for everyday driver behaviour while overtaking cyclists in a naturalistic driving setting were derived and compared. For b), computationally efficient algorithms to fit driver models to data and compute ADAS intervention time were developed for different types of vehicle models. The algorithms can be included in ADAS both for offline use in virtual assessment simulations and online real-time use in in-vehicle ADAS. Lastly, for c), a method was developed that uses Bayesian statistics to combine results from different data sources, e.g., simulations and test-track data, for ADAS safety benefit assessment.In addition to presenting five peer-reviewed scientific publications, which address these issues, this compilation thesis discusses the use of different data sources; introduces the fundamentals of Bayesian inference, linear programming, and numerical root-finding algorithms; and provides the rationale for methodological choices made, where relevant. Finally, this thesis describes the relationships among the publications and places them into context with existing literature.This work developed driver models for the virtual simulations and methods for the reliable estimation of the prospective safety benefit, which together have the potential to improve the design and the evaluation of ADAS in general, and ADAS for the car-to-cyclist overtaking scenario in particular

Methodology for Specifying and Testing Traffic Rule Compliance for Automated Driving

The introduction of highly-automated driving functions promises to increase safety and comfort, but the safety validation remains an unsolved challenge. Here, the requirement is that the introduction does not reduce safety on public roads. This dissertation addresses one major aspect of road safety: traffic rule compliance. Even an automated vehicle must comply with existing traffic rules. The developed method enables automated testing of traffic rule compliance of automated driving functions. In the first part of the thesis, the state of the art for describing and formalizing behavioral rules is analyzed. A special challenge is posed by the different traffic rules depending on the traffic region. With existing approaches, a separate description and formalization of the behavior rules is necessary for each traffic region or even for individual traffic areas. This shows the necessity to develop new approaches for the abstraction and transferability of the behavioral rules in order to reduce the effort of testing and ensuring traffic rule compliance. The rule compliance criteria are to be integrated into the behavior specification within the functional specification. The objective of this thesis is to develop a method to formalize the limits of traffic rule compliance, based on which fail criteria for system testing are defined and applied. For this purpose, existing traffic rules are analyzed as a basis to identify which behavior constraints are imposed by the static traffic environment. Based on this, a semantic description that is transferable between traffic domains and that links the boundaries of traffic rule compliance to the static traffic environment is developed. The method involves deriving behavioral attributes from which the semantic behavior description is constructed. These behavioral attributes construct the behavior space that describes the boundaries of legally allowed behavior. Furthermore, methods for automated derivation of behavioral attributes from high definition maps are developed, thus extracting the behavioral requirement from an operational design domain. It is investigated which functionalities an automated vehicle has to provide to comply with the behavioral attributes. The attributes are then formalized to obtain quantifiable failure criteria of traffic rule compliance that can be used in automated testing. Finally, building on the state of the art, a test strategy for validating traffic rule conformance is presented. The explicit availability of the behavioral limits results in an advantage in the influence analysis of possible parameters for these tests. Finally, the developed method is applied to existing map material and to test drives with an automated vehicle prototype in order to investigate the practical applicability of the approach as well as the resulting gain in knowledge about traffic rule compliance testing. The developed approach allows to derive the behavioral specification with respect to traffic rule conformance as an essential part of the functional specification independent of the application domain. It is proven that the approach is able to test the traffic rule conformance of an automated vehicle in different test scenarios within an application domain. By applying the developed methodology, it was possible to identify defects in the investigated test vehicle with respect to rule understanding and compliance

Vehicle Tracking and Motion Estimation Based on Stereo Vision Sequences

In this dissertation, a novel approach for estimating trajectories of road vehicles such as cars, vans, or motorbikes, based on stereo image sequences is presented. Moving objects are detected and reliably tracked in real-time from within a moving car. The resulting information on the pose and motion state of other moving objects with respect to the own vehicle is an essential basis for future driver assistance and safety systems, e.g., for collision prediction. The focus of this contribution is on oncoming traffic, while most existing work in the literature addresses tracking the lead vehicle. The overall approach is generic and scalable to a variety of traffic scenes including inner city, country road, and highway scenarios. A considerable part of this thesis addresses oncoming traffic at urban intersections. The parameters to be estimated include the 3D position and orientation of an object relative to the ego-vehicle, as well as the object's shape, dimension, velocity, acceleration and the rotational velocity (yaw rate). The key idea is to derive these parameters from a set of tracked 3D points on the object's surface, which are registered to a time-consistent object coordinate system, by means of an extended Kalman filter. Combining the rigid 3D point cloud model with the dynamic model of a vehicle is one main contribution of this thesis. Vehicle tracking at intersections requires covering a wide range of different object dynamics, since vehicles can turn quickly. Three different approaches for tracking objects during highly dynamic turn maneuvers up to extreme maneuvers such as skidding are presented and compared. These approaches allow for an online adaptation of the filter parameter values, overcoming manual parameter tuning depending on the dynamics of the tracked object in the scene. This is the second main contribution. Further issues include the introduction of two initialization methods, a robust outlier handling, a probabilistic approach for assigning new points to a tracked object, as well as mid-level fusion of the vision-based approach with a radar sensor. The overall system is systematically evaluated both on simulated and real-world data. The experimental results show the proposed system is able to accurately estimate the object pose and motion parameters in a variety of challenging situations, including night scenes, quick turn maneuvers, and partial occlusions. The limits of the system are also carefully investigated.In dieser Dissertation wird ein Ansatz zur Trajektorienschätzung von Straßenfahrzeugen (PKW, Lieferwagen, Motorräder,...) anhand von Stereo-Bildfolgen vorgestellt. Bewegte Objekte werden in Echtzeit aus einem fahrenden Auto heraus automatisch detektiert, vermessen und deren Bewegungszustand relativ zum eigenen Fahrzeug zuverlässig bestimmt. Die gewonnenen Informationen liefern einen entscheidenden Grundstein für zukünftige Fahrerassistenz- und Sicherheitssysteme im Automobilbereich, beispielsweise zur Kollisionsprädiktion. Während der Großteil der existierenden Literatur das Detektieren und Verfolgen vorausfahrender Fahrzeuge in Autobahnszenarien adressiert, setzt diese Arbeit einen Schwerpunkt auf den Gegenverkehr, speziell an städtischen Kreuzungen. Der Ansatz ist jedoch grundsätzlich generisch und skalierbar für eine Vielzahl an Verkehrssituationen (Innenstadt, Landstraße, Autobahn). Die zu schätzenden Parameter beinhalten die räumliche Lage des anderen Fahrzeugs relativ zum eigenen Fahrzeug, die Objekt-Geschwindigkeit und -Längsbeschleunigung, sowie die Rotationsgeschwindigkeit (Gierrate) des beobachteten Objektes. Zusätzlich werden die Objektabmaße sowie die Objektform rekonstruiert. Die Grundidee ist es, diese Parameter anhand der Transformation von beobachteten 3D Punkten, welche eine ortsfeste Position auf der Objektoberfläche besitzen, mittels eines rekursiven Schätzers (Kalman Filter) zu bestimmen. Ein wesentlicher Beitrag dieser Arbeit liegt in der Kombination des Starrkörpermodells der Punktewolke mit einem Fahrzeugbewegungsmodell. An Kreuzungen können sehr unterschiedliche Dynamiken auftreten, von einer Geradeausfahrt mit konstanter Geschwindigkeit bis hin zum raschen Abbiegen. Um eine manuelle Parameteradaption abhängig von der jeweiligen Szene zu vermeiden, werden drei verschiedene Ansätze zur automatisierten Anpassung der Filterparameter an die vorliegende Situation vorgestellt und verglichen. Dies stellt den zweiten Hauptbeitrag der Arbeit dar. Weitere wichtige Beiträge sind zwei alternative Initialisierungsmethoden, eine robuste Ausreißerbehandlung, ein probabilistischer Ansatz zur Zuordnung neuer Objektpunkte, sowie die Fusion des bildbasierten Verfahrens mit einem Radar-Sensor. Das Gesamtsystem wird im Rahmen dieser Arbeit systematisch anhand von simulierten und realen Straßenverkehrsszenen evaluiert. Die Ergebnisse zeigen, dass das vorgestellte Verfahren in der Lage ist, die unbekannten Objektparameter auch unter schwierigen Umgebungsbedingungen, beispielsweise bei Nacht, schnellen Abbiegemanövern oder unter Teilverdeckungen, sehr präzise zu schätzen. Die Grenzen des Systems werden ebenfalls sorgfältig untersucht

Design and validation of decision and control systems in automated driving

xxvi, 148 p.En la última década ha surgido una tendencia creciente hacia la automatización de los vehículos, generando un cambio significativo en la movilidad, que afectará profundamente el modo de vida de las personas, la logística de mercancías y otros sectores dependientes del transporte. En el desarrollo de la conducción automatizada en entornos estructurados, la seguridad y el confort, como parte de las nuevas funcionalidades de la conducción, aún no se describen de forma estandarizada. Dado que los métodos de prueba utilizan cada vez más las técnicas de simulación, los desarrollos existentes deben adaptarse a este proceso. Por ejemplo, dado que las tecnologías de seguimiento de trayectorias son habilitadores esenciales, se deben aplicar verificaciones exhaustivas en aplicaciones relacionadas como el control de movimiento del vehículo y la estimación de parámetros. Además, las tecnologías en el vehículo deben ser lo suficientemente robustas para cumplir con los requisitos de seguridad, mejorando la redundancia y respaldar una operación a prueba de fallos. Considerando las premisas mencionadas, esta Tesis Doctoral tiene como objetivo el diseño y la implementación de un marco para lograr Sistemas de Conducción Automatizados (ADS) considerando aspectos cruciales, como la ejecución en tiempo real, la robustez, el rango operativo y el ajuste sencillo de parámetros. Para desarrollar las aportaciones relacionadas con este trabajo, se lleva a cabo un estudio del estado del arte actual en tecnologías de alta automatización de conducción. Luego, se propone un método de dos pasos que aborda la validación de ambos modelos de vehículos de simulación y ADS. Se introducen nuevas formulaciones predictivas basadas en modelos para mejorar la seguridad y el confort en el proceso de seguimiento de trayectorias. Por último, se evalúan escenarios de mal funcionamiento para mejorar la seguridad en entornos urbanos, proponiendo una estrategia alternativa de estimación de posicionamiento para minimizar las condiciones de riesgo

Design and validation of decision and control systems in automated driving

xxvi, 148 p.En la última década ha surgido una tendencia creciente hacia la automatización de los vehículos, generando un cambio significativo en la movilidad, que afectará profundamente el modo de vida de las personas, la logística de mercancías y otros sectores dependientes del transporte. En el desarrollo de la conducción automatizada en entornos estructurados, la seguridad y el confort, como parte de las nuevas funcionalidades de la conducción, aún no se describen de forma estandarizada. Dado que los métodos de prueba utilizan cada vez más las técnicas de simulación, los desarrollos existentes deben adaptarse a este proceso. Por ejemplo, dado que las tecnologías de seguimiento de trayectorias son habilitadores esenciales, se deben aplicar verificaciones exhaustivas en aplicaciones relacionadas como el control de movimiento del vehículo y la estimación de parámetros. Además, las tecnologías en el vehículo deben ser lo suficientemente robustas para cumplir con los requisitos de seguridad, mejorando la redundancia y respaldar una operación a prueba de fallos. Considerando las premisas mencionadas, esta Tesis Doctoral tiene como objetivo el diseño y la implementación de un marco para lograr Sistemas de Conducción Automatizados (ADS) considerando aspectos cruciales, como la ejecución en tiempo real, la robustez, el rango operativo y el ajuste sencillo de parámetros. Para desarrollar las aportaciones relacionadas con este trabajo, se lleva a cabo un estudio del estado del arte actual en tecnologías de alta automatización de conducción. Luego, se propone un método de dos pasos que aborda la validación de ambos modelos de vehículos de simulación y ADS. Se introducen nuevas formulaciones predictivas basadas en modelos para mejorar la seguridad y el confort en el proceso de seguimiento de trayectorias. Por último, se evalúan escenarios de mal funcionamiento para mejorar la seguridad en entornos urbanos, proponiendo una estrategia alternativa de estimación de posicionamiento para minimizar las condiciones de riesgo