An evaluation framework for stereo-based driver assistance

This is the post-print version of the Article - Copyright @ 2012 Springer VerlagThe accuracy of stereo algorithms or optical flow methods is commonly assessed by comparing the results against the Middlebury database. However, equivalent data for automotive or robotics applications rarely exist as they are difficult to obtain. As our main contribution, we introduce an evaluation framework tailored for stereo-based driver assistance able to deliver excellent performance measures while circumventing manual label effort. Within this framework one can combine several ways of ground-truthing, different comparison metrics, and use large image databases. Using our framework we show examples on several types of ground truthing techniques: implicit ground truthing (e.g. sequence recorded without a crash occurred), robotic vehicles with high precision sensors, and to a small extent, manual labeling. To show the effectiveness of our evaluation framework we compare three different stereo algorithms on pixel and object level. In more detail we evaluate an intermediate representation called the Stixel World. Besides evaluating the accuracy of the Stixels, we investigate the completeness (equivalent to the detection rate) of the StixelWorld vs. the number of phantom Stixels. Among many findings, using this framework enables us to reduce the number of phantom Stixels by a factor of three compared to the base parametrization. This base parametrization has already been optimized by test driving vehicles for distances exceeding 10000 km

Multilevel Design Optimization of Automotive Structures Using Dummy- and Vehicle-Based Responses

A computationally efficient multilevel decomposition and optimization framework is developed for application to automotive structures. A full scale finite element (FE) model of a passenger car along with a dummy and occupant restraint system (ORS) is used to analyze crashworthiness and occupant safety criteria in two crash scenarios. The vehicle and ORS models are incorporated into a decomposed multilevel framework and optimized with mass and occupant injury criteria as objectives. A surrogate modeling technique is used to approximate the computationally expensive nonlinear FE responses. A multilevel target matching optimization problem is formulated to obtain a design satisfying system level performance targets. A balance is sought between crashworthiness and structural rigidity while minimizing overall mass of the vehicle. Two separate design problems involving crash and crash+vibration are considered. A major finding of this study is that, it is possible to achieve greater weight savings by including dummy-based responses in optimization problem

Fusion of Data from Heterogeneous Sensors with Distributed Fields of View and Situation Evaluation for Advanced Driver Assistance Systems

In order to develop a driver assistance system for pedestrian protection, pedestrians in the environment of a truck are detected by radars and a camera and are tracked across distributed fields of view using a Joint Integrated Probabilistic Data Association filter. A robust approach for prediction of the system vehicles trajectory is presented. It serves the computation of a probabilistic collision risk based on reachable sets where different sources of uncertainty are taken into account

Towards Safe Autonomous Driving

Autonomous driving is expected to bring several benefits, in particular regarding safety. This thesis aim to contribute towards two questions concerning safety: "What is the potential safety benefit of autonomous driving?\u27\u27 and "How can we ensure safe operation of such vehicles?\u27\u27.In the first part of the thesis, methods for evaluating the safety benefit are investigated. In particular predictive effectiveness evaluation based on resimulation of accident data, using models to estimate new outcomes in case the safety system had been available. To illustrate the methodology, four examples of gradual increase in model complexity are presented. First, an Autonomous Emergency Braking (AEB) system using a sensor model, decision algorithm, vehicle dynamics model and regression based injury model. This is extended in a Forward Collision Warning (FCW) system which additionally requires a driver model to simulate driver reactions. The third example shows how an active, AEB, and passive, airbag, system can be combined.\ua0Finally the fourth example combines several systems to emulate a highly automated vehicle. Apart from predicting the real world performance, this analysis also identifies current safety gaps by studying the residual of the accident set.Safety benefit estimation using accident data gives an evaluation on the current accident distributions, however, the systems may introduce new accidents if not operated as intended. In the second part of the thesis, safety verification processes with the intent of preventing unsafe operation, are presented. This is particularly challenging for machine learning based components, such as neural networks. In this case, traditional analytical verification approaches are\ua0difficult to apply due to the non-linearity and high dimensional parameter spaces. Similarly, statistical safety arguments often require unfeasible amounts of annotated validation data. Instead, monitor functions are investigated as a complement to increase safety during operation. The method presented estimates the similarity of the driving environment, compared to the training data, where decisions inferred from novel data can be considered less reliable.\ua0Although not providing a complete safety assurance, the methodology show promising initial results for increasing safety. In addition, it could potentially be used to collect novel data and reduce redundancy in training data

A New Approach To Estimate The Collision Probability For Automotive Applications

We revisit the computation of probability of collision in the context of automotive collision avoidance (the estimation of a potential collision is also referred to as conflict detection in other contexts). After reviewing existing approaches to the definition and computation of a collision probability we argue that the question "What is the probability of collision within the next three seconds?" can be answered on the basis of a collision probability rate. Using results on level crossings for vector stochastic processes we derive a general expression for the upper bound of the distribution of the collision probability rate. This expression is valid for arbitrary prediction models including process noise. We demonstrate in several examples that distributions obtained by large-scale Monte-Carlo simulations obey this bound and in many cases approximately saturate the bound. We derive an approximation for the distribution of the collision probability rate that can be computed on an embedded platform. In order to efficiently sample this probability rate distribution for determination of its characteristic shape an adaptive method to obtain the sampling points is proposed. An upper bound of the probability of collision is then obtained by one-dimensional numerical integration over the time period of interest. A straightforward application of this method applies to the collision of an extended object with a second point-like object. Using an abstraction of the second object by salient points of its boundary we propose an application of this method to two extended objects with arbitrary orientation. Finally, the distribution of the collision probability rate is identified as the distribution of the time-to-collision.Comment: Revised and restructured version, discussion of extended vehicles expanded, section on TTC expanded, references added, other minor changes, 17 pages, 18 figure

Motorcycles that see: Multifocal stereo vision sensor for advanced safety systems in tilting vehicles

Advanced driver assistance systems, ADAS, have shown the possibility to anticipate crash accidents and effectively assist road users in critical traffic situations. This is not the case for motorcyclists, in fact ADAS for motorcycles are still barely developed. Our aim was to study a camera-based sensor for the application of preventive safety in tilting vehicles. We identified two road conflict situations for which automotive remote sensors installed in a tilting vehicle are likely to fail in the identification of critical obstacles. Accordingly, we set two experiments conducted in real traffic conditions to test our stereo vision sensor. Our promising results support the application of this type of sensors for advanced motorcycle safety applications

Automotive Collision Warning System Retrofit

In the early 2000s, few automakers began implementing forward collision warning systems in their cars. As technology advanced this system became available on more and more luxury cars. In recent years, this technology has spread to more affordable vehicles driven every day. However, as this technology has only recently advanced to less expensive, more economical cars, older vehicles of the same model may not have this advanced and important safety feature. This project investigates and creates a preliminary design for an affordable, easy-to-install, forward collision warning system that can be retrofitted to vehicles without the system currently installed. Using a density-based spatial clustering of applications with noise (DBSCAN) clustering algorithm, an extended Kalman filter, and a time-to-collision algorithm, a forward collision warning system was developed and simulated using the Insurance Institute of Highway Safety (IIHS) test scenarios. Software testing and implementation was done in MATLAB and has provided a foundation for future hardware implementation using Texas Instruments mmWave automotive radar (AWR1843BOOST)