Developing Predictive Models of Driver Behaviour for the Design of Advanced Driving Assistance Systems

World-wide injuries in vehicle accidents have been on the rise in recent years, mainly due to driver error. The main objective of this research is to develop a predictive system for driving maneuvers by analyzing the cognitive behavior (cephalo-ocular) and the driving behavior of the driver (how the vehicle is being driven). Advanced Driving Assistance Systems (ADAS) include different driving functions, such as vehicle parking, lane departure warning, blind spot detection, and so on. While much research has been performed on developing automated co-driver systems, little attention has been paid to the fact that the driver plays an important role in driving events. Therefore, it is crucial to monitor events and factors that directly concern the driver. As a goal, we perform a quantitative and qualitative analysis of driver behavior to find its relationship with driver intentionality and driving-related actions. We have designed and developed an instrumented vehicle (RoadLAB) that is able to record several synchronized streams of data, including the surrounding environment of the driver, vehicle functions and driver cephalo-ocular behavior, such as gaze/head information. We subsequently analyze and study the behavior of several drivers to find out if there is a meaningful relation between driver behavior and the next driving maneuver

Syntactic Method for Vehicles Movement Description and Analysis

The syntactic primitives and the description language can be used for assignment and analysis of vehicles movement. The paper introduces a method that allows spotting vehicles’ manoeuvres on and between traffic lanes, observing images, registered by a video camera. The analysis algorithms of the vehicles’ movement trajectories were considered in this paper as well

Vehicles Recognition Using Fuzzy Descriptors of Image Segments

In this paper a vision-based vehicles recognition method is presented. Proposed method uses fuzzy description of image segments for automatic recognition of vehicles recorded in image data. The description takes into account selected geometrical properties and shape coefficients determined for segments of reference image (vehicle model). The proposed method was implemented using reasoning system with fuzzy rules. A vehicles recognition algorithm was developed based on the fuzzy rules describing shape and arrangement of the image segments that correspond to visible parts of a vehicle. An extension of the algorithm with set of fuzzy rules defined for different reference images (and various vehicle shapes) enables vehicles classification in traffic scenes. The devised method is suitable for application in video sensors for road traffic control and surveillance systems.Comment: The final publication is available at http://www.springerlink.co

Deep Learning-based Vehicle Behaviour Prediction For Autonomous Driving Applications: A Review

Behaviour prediction function of an autonomous vehicle predicts the future states of the nearby vehicles based on the current and past observations of the surrounding environment. This helps enhance their awareness of the imminent hazards. However, conventional behaviour prediction solutions are applicable in simple driving scenarios that require short prediction horizons. Most recently, deep learning-based approaches have become popular due to their superior performance in more complex environments compared to the conventional approaches. Motivated by this increased popularity, we provide a comprehensive review of the state-of-the-art of deep learning-based approaches for vehicle behaviour prediction in this paper. We firstly give an overview of the generic problem of vehicle behaviour prediction and discuss its challenges, followed by classification and review of the most recent deep learning-based solutions based on three criteria: input representation, output type, and prediction method. The paper also discusses the performance of several well-known solutions, identifies the research gaps in the literature and outlines potential new research directions

Deep learning-based vehicle behaviour prediction for autonomous driving applications : a review

Behaviour prediction function of an autonomous vehicle predicts the future states of the nearby vehicles based on the current and past observations of the surrounding environment. This helps enhance their awareness of the imminent hazards. However, conventional behavior prediction solutions are applicable in simple driving scenarios that require short prediction horizons. Most recently, deep learning-based approaches have become popular due to their promising performance in more complex environments compared to the conventional approaches. Motivated by this increased popularity, we provide a comprehensive review of the state-of-the-art of deep learning-based approaches for vehicle behavior prediction in this article. We firstly give an overview of the generic problem of vehicle behavior prediction and discuss its challenges, followed by classification and review of the most recent deep learning-based solutions based on three criteria: input representation, output type, and prediction method. The article also discusses the performance of several well-known solutions, identifies the research gaps in the literature and outlines potential new research directions

Evolving cloud-based system for the recognition of drivers' actions

This paper presents an evolving cloud-based algorithm for the recognition of drivers' actions. The general idea is to detect different manoeuvres by processing the standard signals that are usually measured in a car, such as the speed, the revolutions, the angle of the steering wheel, the position of the pedals, and others, without additional intelligent sensors. The primary goal of this investigation is to propose a concept that can be used to recognise various driver actions. All experiments are performed on a realistic car simulator. The data acquired from the simulator are pre-processed and then used in the evolving cloud-based algorithm to detect the basic elementary actions, which are then combined in a prescribed sequence to create tasks. Finally, the sequences of different tasks form the most complex action, which is called a manoeuvre. As shown in this paper, the evolving cloud-based algorithm can be very efficiently used to recognise the complex driver's action from raw signals obtained by typical car sensors. (C) 2017 Elsevier Ltd. All rights reserved.This work has been supported by the Program Chair of Excellence of Universidad Carlos III de Madrid and Bank of Santander and the Spanish Ministry of Economy, Industry and Competitiveness, projects TRA2015-63708-R and TRA2016-78886-C3-1-R

Naturalistic Driver Intention and Path Prediction using Machine Learning

Autonomous vehicles are still yet to be available to the public. This is because there are a number of challenges that have not been overcome to ensure that autonomous vehicles can safely and efficiently drive on public roads. Accurate prediction of other vehicles is vital for safe driving, as interacting with other vehicles is unavoidable on public streets. This thesis explores reasons why this problem of scene understanding is still unsolved, and presents methods for driver intention and path prediction. The thesis focuses on intersections, as this is a very complex scenario in which to predict the actions of human drivers. There is very limited data available for intersection studies from the perspective of an autonomous vehicle. This thesis presents a very large dataset of over 23,000 vehicle trajectories, used to validate the algorithms presented in this thesis. This dataset was collected using a lidar based vehicle detection and tracking system onboard a vehicle. Analytics of this data is presented. To determine the intent of vehicle at an intersection, a method for manoeuvre classification through the use of recurrent neural networks is presented. This allows accurate predictions of which destination a vehicle will take at an unsignalised intersection, based on that vehicle's approach. The final contribution of this thesis presents a method for driver path prediction, based on recurrent neural networks. It produces a multi-modal prediction for the vehicle’s path with uncertainty assigned to each mode. The output modes are not hand labelled, but instead learned from the data. This results in there not being a fixed number of output modes. Whilst the application of this method is vehicle prediction, this method shows significant promise to be used in other areas of robotics

Statistical analysis of data describing the relationship between driver, truck and characteristics of the road

Road vehicles equipped with appropriate measurement equipment, computing facilities, data storage and data communication capabilities can be considered valuable data sources for the description and quantitative characterisation of road traffic. The data obtained from these vehicles provide valuable direct and indirect information pertaining to traffic states and various aspects of traffic safety in respect of the analysed road network. In this study, trucks’ abrupt braking events, detected by the trucks’ on-board safety protection units, were analysed. The road locations of the detected abrupt braking events can be characterised by a number of features ranging from the specific traffic regulations (e.g., speed limits) in force to the socio-cultural environment of the location. The abrupt braking data evidence was used for identification and description of non-trivial interactions of drivers, trucks and roads. Some of the more interesting results and conclusions of the experiments are reported herein