DMD: A Large-Scale Multi-Modal Driver Monitoring Dataset for Attention and Alertness Analysis

Vision is the richest and most cost-effective technology for Driver Monitoring Systems (DMS), especially after the recent success of Deep Learning (DL) methods. The lack of sufficiently large and comprehensive datasets is currently a bottleneck for the progress of DMS development, crucial for the transition of automated driving from SAE Level-2 to SAE Level-3. In this paper, we introduce the Driver Monitoring Dataset (DMD), an extensive dataset which includes real and simulated driving scenarios: distraction, gaze allocation, drowsiness, hands-wheel interaction and context data, in 41 hours of RGB, depth and IR videos from 3 cameras capturing face, body and hands of 37 drivers. A comparison with existing similar datasets is included, which shows the DMD is more extensive, diverse, and multi-purpose. The usage of the DMD is illustrated by extracting a subset of it, the dBehaviourMD dataset, containing 13 distraction activities, prepared to be used in DL training processes. Furthermore, we propose a robust and real-time driver behaviour recognition system targeting a real-world application that can run on cost-efficient CPU-only platforms, based on the dBehaviourMD. Its performance is evaluated with different types of fusion strategies, which all reach enhanced accuracy still providing real-time response.Comment: Accepted to ECCV 2020 workshop - Assistive Computer Vision and Robotic

The study design of UDRIVE: the Naturalistic Driving Study across Europe for cars, trucks and scooters

Purpose: UDRIVE is the first large-scale European Naturalistic Driving Study on cars, trucks and powered two wheelers. The acronym stands for "European naturalistic Driving and Riding for Infrastructure & Vehicle safety and Environment". The purpose of the study is to gain a better understanding of what happens on the road in everyday traffic situations. Methods: The paper describes Naturalistic Driving Studies, a method which provides insight into the actual real-world behaviour of road users, unaffected by experimental conditions and related biases. Naturalistic driving can be defined as a study undertaken to provide insight into driver behaviour during everyday trips by recording details of the driver, the vehicle and the surroundings through unobtrusive data gathering equipment and without experimental control. Data collection will take place in six EU Member States. Results: Road User Behaviour will be studied with a focus on both safety and environment. The UDRIVE project follows the steps of the FESTA-V methodology, which was originally designed for Field Operational Tests. Conclusions: Defining research questions forms the basis of the study design and the specification of the recording equipment. Both will be described in this paper. Although the project has just started collecting data from drivers, we consider the process of designing the study as a major result which may help other initiatives to set up similar studies

GLAST: Understanding the High Energy Gamma-Ray Sky

We discuss the ability of the GLAST Large Area Telescope (LAT) to identify, resolve, and study the high energy gamma-ray sky. Compared to previous instruments the telescope will have greatly improved sensitivity and ability to localize gamma-ray point sources. The ability to resolve the location and identity of EGRET unidentified sources is described. We summarize the current knowledge of the high energy gamma-ray sky and discuss the astrophysics of known and some prospective classes of gamma-ray emitters. In addition, we also describe the potential of GLAST to resolve old puzzles and to discover new classes of sources.Comment: To appear in Cosmic Gamma Ray Sources, Kluwer ASSL Series, Edited by K.S. Cheng and G.E. Romer

Multi-messenger observations of a binary neutron star merger

On 2017 August 17 a binary neutron star coalescence candidate (later designated GW170817) with merger time 12:41:04 UTC was observed through gravitational waves by the Advanced LIGO and Advanced Virgo detectors. The Fermi Gamma-ray Burst Monitor independently detected a gamma-ray burst (GRB 170817A) with a time delay of ~1.7 s with respect to the merger time. From the gravitational-wave signal, the source was initially localized to a sky region of 31 deg2 at a luminosity distance of 40+8-8 Mpc and with component masses consistent with neutron stars. The component masses were later measured to be in the range 0.86 to 2.26 Mo. An extensive observing campaign was launched across the electromagnetic spectrum leading to the discovery of a bright optical transient (SSS17a, now with the IAU identification of AT 2017gfo) in NGC 4993 (at ~40 Mpc) less than 11 hours after the merger by the One- Meter, Two Hemisphere (1M2H) team using the 1 m Swope Telescope. The optical transient was independently detected by multiple teams within an hour. Subsequent observations targeted the object and its environment. Early ultraviolet observations revealed a blue transient that faded within 48 hours. Optical and infrared observations showed a redward evolution over ~10 days. Following early non-detections, X-ray and radio emission were discovered at the transient’s position ~9 and ~16 days, respectively, after the merger. Both the X-ray and radio emission likely arise from a physical process that is distinct from the one that generates the UV/optical/near-infrared emission. No ultra-high-energy gamma-rays and no neutrino candidates consistent with the source were found in follow-up searches. These observations support the hypothesis that GW170817 was produced by the merger of two neutron stars in NGC4993 followed by a short gamma-ray burst (GRB 170817A) and a kilonova/macronova powered by the radioactive decay of r-process nuclei synthesized in the ejecta

Blind driving by means of a steering-based predictor algorithm

The aim of this work was to develop and empirically test different algorithms of a lane-keeping assistance system that supports drivers by means of a tone when the car is about to deviate from its lane. These auditory assistance systems were tested in a driving simulator with its screens shut down, so that the participants used auditory feedback only. Five participants drove with a previously published algorithm that predicted the future position of the car based on the current velocity vector, and three new algorithms that predicted the future position based on the momentary speed and steering angle. Results of a total of 5 h of driving across participants showed that, with extensive practice and knowledge of the system, it is possible to drive on a track with sharp curves for 5 min without leaving the road. Future research should aim to improve the intuitiveness of the auditory feedback.Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.Intelligent VehiclesBiomechatronics & Human-Machine Contro