Characterizing driving behavior using automatic visual analysis

In this work, we present the problem of rash driving detection algorithm using a single wide angle camera sensor, particularly useful in the Indian context. To our knowledge this rash driving problem has not been addressed using Image processing techniques (existing works use other sensors such as accelerometer). Car Image processing literature, though rich and mature, does not address the rash driving problem. In this work-in-progress paper, we present the need to address this problem, our approach and our future plans to build a rash driving detector.Comment: 4 pages,7 figures, IBM-ICARE201

A high speed Tri-Vision system for automotive applications

Purpose: Cameras are excellent ways of non-invasively monitoring the interior and exterior of vehicles. In particular, high speed stereovision and multivision systems are important for transport applications such as driver eye tracking or collision avoidance. This paper addresses the synchronisation problem which arises when multivision camera systems are used to capture the high speed motion common in such applications. Methods: An experimental, high-speed tri-vision camera system intended for real-time driver eye-blink and saccade measurement was designed, developed, implemented and tested using prototype, ultra-high dynamic range, automotive-grade image sensors specifically developed by E2V (formerly Atmel) Grenoble SA as part of the European FP6 project – sensation (advanced sensor development for attention stress, vigilance and sleep/wakefulness monitoring). Results : The developed system can sustain frame rates of 59.8 Hz at the full stereovision resolution of 1280 × 480 but this can reach 750 Hz when a 10 k pixel Region of Interest (ROI) is used, with a maximum global shutter speed of 1/48000 s and a shutter efficiency of 99.7%. The data can be reliably transmitted uncompressed over standard copper Camera-Link® cables over 5 metres. The synchronisation error between the left and right stereo images is less than 100 ps and this has been verified both electrically and optically. Synchronisation is automatically established at boot-up and maintained during resolution changes. A third camera in the set can be configured independently. The dynamic range of the 10bit sensors exceeds 123 dB with a spectral sensitivity extending well into the infra-red range. Conclusion: The system was subjected to a comprehensive testing protocol, which confirms that the salient requirements for the driver monitoring application are adequately met and in some respects, exceeded. The synchronisation technique presented may also benefit several other automotive stereovision applications including near and far-field obstacle detection and collision avoidance, road condition monitoring and others.Partially funded by the EU FP6 through the IST-507231 SENSATION project.peer-reviewe

Real-time head movement tracking through earables in moving vehicles

Abstract. The Internet of Things is enabling innovations in the automotive industry by expanding the capabilities of vehicles by connecting them with the cloud. One important application domain is traffic safety, which can benefit from monitoring the driver’s condition to see if they are capable of safely handling the vehicle. By detecting drowsiness, inattentiveness, and distraction of the driver it is possible to react before accidents happen. This thesis explores how accelerometer and gyroscope data collected using earables can be used to classify the orientation of the driver’s head in a moving vehicle. It is found that machine learning algorithms such as Random Forest and K-Nearest Neighbor can be used to reach fairly accurate classifications even without applying any noise reduction to the signal data. Data cleaning and transformation approaches are studied to see how the models could be improved further. This study paves the way for the development of driver monitoring systems capable of reacting to anomalous driving behavior before traffic accidents can happen

3D Computer Vision and Wireless Sensor Applications in an-experimental Study on Electric Vehicle Driving in Roundabout Negotiation Scenarios

In this paper, a 3D computer vision application and a wireless sensor application are presented. They were used in an experimental study on electric vehicle driving to analyse the influence of age on driving style in roundabout scenarios. The 3D computer vision application uses the Kinect device to achieve face tracking of the driver. From the pith, roll and yaw angles of the face, the gaze can be estimated. Thus in each processed image, the region, from the predefined ROIs, where the driver is gazing at can be estimated. Gaze patterns and transitions in driving situations, particularly while negotiating roundabouts, can be determined. The wireless sensor application uses the gyroscope included in a 9DoF (Degrees of Freedom) sensor from the Shimmer platform. The gyroscope was placed on the steering wheel. The signal corresponding to the turn axis of the steering wheel is obtained so that the direction and speed of any turn can be detected. Besides, the heart rate was monitored and the electric car used in the experiments was equipped with an extensive telemetry system. 28 people took part in the experiments. They drove on the same 13-kilometer on-road route in Sunderland (UK) using a Smart Fortwo electric vehicle and on a route with a Forum 8 driving simulator. Only a brief description of the experiments is included. Results and analysis will be presented in the future. Experimental studies with electric cars are needed to support their progressive penetration in the market