Video surveillance for monitoring driver's fatigue and distraction

Fatigue and distraction effects in drivers represent a great risk for road safety. For both types of driver behavior problems, image analysis of eyes, mouth and head movements gives valuable information. We present in this paper a system for monitoring fatigue and distraction in drivers by evaluating their performance using image processing. We extract visual features related to nod, yawn, eye closure and opening, and mouth movements to detect fatigue as well as to identify diversion of attention from the road. We achieve an average of 98.3% and 98.8% in terms of sensitivity and specificity for detection of driver's fatigue, and 97.3% and 99.2% for detection of driver's distraction when evaluating four video sequences with different drivers

Safe driving in a green world : a review of driver performance benchmarks and technologies to support ‘smart’ driving

Road transport is a significant source of both safety and environmental concerns. With climate change and fuel prices increasingly prominent on social and political agendas, many drivers are turning their thoughts to fuel efficient or ‘green’ (i.e., environmentally friendly) driving practices. Many vehicle manufacturers are satisfying this demand by offering green driving feedback or advice tools. However, there is a legitimate concern regarding the effects of such devices on road safety – both from the point of view of change in driving styles, as well as potential distraction caused by the in-vehicle feedback. In this paper, we appraise the benchmarks for safe and green driving, concluding that whilst they largely overlap, there are some specific circumstances in which the goals are in conflict. We go on to review current and emerging in-vehicle information systems which purport to affect safe and/or green driving, and discuss some fundamental ergonomics principles for the design of such devices. The results of the review are being used in the Foot-LITE project, aimed at developing a system to encourage ‘smart’ – that is safe and green – driving

Designing Automated Vehicle and Traffic Systems towards Meaningful Human Control

Ensuring operational control over automated vehicles is not trivial and failing to do so severely endangers the lives of road users. An integrated approach is necessary to ensure that all agents play their part including drivers, occupants, vehicle designers and governments. While progress is being made, a comprehensive approach to the problem is being ignored, which can be solved in the main through considering Meaningful Human Control (MHC). In this research, an Integrated System Proximity framework and Operational Process Design approach to assist the development of Connected Automated Vehicles (CAV) under the consideration of MHC are introduced. These offer a greater understanding and basis for vehicle and traffic system design by vehicle designers and governments as two important influencing stakeholders. The framework includes an extension to a system approach, which also considers ways that MHC can be improved through updating: either implicit proximal updating or explicit distal updating. The process and importance are demonstrated in three recent cases from practice. Finally, a call for action is made to government and regulatory authorities, as well as the automotive industry, to ensure that MHC processes are explicitly included in policy, regulations, and design processes to ensure future ad-vancement of CAVs in a responsible, safe and humanly agreeable fashion.Comment: In: Research Handbook on Meaningful Human Control of Artificial Intelligence Systems. Edward Elgar Publishin

The effect of electronic word of mouth communication on purchase intention moderate by trust: a case online consumer of Bahawalpur Pakistan

The aim of this study is concerned with improving the previous research finding complete filling the research gaps and introducing the e-WOM on purchase intention and brand trust as a moderator between the e-WOM, and purchase intention an online user in Bahawalpur city Pakistan, therefore this study was a focus at linking the research gap of previous literature of past study based on individual awareness from the real-life experience. we collected data from the online user of the Bahawalpur Pakistan. In this study convenience sampling has been used to collect data and instruments of this study adopted from the previous study. The quantitative research methodology used to collect data, survey method was used to assemble data for this study, 300 questionnaire were distributed in Bahawalpur City due to the ease, reliability, and simplicity, effective recovery rate of 67% as a result 202 valid response was obtained for the effect of e-WOM on purchase intention and moderator analysis has been performed. Hypotheses of this research are analyzed by using Structural Equation Modeling (SEM) based on Partial Least Square (PLS). The result of this research is e-WOM significantly positive effect on purchase intention and moderator role of trust significantly affects the relationship between e-WOM, and purchase intention. The addition of brand trust in the model has contributed to the explanatory power, some studied was conduct on brand trust as a moderator and this study has contributed to the literature in this favor. significantly this study focused on current marketing research. Unlike past studies focused on western context, this study has extended the regional literature on e-WOM, and purchase intention to be intergrading in Bahawalpur Pakistan context. Lastly, future studies are recommended to examine the effect of trust in other countries allow for the comparison of the findings

Driving automation: Learning from aviation about design philosophies

Full vehicle automation is predicted to be on British roads by 2030 (Walker et al., 2001). However, experience in aviation gives us some cause for concern for the 'drive-by-wire' car (Stanton and Marsden, 1996). Two different philosophies have emerged in aviation for dealing with the human factor: hard vs. soft automation, depending on whether the computer or the pilot has ultimate authority (Hughes and Dornheim, 1995). This paper speculates whether hard or soft automation provides the best solution for road vehicles, and considers an alternative design philosophy in vehicles of the future based on coordination and cooperation

Face pose estimation with automatic 3D model creation for a driver inattention monitoring application

Texto en inglés y resumen en inglés y españolRecent studies have identified inattention (including distraction and drowsiness) as the main cause of accidents, being responsible of at least 25% of them. Driving distraction has been less studied, since it is more diverse and exhibits a higher risk factor than fatigue. In addition, it is present over half of the inattention involved crashes. The increased presence of In Vehicle Information Systems (IVIS) adds to the potential distraction risk and modifies driving behaviour, and thus research on this issue is of vital importance. Many researchers have been working on different approaches to deal with distraction during driving. Among them, Computer Vision is one of the most common, because it allows for a cost effective and non-invasive driver monitoring and sensing. Using Computer Vision techniques it is possible to evaluate some facial movements that characterise the state of attention of a driver. This thesis presents methods to estimate the face pose and gaze direction of a person in real-time, using a stereo camera as a basic for assessing driver distractions. The methods are completely automatic and user-independent. A set of features in the face are identified at initialisation, and used to create a sparse 3D model of the face. These features are tracked from frame to frame, and the model is augmented to cover parts of the face that may have been occluded before. The algorithm is designed to work in a naturalistic driving simulator, which presents challenging low light conditions. We evaluate several techniques to detect features on the face that can be matched between cameras and tracked with success. Well-known methods such as SURF do not return good results, due to the lack of salient points in the face, as well as the low illumination of the images. We introduce a novel multisize technique, based on Harris corner detector and patch correlation. This technique benefits from the better performance of small patches under rotations and illumination changes, and the more robust correlation of the bigger patches under motion blur. The head rotates in a range of ±90º in the yaw angle, and the appearance of the features change noticeably. To deal with these changes, we implement a new re-registering technique that captures new textures of the features as the face rotates. These new textures are incorporated to the model, which mixes the views of both cameras. The captures are taken at regular angle intervals for rotations in yaw, so that each texture is only used in a range of ±7.5º around the capture angle. Rotations in pitch and roll are handled using affine patch warping. The 3D model created at initialisation can only take features in the frontal part of the face, and some of these may occlude during rotations. The accuracy and robustness of the face tracking depends on the number of visible points, so new points are added to the 3D model when new parts of the face are visible from both cameras. Bundle adjustment is used to reduce the accumulated drift of the 3D reconstruction. We estimate the pose from the position of the features in the images and the 3D model using POSIT or Levenberg-Marquardt. A RANSAC process detects incorrectly tracked points, which are not considered for pose estimation. POSIT is faster, while LM obtains more accurate results. Using the model extension and the re-registering technique, we can accurately estimate the pose in the full head rotation range, with error levels that improve the state of the art. A coarse eye direction is composed with the face pose estimation to obtain the gaze and driver's fixation area, parameter which gives much information about the distraction pattern of the driver. The resulting gaze estimation algorithm proposed in this thesis has been tested on a set of driving experiments directed by a team of psychologists in a naturalistic driving simulator. This simulator mimics conditions present in real driving, including weather changes, manoeuvring and distractions due to IVIS. Professional drivers participated in the tests. The driver?s fixation statistics obtained with the proposed system show how the utilisation of IVIS influences the distraction pattern of the drivers, increasing reaction times and affecting the fixation of attention on the road and the surroundings

Face pose estimation with automatic 3D model creation for a driver inattention monitoring application

Texto en inglés y resumen en inglés y españolRecent studies have identified inattention (including distraction and drowsiness) as the main cause of accidents, being responsible of at least 25% of them. Driving distraction has been less studied, since it is more diverse and exhibits a higher risk factor than fatigue. In addition, it is present over half of the inattention involved crashes. The increased presence of In Vehicle Information Systems (IVIS) adds to the potential distraction risk and modifies driving behaviour, and thus research on this issue is of vital importance. Many researchers have been working on different approaches to deal with distraction during driving. Among them, Computer Vision is one of the most common, because it allows for a cost effective and non-invasive driver monitoring and sensing. Using Computer Vision techniques it is possible to evaluate some facial movements that characterise the state of attention of a driver. This thesis presents methods to estimate the face pose and gaze direction of a person in real-time, using a stereo camera as a basic for assessing driver distractions. The methods are completely automatic and user-independent. A set of features in the face are identified at initialisation, and used to create a sparse 3D model of the face. These features are tracked from frame to frame, and the model is augmented to cover parts of the face that may have been occluded before. The algorithm is designed to work in a naturalistic driving simulator, which presents challenging low light conditions. We evaluate several techniques to detect features on the face that can be matched between cameras and tracked with success. Well-known methods such as SURF do not return good results, due to the lack of salient points in the face, as well as the low illumination of the images. We introduce a novel multisize technique, based on Harris corner detector and patch correlation. This technique benefits from the better performance of small patches under rotations and illumination changes, and the more robust correlation of the bigger patches under motion blur. The head rotates in a range of ±90º in the yaw angle, and the appearance of the features change noticeably. To deal with these changes, we implement a new re-registering technique that captures new textures of the features as the face rotates. These new textures are incorporated to the model, which mixes the views of both cameras. The captures are taken at regular angle intervals for rotations in yaw, so that each texture is only used in a range of ±7.5º around the capture angle. Rotations in pitch and roll are handled using affine patch warping. The 3D model created at initialisation can only take features in the frontal part of the face, and some of these may occlude during rotations. The accuracy and robustness of the face tracking depends on the number of visible points, so new points are added to the 3D model when new parts of the face are visible from both cameras. Bundle adjustment is used to reduce the accumulated drift of the 3D reconstruction. We estimate the pose from the position of the features in the images and the 3D model using POSIT or Levenberg-Marquardt. A RANSAC process detects incorrectly tracked points, which are not considered for pose estimation. POSIT is faster, while LM obtains more accurate results. Using the model extension and the re-registering technique, we can accurately estimate the pose in the full head rotation range, with error levels that improve the state of the art. A coarse eye direction is composed with the face pose estimation to obtain the gaze and driver's fixation area, parameter which gives much information about the distraction pattern of the driver. The resulting gaze estimation algorithm proposed in this thesis has been tested on a set of driving experiments directed by a team of psychologists in a naturalistic driving simulator. This simulator mimics conditions present in real driving, including weather changes, manoeuvring and distractions due to IVIS. Professional drivers participated in the tests. The driver?s fixation statistics obtained with the proposed system show how the utilisation of IVIS influences the distraction pattern of the drivers, increasing reaction times and affecting the fixation of attention on the road and the surroundings

Recommendations for a large-scale European naturalistic driving observation study. PROLOGUE Deliverable D4.1.

Naturalistic driving observation is a relatively new research method using advanced technology for in-vehicle unobtrusive recording of driver (or rider) behaviour during ordinary driving in traffic. This method yields unprecedented knowledge primarily related to road safety, but also to environmentally friendly driving/riding and to traffic management. Distraction, inattention and sleepiness are examples of important safety-related topics where naturalistic driving is expected to provide great added value compared to traditional research methods. In order to exploit the full benefits of the naturalistic driving approach it is recommended to carry out a large-scale European naturalistic driving study. The EU project PROLOGUE has investigated the feasibility and value of carrying out such a study, and the present deliverable summarises recommendations based on the PROLOGUE project