Implicit personalization in driving assistance: State-of-the-art and open issues

In recent decades, driving assistance systems have been evolving towards personalization for adapting to different drivers. With the consideration of driving preferences and driver characteristics, these systems become more acceptable and trustworthy. This article presents a survey on recent advances in implicit personalized driving assistance. We classify the collection of work into three main categories: 1) personalized Safe Driving Systems (SDS), 2) personalized Driver Monitoring Systems (DMS), and 3) personalized In-vehicle Information Systems (IVIS). For each category, we provide a comprehensive review of current applications and related techniques along with the discussion of industry status, benefits of personalization, application prospects, and future focal points. Both relevant driving datasets and open issues about personalized driving assistance are discussed to facilitate future research. By creating an organized categorization of the field, we hope that this survey could not only support future research and the development of new technologies for personalized driving assistance but also facilitate the application of these techniques within the driving automation community</h2

Computational driver behavior models for vehicle safety applications

The aim of this thesis is to investigate how human driving behaviors can be formally described in mathematical models intended for online personalization of advanced driver assistance systems (ADAS) or offline virtual safety evaluations. Both longitudinal (braking) and lateral (steering) behaviors in routine driving and emergencies are addressed. Special attention is paid to driver glance behavior in critical situations and the role of peripheral vision.First, a hybrid framework based on autoregressive models with exogenous input (ARX-models) is employed to predict and classify driver control in real time. Two models are suggested, one targeting steering behavior and the other longitudinal control behavior. Although the predictive performance is unsatisfactory, both models can distinguish between different driving styles.Moreover, a basic model for drivers\u27 brake initiation and modulation in critical longitudinal situations (specifically for rear-end conflicts) is constructed. The model is based on a conceptual framework of noisy evidence accumulation and predictive processing. Several model extensions related to gaze behavior are also proposed and successfully fitted to real-world crashes and near-crashes. The influence of gaze direction is further explored in a driving simulator study, showing glance response times to be independent of the glance\u27s visual eccentricity, while brake response times increase for larger gaze angles, as does the rate of missed target detections.Finally, the potential of a set of metrics to quantify subjectively perceived risk in lane departure situations to explain drivers\u27 recovery steering maneuvers was investigated. The most influential factors were the relative yaw angle and splay angle error at steering initiation. Surprisingly, it was observed that drivers often initiated the recovery steering maneuver while looking off-road.To sum up, the proposed models in this thesis facilitate the development of personalized ADASs and contribute to trustworthy virtual evaluations of current, future, and conceptual safety systems. The insights and ideas contribute to an enhanced, human-centric system development, verification, and validation process. In the long term, this will likely lead to improved vehicle safety and a reduced number of severe injuries and fatalities in traffic

Real-time Personalized Driver Support System for Pilot Assist Promotion in Different Traffic Conditions

The complexity of advanced in-vehicle systems and level of automation provided is currently increasing, making the understanding of smart systems design and limitations challenging to a driver. As a result, misinterpretation of the system\u27s capabilities can be detrimental to perceived usefulness and the system\u27s usage. The personalized real-time driver support concept presented in this paper is designed to improve the driver\u27s understanding of Pilot Assist (PA) and increase PA usage effectiveness in various traffic contexts. The designed communication informs drivers about PA capabilities in various traffic conditions, helping drivers recognize the appropriate context for PA activation and reflect on their own PA use strategy

On driver behavior recognition for increased safety:A roadmap

Advanced Driver-Assistance Systems (ADASs) are used for increasing safety in the automotive domain, yet current ADASs notably operate without taking into account drivers’ states, e.g., whether she/he is emotionally apt to drive. In this paper, we first review the state-of-the-art of emotional and cognitive analysis for ADAS: we consider psychological models, the sensors needed for capturing physiological signals, and the typical algorithms used for human emotion classification. Our investigation highlights a lack of advanced Driver Monitoring Systems (DMSs) for ADASs, which could increase driving quality and security for both drivers and passengers. We then provide our view on a novel perception architecture for driver monitoring, built around the concept of Driver Complex State (DCS). DCS relies on multiple non-obtrusive sensors and Artificial Intelligence (AI) for uncovering the driver state and uses it to implement innovative Human–Machine Interface (HMI) functionalities. This concept will be implemented and validated in the recently EU-funded NextPerception project, which is briefly introduced

Affective Role of the Future Autonomous Vehicle Interior

Recent advancements in autonomous technology allow for new opportunities in vehicle interior design. Such a shift in in-vehicle activity suggests vehicle interior spaces should provide an adequate manner by considering users' affective desires. Therefore, this study aims to investigate the affective role of future vehicle interiors. Thirty one participants in ten focus groups were interviewed about challenges they face regarding their current vehicle interior and expectations they have for future vehicles. Results from content analyses revealed the affective role of future vehicle interiors. Advanced exclusiveness and advanced convenience were two primary aspects identified. The identified affective roles of each aspect are a total of eight visceral levels, four visceral levels each, including focused, stimulating, amused, pleasant, safe, comfortable, accommodated, and organized. We expect the results from this study to lead to the development of affective vehicle interiors by providing the fundamental knowledge for developing conceptual direction and evaluating its impact on user experiences.Comment: 15 pages, 4 figures, 2 table

A DATA-DRIVEN APPROACH TO SUPPORTING USERS’ ADAPTATION TO SMART IN-VEHICLE SYSTEMS

The utilization of data to understand user behavior and support user needs began to develop in areas such as internet services, smartphone apps development, and the gaming industry. This bloom of data-driven services and applications forced OEMs to consider possible solutions for better in-vehicle connectivity. However, digital transformation in the automotive sector presents numerous challenges. One of those challenges is identifying and establishing the relevant user-related data that will cover current and future needs to help the automotive industry cope with the digital transformation pace. At the same time, this development should not be sporadic, without a clear purpose or vision of how newly-generated data can support engineers to create better systems for drivers. The important issue is to learn how to extract the knowledge from the immense data we possess, and to understand the extent to which this data can be used.Another challenge is the lack of established approaches towards vehicle data utilization for user-related studies. This area is relatively new to the automotive industry. Despite the positive examples from other fields that demonstrate the potential for data-driven context-aware applications, automotive practices still have gaps in capturing the driving context and driver behavior. This lack of user-related data can partially be explained by the multitasking activities that the driver performs while driving the car and the higher complexity of the automotive context compared to other domains. Thus, more research is needed to explore the capacity of vehicle data to support users in different tasks.Considering all the interrelations between the driver and in-vehicle system in the defined context of use helps to obtain more comprehensive information and better understand how the system under evaluation can be improved to meet driver needs. Tracking driver behavior with the help of vehicle data may provide developers with quick and reliable user feedback on how drivers are using the system. Compared to vehicle data, the driver’s feedback is often incomplete and perception-based since the driver cannot always correlate his behavior to complex processes of vehicle performance or clearly remember the context conditions. Thus, this research aims to demonstrate the ability of vehicle data to support product design and evaluation processes with data-driven automated user insights. This research does not disregard the driver’s qualitative input as unimportant but provides insights into how to better combine quantitative and qualitative methods for more effective results.According to the aim, the research focuses on three main aspects:•\ua0\ua0\ua0\ua0\ua0 Identifying the extent to which vehicle data can contribute to driver behavior understanding.\ua0 •\ua0\ua0\ua0\ua0\ua0 Expanding the concepts for vehicle data utilization to support drivers.•\ua0\ua0\ua0\ua0\ua0 Developing the methodology for a more effective combination of quantitative (vehicle data-based) and qualitative (based on users’ feedback) studies. Additionally, special consideration is given to describing the drawbacks and limitations, to enhance future data-driven applications

Review and perspectives on driver digital twin and its enabling technologies for intelligent vehicles

Digital Twin (DT) is an emerging technology and has been introduced into intelligent driving and transportation systems to digitize and synergize connected automated vehicles. However, existing studies focus on the design of the automated vehicle, whereas the digitization of the human driver, who plays an important role in driving, is largely ignored. Furthermore, previous driver-related tasks are limited to specific scenarios and have limited applicability. Thus, a novel concept of a driver digital twin (DDT) is proposed in this study to bridge the gap between existing automated driving systems and fully digitized ones and aid in the development of a complete driving human cyber-physical system (H-CPS). This concept is essential for constructing a harmonious human-centric intelligent driving system that considers the proactivity and sensitivity of the human driver. The primary characteristics of the DDT include multimodal state fusion, personalized modeling, and time variance. Compared with the original DT, the proposed DDT emphasizes on internal personality and capability with respect to the external physiological-level state. This study systematically illustrates the DDT and outlines its key enabling aspects. The related technologies are comprehensively reviewed and discussed with a view to improving them by leveraging the DDT. In addition, the potential applications and unsettled challenges are considered. This study aims to provide fundamental theoretical support to researchers in determining the future scope of the DDT system

Adaptation and Personalization in Driver Assistance Systems

Driver-related factors (e.g., driver inattention) are a cause of majority of traffic accidents. To reduce the number of accidents and improve traffic safety a variety of driver assistance systems have been proposed. Today, many of these systems do not adapt recommendations and warning to the particular driver (having his-/her own driving style, reaction time etc.). However, in many cases utilization of personal characteristics and preferences may improve the quality of the driver assistance, besides if a driver's expectations about the functionality provided by the assistance system are not met, it may decrease the trust to the system and lead to turning it off, therefore ignoring its potential utility and influence on increasing the safety. In this paper we review scientific publications in the area of driver assistance systems and a) identify most widely used directions of personalization and adaptation in driver assistance systems, b) identify and describe the most widely used models and methods leveraged for personalization and adaptation, c) identify existing research gaps. The paper may serve as mapping study as well as a reference and a toolset of how to deal with driver variability in driver assistance systems

Methods and techniques for analyzing human factors facets on drivers

Mención Internacional en el título de doctorWith millions of cars moving daily, driving is the most performed activity worldwide. Unfortunately, according to the World Health Organization (WHO), every year, around 1.35 million people worldwide die from road traffic accidents and, in addition, between 20 and 50 million people are injured, placing road traffic accidents as the second leading cause of death among people between the ages of 5 and 29. According to WHO, human errors, such as speeding, driving under the influence of drugs, fatigue, or distractions at the wheel, are the underlying cause of most road accidents. Global reports on road safety such as "Road safety in the European Union. Trends, statistics, and main challenges" prepared by the European Commission in 2018 presented a statistical analysis that related road accident mortality rates and periods segmented by hours and days of the week. This report revealed that the highest incidence of mortality occurs regularly in the afternoons during working days, coinciding with the period when the volume of traffic increases and when any human error is much more likely to cause a traffic accident. Accordingly, mitigating human errors in driving is a challenge, and there is currently a growing trend in the proposal for technological solutions intended to integrate driver information into advanced driving systems to improve driver performance and ergonomics. The study of human factors in the field of driving is a multidisciplinary field in which several areas of knowledge converge, among which stand out psychology, physiology, instrumentation, signal treatment, machine learning, the integration of information and communication technologies (ICTs), and the design of human-machine communication interfaces. The main objective of this thesis is to exploit knowledge related to the different facets of human factors in the field of driving. Specific objectives include identifying tasks related to driving, the detection of unfavorable cognitive states in the driver, such as stress, and, transversely, the proposal for an architecture for the integration and coordination of driver monitoring systems with other active safety systems. It should be noted that the specific objectives address the critical aspects in each of the issues to be addressed. Identifying driving-related tasks is one of the primary aspects of the conceptual framework of driver modeling. Identifying maneuvers that a driver performs requires training beforehand a model with examples of each maneuver to be identified. To this end, a methodology was established to form a data set in which a relationship is established between the handling of the driving controls (steering wheel, pedals, gear lever, and turn indicators) and a series of adequately identified maneuvers. This methodology consisted of designing different driving scenarios in a realistic driving simulator for each type of maneuver, including stop, overtaking, turns, and specific maneuvers such as U-turn and three-point turn. From the perspective of detecting unfavorable cognitive states in the driver, stress can damage cognitive faculties, causing failures in the decision-making process. Physiological signals such as measurements derived from the heart rhythm or the change of electrical properties of the skin are reliable indicators when assessing whether a person is going through an episode of acute stress. However, the detection of stress patterns is still an open problem. Despite advances in sensor design for the non-invasive collection of physiological signals, certain factors prevent reaching models capable of detecting stress patterns in any subject. This thesis addresses two aspects of stress detection: the collection of physiological values during stress elicitation through laboratory techniques such as the Stroop effect and driving tests; and the detection of stress by designing a process flow based on unsupervised learning techniques, delving into the problems associated with the variability of intra- and inter-individual physiological measures that prevent the achievement of generalist models. Finally, in addition to developing models that address the different aspects of monitoring, the orchestration of monitoring systems and active safety systems is a transversal and essential aspect in improving safety, ergonomics, and driving experience. Both from the perspective of integration into test platforms and integration into final systems, the problem of deploying multiple active safety systems lies in the adoption of monolithic models where the system-specific functionality is run in isolation, without considering aspects such as cooperation and interoperability with other safety systems. This thesis addresses the problem of the development of more complex systems where monitoring systems condition the operability of multiple active safety systems. To this end, a mediation architecture is proposed to coordinate the reception and delivery of data flows generated by the various systems involved, including external sensors (lasers, external cameras), cabin sensors (cameras, smartwatches), detection models, deliberative models, delivery systems and machine-human communication interfaces. Ontology-based data modeling plays a crucial role in structuring all this information and consolidating the semantic representation of the driving scene, thus allowing the development of models based on data fusion.I would like to thank the Ministry of Economy and Competitiveness for granting me the predoctoral fellowship BES-2016-078143 corresponding to the project TRA2015-63708-R, which provided me the opportunity of conducting all my Ph. D activities, including completing an international internship.Programa de Doctorado en Ciencia y Tecnología Informática por la Universidad Carlos III de MadridPresidente: José María Armingol Moreno.- Secretario: Felipe Jiménez Alonso.- Vocal: Luis Mart

Implicit Personalization in Driving Assistance: State-of-the-Art and Open Issues

In recent decades, driving assistance systems have been evolving towards personalization for adapting to different drivers. With considering personal driving preferences and characteristics, these systems become more acceptable and trustworthy. This paper presents a survey of recent advances in implicit personalized driving assistance. We classify the collection of work into three main categories: 1) personalized Safe Driving Systems (SDS), 2) personalized Driver Monitoring Systems (DMS), and 3) personalized In-vehicle Information Systems (IVIS). For each category, we provide a comprehensive review of current applications and related techniques along with the discussion of industry status, gains of personalization, application prospects, and future focal points. Several existing driving datasets are summarized and open issues of personalized driving assistance are also suggested to facilitate future research. By creating an organized categorization of the field, this survey could not only support future research and the development of new technologies for personalized driving assistance but also facilitate the use of these techniques by researchers within the driving automation community