Driver Monitoring Using Sparse Representation With Part-Based Temporal Face Descriptors

Many driver monitoring systems (DMSs) have been proposed to reduce the risk of human-caused accidents. Traditional DMSs focus on detecting specific predefined abnormal driving behaviors, such as drowsiness or distracted driving, using generic models trained with the data collected during abnormal driving. However, it is difficult to collect sufficient representative training data to construct generic detection models, which are applicable to all drivers. Consequently, this paper proposes a new personal-based hierarchical DMS (HDMS). During driving, the first layer of the proposed HDMS detects normal and abnormal driving behavior based on normal personal driving models represented by sparse representations. When abnormal driving behavior is detected, the second layer of the HDMS further determines whether the behavior is drowsy driving behavior or distracted driving behavior. The experimental results obtained for three datasets show that the proposed HDMS outperforms existing state-of-the-art DMS methods in detecting normal driving behavior, drowsy driving behavior, and distracted driving behavior

Review and perspectives on driver digital twin and its enabling technologies for intelligent vehicles

Digital Twin (DT) is an emerging technology and has been introduced into intelligent driving and transportation systems to digitize and synergize connected automated vehicles. However, existing studies focus on the design of the automated vehicle, whereas the digitization of the human driver, who plays an important role in driving, is largely ignored. Furthermore, previous driver-related tasks are limited to specific scenarios and have limited applicability. Thus, a novel concept of a driver digital twin (DDT) is proposed in this study to bridge the gap between existing automated driving systems and fully digitized ones and aid in the development of a complete driving human cyber-physical system (H-CPS). This concept is essential for constructing a harmonious human-centric intelligent driving system that considers the proactivity and sensitivity of the human driver. The primary characteristics of the DDT include multimodal state fusion, personalized modeling, and time variance. Compared with the original DT, the proposed DDT emphasizes on internal personality and capability with respect to the external physiological-level state. This study systematically illustrates the DDT and outlines its key enabling aspects. The related technologies are comprehensively reviewed and discussed with a view to improving them by leveraging the DDT. In addition, the potential applications and unsettled challenges are considered. This study aims to provide fundamental theoretical support to researchers in determining the future scope of the DDT system