Shared control strategies for automated vehicles

188 p.Los vehículos automatizados (AVs) han surgido como una solución tecnológica para compensar las deficiencias de la conducción manual. Sin embargo, esta tecnología aún no está lo suficientemente madura para reemplazar completamente al conductor, ya que esto plantea problemas técnicos, sociales y legales. Sin embargo, los accidentes siguen ocurriendo y se necesitan nuevas soluciones tecnológicas para mejorar la seguridad vial. En este contexto, el enfoque de control compartido, en el que el conductor permanece en el bucle de control y, junto con la automatización, forma un equipo bien coordinado que colabora continuamente en los niveles táctico y de control de la tarea de conducción, es una solución prometedora para mejorar el rendimiento de la conducción manual aprovechando los últimos avances en tecnología de conducción automatizada. Esta estrategia tiene como objetivo promover el desarrollo de sistemas de asistencia al conductor más avanzados y con mayor grade de cooperatición en comparación con los disponibles en los vehículos comerciales. En este sentido, los vehículos automatizados serán los supervisores que necesitan los conductores, y no al revés. La presente tesis aborda en profundidad el tema del control compartido en vehículos automatizados, tanto desde una perspectiva teórica como práctica. En primer lugar, se proporciona una revisión exhaustiva del estado del arte para brindar una descripción general de los conceptos y aplicaciones en los que los investigadores han estado trabajando durante lasúltimas dos décadas. Luego, se adopta un enfoque práctico mediante el desarrollo de un controlador para ayudar al conductor en el control lateral del vehículo. Este controlador y su sistema de toma de decisiones asociado (Módulo de Arbitraje) se integrarán en el marco general de conducción automatizada y se validarán en una plataforma de simulación con conductores reales. Finalmente, el controlador desarrollado se aplica a dos sistemas. El primero para asistir a un conductor distraído y el otro en la implementación de una función de seguridad para realizar maniobras de adelantamiento en carreteras de doble sentido. Al finalizar, se presentan las conclusiones más relevantes y las perspectivas de investigación futuras para el control compartido en la conducción automatizada

A Review of Shared Control for Automated Vehicles: Theory and Applications

The last decade has shown an increasing interest on advanced driver assistance systems (ADAS) based on shared control, where automation is continuously supporting the driver at the control level with an adaptive authority. A first look at the literature offers two main research directions: 1) an ongoing effort to advance the theoretical comprehension of shared control, and 2) a diversity of automotive system applications with an increasing number of works in recent years. Yet, a global synthesis on these efforts is not available. To this end, this article covers the complete field of shared control in automated vehicles with an emphasis on these aspects: 1) concept, 2) categories, 3) algorithms, and 4) status of technology. Articles from the literature are classified in theory- and application-oriented contributions. From these, a clear distinction is found between coupled and uncoupled shared control. Also, model-based and model-free algorithms from these two categories are evaluated separately with a focus on systems using the steering wheel as the control interface. Model-based controllers tested by at least one real driver are tabulated to evaluate the performance of such systems. Results show that the inclusion of a driver model helps to reduce the conflicts at the steering. Also, variables such as driver state, driver effort, and safety indicators have a high impact on the calculation of the authority. Concerning the evaluation, driver-in-the-loop simulators are the most common platforms, with few works performed in real vehicles. Implementation in experimental vehicles is expected in the upcoming years.This work was supported in part by the ECSEL Joint Undertaking, which funded the PRYSTINE project under Grant 783190, and in part by the AUTOLIB project (ELKARTEK 2019 ref. KK-2019/00035; Gobierno Vasco Dpto. Desarrollo económico e infraestructuras)

A Review of Shared Control for Automated Vehicles: Theory and Applications

The last decade has shown an increasing interest on advanced driver assistance systems (ADAS) based on shared control, where automation is continuously supporting the driver at the control level with an adaptive authority. A first look at the literature offers two main research directions: 1) an ongoing effort to advance the theoretical comprehension of shared control, and 2) a diversity of automotive system applications with an increasing number of works in recent years. Yet, a global synthesis on these efforts is not available. To this end, this article covers the complete field of shared control in automated vehicles with an emphasis on these aspects: 1) concept, 2) categories, 3) algorithms, and 4) status of technology. Articles from the literature are classified in theory- and application-oriented contributions. From these, a clear distinction is found between coupled and uncoupled shared control. Also, model-based and model-free algorithms from these two categories are evaluated separately with a focus on systems using the steering wheel as the control interface. Model-based controllers tested by at least one real driver are tabulated to evaluate the performance of such systems. Results show that the inclusion of a driver model helps to reduce the conflicts at the steering. Also, variables such as driver state, driver effort, and safety indicators have a high impact on the calculation of the authority. Concerning the evaluation, driver-in-the-loop simulators are the most common platforms, with few works performed in real vehicles. Implementation in experimental vehicles is expected in the upcoming years

MPC-Based Haptic Shared Steering System: A Driver Modeling Approach for Symbiotic Driving

Advanced Driver Assistance Systems (ADAS) aim to increase safety and reduce mental workload. However, the gap in the understanding of the closed-loop driver-vehicle interaction often leads to reduced user acceptance. In this study, an optimal torque control law is calculated online in the Model Predictive Control (MPC) framework to guarantee continuous guidance during the steering task. The research contribution is in the integration of an extensive prediction model covering cognitive behaviour, neuromuscular dynamics, and the vehicle- steering dynamics, within the MPC-based haptic controller to enhance collaboration. The driver model is composed of a preview cognitive strategy based on a Linear-Quadratic-Gaussian, sensory organs, and neuromuscular dynamics, including muscle co-activation and reflex action. Moreover, an adaptive cost-function algorithm enables dynamic allocation of the control authority. Experiments were performed in a fixed-base driving simulator at Toyota Motor Europe involving 19 participants to evaluate the proposed controller with two different cost functions against a commercial Lane Keeping Assist (LKA) system as an industry benchmark. The results demonstrate the proposed controller fosters symbiotic driving and reduces driver-vehicle conflicts with respect to a state-of-the-art commercial system, both subjectively and objectively, while still improving path-tracking performance. Summarising, this study tackles the need to blend human and ADAS control, demonstrating the validity of the proposed strategy

From the Concept of Being “the Boss” to the Idea of Being “a Team”: The Adaptive Co-Pilot as the Enabler for a New Cooperative Framework

The “classical” SAE LoA for automated driving can present several drawbacks, and the SAE-L2 and SAE-L3, in particular, can lead to the so-called “irony of automation”, where the driver is substituted by the artificial system, but is still regarded as a “supervisor” or as a “fallback mechanism”. To overcome this problem, while taking advantage of the latest technology, we regard both human and machine as members of a unique team that share the driving task. Depending on the available resources (in terms of driver’s status, system state, and environment conditions) and considering that they are very dynamic, an adaptive assignment of authority for each member of the team is needed. This is achieved by designing a technology enabler, constituted by the intelligent and adaptive co-pilot. It comprises (1) a lateral shared controller based on NMPC, which applies the authority, (2) an arbitration module based on FIS, which calculates the authority, and (3) a visual HMI, as an enabler of trust in automation decisions and actions. The benefits of such a system are shown in this paper through a comparison of the shared control driving mode, with manual driving (as a baseline) and lane-keeping and lane-centering (as two commercial ADAS). Tests are performed in a use case where support for a distracted driver is given. Quantitative and qualitative results confirm the hypothesis that shared control offers the best balance between performance, safety, and comfort during the driving task.This research was supported by the ECSEL Joint-Undertaking,which funded the PRYSTINE project under the Grant 783190

Surrogate in-vehicle information systems and driver behaviour: Effects of visual and cognitive load in simulated rural driving

The underlying aim of HASTE, an EU FP5 project, is the development of a valid, cost-effective and reliable assessment protocol to evaluate the potential distraction of an in-vehicle information system on driving performance. As part of this development, the current study was performed to examine the systematic relationship between primary and secondary task complexity for a specific task modality in a particular driving environment. Two fundamentally distinct secondary tasks (or surrogate in-vehicle information systems, sIVIS) were developed: a visual search task, designed such that it only required visual processing/demand and an auditory continuous memory task, intended to cognitively load drivers without any visual stimulus. A high fidelity, fixed-base driving simulator was used to test 48 participants on a car following task. Virtual traffic scenarios varied in driving demand. Drivers compensated for both types of sIVIS by reducing their speed (this result was more prominent during interaction with the visual task). However, they seemed incapable of fully prioritising the primary driving task over either the visual or cognitive secondary tasks as an increase in sIVIS demand was associated with a reduction in driving performance: drivers showed reduced anticipation of braking requirements and shorter time-to-collision. These results are of potential interest to designers of in-vehicle systems

Human-Centric Detection and Mitigation Approach for Various Levels of Cell Phone-Based Driver Distractions

abstract: Driving a vehicle is a complex task that typically requires several physical interactions and mental tasks. Inattentive driving takes a driver’s attention away from the primary task of driving, which can endanger the safety of driver, passenger(s), as well as pedestrians. According to several traffic safety administration organizations, distracted and inattentive driving are the primary causes of vehicle crashes or near crashes. In this research, a novel approach to detect and mitigate various levels of driving distractions is proposed. This novel approach consists of two main phases: i.) Proposing a system to detect various levels of driver distractions (low, medium, and high) using a machine learning techniques. ii.) Mitigating the effects of driver distractions through the integration of the distracted driving detection algorithm and the existing vehicle safety systems. In phase- 1, vehicle data were collected from an advanced driving simulator and a visual based sensor (webcam) for face monitoring. In addition, data were processed using a machine learning algorithm and a head pose analysis package in MATLAB. Then the model was trained and validated to detect different human operator distraction levels. In phase 2, the detected level of distraction, time to collision (TTC), lane position (LP), and steering entropy (SE) were used as an input to feed the vehicle safety controller that provides an appropriate action to maintain and/or mitigate vehicle safety status. The integrated detection algorithm and vehicle safety controller were then prototyped using MATLAB/SIMULINK for validation. A complete vehicle power train model including the driver’s interaction was replicated, and the outcome from the detection algorithm was fed into the vehicle safety controller. The results show that the vehicle safety system controller reacted and mitigated the vehicle safety status-in closed loop real-time fashion. The simulation results show that the proposed approach is efficient, accurate, and adaptable to dynamic changes resulting from the driver, as well as the vehicle system. This novel approach was applied in order to mitigate the impact of visual and cognitive distractions on the driver performance.Dissertation/ThesisDoctoral Dissertation Applied Psychology 201

MPC-Based Haptic Shared Steering System: A Driver Modeling Approach for Symbiotic Driving

Advanced Driver Assistance Systems (ADAS) aim to increase safety and reduce mental workload. However, the gap in the understanding of the closed-loop driver-vehicle interaction often leads to reduced user acceptance. In this study, an optimal torque control law is calculated online in the Model Predictive Control (MPC) framework to guarantee continuous guidance during the steering task. The research contribution is in the integration of an extensive prediction model covering cognitive behaviour, neuromuscular dynamics, and the vehicle- steering dynamics, within the MPC-based haptic controller to enhance collaboration. The driver model is composed of a preview cognitive strategy based on a Linear-Quadratic-Gaussian, sensory organs, and neuromuscular dynamics, including muscle co-activation and reflex action. Moreover, an adaptive cost-function algorithm enables dynamic allocation of the control authority. Experiments were performed in a fixed-base driving simulator at Toyota Motor Europe involving 19 participants to evaluate the proposed controller with two different cost functions against a commercial Lane Keeping Assist (LKA) system as an industry benchmark. The results demonstrate the proposed controller fosters symbiotic driving and reduces driver-vehicle conflicts with respect to a state-of-the-art commercial system, both subjectively and objectively, while still improving path-tracking performance. Summarising, this study tackles the need to blend human and ADAS control, demonstrating the validity of the proposed strategy