From Manual Driving to Automated Driving: A Review of 10 Years of AutoUI

This paper gives an overview of the ten-year devel- opment of the papers presented at the International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutoUI) from 2009 to 2018. We categorize the topics into two main groups, namely, manual driving-related research and automated driving-related re- search. Within manual driving, we mainly focus on studies on user interfaces (UIs), driver states, augmented reality and head-up displays, and methodology; Within automated driv- ing, we discuss topics, such as takeover, acceptance and trust, interacting with road users, UIs, and methodology. We also discuss the main challenges and future directions for AutoUI and offer a roadmap for the research in this area.https://deepblue.lib.umich.edu/bitstream/2027.42/153959/1/From Manual Driving to Automated Driving: A Review of 10 Years of AutoUI.pdfDescription of From Manual Driving to Automated Driving: A Review of 10 Years of AutoUI.pdf : Main articl

Human-machine collaboration for automated driving using an intelligent two-phase haptic interface

Prior to realizing fully autonomous driving, human intervention is periodically required to guarantee vehicle safety. This poses a new challenge in human–machine interaction, particularly during the control authority transition from automated functionality to a human driver. Herein, this challenge is addressed by proposing an intelligent haptic interface based on a newly developed two‐phase human–machine interaction model. The intelligent haptic torque is applied to the steering wheel and switches its functionality between predictive guidance and haptic assistance according to the varying state and control ability of human drivers. This helps drivers gradually resume manual control during takeover. The developed approach is validated by conducting vehicle experiments with 26 participants. The results suggest that the proposed method effectively enhances the driving state recovery and control performance of human drivers during takeover compared with an existing approach. Thus, this new method further improves the safety and smoothness of human–machine interaction in automated vehicles

Automated driving: A literature review of the take over request in conditional automation

This article belongs to the Special Issue Autonomous Vehicles TechnologyIn conditional automation (level 3), human drivers can hand over the Driving Dynamic Task (DDT) to the Automated Driving System (ADS) and only be ready to resume control in emergency situations, allowing them to be engaged in non-driving related tasks (NDRT) whilst the vehicle operates within its Operational Design Domain (ODD). Outside the ODD, a safe transition process from the ADS engaged mode to manual driving should be initiated by the system through the issue of an appropriate Take Over Request (TOR). In this case, the driver's state plays a fundamental role, as a low attention level might increase driver reaction time to take over control of the vehicle. This paper summarizes and analyzes previously published works in the field of conditional automation and the TOR process. It introduces the topic in the appropriate context describing as well a variety of concerns that are associated with the TOR. It also provides theoretical foundations on implemented designs, and report on concrete examples that are targeted towards designers and the general public. Moreover, it compiles guidelines and standards related to automation in driving and highlights the research gaps that need to be addressed in future research, discussing also approaches and limitations and providing conclusions.This work was funded by the Austrian Ministry for Climate Action, Environment, Energy, Mobility, Innovation, and Technology (BMK) Endowed Professorship for Sustainable Transport Logistics 4.0; the Spanish Ministry of Economy, Industry and Competitiveness under the TRA201563708-R and TRA2016-78886-C3-1-R project; open access funding by the Johannes Kepler University Linz

Shared control strategies for automated vehicles

188 p.Los vehículos automatizados (AVs) han surgido como una solución tecnológica para compensar las deficiencias de la conducción manual. Sin embargo, esta tecnología aún no está lo suficientemente madura para reemplazar completamente al conductor, ya que esto plantea problemas técnicos, sociales y legales. Sin embargo, los accidentes siguen ocurriendo y se necesitan nuevas soluciones tecnológicas para mejorar la seguridad vial. En este contexto, el enfoque de control compartido, en el que el conductor permanece en el bucle de control y, junto con la automatización, forma un equipo bien coordinado que colabora continuamente en los niveles táctico y de control de la tarea de conducción, es una solución prometedora para mejorar el rendimiento de la conducción manual aprovechando los últimos avances en tecnología de conducción automatizada. Esta estrategia tiene como objetivo promover el desarrollo de sistemas de asistencia al conductor más avanzados y con mayor grade de cooperatición en comparación con los disponibles en los vehículos comerciales. En este sentido, los vehículos automatizados serán los supervisores que necesitan los conductores, y no al revés. La presente tesis aborda en profundidad el tema del control compartido en vehículos automatizados, tanto desde una perspectiva teórica como práctica. En primer lugar, se proporciona una revisión exhaustiva del estado del arte para brindar una descripción general de los conceptos y aplicaciones en los que los investigadores han estado trabajando durante lasúltimas dos décadas. Luego, se adopta un enfoque práctico mediante el desarrollo de un controlador para ayudar al conductor en el control lateral del vehículo. Este controlador y su sistema de toma de decisiones asociado (Módulo de Arbitraje) se integrarán en el marco general de conducción automatizada y se validarán en una plataforma de simulación con conductores reales. Finalmente, el controlador desarrollado se aplica a dos sistemas. El primero para asistir a un conductor distraído y el otro en la implementación de una función de seguridad para realizar maniobras de adelantamiento en carreteras de doble sentido. Al finalizar, se presentan las conclusiones más relevantes y las perspectivas de investigación futuras para el control compartido en la conducción automatizada

A Review of Shared Control for Automated Vehicles: Theory and Applications

The last decade has shown an increasing interest on advanced driver assistance systems (ADAS) based on shared control, where automation is continuously supporting the driver at the control level with an adaptive authority. A first look at the literature offers two main research directions: 1) an ongoing effort to advance the theoretical comprehension of shared control, and 2) a diversity of automotive system applications with an increasing number of works in recent years. Yet, a global synthesis on these efforts is not available. To this end, this article covers the complete field of shared control in automated vehicles with an emphasis on these aspects: 1) concept, 2) categories, 3) algorithms, and 4) status of technology. Articles from the literature are classified in theory- and application-oriented contributions. From these, a clear distinction is found between coupled and uncoupled shared control. Also, model-based and model-free algorithms from these two categories are evaluated separately with a focus on systems using the steering wheel as the control interface. Model-based controllers tested by at least one real driver are tabulated to evaluate the performance of such systems. Results show that the inclusion of a driver model helps to reduce the conflicts at the steering. Also, variables such as driver state, driver effort, and safety indicators have a high impact on the calculation of the authority. Concerning the evaluation, driver-in-the-loop simulators are the most common platforms, with few works performed in real vehicles. Implementation in experimental vehicles is expected in the upcoming years

A Review of Shared Control for Automated Vehicles: Theory and Applications

The last decade has shown an increasing interest on advanced driver assistance systems (ADAS) based on shared control, where automation is continuously supporting the driver at the control level with an adaptive authority. A first look at the literature offers two main research directions: 1) an ongoing effort to advance the theoretical comprehension of shared control, and 2) a diversity of automotive system applications with an increasing number of works in recent years. Yet, a global synthesis on these efforts is not available. To this end, this article covers the complete field of shared control in automated vehicles with an emphasis on these aspects: 1) concept, 2) categories, 3) algorithms, and 4) status of technology. Articles from the literature are classified in theory- and application-oriented contributions. From these, a clear distinction is found between coupled and uncoupled shared control. Also, model-based and model-free algorithms from these two categories are evaluated separately with a focus on systems using the steering wheel as the control interface. Model-based controllers tested by at least one real driver are tabulated to evaluate the performance of such systems. Results show that the inclusion of a driver model helps to reduce the conflicts at the steering. Also, variables such as driver state, driver effort, and safety indicators have a high impact on the calculation of the authority. Concerning the evaluation, driver-in-the-loop simulators are the most common platforms, with few works performed in real vehicles. Implementation in experimental vehicles is expected in the upcoming years.This work was supported in part by the ECSEL Joint Undertaking, which funded the PRYSTINE project under Grant 783190, and in part by the AUTOLIB project (ELKARTEK 2019 ref. KK-2019/00035; Gobierno Vasco Dpto. Desarrollo económico e infraestructuras)

MPC-Based Haptic Shared Steering System: A Driver Modeling Approach for Symbiotic Driving

Advanced Driver Assistance Systems (ADAS) aim to increase safety and reduce mental workload. However, the gap in the understanding of the closed-loop driver-vehicle interaction often leads to reduced user acceptance. In this study, an optimal torque control law is calculated online in the Model Predictive Control (MPC) framework to guarantee continuous guidance during the steering task. The research contribution is in the integration of an extensive prediction model covering cognitive behaviour, neuromuscular dynamics, and the vehicle- steering dynamics, within the MPC-based haptic controller to enhance collaboration. The driver model is composed of a preview cognitive strategy based on a Linear-Quadratic-Gaussian, sensory organs, and neuromuscular dynamics, including muscle co-activation and reflex action. Moreover, an adaptive cost-function algorithm enables dynamic allocation of the control authority. Experiments were performed in a fixed-base driving simulator at Toyota Motor Europe involving 19 participants to evaluate the proposed controller with two different cost functions against a commercial Lane Keeping Assist (LKA) system as an industry benchmark. The results demonstrate the proposed controller fosters symbiotic driving and reduces driver-vehicle conflicts with respect to a state-of-the-art commercial system, both subjectively and objectively, while still improving path-tracking performance. Summarising, this study tackles the need to blend human and ADAS control, demonstrating the validity of the proposed strategy

From the Concept of Being “the Boss” to the Idea of Being “a Team”: The Adaptive Co-Pilot as the Enabler for a New Cooperative Framework

The “classical” SAE LoA for automated driving can present several drawbacks, and the SAE-L2 and SAE-L3, in particular, can lead to the so-called “irony of automation”, where the driver is substituted by the artificial system, but is still regarded as a “supervisor” or as a “fallback mechanism”. To overcome this problem, while taking advantage of the latest technology, we regard both human and machine as members of a unique team that share the driving task. Depending on the available resources (in terms of driver’s status, system state, and environment conditions) and considering that they are very dynamic, an adaptive assignment of authority for each member of the team is needed. This is achieved by designing a technology enabler, constituted by the intelligent and adaptive co-pilot. It comprises (1) a lateral shared controller based on NMPC, which applies the authority, (2) an arbitration module based on FIS, which calculates the authority, and (3) a visual HMI, as an enabler of trust in automation decisions and actions. The benefits of such a system are shown in this paper through a comparison of the shared control driving mode, with manual driving (as a baseline) and lane-keeping and lane-centering (as two commercial ADAS). Tests are performed in a use case where support for a distracted driver is given. Quantitative and qualitative results confirm the hypothesis that shared control offers the best balance between performance, safety, and comfort during the driving task.This research was supported by the ECSEL Joint-Undertaking,which funded the PRYSTINE project under the Grant 783190

MPC-Based Haptic Shared Steering System: A Driver Modeling Approach for Symbiotic Driving

Advanced Driver Assistance Systems (ADAS) aim to increase safety and reduce mental workload. However, the gap in the understanding of the closed-loop driver-vehicle interaction often leads to reduced user acceptance. In this study, an optimal torque control law is calculated online in the Model Predictive Control (MPC) framework to guarantee continuous guidance during the steering task. The research contribution is in the integration of an extensive prediction model covering cognitive behaviour, neuromuscular dynamics, and the vehicle- steering dynamics, within the MPC-based haptic controller to enhance collaboration. The driver model is composed of a preview cognitive strategy based on a Linear-Quadratic-Gaussian, sensory organs, and neuromuscular dynamics, including muscle co-activation and reflex action. Moreover, an adaptive cost-function algorithm enables dynamic allocation of the control authority. Experiments were performed in a fixed-base driving simulator at Toyota Motor Europe involving 19 participants to evaluate the proposed controller with two different cost functions against a commercial Lane Keeping Assist (LKA) system as an industry benchmark. The results demonstrate the proposed controller fosters symbiotic driving and reduces driver-vehicle conflicts with respect to a state-of-the-art commercial system, both subjectively and objectively, while still improving path-tracking performance. Summarising, this study tackles the need to blend human and ADAS control, demonstrating the validity of the proposed strategy