Federated Learning for Connected and Automated Vehicles: A Survey of Existing Approaches and Challenges

Machine learning (ML) is widely used for key tasks in Connected and Automated Vehicles (CAV), including perception, planning, and control. However, its reliance on vehicular data for model training presents significant challenges related to in-vehicle user privacy and communication overhead generated by massive data volumes. Federated learning (FL) is a decentralized ML approach that enables multiple vehicles to collaboratively develop models, broadening learning from various driving environments, enhancing overall performance, and simultaneously securing local vehicle data privacy and security. This survey paper presents a review of the advancements made in the application of FL for CAV (FL4CAV). First, centralized and decentralized frameworks of FL are analyzed, highlighting their key characteristics and methodologies. Second, diverse data sources, models, and data security techniques relevant to FL in CAVs are reviewed, emphasizing their significance in ensuring privacy and confidentiality. Third, specific and important applications of FL are explored, providing insight into the base models and datasets employed for each application. Finally, existing challenges for FL4CAV are listed and potential directions for future work are discussed to further enhance the effectiveness and efficiency of FL in the context of CAV

ConVeh: Driving Safely into a Connected Future

© 2017 The Authors. Published by Elsevier B.V. The loss of lives and damages to the property due to the vehicle crashes and road accidents have been an issue for long; a quarter of these accidents happen due to the adverse weather conditions. This paper presents the idea of cooperative driving technique for the drivers with the use of Connected Vehicles to minimize road accidents, traffic congestions, and to lessen, as far as possible, the effects of traffic on the environment and the loss of lives and economy. The frameworks for improving situational awareness and crash avoidance suggested hereby are vehicle-to-vehicle (V2V) and vehicle-to-infrastructure (V2I) data transmission systems. The research will primarily focus on the feasibility of CVs as applicable to the contemporary physical and virtual infrastructure and suggest the required adaptations, while the technical needs for the effective and successful implementation of a robust communication framework through the use of dedicated short-range communications (DSRC) will be discussed thereafter. Peer-review under responsibility of the Conference Program Chairs

Survey on LiDAR Perception in Adverse Weather Conditions

Autonomous vehicles rely on a variety of sensors to gather information about their surrounding. The vehicle's behavior is planned based on the environment perception, making its reliability crucial for safety reasons. The active LiDAR sensor is able to create an accurate 3D representation of a scene, making it a valuable addition for environment perception for autonomous vehicles. Due to light scattering and occlusion, the LiDAR's performance change under adverse weather conditions like fog, snow or rain. This limitation recently fostered a large body of research on approaches to alleviate the decrease in perception performance. In this survey, we gathered, analyzed, and discussed different aspects on dealing with adverse weather conditions in LiDAR-based environment perception. We address topics such as the availability of appropriate data, raw point cloud processing and denoising, robust perception algorithms and sensor fusion to mitigate adverse weather induced shortcomings. We furthermore identify the most pressing gaps in the current literature and pinpoint promising research directions.Comment: published at IEEE IV 202

Wrong Way Vehicle Detection in Single and Double Lane

Wrong-way driving is one of the primary causes of traffic jams and accidents globally. It is possible to identify vehicles going the wrong direction, which lessens accidents and traffic congestion. Surveillance footage has become an important source of data due to the accessibility of less priced cameras and the expanding use of real-time traffic management systems. In this paper, we propose a technique for automatically identifying automobiles moving against traffic. Our system uses the You Only Look Once (CNN) algorithm to recognize and track vehicles from video inputs and the centroid tracking method to determine each vehicle's orientation inside a given region of interest (ROI) in order to identify vehicles traveling in the wrong direction. It functions in three steps. The Deep sort tracking method is particularly good in detecting and tracking objects, and the centroid tracking technique can effectively monitor the direction of travel. Experiments with a variety of traffic films show that the suggested method can detect and identify wrong-way moving vehicles in a variety of lighting and weather scenarios. The interface of the system is quite simple and easy to use

Deep Learning for Safe Autonomous Driving: Current Challenges and Future Directions

[EN] Advances in information and signal processing technologies have a significant impact on autonomous driving (AD), improving driving safety while minimizing the efforts of human drivers with the help of advanced artificial intelligence (AI) techniques. Recently, deep learning (DL) approaches have solved several real-world problems of complex nature. However, their strengths in terms of control processes for AD have not been deeply investigated and highlighted yet. This survey highlights the power of DL architectures in terms of reliability and efficient real-time performance and overviews state-of-the-art strategies for safe AD, with their major achievements and limitations. Furthermore, it covers major embodiments of DL along the AD pipeline including measurement, analysis, and execution, with a focus on road, lane, vehicle, pedestrian, drowsiness detection, collision avoidance, and traffic sign detection through sensing and vision-based DL methods. In addition, we discuss on the performance of several reviewed methods by using different evaluation metrics, with critics on their pros and cons. Finally, this survey highlights the current issues of safe DL-based AD with a prospect of recommendations for future research, rounding up a reference material for newcomers and researchers willing to join this vibrant area of Intelligent Transportation Systems.This work was supported by Institute of Information & Communications Technology Planning & Evaluation (IITP) Grant funded by the Korea Government (MSIT) (2019-0-00136, Development of AI-Convergence Technologies for Smart City Industry Productivity Innovation); The work of Javier Del Ser was supported by the Basque Government through the EMAITEK and ELKARTEK Programs, as well as by the Department of Education of this institution (Consolidated Research Group MATHMODE, IT1294-19); VHCA received support from the Brazilian National Council for Research and Development (CNPq, Grant #304315/2017-6 and #430274/2018-1).Muhammad, K.; Ullah, A.; Lloret, J.; Del Ser, J.; De Albuquerque, VHC. (2021). Deep Learning for Safe Autonomous Driving: Current Challenges and Future Directions. IEEE Transactions on Intelligent Transportation Systems. 22(7):4316-4336. https://doi.org/10.1109/TITS.2020.30322274316433622

Generative AI-empowered Simulation for Autonomous Driving in Vehicular Mixed Reality Metaverses

In the vehicular mixed reality (MR) Metaverse, the distance between physical and virtual entities can be overcome by fusing the physical and virtual environments with multi-dimensional communications in autonomous driving systems. Assisted by digital twin (DT) technologies, connected autonomous vehicles (AVs), roadside units (RSU), and virtual simulators can maintain the vehicular MR Metaverse via digital simulations for sharing data and making driving decisions collaboratively. However, large-scale traffic and driving simulation via realistic data collection and fusion from the physical world for online prediction and offline training in autonomous driving systems are difficult and costly. In this paper, we propose an autonomous driving architecture, where generative AI is leveraged to synthesize unlimited conditioned traffic and driving data in simulations for improving driving safety and traffic efficiency. First, we propose a multi-task DT offloading model for the reliable execution of heterogeneous DT tasks with different requirements at RSUs. Then, based on the preferences of AV's DTs and collected realistic data, virtual simulators can synthesize unlimited conditioned driving and traffic datasets to further improve robustness. Finally, we propose a multi-task enhanced auction-based mechanism to provide fine-grained incentives for RSUs in providing resources for autonomous driving. The property analysis and experimental results demonstrate that the proposed mechanism and architecture are strategy-proof and effective, respectively

From fly-by-wire to drive-by-wire: Safety implications of automation in vehicles

The purpose of this paper is to critically review the current trend in automobile engineering toward automation of many of the functions previously performed by the driver. Working on the assumption that automation in aviation represents the basic model for driver automation, the costs and benefits of automation in aviation are explored as a means of establishing where automation of drivers' tasks are likely to yield benefits. It is concluded that there are areas where automation can provide benefits to the driver, but there are other areas where this is unlikely to be the case. Automation per se does not guarantee success, and therefore it becomes vital to involve Human Factors into design to identify where automation of driver functions can be allocated with a beneficial outcome for driving performance