Quantitative Performance Assessment of LiDAR-based Vehicle Contour Estimation Algorithms for Integrated Vehicle Safety Applications

Many nations and organizations are committing to achieving the goal of `Vision Zero\u27 and eliminate road traffic related deaths around the world. Industry continues to develop integrated safety systems to make vehicles safer, smarter and more capable in safety critical scenarios. Passive safety systems are now focusing on pre-crash deployment of restraint systems to better protect vehicle passengers. Current commonly used bounding box methods for shape estimation of crash partners lack the fidelity required for edge case collision detection and advanced crash modeling. This research presents a novel algorithm for robust and accurate contour estimation of opposing vehicles. The presented method is evaluated via a developed framework for key performance metrics and compared to alternative algorithms found in literature

Auto-sapiens autonomous driving vehicle

This paper presents the Auto-Sapiens project, an autonomous driving car developed by the Mechatronics and Vehicle Dynamics Lab, at Sapienza University of Rome. Auto-Sapiens is a technological platform to test and improve innovative control algorithms. The car platform is a standard car (Smart ForTwo) equipped with throttle, brake, steering actuators and different sensors for attitude identification and environment reconstruction. The first experiments of the Auto-Sapiens car test a new obstacle avoidance. The vehicle, controlled by an optimal variational feedback control, recently developed by the authors, includes the nonlinearities inherent in the car dynamics for better performances. Results show the effectiveness of the system in terms of safety and robustness of the avoidance maneuvers

Novel Validation Techniques for Autonomous Vehicles

L'abstract è presente nell'allegato / the abstract is in the attachmen

Novel Validation Techniques for Autonomous Vehicles

The automotive industry is facing challenges in producing electrical, connected, and autonomous vehicles. Even if these challenges are, from a technical point of view, independent from each other, the market and regulatory bodies require them to be developed and integrated simultaneously. The development of autonomous vehicles implies the development of highly dependable systems. This is a multidisciplinary activity involving knowledge from robotics, computer science, electrical and mechanical engineering, psychology, social studies, and ethics. Nowadays, many Advanced Driver Assistance Systems (ADAS), like Emergency Braking System, Lane Keep Assistant, and Park Assist, are available. Newer luxury cars can drive by themselves on highways or park automatically, but the end goal is to develop completely autonomous driving vehicles, able to go by themselves, without needing human interventions in any situation. The more vehicles become autonomous, the greater the difficulty in keeping them reliable. It enhances the challenges in terms of development processes since their misbehaviors can lead to catastrophic consequences and, differently from the past, there is no more a human driver to mitigate the effects of erroneous behaviors. Primary threats to dependability come from three sources: misuse from the drivers, design systematic errors, and random hardware failures. These safety threats are addressed under various aspects, considering the particular type of item to be designed. In particular, for the sake of this work, we analyze those related to Functional Safety (FuSa), viewed as the ability of a system to react on time and in the proper way to the external environment. From the technological point of view, these behaviors are implemented by electrical and electronic items. Various standards to achieve FuSa have been released over the years. The first, released in 1998, was the IEC 61508. Its last version is the one released in 2010. This standard defines mainly: • a Functional Safety Management System (FSMS); • methods to determine a Safety Integrated Level (SIL); • methods to determine the probability of failures. To adapt the IEC61508 to the automotive industry’s peculiarity, a newer standard, the ISO26262, was released in 2011 then updated in 2018. This standard provides guidelines about FSMS, called in this case Safety Lifecycle, describing how to develop software and hardware components suitable for functional safety. It also provides a different way to compute the SIL, called in this case Automotive SIL (ASIL), allowing us to consider the average driver’s abilities to control the vehicle in case of failures. Moreover, it describes a way to determine the probability of random hardware failures through Failure Mode, Effects, and Diagnostic Analysis (FMEDA). This dissertation contains contributions to three topics: • random hardware failures mitigation; • improvementoftheISO26262HazardAnalysisandRiskAssessment(HARA); • real-time verification of the embedded software. As the main contribution of this dissertation, I address the safety threats due to random hardware failures (RHFs). For this purpose, I propose a novel simulation-based approach to aid the Failure Mode, Effects, and Diagnostic Analysis (FMEDA) required by the ISO26262 standard. Thanks to a SPICE-level model of the item, and the adoption of fault injection techniques, it is possible to simulate its behaviors obtaining useful information to classify the various failure modes. The proposed approach evolved from a mere simulation of the item, allowing only an item-level failure mode classification up to a vehicle-level analysis. The propagation of the failure modes’ effects on the whole vehicle enables us to assess the impacts on the vehicle’s drivability, improving the quality of the classifications. It can be advantageous where it is difficult to predict how the item-level misbehaviors propagate to the vehicle level, as in the case of a virtual differential gear or the mobility system of a robot. It has been chosen since it can be considered similar to the novel light vehicles, such as electric scooters, that are becoming more and more popular. Moreover, my research group has complete access to its design since it is realized by our university’s DIANA students’ team. When a SPICE-level simulation is too long to be performed, or it is not possible to develop a complete model of the item due to intellectual property protection rules, it is possible to aid this process through behavioral models of the item. A simulation of this kind has been performed on a mobile robotic system. Behavioral models of the electronic components were used, alongside mechanical simulations, to assess the software failure mitigation capabilities. Another contribution has been obtained by modifying the main one. The idea was to make it possible to aid also the Hazard Analysis and Risk Assessment (HARA). This assessment is performed during the concept phase, so before starting to design the item implementation. Its goal is to determine the hazards involved in the item functionality and their associated levels of risk. The end goal of this phase is a list of safety goals. For each one of these safety goals, an ASIL has to be determined. Since HARA relies only on designers expertise and knowledge, it lacks in objectivity and repeatability. Thanks to the simulation results, it is possible to predict the effects of the failures on the vehicle’s drivability, allowing us to improve the severity and controllability assessment, thus improving the objectivity. Moreover, since simulation conditions can be stored, it is possible, at any time, to recheck the results and to add new scenarios, improving the repeatability. The third group of contributions is about the real-time verification of embedded software. Through Hardware-In-the-Loop (HIL), a software integration verification has been performed to test a fundamental automotive component, mixed-criticality applications, and multi-agent robots. The first of these contributions is about real-time tests on Body Control Modules (BCM). These modules manage various electronic accessories in the vehicle’s body, like power windows and mirrors, air conditioning, immobilizer, central locking. The main characteristics of BCMs are the communications with other embedded computers via the car’s vehicle bus (Controller Area Network) and to have a high number (hundreds) of low-speed I/Os. As the second contribution, I propose a methodology to assess the error recovery system’s effects on mixed-criticality applications regarding deadline misses. The system runs two tasks: a critical airplane longitudinal control and a non-critical image compression algorithm. I start by presenting the approach on a benchmark application containing an instrumented bug into the lower criticality task; then, we improved it by injecting random errors inside the lower criticality task’s memory space through a debugger. In the latter case, thanks to the HIL, it is possible to pause the time domain simulation when the debugger operates and resume it once the injection is complete. In this way, it is possible to interact with the target without interfering with the simulation results, combining a full control of the target with an accurate time-domain assessment. The last contribution of this third group is about a methodology to verify, on multi-agent robots, the synchronization between two agents in charge to move the end effector of a delta robot: the correct position and speed of the end effector at any time is strongly affected by a loss of synchronization. The last two contributions may seem unrelated to the automotive industry, but interest in these applications is gaining. Mixed-criticality systems allow reducing the number of ECUs inside cars (for cost reduction), while the multi-agent approach is helpful to improve the cooperation of the connected cars with respect to other vehicles and the infrastructure. The fourth contribution, contained in the appendix, is about a machine learning application to improve the social acceptance of autonomous vehicles. The idea is to improve the comfort of the passengers by recognizing their emotions. I started with the idea to modify the vehicle’s driving style based on a real-time emotions recognition system but, due to the difficulties of performing such operations in an experimental setup, I move to analyze them offline. The emotions are determined on volunteers’ facial expressions recorded while viewing 3D representa- tions showing different calibrations. Thanks to the passengers’ emotional responses, it is possible to choose the better calibration from the comfort point of view

A systematic literature review on the relationship between autonomous vehicle technology and traffic-related mortality.

학위논문(석사) -- 서울대학교대학원 : 행정대학원 글로벌행정전공, 2023. 2. 최태현.The society is anticipated to gain a lot from Autonomous Vehicles (AV), such as improved traffic flow and a decrease in accidents. They heavily rely on improvements in various Artificial Intelligence (AI) processes and strategies. Though some researchers in this field believe AV is the key to enhancing safety, others believe AV creates new challenges when it comes to ensuring the security of these new technology/systems and applications. The article conducts a systematic literature review on the relationship between autonomous vehicle technology and traffic-related mortality. According to inclusion and exclusion criteria, articles from EBSCO, ProQuest, IEEE Explorer, Web of Science were chosen, and they were then sorted. The findings reveal that the most of these publications have been published in advanced transport-related journals. Future improvements in the automobile industry and the development of intelligent transportation systems could help reduce the number of fatal traffic accidents. Technologies for autonomous cars provide effective ways to enhance the driving experience and reduce the number of traffic accidents. A multitude of driving-related problems, such as crashes, traffic, energy usage, and environmental pollution, will be helped by autonomous driving technology. More research is needed for the significant majority of the studies that were assessed. They need to be expanded so that they can be tested in real-world or computer-simulated scenarios, in better and more realistic scenarios, with better and more data, and in experimental designs where the results of the proposed strategy are compared to those of industry standards and competing strategies. Therefore, additional study with improved methods is needed. Another major area that requires additional research is the moral and ethical choices made by AVs. Government, policy makers, manufacturers, and designers all need to do many actions in order to deploy autonomous vehicles on the road effectively. The government should develop laws, rules, and an action plan in particular. It is important to create more effective programs that might encourage the adoption of emerging technology in transportation systems, such as driverless vehicles. In this regard, user perception becomes essential since it may inform designers about current issues and observations made by people. The perceptions of autonomous car users in developing countries like Azerbaijan haven't been thoroughly studied up to this point. The manufacturer has to fix the system flaw and needs a good data set for efficient operation. In the not-too-distant future, the widespread use of highly automated vehicles (AVs) may open up intriguing new possibilities for resolving persistent issues in current safety-related research. Further research is required to better understand and quantify the significant policy implications of Avs, taking into consideration factors like penetration rate, public adoption, technological advancements, traffic patterns, and business models. It only needs to take into account peer-reviewed, full-text journal papers for the investigation, but it's clear that a larger database and more documents would provide more results and a more thorough analysis.자율주행차(AV)를 통해 교통 흐름이 개선되고 사고가 줄어드는 등 사회가 얻는 것이 많을 것으로 예상된다. 그들은 다양한 인공지능(AI) 프로세스와 전략의 개선에 크게 의존한다. 이 분야의 일부 연구자들은 AV가 안전성을 향상시키는 열쇠라고 믿지만, 다른 연구자들은 AV가 이러한 새로운 기술/시스템 및 애플리케이션의 보안을 보장하는 것과 관련하여 새로운 문제를 야기한다고 믿는다. 이 논문은 자율주행차 기술과 교통 관련 사망률 사이의 관계에 대한 체계적인 문헌 검토를 수행한다. 포함 및 제외 기준에 따라 EBSCO, ProQuest, IEEE Explorer 및 Web of Science의 기사를 선택하고 분류했다.연구 결과는 이러한 출판물의 대부분이 고급 운송 관련 저널에 게재되었음을 보여준다. 미래의 자동차 산업의 개선과 지능형 교통 시스템의 개발은 치명적인 교통 사고의 수를 줄이는 데 도움이 될 수 있다. 자율주행 자동차 기술은 운전 경험을 향상시키고 교통 사고의 수를 줄일 수 있는 효과적인 방법을 제공한다. 충돌, 교통, 에너지 사용, 환경 오염과 같은 수많은 운전 관련 문제들은 자율 주행 기술에 의해 도움을 받을 것이다. 평가된 대부분의 연구에 대해 더 많은 연구가 필요하다. 실제 또는 컴퓨터 시뮬레이션 시나리오, 더 좋고 현실적인 시나리오, 더 좋고 더 많은 데이터, 그리고 제안된 전략 결과가 산업 표준 및 경쟁 전략의 결과와 비교되는 실험 설계에서 테스트될 수 있도록 확장되어야 한다. 따라서 개선된 방법에 대한 추가 연구가 필요하다. 추가 연구가 필요한 또 다른 주요 분야는 AV의 도덕적, 윤리적 선택이다. 정부, 정책 입안자, 제조업체 및 설계자는 모두 자율 주행 차량을 효과적으로 도로에 배치하기 위해 많은 조치를 취해야 한다. 정부는 특히 법, 규칙, 실행 계획을 개발해야 한다. 운전자 없는 차량과 같은 운송 시스템에서 새로운 기술의 채택을 장려할 수 있는 보다 효과적인 프로그램을 만드는 것이 중요하다. 이와 관련하여, 설계자에게 현재 이슈와 사람에 의한 관찰을 알려줄 수 있기 때문에 사용자 인식이 필수적이 된다.제조업체는 시스템 결함을 수정해야 하며 효율적인 작동을 위해 좋은 데이터 세트가 필요하다. 멀지 않은 미래에, 고도로 자동화된 차량(AV)의 광범위한 사용은 현재의 안전 관련 연구에서 지속적인 문제를 해결하기 위한 흥미로운 새로운 가능성을 열어줄 수 있다. 보급률, 공공 채택, 기술 발전, 교통 패턴 및 비즈니스 모델과 같은 요소를 고려하여 Avs의 중요한 정책 영향을 더 잘 이해하고 정량화하기 위한 추가 연구가 필요하다. 조사를 위해 동료 검토를 거친 전문 저널 논문만 고려하면 되지만, 데이터베이스가 커지고 문서가 많아지면 더 많은 결과와 더 철저한 분석이 제공될 것이 분명하다.Abstract 3 Table of Contents 6 List of Tables 7 List of Figures 7 List of Appendix 7 CHAPTER 1: INTRODUCTION 8 1.1. Background 8 1.2. Purpose of Research 13 CHAPTER 2: AUTONOMOUS VEHICLES 21 2.1. Intelligent Traffic Systems 21 2.2. System Architecture for Autonomous Vehicles 22 2.3. Key components in AV classification 27 CHAPTER 3: METHODOLOGY AND DATA COLLECTION PROCEDURE 35 CHAPTER 4: FINDINGS AND DISCUSSION 39 4.1. RQ1: Do autonomous vehicles reduce traffic-related deaths 40 4.2. RQ2: Are there any challenges to using autonomous vehicles 63 4.3. RQ3: As a developing country, how effective is the use of autonomous vehicles for reducing traffic mortality 72 CHAPTER 5: CONCLUSION 76 5.1. Summary 76 5.2. Implications and Recommendations 80 5.3. Limitation of the study 91 Bibliography 93 List of Tables Table 1: The 6 Levels of Autonomous Vehicles Table 2: Search strings Table 3: Inclusion and exclusion criteria List of Figures Figure 1: Traffic Death Comparison with Europe Figure 2: Research strategy and study selection process List of Appendix Appendix 1: List of selected articles석

차량간 통신을 이용한 지능형 자동차의 전방차량 위험판단 기법

학위논문 (박사)-- 서울대학교 대학원 공과대학 기계항공공학부, 2017. 8. 이경수.In recent years, advanced driver assistance systems or highly automated driving systems are expected to enhance road traffic safety, transport efficiency, and driver comfort. Practical applications have become possible due to recent advances in vehicle local sensors and inter vehicle communications. These advances have opened up many possibilities for active safety systems to be more intelligent and robust. The further enhancement of these technologies can be utilized as a risk assessment system of automated drive. This dissertation presents a risk assessment for improved vehicle safety using Front Vehicle Dynamic States through vehicle-to-vehicle wireless communication. A vehicle-to-vehicle wireless communication (V2V communication) has been implemented and fused with a radar sensor to obtain the prediction of remote vehicles motion. Based on the predicted behavior of remote vehicles, a collision risk and a human reaction time are determined for a better driver acceptance and active safety control intervention. A human-centered risk assessment using the V2V communication has been incorporated into a collision avoidance algorithm to monitor threat vehicles ahead and to find the best intervention point. The performance of the proposed algorithm has been investigated via computer simulations and vehicle tests for application to urban and highway driving situation. It has been shown from both simulations and vehicle tests that the proposed integrated risk assessment algorithm with the V2V communication can be beneficial to active safety systems in decision of controller intervention moment and in control of automated drive for the guaranteed safety.Chapter 1 Introduction 1 1.1 Background and Motivations 1 1.2 Previous Researches 5 1.3 Thesis Objectives 9 1.4 Thesis Outline 11 Chapter 2 Vehicular Communication 12 2.1. Literature Review 14 2.1.1 An Empirical Model for V2V communication 14 2.1.2 Position based Sampling and Distance based Interpolation 17 2.2. Communication Delay and Packet Loss Ratio 21 2.2.1 Compensation of V2V Communication Delay 21 Chapter 3 Human Factor Considerations 27 3.1. Driver Acceptance 30 3.1.1 Driver inattention and distraction 31 3.1.2 Mode Confusion 31 3.1.3 Motion Sickness 32 3.2. Sight Distance 33 3.2.1 Stopping Sight Distance 35 3.2.2 Decision Sight Distance 35 Chapter 4 Human-Centered Risk Assessment using Vehicular Wireless Communication 37 4.1. Human-Centered Design 41 4.2. Convergence 43 4.2.1. Sensor-Based Solutions 44 4.2.2. The Benefits to Convergence 45 4.2.3. V2V/Radar Information Fusion 45 4.3. Related Work 46 4.3.1. Radar Sensing Characteristics 47 4.3.2. Probabilistic Threat Assessment 50 4.3.3. Human-Centered Vehicle Control 52 4.3.4. High-Level Information Fusion 54 4.3.5. Target Vehicle State Estimation Performance 58 4.4 Remote Vehicle States Prediction 64 4.5. Collision Risk Analysis 67 4.6. Predicted Collision Distance 70 4.7. Active Safety Intervention Moment Decision 72 Chapter 5 Performance Evaluations 77 5.1. Simulations: MPC based Automated Vehicle Control 78 5.1.1. Effects of V2V Communication on the Controller 78 5.2. Simulations : Human-Centered Risk Assessment 84 5.2.1. Scenarios 84 5.2.2. Effects of V2V Communication: Host vehicle perception only 86 5.2.3. Effects of V2V Communication: Controlled host vehicle 90 5.3. Vehicle Tests 94 5.3.1. Test Vehicle Configuration and Scenario 94 5.3.2. Implementation and Evaluation 96 Chapter 6 Conclusion 99 Bibliography 100 국문초록 110Docto

Performance of Sensor Fusion for Vehicular Applications

Sensor fusion is a key system in Advanced Driver Assistance Systems, ADAS. The perfor-mance of the sensor fusion depends on many factors such as the sensors used, the kinematicmodel used in the Extended Kalman Filter, EKF, the motion of the vehicles, the type ofroad, the density of vehicles, and the gating methods. The interactions between parametersand the extent to which individual parameters contribute to the overall accuracy of a sensorfusion system can be difficult to assess.In this study, a full-factorial experimental evaluation of a sensor fusion system basedon a real vehicle was performed. The experimental results for different driving scenariosand parameters are discussed and the factors that make the most impact are identified.The performance of sensor fusion depends on many factors such as the sensors used, thekinematic model used in the Extended Kalman Filter (EKF) motion of the vehicles, type ofroad, density of vehicles, and gating methods.This study identified that the distance between the vehicles has the largest impact on theestimation error because the vision sensor performs poorly with increased distance. In addi-tion, it was identified that the kinematic models had no significant impact on the estimation.Last but not least, the ellipsoid gates performed better than rectangular gates.In addition, we propose a new gating algorithm called an angular gate. This algorithmis based on the observation that the data for each target lies in the direction of that target.Therefore, the angle and the range can be used for setting up a two-level gating approachthat is both more intuitive and computationally faster than ellipsoid gates. The angulargates can achieve a speedup factor of up to 2.27 compared to ellipsoid gates.Furthermore, we provide time complexity analysis of angular gates, ellipsoid gates, andrectangular gates demonstrating the theoretical reasons why angular gates perform better.Last, we evaluated the performance of the Munkres algorithm using a full factorial designand identified that narrower gates can speedup the running time of the Munkres algorithmand, surprisingly, even improve the RMSE in some cases.The low target maneuvering index of vehicular systems was identified as the reason whythe kinematic models do not have an impact on the estimation. This finding supports the useof simpler and computationally inexpensive filters instead of complex Interacting MultipleModel filters. The angular gates also improve the computational efficiency of the overallsensor fusion system making them suitable for vehicular application as well as for embeddedsystems and robotics

Localization and 2D Mapping Using Low-Cost Lidar

Autonomous vehicles are expected to make a profound change in auto industry. An autonomous vehicle is a vehicle that is able to sense its surroundings and travel with little or no human intervention. The four key capabilities of autonomous vehicles are a comprehensive understanding of sensor data, knowledge of their positions in the world, building the map of unknown environment, as well as following the planed route and collision avoidance. This thesis is aimed at building a low-cost autonomous vehicle prototype that is capable of localization and 2D mapping simultaneously. In addition, the prototype should be able to detect obstacles and avoid collision. In this thesis, a Redbot is utilized as a moving vehicle to evaluate collision avoidance functionality. A mechnical bumper in front of the Redbot is used to detect obstacles, and a remote user can send appropriate commands to control the Redbot via Zigbee network, then Redbot acts accordingly, including driving straightly, changing direction to right or left, and stop. Redbot are also used to carry the lidar scanner which consists of Lidar Lite V3 and a servo motor. Lidar data are sent back to a Laptop running ROS via Zigbee network. In ROS, Hector SLAM metapackage is adopted to process the lidar data, and realize the functionality of simultaneous localization and 2D mapping. After implementing the autonomous vehicle prototype, a series of tests are con- ducted to evaluate the functionality of localization, 2D mapping, obstacle detection, and collision avoidance. The results demonstrated that the prototype is capable of building usable 2D maps of unknown environment, simultaneous localization, obstacle detection and collision avoidance in time. Due to the limited scan range of the low-cost lidar scanner, boundary missing problem can happen. This limitation can be solved through the use of a lidar scanner with larger scan range

Design and evaluation of safety-critical applications based on inter-vehicle communication

Inter-vehicle communication has a potential to improve road traffic safety and efficiency. Technical feasibility of communication between vehicles has been extensively studied, but due to the scarcity of application-level research, communication\u27s impact on the road traffic is still unclear. This thesis addresses this uncertainty by designing and evaluating two fail-safe applications, namely, Rear-End Collision Avoidance and Virtual Traffic Lights

A Survey on Modelling of Automotive Radar Sensors for Virtual Test and Validation of Automated Driving

Radar sensors were among the first perceptual sensors used for automated driving. Although several other technologies such as lidar, camera, and ultrasonic sensors are available, radar sensors have maintained and will continue to maintain their importance due to their reliability in adverse weather conditions. Virtual methods are being developed for verification and validation of automated driving functions to reduce the time and cost of testing. Due to the complexity of modelling high-frequency wave propagation and signal processing and perception algorithms, sensor models that seek a high degree of accuracy are challenging to simulate. Therefore, a variety of different modelling approaches have been presented in the last two decades. This paper comprehensively summarises the heterogeneous state of the art in radar sensor modelling. Instead of a technology-oriented classification as introduced in previous review articles, we present a classification of how these models can be used in vehicle development by using the V-model originating from software development. Sensor models are divided into operational, functional, technical, and individual models. The application and usability of these models along the development process are summarised in a comprehensive tabular overview, which is intended to support future research and development at the vehicle level and will be continuously updated