215 research outputs found

    Image Filtering Techniques for Object Recognition in Autonomous Vehicles

    Get PDF
    The deployment of autonomous vehicles has the potential to significantly lessen the variety of current harmful externalities, (such as accidents, traffic congestion, security, and environmental degradation), making autonomous vehicles an emerging topic of research. In this paper, a literature review of autonomous vehicle development has been conducted with a notable finding that autonomous vehicles will inevitably become an indispensable future greener solution. Subsequently, 5 different deep learning models, YOLOv5s, EfficientNet-B7, Xception, MobilenetV3, and InceptionV4, have been built and analyzed for 2-D object recognition in the navigation system. While testing on the BDD100K dataset, YOLOv5s and EfficientNet-B7 appear to be the two best models. Finally, this study has proposed Hessian, Laplacian, and Hessian-based Ridge Detection filtering techniques to optimize the performance and sustainability of those 2 models. The results demonstrate that these filters could increase the mean average precision by up to 11.81%, reduce detection time by up to 43.98%, and significantly reduce energy consumption by up to 50.69% when applied to YOLOv5s and EfficientNet-B7 models. Overall, all the experiment results are promising and could be extended to other domains for semantic understanding of the environment. Additionally, various filtering algorithms for multiple object detection and classification could be applied to other areas. Different recommendations and future work have been clearly defined in this study

    Advances and Applications of DSmT for Information Fusion. Collected Works, Volume 5

    Get PDF
    This fifth volume on Advances and Applications of DSmT for Information Fusion collects theoretical and applied contributions of researchers working in different fields of applications and in mathematics, and is available in open-access. The collected contributions of this volume have either been published or presented after disseminating the fourth volume in 2015 in international conferences, seminars, workshops and journals, or they are new. The contributions of each part of this volume are chronologically ordered. First Part of this book presents some theoretical advances on DSmT, dealing mainly with modified Proportional Conflict Redistribution Rules (PCR) of combination with degree of intersection, coarsening techniques, interval calculus for PCR thanks to set inversion via interval analysis (SIVIA), rough set classifiers, canonical decomposition of dichotomous belief functions, fast PCR fusion, fast inter-criteria analysis with PCR, and improved PCR5 and PCR6 rules preserving the (quasi-)neutrality of (quasi-)vacuous belief assignment in the fusion of sources of evidence with their Matlab codes. Because more applications of DSmT have emerged in the past years since the apparition of the fourth book of DSmT in 2015, the second part of this volume is about selected applications of DSmT mainly in building change detection, object recognition, quality of data association in tracking, perception in robotics, risk assessment for torrent protection and multi-criteria decision-making, multi-modal image fusion, coarsening techniques, recommender system, levee characterization and assessment, human heading perception, trust assessment, robotics, biometrics, failure detection, GPS systems, inter-criteria analysis, group decision, human activity recognition, storm prediction, data association for autonomous vehicles, identification of maritime vessels, fusion of support vector machines (SVM), Silx-Furtif RUST code library for information fusion including PCR rules, and network for ship classification. Finally, the third part presents interesting contributions related to belief functions in general published or presented along the years since 2015. These contributions are related with decision-making under uncertainty, belief approximations, probability transformations, new distances between belief functions, non-classical multi-criteria decision-making problems with belief functions, generalization of Bayes theorem, image processing, data association, entropy and cross-entropy measures, fuzzy evidence numbers, negator of belief mass, human activity recognition, information fusion for breast cancer therapy, imbalanced data classification, and hybrid techniques mixing deep learning with belief functions as well

    Topology Reasoning for Driving Scenes

    Full text link
    Understanding the road genome is essential to realize autonomous driving. This highly intelligent problem contains two aspects - the connection relationship of lanes, and the assignment relationship between lanes and traffic elements, where a comprehensive topology reasoning method is vacant. On one hand, previous map learning techniques struggle in deriving lane connectivity with segmentation or laneline paradigms; or prior lane topology-oriented approaches focus on centerline detection and neglect the interaction modeling. On the other hand, the traffic element to lane assignment problem is limited in the image domain, leaving how to construct the correspondence from two views an unexplored challenge. To address these issues, we present TopoNet, the first end-to-end framework capable of abstracting traffic knowledge beyond conventional perception tasks. To capture the driving scene topology, we introduce three key designs: (1) an embedding module to incorporate semantic knowledge from 2D elements into a unified feature space; (2) a curated scene graph neural network to model relationships and enable feature interaction inside the network; (3) instead of transmitting messages arbitrarily, a scene knowledge graph is devised to differentiate prior knowledge from various types of the road genome. We evaluate TopoNet on the challenging scene understanding benchmark, OpenLane-V2, where our approach outperforms all previous works by a great margin on all perceptual and topological metrics. The code would be released soon

    Methodology for Specifying and Testing Traffic Rule Compliance for Automated Driving

    Get PDF
    The introduction of highly-automated driving functions promises to increase safety and comfort, but the safety validation remains an unsolved challenge. Here, the requirement is that the introduction does not reduce safety on public roads. This dissertation addresses one major aspect of road safety: traffic rule compliance. Even an automated vehicle must comply with existing traffic rules. The developed method enables automated testing of traffic rule compliance of automated driving functions. In the first part of the thesis, the state of the art for describing and formalizing behavioral rules is analyzed. A special challenge is posed by the different traffic rules depending on the traffic region. With existing approaches, a separate description and formalization of the behavior rules is necessary for each traffic region or even for individual traffic areas. This shows the necessity to develop new approaches for the abstraction and transferability of the behavioral rules in order to reduce the effort of testing and ensuring traffic rule compliance. The rule compliance criteria are to be integrated into the behavior specification within the functional specification. The objective of this thesis is to develop a method to formalize the limits of traffic rule compliance, based on which fail criteria for system testing are defined and applied. For this purpose, existing traffic rules are analyzed as a basis to identify which behavior constraints are imposed by the static traffic environment. Based on this, a semantic description that is transferable between traffic domains and that links the boundaries of traffic rule compliance to the static traffic environment is developed. The method involves deriving behavioral attributes from which the semantic behavior description is constructed. These behavioral attributes construct the behavior space that describes the boundaries of legally allowed behavior. Furthermore, methods for automated derivation of behavioral attributes from high definition maps are developed, thus extracting the behavioral requirement from an operational design domain. It is investigated which functionalities an automated vehicle has to provide to comply with the behavioral attributes. The attributes are then formalized to obtain quantifiable failure criteria of traffic rule compliance that can be used in automated testing. Finally, building on the state of the art, a test strategy for validating traffic rule conformance is presented. The explicit availability of the behavioral limits results in an advantage in the influence analysis of possible parameters for these tests. Finally, the developed method is applied to existing map material and to test drives with an automated vehicle prototype in order to investigate the practical applicability of the approach as well as the resulting gain in knowledge about traffic rule compliance testing. The developed approach allows to derive the behavioral specification with respect to traffic rule conformance as an essential part of the functional specification independent of the application domain. It is proven that the approach is able to test the traffic rule conformance of an automated vehicle in different test scenarios within an application domain. By applying the developed methodology, it was possible to identify defects in the investigated test vehicle with respect to rule understanding and compliance

    Conditional Behavior Prediction of Interacting Agents on Map Graphs with Neural Networks

    Get PDF
    Solange Verkehrsteilnehmer ihre Manöverabsicht und ihre geplante Trajektorie automatischen Fahrzeugen nicht mitteilen können, ist eine Verhaltensvorhersage für alle beteiligten Verkehrsteilnehmer erforderlich. Mit einer solchen Vorhersage kann das Verhalten eines automatischen Fahrzeugs vorausschauend generiert und damit komfortabler und energieeffizienter gemacht werden, was den Verkehrsfluss verbessert. Es wird ein künstliches neuronales Netz für Graphen (GNN) vorgestellt, das verschiedene probabilistische Positionsvorhersagen für interagierende Agenten zur Analyse bereitstellt. Das vorliegende Anwendungsbeispiel ist die Verkehrssituationsanalyse für das automatische Fahren, für welches ein diskretisierter Vorhersagezeitraum von einigen Sekunden als relevant angesehen wird. Das GNN propagiert einen vollvernetzten, gerichteten Agentengraphen probabilistisch durch einen dünnvernetzten, gerichteten Kartengraphen. Merkmale des Agentengraphen, der aus Verkehrsteilnehmern und deren Beziehungen besteht, sowie Merkmale des Kartengraphen, der aus Fahrbahnstücken und deren geometrischer, sowie verkehrsregelbezogenen Verbindungen besteht, können für die Vorhersage verwertet werden. Das Modell prädiziert für jeden Agenten zu jedem Prädiktionszeitpunkt eine diskrete Aufenthaltswahrscheinlichkeitsverteilung über alle Fahrbahnstücke des Kartengraphen. Eine solche Prädiktion ist in der wissenschaftlichen Literatur zwar üblich, setzt aber für deren stochastische Interpretierbarkeit und damit Anwendbarkeit statistische Unabhängigkeit des zukünftigen Verhaltens der Verkehrsteilnehmer voraus. Da diese Annahme bei interagierenden Agenten als unzulässig erachtet wird, prädiziert das Modell darüber hinaus für alle Agentenpaare diskrete Verbundwahrscheinlichkeitsverteilungen. Aus diesen können bedingte Prädiktionen gegeben möglicher zukünftiger Positionen einer der beiden Agenten berechnet werden. In der Evaluierung werden gängige Metriken für den vorliegenden Fall angepasst und verschiedene Modellierungstiefen einander gegenübergestellt. Sowohl die individuelle Prädiktion als auch die bedingte Prädiktion werden erfolgreich auf Genauigkeit und statistischer Zuverlässigkeit untersucht

    Milestones in Autonomous Driving and Intelligent Vehicles Part II: Perception and Planning

    Full text link
    Growing interest in autonomous driving (AD) and intelligent vehicles (IVs) is fueled by their promise for enhanced safety, efficiency, and economic benefits. While previous surveys have captured progress in this field, a comprehensive and forward-looking summary is needed. Our work fills this gap through three distinct articles. The first part, a "Survey of Surveys" (SoS), outlines the history, surveys, ethics, and future directions of AD and IV technologies. The second part, "Milestones in Autonomous Driving and Intelligent Vehicles Part I: Control, Computing System Design, Communication, HD Map, Testing, and Human Behaviors" delves into the development of control, computing system, communication, HD map, testing, and human behaviors in IVs. This part, the third part, reviews perception and planning in the context of IVs. Aiming to provide a comprehensive overview of the latest advancements in AD and IVs, this work caters to both newcomers and seasoned researchers. By integrating the SoS and Part I, we offer unique insights and strive to serve as a bridge between past achievements and future possibilities in this dynamic field.Comment: 17pages, 6figures. IEEE Transactions on Systems, Man, and Cybernetics: System

    Interpretable and verifiable planning and prediction for autonomous vehicles

    Get PDF
    Autonomous driving (AD) has gained much attention in recent years due to its many potential benefits such as improving safety and increasing efficiency. However, AD is a difficult problem with challenges such as handling interactions with other vehicles and predicting the future behaviour of human drivers. This often takes place in complicated urban environments where information is missing due to occlusions. AD methods must also be accurate and effective while still being efficient enough to run in real time. In this thesis, several novel AD methods are presented which contribute towards solving some of the problems of AD. In particular, the focus is on planning, prediction and goal recognition (GR) methods which are interpretable by humans and formally verifiable. Interpretability can increase user trust of AD systems and aid with debugging issues with such systems. Having the ability to formally verify propositions made about AD methods can help ensure safety and compliance with regulations. The first novel method is Interpretable Goal-based Prediction and Planning (IGP2) which integrates GR through inverse planning with Monte Carlo tree search (MCTS) to achieve a full planning and prediction system. IGP2 is evaluated in several urban driving scenarios and is shown to successfully recognise other vehicle's goals and improve driving efficiency. The second method is Goal Recognition with Interpretable Trees (GRIT). GRIT makes use of learned decision trees trained to infer a probability distribution over the goals of other vehicles. An evaluation across two vehicle trajectory datasets shows that the inference process of GRIT is fast, accurate, interpretable and verifiable. The third method is Goal Recognition with Interpretable Trees under Occlusion (OGRIT). Similarly to GRIT, OGRIT makes use of learned decision trees for GR. Through an evaluation across two vehicle trajectory datasets with significant occlusions, OGRIT is also shown to handle information missing due to occlusions and can make inferences across multiple scenarios using the same learned models, while still remaining fast, accurate, interpretable and verifiable. This thesis contributes three novel methods which work towards allowing autonomous vehicles to accurately and efficiently infer the goals of other vehicles in complex, partially occluded urban environments, and then predict their future behaviour and plan accordingly

    Self-Localization for Autonomous Driving Using Vector Maps and Multi-Modal Odometry

    Get PDF
    One of the fundamental requirements in automated driving is having accurate vehicle localization. It is because different modules such as motion planning and control require accurate location and heading of the ego-vehicle to navigate within the drivable region safely. Global Navigation Satellite Systems (GNSS) can provide the geolocation of the vehicle in different outdoor environments. However, they suffer from poor observability and even signal loss in GNSS-denied environments such as city canyons. Map-based self-localization systems are the other tools to estimate the pose of the vehicle in known environments. The main purpose of this research is to design a real-time self-localization system for autonomous driving. To provide short-term constraints over the self-localization system a multi-modal vehicle odometry algorithm is developed that fuses an Inertial Measurement Unit (IMU), a camera, a Lidar, and a GNSS through an Error-State Kalman Filter (ESKF). Additionally, a Machine-Learning (ML)-based odometry algorithm is developed to compensate for the self-localization unavailability through kernel-based regression models that fuse IMU, encoders, and a steering sensor along with recent historical measurement data. The simulation and experimental results demonstrate that the vehicle odometry can be estimated with good accuracy. Based on the main objective of the thesis, a novel computationally efficient self-localization algorithm is developed that uses geospatial information from High-Definition (HD) maps along with observation of nearby landmarks. This approach uses situation- and uncertainty-aware attention mechanisms to select “suitable” landmarks at any drivable location within the known environment based on their observability and level of uncertainty. By using landmarks that are invariant to seasonal changes and knowing “where to look” proactively, robustness and computational efficiency are improved. The developed localization system is implemented and experimentally evaluated on WATonoBus, the University of Waterloo's autonomous shuttle. The experimental results confirm excellent computational efficiency and good accuracy
    corecore