Ontology based Scene Creation for the Development of Automated Vehicles

The introduction of automated vehicles without permanent human supervision demands a functional system description, including functional system boundaries and a comprehensive safety analysis. These inputs to the technical development can be identified and analyzed by a scenario-based approach. Furthermore, to establish an economical test and release process, a large number of scenarios must be identified to obtain meaningful test results. Experts are doing well to identify scenarios that are difficult to handle or unlikely to happen. However, experts are unlikely to identify all scenarios possible based on the knowledge they have on hand. Expert knowledge modeled for computer aided processing may help for the purpose of providing a wide range of scenarios. This contribution reviews ontologies as knowledge-based systems in the field of automated vehicles, and proposes a generation of traffic scenes in natural language as a basis for a scenario creation.Comment: Accepted at the 2018 IEEE Intelligent Vehicles Symposium, 8 pages, 10 figure

Kalibrierung mobiler Multikamerasysteme mit disjunkten Sichtfeldern

Die Arbeit beschreibt ein bildgestütztes Verfahren zur extrinsischen Kalibrierung eines Multikamerasystems mit nichtüberlappenden Sichten auf einer mobilen Plattform. Die Kalibrierung basiert auf der geschätzten Kamerabewegung, da in den Kameras keine gemeinsamen Bezugspunkte beobachtbar sind. Die Schätzung der Parameter erfolgt kontinuierlich und ist in ein skalierbares Fusionsschema eingebettet. Die Funktionsfähigkeit des Verfahrens wurde mit simulierten sowie reellen Daten untersucht

A Knowledge-based Approach for Creating Detailed Landscape Representations by Fusing GIS Data Collections with Associated Uncertainty

Geographic Information Systems (GIS) data for a region is of different types and collected from different sources, such as aerial digitized color imagery, elevation data consisting of terrain height at different points in that region, and feature data consisting of geometric information and properties about entities above/below the ground in that region. Merging GIS data and understanding the real world information present explicitly or implicitly in that data is a challenging task. This is often done manually by domain experts because of their superior capability to efficiently recognize patterns, combine, reason, and relate information. When a detailed digital representation of the region is to be created, domain experts are required to make best-guess decisions about each object. For example, a human would create representations of entities by collectively looking at the data layers, noting even elements that are not visible, like a covered overpass or underwater tunnel of a certain width and length. Such detailed representations are needed for use by processes like visualization or 3D modeling in applications used by military, simulation, earth sciences and gaming communities. Many of these applications are increasingly using digitally synthesized visuals and require detailed digital 3D representations to be generated quickly after acquiring the necessary initial data. Our main thesis, and a significant research contribution of this work, is that this task of creating detailed representations can be automated to a very large extent using a methodology which first fuses all Geographic Information System (GIS) data sources available into knowledge base (KB) assertions (instances) representing real world objects using a subprocess called GIS2KB. Then using reasoning, implicit information is inferred to define detailed 3D entity representations using a geometry definition engine called KB2Scene. Semantic Web is used as the semantic inferencing system and is extended with a data extraction framework. This framework enables the extraction of implicit property information using data and image analysis techniques. The data extraction framework supports extraction of spatial relationship values and attribution of uncertainties to inferred details. Uncertainty is recorded per property and used under Zadeh fuzzy semantics to compute a resulting uncertainty for inferred assertional axioms. This is achieved by another major contribution of our research, a unique extension of the KB ABox Realization service using KB explanation services. Previous semantics based research in this domain has concentrated more on improving represented details through the addition of artifacts like lights, signage, crosswalks, etc. Previous attempts regarding uncertainty in assertions use a modified reasoner expressivity and calculus. Our work differs in that separating formal knowledge from data processing allows fusion of different heterogeneous data sources which share the same context. Imprecision is modeled through uncertainty on assertions without defining a new expressivity as long as KB explanation services are available for the used expressivity. We also believe that in our use case, this simplifies uncertainty calculations. The uncertainties are then available for user-decision at output. We show that the process of creating 3D visuals from GIS data sources can be more automated, modular, verifiable, and the knowledge base instances available for other applications to use as part of a common knowledge base. We define our method’s components, discuss advantages and limitations, and show sample results for the transportation domain

Non-Line of Sight Test Scenario Generation for Connected Autonomous Vehicle

Connected autonomous vehicles (CAV) level 4-5 use sensors to perceive their environment. These sensors are able to detect only up to a certain range and this range can be further constrained by the presence of obstacles in its path or as a result of the geometry of the road, for example, at a junction. This is termed as a non-line of sight (NLOS) scenario where the ego vehicle (system under test) is unable to detect an oncoming dynamic object due to obstacles or the geometry of the road. A large body of work now exist which proposes methods for extending the perception horizon of CAV’s using vehicular communication and incorporating this into CAV algorithms ranging from obstacle detection to path planning and beyond. Such proposed new algorithms and entire systems needs testing and validating, which can be conducted through primarily two ways, on road testing and simulation. On-road testing can be extremely expensive and time-consuming and may not cover all possible test scenarios. Testing through simulation is inexpensive and has a better scenario space coverage. However, there is currently a dearth in simulated testing techniques that provides the environment to test technologies and algorithms developed for NLOS scenarios. This thesis puts forward a novel end-to-end framework for testing the abilities of a CAV through simulated generation of NLOS scenarios. This has been achieved through following the development process of Functional, Logical and Concrete scenarios along the V-model-based development process in ISO 26262. The process begins with the representation of the NLOS environment (including the digital environment) knowledge as a scalable ontology where Functional and Logical scenarios stand for different abstraction levels. The proposed new ontology comprises of six layers: ‘Environment’, ‘Road User’, ‘Object Type’, ‘Communication Network’, ‘Scene’ and ‘Scenario’. The ontology is modelled and validated in protégé software and exported to OWL API where the logical scenarios are generated and validated. An innumerable number of “concrete” scenarios are generated as a result of the possible combinations of the values from the domains of each concept’s attributes. This research puts forward a novel genetic- algorithm (GA) approach to search through the scenario space and filter out safety critical test scenarios. A critical NLOS scenario is one where a collision is highly likely because the ego vehicle was unable to detect an obstacle in time due to obstructions present in the line-of-sight of the sensors or created due to the road geometry. The metric proposed to identify critical scenarios which also acts as the GA’s fitness function uses the time-to-collision (TTC) and total stopping time (TST) metric. These generated critical scenarios and proposed fitness function have been validated through MATLAB simulation. Furthermore, this research incorporates the relevant knowledge of vehicle-to-vehicle (V2V) communication technologies in the proposed ontology and uses the communication layer instances in the MATLAB simulation to support the testing of the increasing number of approaches that uses communications for alerting oncoming vehicles about imminent danger, or in other word, mitigating an otherwise critical scenario