Domain Knowledge Distillation from Large Language Model: An Empirical Study in the Autonomous Driving Domain

Engineering knowledge-based (or expert) systems require extensive manual effort and domain knowledge. As Large Language Models (LLMs) are trained using an enormous amount of cross-domain knowledge, it becomes possible to automate such engineering processes. This paper presents an empirical automation and semi-automation framework for domain knowledge distillation using prompt engineering and the LLM ChatGPT. We assess the framework empirically in the autonomous driving domain and present our key observations. In our implementation, we construct the domain knowledge ontology by "chatting" with ChatGPT. The key finding is that while fully automated domain ontology construction is possible, human supervision and early intervention typically improve efficiency and output quality as they lessen the effects of response randomness and the butterfly effect. We, therefore, also develop a web-based distillation assistant enabling supervision and flexible intervention at runtime. We hope our findings and tools could inspire future research toward revolutionizing the engineering of knowledge-based systems across application domains.Comment: Accepted by ITSC 202

Ontology-based scenario generation for automated driving systems verification and validation using rules of the road

The verification and validation (V&V) process for Automated Driving Systems (ADS) has undergone a significant transformation in defining the meaning of safety. Initially rooted in the quantity of miles driven, it has now shifted towards emphasizing the quality of test miles. These test miles must effectively capture the full spectrum of behaviours and operational design domains (ODD) of the ADS. To assess an ADS's compliance with specific rules or requirements, a connection must be established between the rules and the scenarios used for testing. In this paper, we propose a targeted scenario generation methodology aimed at testing ADS against formal rules. Our approach leverages ontologies to represent objects and their relationships in a scenario. The rules, are first formally specified, expressed as horn clauses. We then employ a rule transformation process, along with off-the-shelf reasoning tools, to generate corresponding scenarios. These generated scenarios may then utilized to test the ADS's adherence to the specified rules. To illustrate the effectiveness of our methodology, we present an application to example rules derived from both the UK Highway Code and the Vienna Conventions. By utilizing our approach, we enhance the precision and rigor of the verification and validation flow for ADS, ensuring improved safety measures during operation

The Differentiation and Promotion of Students’ Rights in Portugal

This investigation includes a differential study (Study 1) and a quasi-experimental research (Study 2). In Study 1, the objective was to establish to what extent students’ rights existed and analyse the differentiation between students’ rights with Portuguese and immigrant mothers, throughout school years. The sample consisted of 537 students with Portuguese and immigrant mothers, distributed by different school years (7th, 9th and 11th grades). The Children’s Rights Scale (Hart et al., 1996; Veiga, 2001) was used. In Study 2, the purpose was to analyse the effects on students’ rights of the use by teachers of a communicational intervention program, supervised by school psychologists. The sample involved 7th and 9th grade students, in a total of four classes, two forming the experimental groups (n = 36) and two the control groups (n = 43); as in Study 1, the Children’s Rights Scale was used. The results indicated the effectiveness of the communicational intervention program on students’ rights and are consistent with previous studies. An implication is that psychologists and teachers, working together and taking a human rights perspective, may develop an important role in projects to promote the students’ rights

ODD-based query-time scenario mutation framework for autonomous driving scenario databases

Large-scale scenario databases have been set up containing hundreds of thousands of traffic scenarios for the verification and validation (V&V) of autonomous vehicles (AV). Scenarios in the database are often labelled with semantic Operational Design Domain (ODD) tags (e.g., WeatherRainy, RoadTypeHighway and ActorTypeTruck) to be queried via exact tag matching. Such a scenario database design has two major limitations, i.e. combinatorial scenario generation inevitably leads to many redundant scenarios, and each ODD query matches only a small number of scenarios in the database (0.2% in our case study), rendering most of the database wealth wasted. We propose a novel scenario database design and an ODD-based query-time scenario mutation framework to address the limitations. Our case study results show that the proposed framework has the potential to fully utilize all the database scenarios at query time while eliminating scenario redundancy in the database (in our case study, given the same ODD query, the number of final matched scenarios increased by 36 times, diversity increased by 99 times, and scenario database utilization rate increased from 0.2% to 36%)

Music and drama in primary schools in the Madeira Island - Narratives of ownership and leadership

Este artigo foi uma das publicações resultantes do projeto financiado pela FCT "Música e Drama no 1º ciclo do Ensino básico – o caso da Região Autónoma da Madeira" (PTDC/CED/72112/2006).A three-year-case study funded by the Foundation for Science and Technology (FCT) from the Portuguese Ministry of Science, Technology and Higher Education was designed to study a 30-year project of music and drama in primary schools in Madeira. This article reports on the narratives of the three main figures in the project as they elaborate on its construction according to the following themes: innovation, philosophies of music education and teacher education. Through the lens of a narrative inquiry, the discourses produced are analysed, taking into account the emerging concepts of ownership and leadership.