21 research outputs found
Domain Knowledge Distillation from Large Language Model: An Empirical Study in the Autonomous Driving Domain
Engineering knowledge-based (or expert) systems require extensive manual
effort and domain knowledge. As Large Language Models (LLMs) are trained using
an enormous amount of cross-domain knowledge, it becomes possible to automate
such engineering processes. This paper presents an empirical automation and
semi-automation framework for domain knowledge distillation using prompt
engineering and the LLM ChatGPT. We assess the framework empirically in the
autonomous driving domain and present our key observations. In our
implementation, we construct the domain knowledge ontology by "chatting" with
ChatGPT. The key finding is that while fully automated domain ontology
construction is possible, human supervision and early intervention typically
improve efficiency and output quality as they lessen the effects of response
randomness and the butterfly effect. We, therefore, also develop a web-based
distillation assistant enabling supervision and flexible intervention at
runtime. We hope our findings and tools could inspire future research toward
revolutionizing the engineering of knowledge-based systems across application
domains.Comment: Accepted by ITSC 202
Ontology-based scenario generation for automated driving systems verification and validation using rules of the road
The verification and validation (V&V) process for Automated Driving Systems (ADS) has undergone a significant transformation in defining the meaning of safety. Initially rooted in the quantity of miles driven, it has now shifted towards emphasizing the quality of test miles. These test miles must effectively capture the full spectrum of behaviours and operational design domains (ODD) of the ADS. To assess an ADS's compliance with specific rules or requirements, a connection must be established between the rules and the scenarios used for testing. In this paper, we propose a targeted scenario generation methodology aimed at testing ADS against formal rules. Our approach leverages ontologies to represent objects and their relationships in a scenario. The rules, are first formally specified, expressed as horn clauses. We then employ a rule transformation process, along with off-the-shelf reasoning tools, to generate corresponding scenarios. These generated scenarios may then utilized to test the ADS's adherence to the specified rules.
To illustrate the effectiveness of our methodology, we present an application to example rules derived from both the UK Highway Code and the Vienna Conventions. By utilizing our approach, we enhance the precision and rigor of the verification and validation flow for ADS, ensuring improved safety measures during operation
The Differentiation and Promotion of Students’ Rights in Portugal
This investigation includes a differential study (Study 1)
and a quasi-experimental research (Study 2). In Study 1, the objective
was to establish to what extent students’ rights existed and analyse
the differentiation between students’ rights with Portuguese and
immigrant mothers, throughout school years. The sample consisted of
537 students with Portuguese and immigrant mothers, distributed by
different school years (7th, 9th and 11th grades). The Children’s Rights
Scale (Hart et al., 1996; Veiga, 2001) was used. In Study 2, the purpose
was to analyse the effects on students’ rights of the use by teachers of a
communicational intervention program, supervised by school psychologists.
The sample involved 7th and 9th grade students, in a total of
four classes, two forming the experimental groups (n = 36) and two the
control groups (n = 43); as in Study 1, the Children’s Rights Scale was used. The results indicated the effectiveness of the communicational intervention program on students’ rights and are consistent with previous studies. An implication is that psychologists and teachers, working together and taking a human rights perspective, may develop an important role in projects to promote the students’ rights
Domain knowledge distillation from large language model : an empirical study in the autonomous driving domain
ODD-based query-time scenario mutation framework for autonomous driving scenario databases
Large-scale scenario databases have been set up containing hundreds of thousands of traffic scenarios for the verification and validation (V&V) of autonomous vehicles (AV). Scenarios in the database are often labelled with semantic Operational Design Domain (ODD) tags (e.g., WeatherRainy, RoadTypeHighway and ActorTypeTruck) to be queried via exact tag matching. Such a scenario database design has two major limitations, i.e. combinatorial scenario generation inevitably leads to many redundant scenarios, and each ODD query matches only a small number of scenarios in the database (0.2% in our case study), rendering most of the database wealth wasted. We propose a novel scenario database design and an ODD-based query-time scenario mutation framework to address the limitations. Our case study results show that the proposed framework has the potential to fully utilize all the database scenarios at query time while eliminating scenario redundancy in the database (in our case study, given the same ODD query, the number of final matched scenarios increased by 36 times, diversity increased by 99 times, and scenario database utilization rate increased from 0.2% to 36%)
Music and drama in primary schools in the Madeira Island - Narratives of ownership and leadership
Este artigo foi uma das publicações resultantes do projeto financiado pela FCT "Música e Drama no 1º ciclo do Ensino básico – o caso da Região Autónoma da Madeira" (PTDC/CED/72112/2006).A three-year-case study funded by the Foundation for Science and Technology
(FCT) from the Portuguese Ministry of Science, Technology and Higher
Education was designed to study a 30-year project of music and drama in
primary schools in Madeira. This article reports on the narratives of the three
main figures in the project as they elaborate on its construction according to the
following themes: innovation, philosophies of music education and teacher
education. Through the lens of a narrative inquiry, the discourses produced are
analysed, taking into account the emerging concepts of ownership and leadership.