9 research outputs found
Assessment of Intelligence Complexity in Embedded Intelligent Real Time Systems
Intelligent systems and their applications are proliferating. Embedded Intelligent Real-Time Systems (EIRTS) are one type of intelligent system. Defining and measuring the complexity of this kind of system may help with better design, development, maintenance, and performance of EIRTS. In this paper, we propose a set of evaluation criteria to measure the complexity of Embedded Intelligent Real-Time Systems (EIRTS). We show an operationalization of the criteria with a sample EIRTS
An Agile Approach to Validate a Formal Representation of the GDPR
Modeling in a knowledge base of logic formulæ the articles of the GDPR enables semi-automatic reasoning of the Regulation. To be legally substantiated, it requires that the formulæ express validly the legal meaning of the Regulation’s articles. But legal experts are usually not familiar with logic, and this calls for an interdisciplinary validation methodology that bridges the communication gap between formal modelers and legal evaluators. We devise such a validation methodology and exemplify it over a knowledge base of articles of the GDPR translated
AQ2 into Reified I/O (RIO) logic and encoded in LegalRuleML. A pivotal element of the methodology is a human-readable intermediate representation of the logic formulæ that preserves the formulæ’s meaning while rendering it in a readable way to non-experts. After being applied over a use case, we prove that it is possible to retrieve feedback from legal experts about the formal representation of Art. 5.1a and Art. 7.1. What emerges is an agile process to build logic knowledge bases of legal texts, and to support their public trust, which we intend to use for a logic AQ3 model of the GDPR, called DAPRECO knowledge base
Legal Knowledge and Information Systems - JURIX 2017: The Thirtieth Annual Conference
The proceedings of the 30th International Conference on Legal Knowledge and Information Systems – JURIX 2017. For three decades, the JURIX conferences have been held under the auspices of the Dutch Foundation for Legal Knowledge Based Systems (www.jurix.nl). In the time, it has become a European conference in terms of the diverse venues throughout Europe and the nationalities of
participants
The Evaluation of Legal Knowledge Based Systems
Evaluation strategies to assess the effectiveness of legal knowledge based systems enable strengths and limitations of systems to be accurately articulated. This facilitates efforts in the research community to develop systems and also promotes the adoption of research prototypes in the commercial world. However, evaluation strategies for systems that operate in a domain as complex as law are difficult to specify. In this paper, we present an evaluation framework put forward by Reich and describe how this motivated the evaluation of our systems in Australian family law. Strategies surveyed include a comparison of linear regression with neural networks, user acceptance surveys, a comparison of system predictions with those from past cases, and a comparison of system outputs with those proposed by a panel of lawyers. Specific criteria for the evaluation of explanation facilities are also described.. Keywords Evaluation, legal knowledge based systems. 1. INTRODUCTION Reich [10] notes ..
A Strategy for Evaluating Web-Based Discretionary Decision Support Systems
The World Wide Web facilitates user access to knowledge-based
decision support systems. Such web-enabled systems can provide users with
advice about how decision-makers exercise discretion. GetAid, developed using
the web-based shell environment WebShell, is an example of a web-based
decision support system operating in a discretionary legal domain. This paper
presents the Context, Criteria, Contingency evaluation framework for knowledge-
based systems, general in design but geared towards the evaluation of legal
knowledge-based systems. Central to this framework is a hierarchical model of
evaluation criteria arranged in four quadrants: verification and validation, user
credibility, technical infrastructure and the impact of the system upon its
environment. This framework frames an evaluation both in terms of the context
of use of the system and the context of its evaluation and includes guidelines for
the selection of appropriate evaluation criteria under differing contingencies. A
case study is presented describing the use of this evaluation framework in
planning the evaluation of the web-deployed GetAid system
A Strategy for Evaluating Web-Based Discretionary Decision Support Systems
Abstract. The World Wide Web facilitates user access to knowledge-based decision support systems. Such web-enabled systems can provide users with advice about how decision-makers exercise discretion. GetAid, developed using the web-based shell environment WebShell, is an example of a web-based decision support system operating in a discretionary legal domain. This paper presents the Context, Criteria, Contingency evaluation framework for knowledge-based systems, general in design but geared towards the evaluation of legal knowledge-based systems. Central to this framework is a hierarchical model of evaluation criteria arranged in four quadrants: verification and validation, user credibility, technical infrastructure and the impact of the system upon its environment. This framework frames an evaluation both in terms of the context of use of the system and the context of its evaluation and includes guidelines for the selection of appropriate evaluation criteria under differing contingencies. A case study is presented describing the use of this evaluation framework in planning the evaluation of the web-deployed GetAid system.