COSMA - multi-participant NL interaction for appointment scheduling

We discuss the use of NL systems in the domain of appointment scheduling. Appointment scheduling is a problem faced daily by many people and organizations, and typically solved using communication in natural language. In general, cooperative interaction between several participants is required whose calendar data are distributed rather than centralized. In this distributed multi-agent environment, the use of NL systems makes it possible for machines and humans to cooperate in solving scheduling problems. We describe the COSMA (Cooperative Schedule Managament Agent) system, a secretarial assistant for appointment scheduling. A central part of COSMA is the reusable NL core system DISCO, which serves, in this application, as an NL interface between an appointment planning system and the human user. COSMA is fully implemented in Common Lisp and runs on Unix Workstations. Our experience with COSMA shows that it is a plausible and useful application for NL systems. However, the appointment planner was not designed for NL communication and thus makes strong assumptions about sequencing of domain actions and about the error-freeness of the communication. We suggest that further improvements of the overall COSMA functionality, especially with regard to flexibility and robustness, be based on a modified architecture

AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation Framework

This technical report presents AutoGen, a new framework that enables development of LLM applications using multiple agents that can converse with each other to solve tasks. AutoGen agents are customizable, conversable, and seamlessly allow human participation. They can operate in various modes that employ combinations of LLMs, human inputs, and tools. AutoGen's design offers multiple advantages: a) it gracefully navigates the strong but imperfect generation and reasoning abilities of these LLMs; b) it leverages human understanding and intelligence, while providing valuable automation through conversations between agents; c) it simplifies and unifies the implementation of complex LLM workflows as automated agent chats. We provide many diverse examples of how developers can easily use AutoGen to effectively solve tasks or build applications, ranging from coding, mathematics, operations research, entertainment, online decision-making, question answering, etc.Comment: 28 page

EXPRESS: Resource-oriented and RESTful Semantic Web services

This thesis investigates an approach that simplifies the development of Semantic Web services (SWS) by removing the need for additional semantic descriptions.The most actively researched approaches to Semantic Web services introduce explicit semantic descriptions of services that are in addition to the existing semantic descriptions of the service domains. This increases their complexity and design overhead. The need for semantically describing the services in such approaches stems from their foundations in service-oriented computing, i.e. the extension of already existing service descriptions. This thesis demonstrates that adopting a resource-oriented approach based on REST will, in contrast to service-oriented approaches, eliminate the need for explicit semantic service descriptions and service vocabularies. This reduces the development efforts while retaining the significant functional capabilities.The approach proposed in this thesis, called EXPRESS (Expressing RESTful Semantic Services), utilises the similarities between REST and the Semantic Web, such as resource realisation, self-describing representations, and uniform interfaces. The semantics of a service is elicited from a resource’s semantic description in the domain ontology and the semantics of the uniform interface, hence eliminating the need for additional semantic descriptions. Moreover, stub-generation is a by-product of the mapping between entities in the domain ontology and resources.EXPRESS was developed to test the feasibility of eliminating explicit service descriptions and service vocabularies or ontologies, to explore the restrictions placed on domain ontologies as a result, to investigate the impact on the semantic quality of the description, and explore the benefits and costs to developers. To achieve this, an online demonstrator that allows users to generate stubs has been developed. In addition, a matchmaking experiment was conducted to show that the descriptions of the services are comparable to OWL-S in terms of their ability to be discovered, while improving the efficiency of discovery. Finally, an expert review was undertaken which provided evidence of EXPRESS’s simplicity and practicality when developing SWS from scratch

SILS MRAT: A Multi-Agent Decision-Support System for Shipboard Integration of Logistics Systems

This report describes work performed by CDM Technologies Inc. on subcontract to ManTech Advanced Systems International, Inc. (Fairmont, West Virginia), and under sponsorship of the Office of Naval Research (ONR). The principal aim of the SILS (Shipboard Integration of Logistics Systems) project is to provide a decision-support capability for Navy ships that integrates shipboard logistical and tactical systems within a near real-time, automated, computer-based shipboard readiness and situation awareness facility. Specifically, SILS is intended to provide the captain of a ship and his staff with an accurate evaluation of the current condition of the ship, based on the ability of all of its equipment, services and personnel to perform their intended functions. The SILS software system consists of two main subsystems, namely: the SILS IE (Interface Engine) subsystem for information interchange with heterogeneous external applications, developed by ManTech Advanced Systems International; and, the SILS MRAT (Mission Readiness Analysis Toolkit) subsystem for intelligent decision-support with collaborative software agents, developed by CDM Technologies. This report is focused specifically on the technical aspects of the SILS MRAT subsystem. The automated reasoning capabilities of SILS MRAT are supported by a knowledge management architecture that is based on information-centric principles. Such an architecture utilizes a virtual model of the real world problem situation, consisting of data objects with characteristics and a rich set of relationships. Commonly referred to as an ontology, this internal information model provides a common vocabulary and context for software agents with reasoning capabilities. The concurrent need for incremental capability increases implies a steadily increasing data load from diverse operational (dynamic) and historical (static) data sources, ranging from free text messages and Web content to highly structured data contained in consolidated operational data stores, Data Warehouses, and Data Marts. In order to provide useful high-level capabilities the architecture is required to support the transformation of these data flows into information and knowledge relevant to the concerns and operational context of individual shipboard users. Accordingly, the system must be capable of not only storing data but also the relationships and higher level concepts that place the data into context. For this reason, to manage an increasing number of relationships and concepts over time, the SILS MRAT subsystem was designed to employ a formalized ontological framework. There were four additional considerations in the selection of the overall SILS architecture. First, utility to support a useful level of automated information management (i.e., the ability to collaboratively analyze data, monitor dynamic operational context, formulate warnings and alerts, and generate recommendations). Second, flexibility to accommodate contributions from multiple team members that may employ differing technologies and implementation paradigms. Third, scalability to allow a progressive increase in the breadth and diversity of the data sources, the volume of data processed, the number of validated components, and the intelligence of the tools (i.e., agents). Fourth, adaptability to facilitate the tailoring of the information management capabilities to different data sources and existing data environments. The current SILS architecture addresses these desirable characteristics by partitioning the system into a lower-level data collection and integration layer, a higher-level information management layer (SILS MRAT), and a translation facility that is capable of mapping the data schema of the lower layer to the information representation (i.e., ontology) of the upper layer (SILS IE). The higher-level information management layer provides a collaborative, distributed communication facility that supports the development of semi-autonomous modules of capability referred to as agents. The agents employ the formalized ontology supported by the communication facility to collaborate with each other and the human users in a meaningful manner

Proceedings of the 1993 Conference on Intelligent Computer-Aided Training and Virtual Environment Technology, Volume 1

These proceedings are organized in the same manner as the conference's contributed sessions, with the papers grouped by topic area. These areas are as follows: VE (virtual environment) training for Space Flight, Virtual Environment Hardware, Knowledge Aquisition for ICAT (Intelligent Computer-Aided Training) & VE, Multimedia in ICAT Systems, VE in Training & Education (1 & 2), Virtual Environment Software (1 & 2), Models in ICAT systems, ICAT Commercial Applications, ICAT Architectures & Authoring Systems, ICAT Education & Medical Applications, Assessing VE for Training, VE & Human Systems (1 & 2), ICAT Theory & Natural Language, ICAT Applications in the Military, VE Applications in Engineering, Knowledge Acquisition for ICAT, and ICAT Applications in Aerospace

Robust Dialog Management Through A Context-centric Architecture

This dissertation presents and evaluates a method of managing spoken dialog interactions with a robust attention to fulfilling the human user’s goals in the presence of speech recognition limitations. Assistive speech-based embodied conversation agents are computer-based entities that interact with humans to help accomplish a certain task or communicate information via spoken input and output. A challenging aspect of this task involves open dialog, where the user is free to converse in an unstructured manner. With this style of input, the machine’s ability to communicate may be hindered by poor reception of utterances, caused by a user’s inadequate command of a language and/or faults in the speech recognition facilities. Since a speech-based input is emphasized, this endeavor involves the fundamental issues associated with natural language processing, automatic speech recognition and dialog system design. Driven by ContextBased Reasoning, the presented dialog manager features a discourse model that implements mixed-initiative conversation with a focus on the user’s assistive needs. The discourse behavior must maintain a sense of generality, where the assistive nature of the system remains constant regardless of its knowledge corpus. The dialog manager was encapsulated into a speech-based embodied conversation agent platform for prototyping and testing purposes. A battery of user trials was performed on this agent to evaluate its performance as a robust, domain-independent, speech-based interaction entity capable of satisfying the needs of its users

Groupware design : principles, prototypes, and systems

Computers are valuable tools for a wide range of work tasks. A substantial limitation on their value, however, is the predominant focus on enhancing the work of individuals. This fails to account for the issues of collaboration that affect almost all work. Research into computer supported cooperative work (CSCW) aims to eliminate this deficiency, but the promise of computer systems for group work has not been met. This thesis presents four design principles that promote the development of successful groupware. The principles identify the particular problems encountered by groupware, and provide guidelines and strategies to avoid, overcome, or minimise their impact. Derived from several sources, the major influence on the principles development is an investigation into the relationship between factors affecting groupware failure. They are stimulated by observations of groupware use, and by design insights arising from the development of two groupware applications and their prototypes: Mona and TELEFREEK. Mona provides conversation-based email management. Several groupware applications allow similar functionality, but the design principles result in Mona using different mechanisms to achieve its user-support. TELEFREEK provides a platform for accessing computer-supported communication and collaboration facilities. It attends to the problems of initiating interaction, and supports an adaptable and extendible set of "social awareness" assistants. TELEFREEK offers a broader range of facilities than other groupware, and avoids the use of prohibitively high-bandwidth communication networks. TELEFREEK demonstrates that much can be achieved through current and widely accessible technology. Together, Mona and TELEFREEK forcefully demonstrate the use of the design principles, and substantiate the claim of their utility

Factors shaping the evolution of electronic documentation systems

The main goal is to prepare the space station technical and managerial structure for likely changes in the creation, capture, transfer, and utilization of knowledge. By anticipating advances, the design of Space Station Project (SSP) information systems can be tailored to facilitate a progression of increasingly sophisticated strategies as the space station evolves. Future generations of advanced information systems will use increases in power to deliver environmentally meaningful, contextually targeted, interconnected data (knowledge). The concept of a Knowledge Base Management System is emerging when the problem is focused on how information systems can perform such a conversion of raw data. Such a system would include traditional management functions for large space databases. Added artificial intelligence features might encompass co-existing knowledge representation schemes; effective control structures for deductive, plausible, and inductive reasoning; means for knowledge acquisition, refinement, and validation; explanation facilities; and dynamic human intervention. The major areas covered include: alternative knowledge representation approaches; advanced user interface capabilities; computer-supported cooperative work; the evolution of information system hardware; standardization, compatibility, and connectivity; and organizational impacts of information intensive environments

Embedding Intelligence. Designerly reflections on AI-infused products

Artificial intelligence is more-or-less covertly entering our lives and houses, embedded into products and services that are acquiring novel roles and agency on users. Products such as virtual assistants represent the first wave of materializa- tion of artificial intelligence in the domestic realm and beyond. They are new interlocutors in an emerging redefined relationship between humans and computers. They are agents, with miscommunicated or unclear proper- ties, performing actions to reach human-set goals. They embed capabilities that industrial products never had. They can learn users’ preferences and accordingly adapt their responses, but they are also powerful means to shape people’s behavior and build new practices and habits. Nevertheless, the way these products are used is not fully exploiting their potential, and frequently they entail poor user experiences, relegating their role to gadgets or toys. Furthermore, AI-infused products need vast amounts of personal data to work accurately, and the gathering and processing of this data are often obscure to end-users. As well, how, whether, and when it is preferable to implement AI in products and services is still an open debate. This condition raises critical ethical issues about their usage and may dramatically impact users’ trust and, ultimately, the quality of user experience. The design discipline and the Human-Computer Interaction (HCI) field are just beginning to explore the wicked relationship between Design and AI, looking for a definition of its borders, still blurred and ever-changing. The book approaches this issue from a human-centered standpoint, proposing designerly reflections on AI-infused products. It addresses one main guiding question: what are the design implications of embedding intelligence into everyday objects