Specification Techniques for Multi-Modal Dialogues in the U-Wish Project

In this paper we describe the development of a specification\ud technique for specifying interactive web-based services. We\ud wanted to design a language that can be a means of\ud communication between designers and developers of interactive services, that makes it easier to develop web-based services fitted to the users and that shortens the pathway from design to implementation. The language, still under development, is based on process algebra and can be\ud connected to the results of task analysis. We have been\ud working on the automatic generation of executable prototypes\ud out of the specifications. In this way the specification\ud language can establish a connection between users, design\ud and implementation. A first version of this language is\ud available as well as prototype tools for executing the specifications. Ideas will be given as to how to make the connection between specifications and task analysis

PRESENCE: A human-inspired architecture for speech-based human-machine interaction

Recent years have seen steady improvements in the quality and performance of speech-based human-machine interaction driven by a significant convergence in the methods and techniques employed. However, the quantity of training data required to improve state-of-the-art systems seems to be growing exponentially and performance appears to be asymptotic to a level that may be inadequate for many real-world applications. This suggests that there may be a fundamental flaw in the underlying architecture of contemporary systems, as well as a failure to capitalize on the combinatorial properties of human spoken language. This paper addresses these issues and presents a novel architecture for speech-based human-machine interaction inspired by recent findings in the neurobiology of living systems. Called PRESENCE-"PREdictive SENsorimotor Control and Emulation" - this new architecture blurs the distinction between the core components of a traditional spoken language dialogue system and instead focuses on a recursive hierarchical feedback control structure. Cooperative and communicative behavior emerges as a by-product of an architecture that is founded on a model of interaction in which the system has in mind the needs and intentions of a user and a user has in mind the needs and intentions of the system

Natural‐language processing applied to an ITS interface

The aim of this paper is to show that with a subset of a natural language, simple systems running on PCs can be developed that can nevertheless be an effective tool for interfacing purposes in the building of an Intelligent Tutoring System (ITS). After presenting the special characteristics of the Smalltalk/V language, which provides an appropriate environment for the development of an interface, the overall architecture of the interface module is discussed. We then show how sentences are parsed by the interface, and how interaction takes place with the user. The knowledge‐acquisition phase is subsequently described. Finally, some excerpts from a tutoring session concerned with elementary geometry are discussed, and some of the problems and limitations of the approach are illustrated

From the invalidity of a General Classification Theory to a new organization of knowledge for the millennium to come

Proceedings der 10. Tagung der Deutschen Sektion der Internationalen Gesellschaft für Wissensorganisation. Wien, 3-5 Juli 2006The idea of organizing knowledge and the determinism in classifícation structures implicitly involve certain limits which are translated into a General Theory on the Classifícation of Knowledge, given that classifícation responds to specific parameters and structures more than to a theoretical concept. The classifícation of things is a refiection of their classifícation by man, and this is what determines classifícation structures. The classifícation and organization of knowledge are presented to us as an artificial construct or as a useful fiction elaborated by man. Positivist knowledge reached its peak in the 20* century when science classifications and implemented classifícation systems based on the latter were to be gestated and Consolidated. Pragmatism was to serve as the epistemological and theoretical basis for science and its classifícation. If the classifícation of the sciences has given rise to clastification systems, the organisation and representation of knowledge has to currendy give rise to the context of the globalisation of electronic information in the hypertextual organisational form of electronic information where, if in information the médium ivas the message, in organisation the médium is the structure. The virtual reality of electronic information delves even deeper into it; the process is completed as the subject attempts to look for information. This information market needs standards of an international nature for documents and data. This body of information organization will be characterized by its dynamic nature. If formal and material structures change our concept of knowledge and the way it is structured, then this organization will undergo dynamic change along with the material and formal structures of the real world. The semantic web is a qualitative leap which can be glimpsed on tiie new knowledge horizon; the latter would be shaped with the full integration of contents and data, the language itself would include data and its rules of reason or representation system. The new organisation of knowledge points to a totally nCw conception; post-modern epistemology has yet to be articulated. In the 21 st century, the organization of electronic information is presenting a novel hypertextual, non-linear architecture that will lead to a new change in the paradigm for organization of knowledge for the mülennium to come.Publicad

A conceptual architecture for interactive educational multimedia

Learning is more than knowledge acquisition; it often involves the active participation of the learner in a variety of knowledge- and skills-based learning and training activities. Interactive multimedia technology can support the variety of interaction channels and languages required to facilitate interactive learning and teaching. A conceptual architecture for interactive educational multimedia can support the development of such multimedia systems. Such an architecture needs to embed multimedia technology into a coherent educational context. A framework based on an integrated interaction model is needed to capture learning and training activities in an online setting from an educational perspective, to describe them in the human-computer context, and to integrate them with mechanisms and principles of multimedia interaction

A taxonomy for interactive educational multimedia

Learning is more than knowledge acquisition; it often involves the active participation of the learner in a variety of knowledge- and skills-based learning and training activities. Interactive multimedia technology can support the variety of interaction channels and languages required to facilitate interactive learning and teaching. We will present a taxonomy for interactive educational multimedia that supports the classification, description and development of such systems. Such a taxonomy needs to embed multimedia technology into a coherent educational context. A conceptual framework based on an integrated interaction model is needed to capture learning and training activities in an online setting from an educational perspective, describe them in the human-computer context, and integrate them with mechanisms and principles of multimedia interaction

Conceptual spatial representations for indoor mobile robots

We present an approach for creating conceptual representations of human-made indoor environments using mobile robots. The concepts refer to spatial and functional properties of typical indoor environments. Following findings in cognitive psychology, our model is composed of layers representing maps at different levels of abstraction. The complete system is integrated in a mobile robot endowed with laser and vision sensors for place and object recognition. The system also incorporates a linguistic framework that actively supports the map acquisition process, and which is used for situated dialogue. Finally, we discuss the capabilities of the integrated system