Voice Operated Information System in Slovak

Speech communication interfaces (SCI) are nowadays widely used in several domains. Automated spoken language human-computer interaction can replace human-human interaction if needed. Automatic speech recognition (ASR), a key technology of SCI, has been extensively studied during the past few decades. Most of present systems are based on statistical modeling, both at the acoustic and linguistic levels. Increased attention has been paid to speech recognition in adverse conditions recently, since noise-resistance has become one of the major bottlenecks for practical use of speech recognizers. Although many techniques have been developed, many challenges still have to be overcome before the ultimate goal -- creating machines capable of communicating with humans naturally -- can be achieved. In this paper we describe the research and development of the first Slovak spoken language dialogue system. The dialogue system is based on the DARPA Communicator architecture. The proposed system consists of the Galaxy hub and telephony, automatic speech recognition, text-to-speech, backend, transport and VoiceXML dialogue management modules. The SCI enables multi-user interaction in the Slovak language. Functionality of the SLDS is demonstrated and tested via two pilot applications, ``Weather forecast for Slovakia'' and ``Timetable of Slovak Railways''. The required information is retrieved from Internet resources in multi-user mode through PSTN, ISDN, GSM and/or VoIP network

Personalizing Interactions with Information Systems

Personalization constitutes the mechanisms and technologies necessary to customize information access to the end-user. It can be defined as the automatic adjustment of information content, structure, and presentation tailored to the individual. In this chapter, we study personalization from the viewpoint of personalizing interaction. The survey covers mechanisms for information-finding on the web, advanced information retrieval systems, dialog-based applications, and mobile access paradigms. Specific emphasis is placed on studying how users interact with an information system and how the system can encourage and foster interaction. This helps bring out the role of the personalization system as a facilitator which reconciles the user’s mental model with the underlying information system’s organization. Three tiers of personalization systems are presented, paying careful attention to interaction considerations. These tiers show how progressive levels of sophistication in interaction can be achieved. The chapter also surveys systems support technologies and niche application domains

Adaptable dialogue architecture and runtime engine (AdaRTE): A framework for rapid prototyping of health dialog systems

International audienceSpoken dialog systems have been increasingly employed to provide ubiquitous access via telephone to information and services for the non-Internet-connected public. They have been successfully applied in the health care context; however, speech technology requires a considerable development investment. The advent of VoiceXML reduced the proliferation of incompatible dialog formalisms, at the expense of adding even more complexity. This paper introduces a novel architecture for dialogue representation and interpretation, AdaRTE, which allows developers to lay out dialog interactions through a high-level formalism, offering both declarative and procedural features. AdaRTE's aim is to provide a ground for deploying complex and adaptable dialogs whilst allowing experimentation and incremental adoption of innovative speech technologies. It enhances augmented transition networks with dynamic behavior, and drives multiple back-end realizers, including VoiceXML. It has been especially targeted to the health care context, because of the great scale and the need for reducing the barrier to a widespread adoption of dialog systems

Improving Contact Center Demonstrations at Cisco Systems

This project involved the design, construction, and implementation of a system to improve Cisco\u27s Contact Center demonstrations to potential customers. The system aimed to provide customized demonstration resources by industry vertical and geographic sales theater and streamline the demonstration creation process by Cisco sales representatives. By collaborating with Cisco sales representatives directly, the final deliverable is a set of demo resources that is likely to be used and ultimately increase Cisco\u27s Contact Center sales

Context-aware platform for mobile data management

Interaction design is a major issue for mobile information systems in terms of not only the choice of input/output channels and presentation of information, but also the application of context-awareness. To support experimentation with these factors, we have developed platforms to support the rapid prototyping of multi-channel, multi-modal, context-aware applications. The Java-based platform presented here is based on an integration of a cross-media link server and an object-oriented framework for advanced content publishing, along with a Client Controller and Context Engine. We also describe how this platform was used to develop a mobile tourist information system for an international arts festival where interaction was based on a combination of interactive paper and speech outpu

Decision Support Systems

Decision support systems (DSS) have evolved over the past four decades from theoretical concepts into real world computerized applications. DSS architecture contains three key components: knowledge base, computerized model, and user interface. DSS simulate cognitive decision-making functions of humans based on artificial intelligence methodologies (including expert systems, data mining, machine learning, connectionism, logistical reasoning, etc.) in order to perform decision support functions. The applications of DSS cover many domains, ranging from aviation monitoring, transportation safety, clinical diagnosis, weather forecast, business management to internet search strategy. By combining knowledge bases with inference rules, DSS are able to provide suggestions to end users to improve decisions and outcomes. This book is written as a textbook so that it can be used in formal courses examining decision support systems. It may be used by both undergraduate and graduate students from diverse computer-related fields. It will also be of value to established professionals as a text for self-study or for reference

PRESTK : situation-aware presentation of messages and infotainment content for drivers

The amount of in-car information systems has dramatically increased over the last few years. These potentially mutually independent information systems presenting information to the driver increase the risk of driver distraction. In a first step, orchestrating these information systems using techniques from scheduling and presentation planning avoid conflicts when competing for scarce resources such as screen space. In a second step, the cognitive capacity of the driver as another scarce resource has to be considered. For the first step, an algorithm fulfilling the requirements of this situation is presented and evaluated. For the second step, I define the concept of System Situation Awareness (SSA) as an extension of Endsley’s Situation Awareness (SA) model. I claim that not only the driver needs to know what is happening in his environment, but also the system, e.g., the car. In order to achieve SSA, two paths of research have to be followed: (1) Assessment of cognitive load of the driver in an unobtrusive way. I propose to estimate this value using a model based on environmental data. (2) Developing model of cognitive complexity induced by messages presented by the system. Three experiments support the claims I make in my conceptual contribution to this field. A prototypical implementation of the situation-aware presentation management toolkit PRESTK is presented and shown in two demonstrators.In den letzten Jahren hat die Menge der informationsanzeigenden Systeme im Auto drastisch zugenommen. Da sie potenziell unabhängig voneinander ablaufen, erhöhen sie die Gefahr, die Aufmerksamkeit des Fahrers abzulenken. Konflikte entstehen, wenn zwei oder mehr Systeme zeitgleich auf limitierte Ressourcen wie z. B. den Bildschirmplatz zugreifen. Ein erster Schritt, diese Konflikte zu vermeiden, ist die Orchestrierung dieser Systeme mittels Techniken aus dem Bereich Scheduling und Präsentationsplanung. In einem zweiten Schritt sollte die kognitive Kapazität des Fahrers als ebenfalls limitierte Ressource berücksichtigt werden. Der Algorithmus, den ich zu Schritt 1 vorstelle und evaluiere, erfüllt alle diese Anforderungen. Zu Schritt 2 definiere ich das Konzept System Situation Awareness (SSA), basierend auf Endsley’s Konzept der Situation Awareness (SA). Dadurch wird erreicht, dass nicht nur der Fahrer sich seiner Umgebung bewusst ist, sondern auch das System (d.h. das Auto). Zu diesem Zweck m¨ussen zwei Bereiche untersucht werden: (1) Die kognitive Belastbarkeit des Fahrers unaufdringlich ermitteln. Dazu schlage ich ein Modell vor, das auf Umgebungsinformationen basiert. (2) Ein weiteres Modell soll die Komplexität der präsentierten Informationen bestimmen. Drei Experimente stützen die Behauptungen in meinem konzeptuellen Beitrag. Ein Prototyp des situationsbewussten Präsentationsmanagement-Toolkits PresTK wird vorgestellt und in zwei Demonstratoren gezeigt

Techniques d'interaction multimodales pour l'accès aux mathématiques par des personnes non-voyantes

Cette thèse s‟inscrit dans le domaine de l‟interaction Homme-Machine et plus précisément dans celui des interfaces multimodales destinées aux non-voyants. Elle a pour thème principal la présentation des expressions mathématiques aux non-voyants. Pour les étudiants non-voyants, apprendre les mathématiques est une tâche ardue et peut constituer une barrière, les séparant des disciplines techniques. Les travaux de recherche présentés ici décrivent les problèmes rencontrés dans la conception d‟un système permettant l‟accès aux mathématiques pour les utilisateurs déficients visuels. En effet, nous présentons une analyse des outils existants puis nous proposons des solutions pour combler leurs insuffisances. Nous exposons les techniques utilisées au sein de notre système pour répondre aux problèmes de la présentation des expressions mathématiques aux non-voyants. Nous exploitons la multimodalité comme technique d‟interaction pour développer des applications destinées à ce type d‟utilisateurs parce qu‟elle offre plusieurs opportunités grâce à sa richesse des interactions. Nous dotons également notre système d‟un comportement intelligent pour assurer une certaine autonomie à l‟utilisateur. En effet, le système est capable de présenter l‟information en fonction du contexte de l‟interaction (c-à-d. l‟utilisateur, son environnement et sa machine) et de la nature de l‟information. Le système est « pervasif » et adaptatif. L‟accès à l‟information est assuré n‟importe où n‟importe quand et il s‟adapte dynamiquement aux changements du contexte tout en fournissant continuellement des services à l‟utilisateur non-voyant, sans intervention humaine. Pour rendre le système adaptatif, nous avons élaboré un modèle qui détermine la complexité de l‟expression mathématique et nous avons intégré une technique d‟apprentissage automatique pour implémenter les mécanismes de décisions. Enfin, l‟architecture proposée est du type multi-agent. Ces techniques ont été validées par des études de cas et en utilisant les réseaux de Pétri et l‟outil de simulations JADE

An insight into the evolution of mutual understanding in teamwork - Volume 2

The topic of this research is characterising and monitoring mutual understanding in multidisciplinary teamwork. Existing literature has not drawn these two themes together in great detail. This research brings together literature from these two themes. This thesis explores the nature of mutual understanding in teams, monitors its evolution in one multidisciplinary team and proposes a set of guidelines for enhancing and promoting mutual understanding in teams that communicate face-to-face and by electronic-mail (e-mail). The term ‘mutual understanding’ although commonly referred to in literature, remains a term which is not well defined. For this reason a more precise definition is necessary to identity and establish what this term actually means. In addition, the theoretical work on mutual understanding, and aspects related to mutual understanding are often limited to dyadic interactions, involving just two persons. As teams can be more than two persons more attention needs to be paid to extend existing research. Further, the process of how mutual understanding can be monitored has not been well defined, and attempts which have been made also focus on dyadic interactions. This identifies and establishes the need to characterise a method to monitor the evolution of mutual understanding in a team. In the context of teamwork, understanding and supporting team members and their tasks is necessary to work towards shared goals and objectives. Sharing information is also important and can contribute towards the progress that the team makes. Including team members who have first-hand experiences to share can also benefit the make-up of the team. However, sometimes changes need to be made to accommodate team members’ individual needs, especially when the team member in question has a disability. Additional challenges can also be encountered when the team in question is multidisciplinary due to differences in disciplinary backgrounds, practices, professional languages, understanding, cultures (disciplinary, institutional, and cultural), and assumptions in communication. Such challenges can make it harder for mutual understanding to evolve in this type of team. This thesis presents a definition for mutual understanding that can be applied to a team and a method to monitor the evolution of mutual understanding. Detailed empirical analysis of a case study looking at how mutual understanding evolves in a large multidisciplinary team that communicates as a group face- to-face once every 3- months and uses e-mail messages to stay in touch with the team at all other times is also presented. Furthermore the analysis identifies how categories or aspects of mutual understanding appear over time. This analysis can provide an insight to developers and designers in computer supported cooperative work (CSCW) to show them in detail, how a team communicates together face-to-face and by e-mail, but in the context of mutual understanding. Also based on the empirical analysis, guidelines are proposed to promote the evolution of mutual understanding in other types of teamwork. Guidelines are aimed at team members and not just the manager or leader and focus on the two forms of interactions which are the focus of this investigation, face-to-face and e-mail communication. To assess the value of the proposed guidelines a validation exercise using a separate multidisciplinary team was performed