Speech Communication

Contains reports on two research projects.U.S. Navy Office of Naval Research (Contract N00014-67-A-0204-0064)National Institutes of Health (Grant 5 ROl NS04332-09)National Science Foundation (Grant GK-31353

Multi-Agent System (MAS) Applications in Ambient Intelligence (AmI) Environments

Proceedings of: 8th Conference on Practical Applications of Agents and Multi-Agent Systems (PAAMS`10). Salamanca (Spain), 28-30 April 2010Research in context-aware systems has been moving towards reusable and adaptable architectures for managing more advanced human-computer interfaces. Ambient. Intelligence (AmI) investigates computer-based services, which are ubiquitous and based on a variety of objects and devices. Their intelligent and intuitive interfaces act as mediators through which people can interact with the ambient environment. In this paper we present an agent-based architecture which supports the execution of agents in AmI environments. Two case studies are also presented, an airport information system and a railway information system, which uses spoken conversational agents to respond to the user's requests using the contextual information that includes the location information of the user.This work has been partially supported by CICYT TIN2008-06742-C02-02/TSI, CICYT TEC2008-06732-C02-02/TEC, SINPROB, CAM MADRINET S-0505/TIC/0255 and DPS2008-07029-C02-02Publicad

Digital Signal Processing

Contains research objectives and summary of research.National Science Foundation (Grant GK-31353)U. S. Navy Office of Naval Research (Contract N00014-67-A-0204-0064

Bringing Statistical Methodologies for Enterprise Integration of Conversational Agents

Proceedings of: 9th International Conference on Practical Applications of Agents and Multiagent Systems (PAAMS 11). Salamanca, 6-8 April, 2011In this paper we present a methodology to develop commercial conversational agents that avoids the effort of manually defining the dialog strategy for the dialog management module. Our corpus-based methodology is based on selecting the next system answer by means of a classification process in which the complete dialog history is considered. This way, system developers can employ standards like VoiceXML to simply define system prompts and the associated grammars to recognize the users responses to the prompt, and the statistical dialog model automatically selects the next system prompt.We have applied this methodology for the development of an academic conversational agent.Funded by projects CICYT TIN2008-06742-C02-02/TSI, CICYT TEC 2008-06732-C02-02/TEC, CAM CONTEXTS (S2009/TIC-1485), and DPS2008-07029- C02-02.Publicad

Understanding Technology as Situated Practice: Everyday use of Voice User Interfaces Among Diverse Groups of Users in Urban India

Abstract: As smartphones have become ubiquitous across urban India, voice user interfaces (VUIs) are increasingly becoming part of diverse groups of users’ daily experiences. These technologies are now generally accessible as a result of improvements in mobile Internet access, [-8.5pc]Biography is Required. Please provide. introduction of low-cost smartphones and the ongoing process of their localisation into Indian languages. However, when people engage with technologies in their everyday lives, they not only enact the material attributes of the artifact but also draw on their skills, social positions, prior experience and societal norms and expectations to make use of the artifact. Drawing on Orlikowski’s analytical framework of “technologies-in-practice” we engage in an interview-based exploratory study among diverse groups of users in urban India to understand use of VUIs as situated practice. We identify three technologies-in-practice emerging through enactment of VUIs on users’ smartphones: looking up, learning and leisure. We argue that – instead of asking why and how users appropriate VUIs – identifying different kinds of enactments of VUIs present researchers and practitioners with a more nuanced understanding of existing and potential use of VUIs across varied contexts

Nonstrict hierarchical reinforcement learning for interactive systems and robots

Conversational systems and robots that use reinforcement learning for policy optimization in large domains often face the problem of limited scalability. This problem has been addressed either by using function approximation techniques that estimate the approximate true value function of a policy or by using a hierarchical decomposition of a learning task into subtasks. We present a novel approach for dialogue policy optimization that combines the benefits of both hierarchical control and function approximation and that allows flexible transitions between dialogue subtasks to give human users more control over the dialogue. To this end, each reinforcement learning agent in the hierarchy is extended with a subtask transition function and a dynamic state space to allow flexible switching between subdialogues. In addition, the subtask policies are represented with linear function approximation in order to generalize the decision making to situations unseen in training. Our proposed approach is evaluated in an interactive conversational robot that learns to play quiz games. Experimental results, using simulation and real users, provide evidence that our proposed approach can lead to more flexible (natural) interactions than strict hierarchical control and that it is preferred by human users

Communications Biophysics

Contains reports on ten research projects.National Institutes of Health (Grant 5 P01 NS13126)National Institutes of Health (Training Grant 5 T32 NS0704)National Science Foundation (Grant BNS80-06369)National Institutes of Health (Grant 5 R01 NS11153)National Science Foundation (Grant BNS77-16861)National Institutes of Health (Grant 5 RO1 NS12846)National Science Foundation (Grant BNS77-21751)National Institutes of Health (Grant 1 P01 NS14092)Karmazin Foundation through the Council for the Arts at MITNational Institutes of Health (Fellowship 5 F32 NS06386)National Science Foundation (Fellowship SP179-14913)National Institutes of Health (Grant 5 RO1 NS11080

Communications Biophysics

Contains reports on eight research projects split into four sections.National Institutes of Health (Grant 5 P01 NS13126)National Institutes of Health (Grant 5 K04 NS00113)National Institutes of Health (Training Grant 5 T32 NS07047)National Science Foundation (Grant BNS80-06369)National Institutes of Health (Grant 5 ROl NS11153)National Institutes of Health (Fellowship 1 F32 NS06544)National Science Foundation (Grant BNS77-16861)National Institutes of Health (Grant 5 R01 NS10916)National Institutes of Health (Grant 5 RO1 NS12846)National Science Foundation (Grant BNS77-21751)National Institutes of Health (Grant 1 R01 NS14092)National Institutes of Health (Grant 2 R01 NS11680)National Institutes of Health (Grant 5 ROl1 NS11080)National Institutes of Health (Training Grant 5 T32 GM07301

Communications Biophysics

Contains reports on seven research projects split into three sections, with research objective for the final section.National Institutes of Health (Grant 2 PO1 NS 13126)National Institutes of Health (Grant 5 RO1 NS 18682)National Institutes of Health (Grant 1 RO1 NS 20322)National Institutes of Health (Grant 1 RO1 NS 20269)National Institutes of Health (Grant 5 T32 NS 07047)Symbion, Inc.National Institutes of Health (Grant 5 RO1 NS10916)National Institutes of Health (Grant 1 RO1 NS16917)National Science Foundation (Grant BNS83-19874)National Science Foundation (Grant BNS83-19887)National Institutes of Health (Grant 5 RO1 NS12846)National Institutes of Health (Grant 5 RO1 NS21322)National Institutes of Health (Grant 5 RO1 NS 11080

Communications Biophysics

Contains research objectives and reports on eight research projects split into three sections.National Institutes of Health (Grant 2 PO1 NS13126)National Institutes of Health (Grant 5 RO1 NS18682)National Institutes of Health (Grant 5 RO1 NS20322)National Institutes of Health (Grant 1 RO1 NS 20269)National Institutes of Health (Grant 5 T32 NS 07047)Symbion, Inc.National Institutes of Health (Grant 5 R01 NS10916)National Institutes of Health (Grant 1 RO NS 16917)National Science Foundation (Grant BNS83-19874)National Science Foundation (Grant BNS83-19887)National Institutes of Health (Grant 5 RO1 NS12846)National Institutes of Health (Grant 1 RO1 NS21322-01)National Institutes of Health (Grant 5 T32-NS07099-07)National Institutes of Health (Grant 1 RO1 NS14092-06)National Science Foundation (Grant BNS77-21751)National Institutes of Health (Grant 5 RO1 NS11080