5 research outputs found

    A Proposal for Processing and Fusioning Multiple Information Sources in Multimodal Dialog Systems

    Get PDF
    Proceedings of: PAAMS 2014 International Workshops. Agent-based Approaches for the Transportation Modelling and Optimisation (AATMO' 14 ) & Intelligent Systems for Context-based Information Fusion (ISCIF' 14). Salamanca, Spain, June 4-6, 2014.Multimodal dialog systems can be defined as computer systems that process two or more user input modes and combine them with multimedia system output. This paper is focused on the multimodal input, providing a proposal to process and fusion the multiple input modalities in the dialog manager of the system, so that a single combined input is used to select the next system action. We describe an application of our technique to build multimodal systems that process user's spoken utterances, tactile and keyboard inputs, and information related to the context of the interaction. This information is divided in our proposal into external and internal context, user's internal, represented in our contribution by the detection of their intention during the dialog and their emotional state.This work was supported in part by Projects MINECO TEC2012-37832-C02-01, CICYT TEC2011-28626-C02-02, CAM CONTEXTS (S2009/TIC-1485)

    Processing and fusioning multiple heterogeneous information sources in multimodal dialog systems

    Get PDF
    Proceedings of: 17th International Conference on Information Fusion (FUSION 2014): Salamanca, Spain 7-10 July 2014.Context-aware dialog systems must be able to process very heterogeneous information sources and user input modes. In this paper we propose a method to fuse multimodal inputs into a unified representation. This representation allows the dialog manager of the system to find the best interaction strategy and also select the next system response. We show the applicability of our proposal by means of the implementation of a dialog system that considers spoken, tactile, and also information related to the context of the interaction with its users. Context information is related to the detection of user's intention during the dialog and their emotional state (internal context), and the user's location (external context).This work was supported in part by Projects MINECO TEC2012-37832-C02-01, CICYT TEC2011-28626-C02-02, CAM CONTEXTS (S2009/TIC-1485).Publicad

    Personalized City Tours - An Extension of the OGC OpenLocation Specification

    Get PDF
    A business trip to London last month , a day visit in Cologne next saturday and romantic weekend in Paris in autumn – this example exhibits one of the central characteristics of today’s tourism. People in the western hemisphere take much pleasure in frequent and repeated short term visits of cities. Every city visitor faces the general problems of where to go and what to see in the diverse microcosm of a metropolis. This thesis presents a framework for the generation of personalized city tours - as extension of the Open Location Specification of the Open Geospatial Consortium. It is founded on context-awareness and personalization while at the same time proposing a combined approach to allow for adaption to the user. This framework considers TimeGeography and its algorithmic implementations to be able to cope with spatio-temporal constraints of a city tour. Traveling salesmen problems - for which a heuristic approache is proposed – are subjacent to the tour generation. To meet the requirements of today’s distributed and heterogeneous computing environments, the tour framework comprises individual services that expose standard-compliant interfaces and allow for integration in service oriented architectures

    Aesthetic Animism: Digital Poetry as Ontological Probe

    Get PDF
    This thesis is about the poetic edge of language and technology. It inter-relates both computational creation and poetic reception by analysing typographic animation softwares and meditating (speculatively) on a future malleable language that possesses the quality of being (and is implicitly perceived as) alive. As such it is a composite document: a philosophical and practice-based exploration of how computers are transforming literature, an ontological meditation on life and language, and a contribution to software studies. Digital poetry introduces animation, dimensionality and metadata into literary discourse. This necessitates new terminology; an acronym for Textual Audio-Visual Interactivity is proposed: Tavit. Tavits (malleable digital text) are tactile and responsive in ways that emulate living entities. They can possess dimensionality, memory, flocking, kinematics, surface reflectivity, collision detection, and responsiveness to touch, etc…. Life-like tactile tavits involve information that is not only semantic or syntactic, but also audible, imagistic and interactive. Reading mediated language-art requires an expanded set of critical, practical and discourse tools, and an awareness of the historical continuum that anticipates this expansion. The ontological and temporal design implications of tavits are supported with case-studies of two commercial typographic-animation softwares and one custom software (Mr Softie created at OBX Labs, Concordia) used during a research-creation process

    Interdisziplinäre Kooperation bei der Erstellung virtueller geschichtswissenschaftlicher 3D-Rekonstruktionen

    Get PDF
    Virtuelle 3D-Modelle finden in den historischen Disziplinen in zweierlei Art Verwendung. Zum einen dienen diese zur Erfassung und Digitalisierung existierender historischer Objekte. Daneben dient die Erstellung von virtuellen 3D-Rekonstruktionen der Nachbildung nicht mehr existierender Objekte und Strukturen. Während technische Abläufe beider Ansätze ebenso wie methodische und wissenschaftstheoretische Aspekte in der Fachliteratur häufig und umfassend thematisiert werden, ist eine Frage nach sozialen Aspekten und sozialer Interaktion im Kontext derartiger Vorhaben bisher unbeleuchtet geblieben. Ziel der Arbeit stellt dar, eine Bandbreite und Relevanz von Aspekten der Kooperation als „Zusammenarbeit mit gemeinsamem Ziel, gegenseitiger Abstimmung, planvollem Vorgehen sowie Vorteilen für alle Akteure“ (Hagenhoff, 2004) im Kontext derartiger geschichtswissenschaftlicher 3D-Modellierungsvorhaben mittels sozialwissenschaftlicher Methoden zu beleuchten. Dabei zielt eine Darlegung auf unterschiedliche Skalierungen von Kooperation ab – angefangen bei einer Wissenschaftslandschaft über Kooperationsstrukturen bis hin zu einer Betrachtung von spezifischen Kooperationsphänomenen und -strategien innerhalb von Arbeits- und Erstellungsprozessen
    corecore