13,884 research outputs found
Recommended from our members
Reference and Gestures in Dialogue Generation: Three Studies with Embodied Conversational Agents
This paper reports on three studies into social presence cues which were carried out in the context of the NECA (Net-environment for Embodied Emotional Conversational Agents) project and the EPOCH network. The first study concerns the generation of referring expressions. We adopted an existing algorithm for generating referring expressions such that it could run according to an egocentric and a neutral strategy. In an evaluation study, we found that the two strategies were correlated with the perceived friendliness of the speaker. In the second and the third study, we evaluated the gestures that were generated by the NECA system. In this paper, we briefly summarize the most salient results of these two studies. They concern the effect of gestures on perceived quality of speech and information retention
Between Art and Social Science: scenic composition as a methodological device
The scenic composition (SC) is a methodological device enabling the synthesis and articulation of researchers' own complex experiences of events witnessed during data collection. Positioned between art and social science, it makes use of literary conventions to synthesise "experience near" accounts of data for interpretation. This article explains how the SC is composed by drawing on associative thinking and illustrates its use within a specific case study. The conceptual basis of the SC is discussed with reference to the work of LORENZER, WINNICOTT and BION. This is the first study in which four compositions, each by a different researcher, have been used to provide a multi-faceted view of a complex event, a live webcast. The compositions are presented along with researchers' reflections. Common themes and significant differences relating to life situations, histories and dispositions of the researchers emerge. The differences were expressed through choice of literary genres, which are common cultural resources. We ask what was achieved through the use of SCs compared with a thematic analysis of the webcast, and find that apart from synthesising and presentational functions, they give access to a multi-sensory range of researchers' experiences, including unconscious elements which were then available for reflexive interpretation by an interpretation panel
Virtual reality in theatre education and design practice - new developments and applications
The global use of Information and Communication Technologies (ICTs) has already established new approaches to theatre education and research, shifting traditional methods of knowledge delivery towards a more visually enhanced experience, which is especially important for teaching scenography. In this paper, I examine the role of multimedia within the field of theatre studies, with particular focus on the theory and practice of theatre design and education. I discuss various IT applications that have transformed the way we experience, learn and co-create our cultural heritage. I explore a suite of rapidly developing communication and computer-visualization techniques that enable reciprocal exchange between students, theatre performances and artefacts. Eventually, I analyse novel technology-mediated teaching techniques that attempt to provide a new media platform for visually enhanced information transfer. My findings indicate that the recent developments in the personalization of knowledge delivery, and also in student-centred study and e-learning, necessitate the transformation of the learners from passive consumers of digital products to active and creative participants in the learning experience
A semantic memory bank assisted by an embodied conversational agents for mobile devices
Alzheimer’s disease is a type of dementia that causes memory loss and interferes with intellectual abilities seriously. It has no current cure and therapeutic efficiency of current medication is limited. However, there is evidence that non-pharmacological treatments could be useful to stimulate cognitive abilities. In the last few year, several studies have focused on describing and under- standing how Virtual Coaches (VC) could be key drivers for health promotion in home care settings. The use of VC gains an augmented attention in the considerations of medical innovations. In this paper, we propose an approach that exploits semantic technologies and Embodied Conversational Agents to help patients training cognitive abilities using mobile devices. In this work, semantic technologies are used to provide knowledge about the memory of a specific person, who exploits the structured data stored in a linked data repository and take advantage of the flexibility provided by ontologies to define search domains and expand the agent’s capabilities. Our Memory Bank Embodied Conversational Agent (MBECA) is used to interact with the patient and ease the interaction with new devices. The framework is oriented to Alzheimer’s patients, caregivers, and therapists
Literacy for digital futures : Mind, body, text
The unprecedented rate of global, technological, and societal change calls for a radical, new understanding of literacy. This book offers a nuanced framework for making sense of literacy by addressing knowledge as contextualised, embodied, multimodal, and digitally mediated.
In today’s world of technological breakthroughs, social shifts, and rapid changes to the educational landscape, literacy can no longer be understood through established curriculum and static text structures. To prepare teachers, scholars, and researchers for the digital future, the book is organised around three themes – Mind and Materiality; Body and Senses; and Texts and Digital Semiotics – to shape readers’ understanding of literacy. Opening up new interdisciplinary themes, Mills, Unsworth, and Scholes confront emerging issues for next-generation digital literacy practices. The volume helps new and established researchers rethink dynamic changes in the materiality of texts and their implications for the mind and body, and features recommendations for educational and professional practice
Spectators’ aesthetic experiences of sound and movement in dance performance
In this paper we present a study of spectators’ aesthetic experiences of sound and movement in live dance performance. A multidisciplinary team comprising a choreographer, neuroscientists and qualitative researchers investigated the effects of different sound scores on dance spectators. What would be the impact of auditory stimulation on kinesthetic experience and/or aesthetic appreciation of the dance? What would be the effect of removing music altogether, so that spectators watched dance while hearing only the performers’ breathing and footfalls? We investigated audience experience through qualitative research, using post-performance focus groups, while a separately conducted functional brain imaging (fMRI) study measured the synchrony in brain activity across spectators when they watched dance with sound or breathing only. When audiences watched dance accompanied by music the fMRI data revealed evidence of greater intersubject synchronisation in a brain region consistent with complex auditory processing. The audience research found that some spectators derived pleasure from finding convergences between two complex stimuli (dance and music). The removal of music and the resulting audibility of the performers’ breathing had a significant impact on spectators’ aesthetic experience. The fMRI analysis showed increased synchronisation among observers, suggesting greater influence of the body when interpreting the dance stimuli. The audience research found evidence of similar corporeally focused experience. The paper discusses possible connections between the findings of our different approaches, and considers the implications of this study for interdisciplinary research collaborations between arts and sciences
Paving the way to e-services: Innovation through online games
The transformative power of organizational and service innovations on value or supply chains has been the object of several studies. The question identified in this paper is how disruptive trends in the videogames world can have spill-over effects in the broader realm of e-services. Section 1 opens with a brief review of literature. Section 2 proposes a description of the on-line games industrial ecosystem, the characteristics of the production process and the value chain in the online video games industry. The main techno-economic models for the production and distribution of online games are described in a third section with an emphasis on service creation, and illustrated by some case studies. The last part highlights the trend of innovative paths towards an economy of e-Services which are driven by the evolution of online games in a converged environment. --Online value creation,virtual world,virtual good,value chain,digital content convergence,new business models,services
On the Development of Adaptive and User-Centred Interactive Multimodal Interfaces
Multimodal systems have attained increased attention in recent years, which has made possible important
improvements in the technologies for recognition, processing, and generation of multimodal information.
However, there are still many issues related to multimodality which are not clear, for example, the
principles that make it possible to resemble human-human multimodal communication. This chapter
focuses on some of the most important challenges that researchers have recently envisioned for future
multimodal interfaces. It also describes current efforts to develop intelligent, adaptive, proactive, portable
and affective multimodal interfaces
Face modeling and animation language for MPEG-4 XMT framework
This paper proposes FML, an XML-based face modeling and animation language. FML provides a structured content description method for multimedia presentations based on face animation. The language can be used as direct input to compatible players, or be compiled within MPEG-4 XMT framework to create MPEG-4 presentations. The language allows parallel and sequential action description, decision-making and dynamic event-based scenarios, model configuration, and behavioral template definition. Facial actions include talking, expressions, head movements, and low-level MPEG-4 FAPs. The ShowFace and iFACE animation frameworks are also reviewed as example FML-based animation systems
- …