Evaluation of ECA Gesture strategies for robust Human-Computer Interaction

Embodied Conversational Agents (ECAs) offer us the possibility to design pleasant and efficient human-machine interaction. In this paper we present an evaluation scheme to compare dialogue-based speaker authentication and information retrieval systems with and without ECAs on the interface. We used gestures and other visual cues to improve fluency and robustness of interaction with these systems. Our tests results suggest that when an ECA is present users perceive fewer system errors, their frustration levels are lower, turn-changing goes more smoothly, the interaction experience is more enjoyable, and system capabilities are generally perceived more positively than when no ECA is present. However, the ECA seems to intensify the users' privacy concerns

Meetings and Meeting Modeling in Smart Environments

In this paper we survey our research on smart meeting rooms and its relevance for augmented reality meeting support and virtual reality generation of meetings in real time or off-line. The research reported here forms part of the European 5th and 6th framework programme projects multi-modal meeting manager (M4) and augmented multi-party interaction (AMI). Both projects aim at building a smart meeting environment that is able to collect multimodal captures of the activities and discussions in a meeting room, with the aim to use this information as input to tools that allow real-time support, browsing, retrieval and summarization of meetings. Our aim is to research (semantic) representations of what takes place during meetings in order to allow generation, e.g. in virtual reality, of meeting activities (discussions, presentations, voting, etc.). Being able to do so also allows us to look at tools that provide support during a meeting and at tools that allow those not able to be physically present during a meeting to take part in a virtual way. This may lead to situations where the differences between real meeting participants, human-controlled virtual participants and (semi-) autonomous virtual participants disappear

Artificial intelligence-based conversational agents used for sustainable fashion: systematic literature review.

In the past five years, the textile industry has undergone significant transformations in response to evolving fashion trends and increased consumer garment turnover. To address the environmental impacts of fast fashion, the industry is embracing artificial intelligence (AI) and immersive technologies, particularly leveraging conversational agents as personalised guides for sustainable fashion practices. In this research paper, we conduct a systematic literature review to categorise techniques, platforms, and applications of conversational agents in promoting sustainability within the fashion industry. Additionally, the review aims to scrutinise the solutions offered, identify gaps in the existing literature, and provide insights into the effectiveness and limitations of these conversational agents. Utilising a predefined search strategy on IEEE Xplore, Google Scholar, SCOPUS, and Web of Science, 15 relevant articles were selected through a step-by-step procedure based on the guidelines of the PRISMA framework. The findings reveal a notable global interest in AI-powered conversational agents, with Italy emerging as a significant centre for research in this domain. The studies predominantly focus on consumer perceptions and intentions regarding the adoption of AI technologies, indicating a broader curiosity about how individuals incorporate such innovations into their daily lives. Moreover, a substantial proportion of the studies employs diverse methods, reflecting a comprehensive approach to understanding the functionality and performance of conversational agents in various contexts. While acknowledging the historical precedence of text-based agents, the review highlights a research gap related to embodied agents. The conclusion emphasises the need for continued exploration, particularly in understanding the broader impact of these technologies on creating sustainable and environmentally-friendly business models in the e-retail sector

Evaluation of human-like anthropomorphism in the context of online bidding and affordances

This paper presents a four condition experiment and the results concerning the wider area of investigating the effectiveness and user satisfaction of using anthropomorphic feedback at the user interface. The specific context used was online bidding. The four conditions used in the experiment were human video, human voice, human voice with anthropomorphic text and a control consisting of neutral text. The main results of the experiment showed significant differences in participants' perceptions regarding the 'humanity' of the feedback they used. As expected, the control condition consisting of neutral text incurred significantly lower ratings for the 'humanity' characteristics of the feedback. The human video condition also incurred significantly stronger perceptions regarding the appearance being human. The results were also analysed in light of the theory of affordances and the authors conclude that the four conditions used in the experiment were likely equivalent in their facilitating the affordances. Therefore the authors suggest that facilitating the affordances may be more crucial to a user interface and the users than the actual anthropomorphic characteristic of the feedback used

“Funny How?” A Serious Look at Humor in Conversational Agents

Conversational agents are rapidly advancing in terms of their capabilities and human likeness - both of which are intended to enhance the user experience and engagement. One human quality that can potentially increase trust and likeability is humor. However, what is considered humorous and what is not depends on many contextual and personal factors that are not only difficult for machines to detect, but even humans are still struggling to understand them. This makes training AI to be humorous highly challenging. But is this due only to the technical limitations? In this provocation paper, we discuss the hindrances to utilizing humor in commercial conversational agents and propose addressing this topic from a social and political perspective

Humanos virtuales para la intervención en TEA: una breve revisión del alcance

Individuals with autism spectrum disorder may present social-communicative and behavioral deficits. Recently, research on treatment and diagnosis has shifted its focus to the application of new technologies. Among them is virtual reality, which guarantees a high sense of realism to the experience and allows the implementation of a virtual agent that facilitates the use of the application. In social skills interventions, it has been mostly chosen to implement a virtual agent with a human appearance. Virtual humans guide the user-system interaction through the use of verbal and nonverbal language. They can be equipped with responsiveness: the ability to provide responses to the user based on data recorded during the use of the technology. Responsiveness is functional when the goal is to create an interaction similar to that of everyday life, as it allows for behavioral responses and, at a more sophisticated level, vocal responses. Considering virtual agents capable of holding a conversation with the user, to date three different methods have been implemented that make communication more or less realistic. This brief review proposes a synopsis of relevant virtual humans’ features and highlights some key ASD research areas wherein virtual humans are implemented for diagnosis and treatment. A total of 11 studies were selected and their analysis was summarized into 7 main categories. Finally, the clinical and technological implications of the results found were discussed.Los individuos con trastorno del espectro autista pueden presentar déficits socio-comunicativos y conductuales. Recientemente, la investigación sobre el tratamiento y el diagnóstico se ha centrado en la aplicación de nuevas tecnologías. Entre ellas se encuentra la realidad virtual, que garantiza un alto sentido de realismo a la experiencia y permite la implementación de un agente virtual que facilite el uso de la aplicación. En las intervenciones de habilidades sociales, se ha optado mayoritariamente por implementar un agente virtual con apariencia humana. Los humanos virtuales guían la interacción usuario-sistema mediante el uso de lenguaje verbal y no verbal. Estos pueden estar dotados de responsividad: la capacidad de proporcionar respuestas al usuario basadas en los datos registrados durante el uso de la tecnología. La responsividad es funcional cuando el objetivo es crear una interacción similar a la de la vida cotidiana, ya que permite dar respuestas conductuales y, a un nivel más sofisticado, respuestas vocales. Considerando los agentes virtuales capaces de mantener una conversación con el usuario, hasta la fecha se han implementado tres métodos diferentes que hacen que la comunicación sea más o menos realista. Esta breve revisión propone una sinopsis de las características de los humanos virtuales relevantes y destaca algunas áreas de investigación clave del TEA en las que se implementan humanos virtuales para el diagnóstico y el tratamiento. Se seleccionó un total de 11 estudios y su análisis se resumió en 7 categorías principales. Por último, se discuten las implicaciones clínicas y tecnológicas de los resultados encontrados.Educació