Towards responsive Sensitive Artificial Listeners

This paper describes work in the recently started project SEMAINE, which aims to build a set of Sensitive Artificial Listeners – conversational agents designed to sustain an interaction with a human user despite limited verbal skills, through robust recognition and generation of non-verbal behaviour in real-time, both when the agent is speaking and listening. We report on data collection and on the design of a system architecture in view of real-time responsiveness

Affective feedback: an investigation into the role of emotions in the information seeking process

User feedback is considered to be a critical element in the information seeking process, especially in relation to relevance assessment. Current feedback techniques determine content relevance with respect to the cognitive and situational levels of interaction that occurs between the user and the retrieval system. However, apart from real-life problems and information objects, users interact with intentions, motivations and feelings, which can be seen as critical aspects of cognition and decision-making. The study presented in this paper serves as a starting point to the exploration of the role of emotions in the information seeking process. Results show that the latter not only interweave with different physiological, psychological and cognitive processes, but also form distinctive patterns, according to specific task, and according to specific user

Human-computer interaction in ubiquitous computing environments

Purpose &ndash; The purpose of this paper is to explore characteristics of human-computer interaction when the human body and its movements become input for interaction and interface control in pervasive computing settings. Design/methodology/approach &ndash; The paper quantifies the performance of human movement based on Fitt\u27s Law and discusses some of the human factors and technical considerations that arise in trying to use human body movements as an input medium. Findings &ndash; The paper finds that new interaction technologies utilising human movements may provide more flexible, naturalistic interfaces and support the ubiquitous or pervasive computing paradigm. Practical implications &ndash; In pervasive computing environments the challenge is to create intuitive and user-friendly interfaces. Application domains that may utilize human body movements as input are surveyed here and the paper addresses issues such as culture, privacy, security and ethics raised by movement of a user\u27s body-based interaction styles. Originality/value &ndash; The paper describes the utilization of human body movements as input for interaction and interface control in pervasive computing settings. <br /

Affective computing: challenges and prospect

Abstract-Affective computing simulates empathy through machine that could recognize, interpret, process and respond to human affects. With the use of sensors and computational devices, it proposes to exhibit either innate emotional capabilities or that is capable of convincingly simulating emotions. The paper focuses on varied challenges and future scope of affective computing. The technologies for affective computing are varied but expression if not natural may not yield 100% accurate results. The systems may lack rotational movement freedom and also ignores situational factors in emotional understanding

Methodological considerations concerning manual annotation of musical audio in function of algorithm development

In research on musical audio-mining, annotated music databases are needed which allow the development of computational tools that extract from the musical audiostream the kind of high-level content that users can deal with in Music Information Retrieval (MIR) contexts. The notion of musical content, and therefore the notion of annotation, is ill-defined, however, both in the syntactic and semantic sense. As a consequence, annotation has been approached from a variety of perspectives (but mainly linguistic-symbolic oriented), and a general methodology is lacking. This paper is a step towards the definition of a general framework for manual annotation of musical audio in function of a computational approach to musical audio-mining that is based on algorithms that learn from annotated data. 1

Observer Annotation of Affective Display and Evaluation of Expressivity: Face vs. Face-and-body

A first step in developing and testing a robust affective multimodal system is to obtain or access data representing human multimodal expressive behaviour. Collected affect data has to be further annotated in order to become usable for the automated systems. Most of the existing studies of emotion or affect annotation are monomodal. Instead, in this paper, we explore how independent human observers annotate affect display from monomodal face data compared to bimodal face-and-body data. To this aim we collected visual affect data by recording the face and face-and-body simultaneously. We then conducted a survey by asking human observers to view and label the face and face-and-body recordings separately. The results obtained show that in general, viewing face-and-body simultaneously helps with resolving the ambiguity in annotating emotional behaviours

Inclusive Intelligent Learning Management System Framework

Machado, D. S-M., & Santos, V. (2023). Inclusive Intelligent Learning Management System Framework. International Journal of Automation and Smart Technology, 13(1), [2423]. https://doi.org/10.5875/ausmt.v13i1.2423The article finds context and the current state of the art in a systematic literature review on intelligent systems employing PRISMA Methodology which is complemented with narrative literature review on disabilities, digital accessibility and legal and standards context. The main conclusion from this review was the existing gap between the available knowledge, standards, and law and what is put into practice in higher education institutions in Portugal. Design Science Research Methodology was applied to output an Inclusive Intelligent Learning Management System Framework aiming to help higher education professors to share accessible pedagogic content and deliver on-line and presential classes with a high level of accessibility for students with different types of disabilities, assessing the uploaded content with Web content Accessibility Guidelines 3.0, clustering students according to their profile, conscient feedback and emotional assessment during content consumption, applying predictive models and signaling students at risk of failing classes according to study habits and finally applying a recommender system. The framework was validated by a focus group to which experts in digital accessibility, information systems and a disabled PhD graduate.publishersversionpublishe

A Survey on Human Emotion Recognition Approaches, Databases and Applications

This paper presents the various emotion classification and recognition systems which implement methods aiming at improving Human Machine Interaction. The modalities and approaches used for affect detection vary and contribute to accuracy and efficacy in detecting emotions of human beings. This paper discovers them in a comparison and descriptive manner. Various applications that use the methodologies in different contexts to address the challenges in real time are discussed. This survey also describes the databases that can be used as standard data sets in the process of emotion identification. Thus an integrated discussion of methods, databases used and applications pertaining to the emerging field of Affective Computing (AC) is done and surveyed.This paper presents the various emotion classification and recognition systems which implement methods aiming at improving Human Machine Interaction. The modalities and approaches used for affect detection vary and contribute to accuracy and efficacy in detecting emotions of human beings. This paper discovers them in a comparison and descriptive manner. Various applications that use the methodologies in different contexts to address the challenges in real time are discussed. This survey also describes the databases that can be used as standard data sets in the process of emotion identification. Thus an integrated discussion of methods, databases used and applications pertaining to the emerging field of Affective Computing (AC) is done and surveyed