A Novel Multimodal Approach for Studying the Dynamics of Curiosity in Small Group Learning

Curiosity is a vital metacognitive skill in educational contexts, leading to creativity, and a love of learning. And while many school systems increasingly undercut curiosity by teaching to the test, teachers are increasingly interested in how to evoke curiosity in their students to prepare them for a world in which lifelong learning and reskilling will be more and more important. One aspect of curiosity that has received little attention, however, is the role of peers in eliciting curiosity. We present what we believe to be the first theoretical framework that articulates an integrated socio-cognitive account of curiosity that ties observable behaviors in peers to underlying curiosity states. We make a bipartite distinction between individual and interpersonal functions that contribute to curiosity, and multimodal behaviors that fulfill these functions. We validate the proposed framework by leveraging a longitudinal latent variable modeling approach. Findings confirm a positive predictive relationship between the latent variables of individual and interpersonal functions and curiosity, with the interpersonal functions exercising a comparatively stronger influence. Prominent behavioral realizations of these functions are also discovered in a data-driven manner. We instantiate the proposed theoretical framework in a set of strategies and tactics that can be incorporated into learning technologies to indicate, evoke, and scaffold curiosity. This work is a step towards designing learning technologies that can recognize and evoke moment-by-moment curiosity during learning in social contexts and towards a more complete multimodal learning analytics. The underlying rationale is applicable more generally for developing computer support for other metacognitive and socio-emotional skills.Comment: arXiv admin note: text overlap with arXiv:1704.0748

Confirmation Report: Modelling Interlocutor Confusion in Situated Human Robot Interaction

Human-Robot Interaction (HRI) is an important but challenging field focused on improving the interaction between humans and robots such to make the interaction more intelligent and effective. However, building a natural conversational HRI is an interdisciplinary challenge for scholars, engineers, and designers. It is generally assumed that the pinnacle of human- robot interaction will be having fluid naturalistic conversational interaction that in important ways mimics that of how humans interact with each other. This of course is challenging at a number of levels, and in particular there are considerable difficulties when it comes to naturally monitoring and responding to the user’s mental state. On the topic of mental states, one field that has received little attention to date is moni- toring the user for possible confusion states. Confusion is a non-trivial mental state which can be seen as having at least two substates. There two confusion states can be thought of as being associated with either negative or positive emotions. In the former, when people are productively confused, they have a passion to solve any current difficulties. Meanwhile, people who are in unproductive confusion may lose their engagement and motivation to overcome those difficulties, which in turn may even lead them to drop the current conversation. While there has been some research on confusion monitoring and detection, it has been limited with the most focused on evaluating confusion states in online learning tasks. The central hypothesis of this research is that the monitoring and detection of confusion states in users is essential to fluid task-centric HRI and that it should be possible to detect such confusion and adjust policies to mitigate the confusion in users. In this report, I expand on this hypothesis and set out several research questions. I also provide a comprehensive literature review before outlining work done to date towards my research hypothesis, I also set out plans for future experimental work

Leveraging the Potential of Conversational Agents: Quality Criteria for the Continuous Evaluation and Improvement

Contemporary organizations are increasingly adopting conversational agents (CAs) as intelligent and natural language-based solutions for providing services and information. CAs promote new forms of personalization, speed, cost-effectiveness, and automation. However, despite their hype in research and practice, organizations fail to sustain CAs in operations. They struggle to leverage CAs’ potential because they lack knowledge on how to evaluate and improve the quality of CAs throughout their lifecycle. We build on this research gap by conducting a design science research (DSR) project, aggregating insights from the literature and practice to derive a validated set of quality criteria for CAs. Our study contributes to CA research and guides practitioners by providing a blueprint to structure the evaluation of CAs to discover areas for systematic improvement

Conversational affective social robots for ageing and dementia support

Socially assistive robots (SAR) hold significant potential to assist older adults and people with dementia in human engagement and clinical contexts by supporting mental health and independence at home. While SAR research has recently experienced prolific growth, long-term trust, clinical translation and patient benefit remain immature. Affective human-robot interactions are unresolved and the deployment of robots with conversational abilities is fundamental for robustness and humanrobot engagement. In this paper, we review the state of the art within the past two decades, design trends, and current applications of conversational affective SAR for ageing and dementia support. A horizon scanning of AI voice technology for healthcare, including ubiquitous smart speakers, is further introduced to address current gaps inhibiting home use. We discuss the role of user-centred approaches in the design of voice systems, including the capacity to handle communication breakdowns for effective use by target populations. We summarise the state of development in interactions using speech and natural language processing, which forms a baseline for longitudinal health monitoring and cognitive assessment. Drawing from this foundation, we identify open challenges and propose future directions to advance conversational affective social robots for: 1) user engagement, 2) deployment in real-world settings, and 3) clinical translation

Persuasiveness of social robot ‘Nao’ based on gaze and proximity

Social Robots have widely infiltrated the retail and public space. Mainly, social robots are being utilized across a wide range of scenarios to influence decision making, disseminate information, and act as a signage mechanism, under the umbrella of Persuasive Robots or Persuasive Technology. While there have been several studies in the afore-mentioned area, the effect of non-verbal behaviour on persuasive abilities is generally unexplored. Therefore, in this research, we report whether two key non-verbal attributes, namely proximity and gaze, can elicit persuasively, compliance, and specific personality appeals. For this, we conducted a 2 (eye gaze) x 2 (proximity) between-subjects experiment where participants viewed a video-based scenario of the Nao robot. Our initial results did not reveal any significant results based on the non-verbal attributes. However, perceived compliance and persuasion were significantly correlated with knowledge, responsiveness, and trustworthiness. In conclusion, we discuss how the design of a robot could make it more convincing as extensive marketing and brand promotion companies could use robots to enhance their advertisement operations

A Novel Multimodal Approach for Studying the Dynamics of Curiosity in Small Group Learning

Curiosity is a vital metacognitive skill in educational contexts, leading to creativity, and a love of learning. And while many school systems increasingly undercut curiosity by teaching to the test, teachers are increasingly interested in how to evoke curiosity in their students to prepare them for a world in which lifelong learning and reskilling will be more and more important. One aspect of curiosity that has received little attention, however, is the role of peers in eliciting curiosity. We present what we believe to be the first theoretical framework that articulates an integrated socio-cognitive account of curiosity that ties observable behaviors in peers to underlying curiosity states. We make a bipartite distinction between individual and interpersonal functions that contribute to curiosity, and multimodal behaviors that fulfill these functions. We validate the proposed framework by leveraging a longitudinal latent variable modeling approach. Findings confirm a positive predictive relationship between the latent variables of individual and interpersonal functions and curiosity, with the interpersonal functions exercising a comparatively stronger influence. Prominent behavioral realizations of these functions are also discovered in a data-driven manner. We instantiate the proposed theoretical framework in a set of strategies and tactics that can be incorporated into learning technologies to indicate, evoke, and scaffold curiosity. This work is a step towards designing learning technologies that can recognize and evoke moment-by-moment curiosity during learning in social contexts and towards a more complete multimodal learning analytics. The underlying rationale is applicable more generally for developing computer support for other metacognitive and socio-emotional skills

Artificial Empathy in Marketing Interactions: Bridging the Human-AI Gap in Affective and Social Customer Experience

Artificial intelligence (AI) continues to transform firm-customer interactions. However, current AI marketing agents are often perceived as cold and uncaring and can be poor substitutes for human-based interactions. Addressing this issue, this article argues that artificial empathy needs to become an important design consideration in the next generation of AI marketing applications. Drawing from research in diverse disciplines, we develop a systematic framework for integrating artificial empathy into AI-enabled marketing interactions. We elaborate on the key components of artificial empathy and how each component can be implemented in AI marketing agents. We further explicate and test how artificial empathy generates value for both customers and firms by bridging the AI-human gap in affective and social customer experience. Recognizing that artificial empathy may not always be desirable or relevant, we identify the requirements for artificial empathy to create value and deduce situations where it is unnecessary and, in some cases, harmful

The Role of Pragmatics in Cross-cultural

We here try to find out the role of pragmatics in the cross-cultural contexts. Pragmatics is the way we convey meaning through communication (Deda, 2013). Other factors beyond competence are the adjustments between contexts and situations that can change the ordinary meaning of elements/sentences according to the language situation. The culture of an organization decides the way employees behave amongst themselves as well as the people outside the organization. Pragmatic culture more emphasis is placed on the clients and the external parties. Customer satisfaction is the main motive of the employees in a pragmatic culture. In linguistics, pragmatic competence is the ability to use language effectively in a contextually appropriate fashion. Pragmatic competence is a fundamental aspect of a more general communicative competence

Gesture as a Communication Strategy in Second Language Discourse : A Study of Learners of French and Swedish

Gesture is always mentioned in descriptions of compensatory behaviour in second language discourse, yet it has never been adequately integrated into any theory of Communication Strategies (CSs). This study suggests a method for achieving such an integration. By combining a cognitive theory of speech-associated gestures with a process-oriented framework for CSs, gesture and speech can be seen as reflections of similar underlying processes with different output modes. This approach allows oral and gestural CSs to be classified and analysed within a unified framework. The respective fields are presented in introductory surveys, and a review is provided of studies dealing specifically with compensatory gesture–in aphasia as well as in first and second language acquisition. The experimental part of this work consists of two studies. The production study examines the gestures exploited strategically by Swedish learners of French and French learners of Swedish. The subjects retold a cartoon story in their foreign language to native speakers in conversational narratives. To enable comparisons between learners and proficiency conditions both at individual and group level, subjects performed the task in both their first and their second language. The results show that, contrary to expectations in both fields, strategic gestures do not replace speech, but complement it. Moreover, although strategic gestures are used to solve lexical problems by depicting referential features, most learner gestures instead serve either to maintain visual co-reference at discourse level, or to provide metalinguistic comments on the communicative act itself. These latter functions have hitherto been ignored in CS research. Both similarities and differences can be found between oral and gestural CSs regarding the effect of proficiency, culture, task, and success. The influence of individual communicative style and strategic communicative competence is also discussed. Finally, native listeners’ gestural behaviour is shown to be related to the co-operative effort invested by them to ensure continued interaction, which in turn depends on the proficiency levels of the non-native narrators. The evaluation study investigates native speakers’ assessments of subjects’ gestures, and the effect of gestures on evaluations of proficiency. Native speakers rank all subjects as showing normal or reduced gesture rates and ranges–irrespective of proficiency condition. The influence of gestures on proficiency assessments is modest, but tends to be positive. The results concerning the effectiveness of gestural strategies are inconclusive, however. When exposed to auditory learner data only, listeners believe gestures would improve comprehension, but when learner gestures can be seen, they are not regarded as helpful. This study stresses the need to further examine the effect of strategic behaviour on assessments, and the perception of gestures in interaction. An integrated theory of Communication Strategies has to consider that gestures operate in two ways: as local measures of communicative ‘first-aid’, and as global communication enhancement for speakers and listeners alike. A probabilistic framework is outlined, where variability in performance as well as psycholinguistic and interactional aspects of gesture use are taken into account