A model for providing emotion awareness and feedback using fuzzy logic in online learning

Monitoring users’ emotive states and using that information for providing feedback and scaffolding is crucial. In the learning context, emotions can be used to increase students’ attention as well as to improve memory and reasoning. In this context, tutors should be prepared to create affective learning situations and encourage collaborative knowledge construction as well as identify those students’ feelings which hinder learning process. In this paper, we propose a novel approach to label affective behavior in educational discourse based on fuzzy logic, which enables a human or virtual tutor to capture students’ emotions, make students aware of their own emotions, assess these emotions and provide appropriate affective feedback. To that end, we propose a fuzzy classifier that provides a priori qualitative assessment and fuzzy qualifiers bound to the amounts such as few, regular and many assigned by an affective dictionary to every word. The advantage of the statistical approach is to reduce the classical pollution problem of training and analyzing the scenario using the same dataset. Our approach has been tested in a real online learning environment and proved to have a very positive influence on students’ learning performance.Peer ReviewedPostprint (author's final draft

The efects of peer corrective feedback trainning in face to face interaction and synchronousvideo-based computer-mediated comunication

Tesis (Profesor de Inglés para la Enseñanza Básica y Media y al grado académico de Licenciado en Educación)This quasi-experimental study was conducted in a private school, in Santiago, Chile, with four groups formed by 9th graders with the same L1 (Spanish) immersed in an EFL context. The purpose of the study was to examine ways in which the potential of peer interaction on learning is maximized. Specifically, the study examined two instructional techniques, both of which have been gaining increasing attention from second language acquisition researchers: (a) training learners how to correct each other (corrective feedback: CF), and (b) synchronous communicative interaction via video-based computer-mediated communication (SVCMC). Participants were divided into four groups depending on their experimental conditions. Group A (SVCMC+CF training) engaged in communicative peer interaction via SVCMC and received CF training. Group B (SVCMC-CF training) was given the same peer interaction tasks but did not receive any CF training. Groups C (FTF+CF training) and D (FTF-CF training) engaged in the same tasks in face-to-face in the classroom while only Group C received CF training. The intervention period lasted two weeks, consisting of four classes of 45 minutes for each of the four groups. The analysis involved (a) learners’ interactional behaviors, namely, language-related episodes, (b) their developmental outcomes with pre- and posttests focusing on past tense and locative usages, and (c) their perceptions based on exit questionnaire with close- and open-items. The results of this study reflected 3 main findings in peer interaction, corrective feedback, and SVCMC. With regard to interactional patterns (peer interaction), corrective feedback training promotes collaboration and so FTF environments, yet in SVCMC dominant patterns were more likely to arise. Meanwhile, CF training helped enhance learners’ language development as their results in the post-test were higher than in the pre-test and, in turn, SVCMC groups outperformed FTF groups. Concerning students’ perceptions, they overtly expressed positive beliefs regarding Peer Corrective Feedback and SVCMC activities. In short, clear differences were found among groups with different interventions resulting in distinct patterns, L2 development outcomes, and learner perceptions.Este estudio cuasi-experimental fue conducido en un colegio privado en Santiago de Chile, con cuatro grupos formados por estudiantes de primer año medio, cuya lengua nativa es el español. Los estudiantes estuvieron inmersos en un contexto EFL. El propósito del estudio fue examinar medios por las cuales el potencial de la interacción entre pares en el aprendizaje sea maximizado. Específicamente, este estudio examinó dos técnicas instructivas, las cuales han recibido recientemente atención paulatina de los investigadores en el campo de la adquisición de un segundo idioma: (a) capacitar a los estudiantes en como corregir a sus pares (retroalimentación), e (b) interacción comunicativa sincronizada a través de video conferencias (ICSV) mediadas por computadores. Los participantes fueron divididos en cuatro grupos según sus condiciones experimentales. El Grupo A (ICSV+ capacitación en retroalimentación) involucrado en interacción comunicativa— entre pares— a través de ICSV y recibieron instrucción en retroalimentación entre pares. Al Grupo B (ICSV – capacitación en retroalimentación) se le dio las mismas tareas, pero no recibió capacitación en retroalimentación. El Grupo C (cara a cara + capacitación en retroalimentación) y el Grupo D (cara a cara – capacitación en retroalimentación) participaron en las mismas tareas cara a cara en la sala de clases mientras que solo el Grupo C recibió capacitación en retroalimentación. El periodo de intervención fue de 2 semanas, compuesto de 4 clases de 45 min para cada uno de los grupos. Este análisis involucró (a) comportamientos interaccionales de los estudiantes, es decir, episodios relacionados con el lenguaje, (b) los resultados que reflejaron el desarrollo del lenguaje de los estudiantes fueron obtenidos mediante una evaluación previa a la intervención y otra posterior a la intervención; las evaluaciones se enfocaron en el uso del pasado simple y locativos, finalmente (c) las percepciones de los estudiantes obtenidas mediante un cuestionario de preguntas cerradas y abiertas. Los resultados de este estudio reflejaron 3 hallazgos principales en cuanto a interacción entre pares, retroalimentación, e ICSV. En cuanto a los patrones interacciónales (interacción entre pares), la retroalimentación y la comunicación cara a cara resultaron promover la colaboración, a diferencia de ICSV en la cual los patrones dominantes tuvieron más probabilidades de surgir. Mientras tanto, la capacitación en retroalimentación ayudó al mejoramiento del desarrollo del lenguaje de los estudiantes ya que sus resultados a lo largo de las evaluaciones pre y post presentaron un alza y, en consecuencia, los grupos que interactuaron a través de ICSV superaron a los grupos que interactuaron cara a cara. Tomando en cuenta las percepciones de los estudiantes, ellos expresaron abiertamente ideas positivas en cuanto a las actividades la capacitación en retroalimentación e ICSV. En resumen, diferencias claras fueron encontradas entre los grupos con diferentes intervenciones resultando en distintos patrones de interacción, resultados en el desarrollo del lenguaje, y percepciones de los estudiantes

Situational Awareness Support to Enhance Teamwork in Collaborative Environments

Modern collaborative environments often provide an overwhelming amount of visual information on multiple displays. The multitude of personal and shared interaction devices leads to lack of awareness of team members on ongoing activities, and awareness of who is in control of shared artefacts. This research addresses the situational awareness (SA) support of multidisciplinary teams in co-located collaborative environments. This work aims at getting insights into design and evaluation of large displays systems that afford SA and effective teamwork

Collocated Collaboration Analytics: Principles and Dilemmas for Mining Multimodal Interaction Data

© 2019, Copyright © 2017 Taylor & Francis Group, LLC. Learning to collaborate effectively requires practice, awareness of group dynamics, and reflection; often it benefits from coaching by an expert facilitator. However, in physical spaces it is not always easy to provide teams with evidence to support collaboration. Emerging technology provides a promising opportunity to make collocated collaboration visible by harnessing data about interactions and then mining and visualizing it. These collocated collaboration analytics can help researchers, designers, and users to understand the complexity of collaboration and to find ways they can support collaboration. This article introduces and motivates a set of principles for mining collocated collaboration data and draws attention to trade-offs that may need to be negotiated en route. We integrate Data Science principles and techniques with the advances in interactive surface devices and sensing technologies. We draw on a 7-year research program that has involved the analysis of six group situations in collocated settings with more than 500 users and a variety of surface technologies, tasks, grouping structures, and domains. The contribution of the article includes the key insights and themes that we have identified and summarized in a set of principles and dilemmas that can inform design of future collocated collaboration analytics innovations

Cooperative Interactive Distributed Guidance on Mobile Devices

Mobiles device are quickly becoming an indispensable part of our society. Equipped with numerous communication capabilities, they are increasingly being examined as potential tools for civilian and military usage to aide in distributed remote collaboration for dynamic decision making and physical task completion. With an ever growing mobile workforce, the need for remote assistance in aiding field workers who are confronted with situations outside their expertise certainly increases. Enhanced capabilities in using mobile devices could significantly improve numerous components of a task\u27s completion (i.e. accuracy, timing, etc.). This dissertation considers the design of mobile implementation of technology and communication capabilities to support interactive collaboration between distributed team members. Specifically, this body of research seeks to explore and understand how various multimodal remote assistances affect both the human user\u27s performance and the mobile device\u27s effectiveness when used during cooperative tasks. Additionally, power effects are additionally studied to assess the energy demands on a mobile device supporting multimodal communication. In a series of applied experiments and demonstrations, the effectiveness of a mobile device facilitating multimodal collaboration is analyzed through both empirical data collection and subjective exploration. The utility of the mobile interactive system and its configurations are examined to assess the impact on distributed task performance and collaborative dialogue between pairs. The dissertation formulates and defends an argument that multimodal communication capabilities should be incorporated into mobile communication channels to provide collaborating partners salient perspectives with a goal of reaching a mutual understanding of task procedures. The body of research discusses the findings of this investigation and highlight these findings they may influence future mobile research seeking to enhance interactive distributed guidance

Evaluating the impact of multimodal Collaborative Virtual Environments on user’s spatial knowledge and experience of gamified educational tasks

Several research projects in spatial cognition have suggested Virtual Environments (VEs) as an effective way of facilitating mental map development of a physical space. In the study reported in this paper, we evaluated the effectiveness of multimodal real-time interaction in distilling understanding of the VE after completing gamified educational tasks. We also measure the impact of these design elements on the user’s experience of educational tasks. The VE used reassembles an art gallery and it was built using REVERIE (Real and Virtual Engagement In Realistic Immersive Environment) a framework designed to enable multimodal communication on the Web. We compared the impact of REVERIE VG with an educational platform called Edu-Simulation for the same gamified educational tasks. We found that the multimodal VE had no impact on the ability of students to retain a mental model of the virtual space. However, we also found that students thought that it was easier to build a mental map of the virtual space in REVERIE VG. This means that using a multimodal CVE in a gamified educational experience does not benefit spatial performance, but also it does not cause distraction. The paper ends with future work and conclusions and suggestions for improving mental map construction and user experience in multimodal CVEs

Evaluating the impact of multimodal Collaborative Virtual Environments on user’s spatial knowledge and experience of gamified educational tasks

Several research projects in spatial cognition have suggested Virtual Environments (VEs) as an effective way of facilitating mental map development of a physical space. In the study reported in this paper, we evaluated the effectiveness of multimodal real-time interaction in distilling understanding of the VE after completing gamified educational tasks. We also measure the impact of these design elements on the user’s experience of educational tasks. The VE used reassembles an art gallery and it was built using REVERIE (Real and Virtual Engagement In Realistic Immersive Environment) a framework designed to enable multimodal communication on the Web. We compared the impact of REVERIE VG with an educational platform called Edu-Simulation for the same gamified educational tasks. We found that the multimodal VE had no impact on the ability of students to retain a mental model of the virtual space. However, we also found that students thought that it was easier to build a mental map of the virtual space in REVERIE VG. This means that using a multimodal CVE in a gamified educational experience does not benefit spatial performance, but also it does not cause distraction. The paper ends with future work and conclusions and suggestions for improving mental map construction and user experience in multimodal CVEs