Estimation of Success in Collaborative Learning Based on Multimodal Learning Analytics Features

Multimodal learning analytics provides researchers new tools and techniques to capture different types of data from complex learning activities in dynamic learning environments. This paper investigates high-fidelity synchronised multimodal recordings of small groups of learners interacting from diverse sensors that include computer vision, user generated content, and data from the learning objects (like physical computing components or laboratory equipment). We processed and extracted different aspects of the students' interactions to answer the following question: which features of student group work are good predictors of team success in open-ended tasks with physical computing? The answer to the question provides ways to automatically identify the students' performance during the learning activities

Collocated Collaboration Analytics: Principles and Dilemmas for Mining Multimodal Interaction Data

© 2019, Copyright © 2017 Taylor & Francis Group, LLC. Learning to collaborate effectively requires practice, awareness of group dynamics, and reflection; often it benefits from coaching by an expert facilitator. However, in physical spaces it is not always easy to provide teams with evidence to support collaboration. Emerging technology provides a promising opportunity to make collocated collaboration visible by harnessing data about interactions and then mining and visualizing it. These collocated collaboration analytics can help researchers, designers, and users to understand the complexity of collaboration and to find ways they can support collaboration. This article introduces and motivates a set of principles for mining collocated collaboration data and draws attention to trade-offs that may need to be negotiated en route. We integrate Data Science principles and techniques with the advances in interactive surface devices and sensing technologies. We draw on a 7-year research program that has involved the analysis of six group situations in collocated settings with more than 500 users and a variety of surface technologies, tasks, grouping structures, and domains. The contribution of the article includes the key insights and themes that we have identified and summarized in a set of principles and dilemmas that can inform design of future collocated collaboration analytics innovations

Trusted Artificial Intelligence in Manufacturing; Trusted Artificial Intelligence in Manufacturing

The successful deployment of AI solutions in manufacturing environments hinges on their security, safety and reliability which becomes more challenging in settings where multiple AI systems (e.g., industrial robots, robotic cells, Deep Neural Networks (DNNs)) interact as atomic systems and with humans. To guarantee the safe and reliable operation of AI systems in the shopfloor, there is a need to address many challenges in the scope of complex, heterogeneous, dynamic and unpredictable environments. Specifically, data reliability, human machine interaction, security, transparency and explainability challenges need to be addressed at the same time. Recent advances in AI research (e.g., in deep neural networks security and explainable AI (XAI) systems), coupled with novel research outcomes in the formal specification and verification of AI systems provide a sound basis for safe and reliable AI deployments in production lines. Moreover, the legal and regulatory dimension of safe and reliable AI solutions in production lines must be considered as well. To address some of the above listed challenges, fifteen European Organizations collaborate in the scope of the STAR project, a research initiative funded by the European Commission in the scope of its H2020 program (Grant Agreement Number: 956573). STAR researches, develops, and validates novel technologies that enable AI systems to acquire knowledge in order to take timely and safe decisions in dynamic and unpredictable environments. Moreover, the project researches and delivers approaches that enable AI systems to confront sophisticated adversaries and to remain robust against security attacks. This book is co-authored by the STAR consortium members and provides a review of technologies, techniques and systems for trusted, ethical, and secure AI in manufacturing. The different chapters of the book cover systems and technologies for industrial data reliability, responsible and transparent artificial intelligence systems, human centered manufacturing systems such as human-centred digital twins, cyber-defence in AI systems, simulated reality systems, human robot collaboration systems, as well as automated mobile robots for manufacturing environments. A variety of cutting-edge AI technologies are employed by these systems including deep neural networks, reinforcement learning systems, and explainable artificial intelligence systems. Furthermore, relevant standards and applicable regulations are discussed. Beyond reviewing state of the art standards and technologies, the book illustrates how the STAR research goes beyond the state of the art, towards enabling and showcasing human-centred technologies in production lines. Emphasis is put on dynamic human in the loop scenarios, where ethical, transparent, and trusted AI systems co-exist with human workers. The book is made available as an open access publication, which could make it broadly and freely available to the AI and smart manufacturing communities

Emotional Regulation in Synchronous Online Collaborative Learning: A Facial Expression Recognition Study

Emotional regulation in learning has been recognised as a critical factor for collaborative learning success. However, the “unobservable” processes of emotion and motivation at the core of learning regulation have challenged the methodological progress to examine and support learners’ regulation. Artificial intelligence (AI) and learning analytics have recently brought novel opportunities for investigating the learning processes. This multidisciplinary study proposes a novel fine-grained approach to provide empirical evidence on the application of these advanced technologies in assessing emotional regulation in synchronous computer-support collaborative learning (CSCL). The study involved eighteen university students (N=18) working collaboratively in groups of three. The process mining analysis was adopted to explore the patterns of emotional regulation in synchronous CSCL, while AI facial expression recognition was used for examining learners’ associated emotions and emotional synchrony in regulatory activities. Our findings establish a foundation for further design of human-centred AI-enhanced support for collaborative learning regulation

Exploring teachers’ perceptions of critical digital literacies and how these are manifested in their teaching practices

Digital systems are increasingly becoming central to the running of contemporary schools. A range of digital tools are also adopted by teachers to facilitate face to face teaching and learning and more recently to accommodate remote schooling. Similarly, digital technologies lie at the heart of how students support their learning but also interact with peers. These digital practices raise questions in relation to teachers’ own critical digital literacies as well as their role in developing students’ critical digital literacies. This paper presents the findings of a qualitative study that aimed to develop an understanding of teachers’ current experiences and future needs relating to critical digital literacies within school contexts. Drawing on empirical data collected during focus group interviews with primary and secondary school teachers in Finland, Italy, Spain and the UK this paper looks at teachers’ perceptions of critical digital literacies and explores whether and how these are manifested in their practices. Findings revealed that different dimensions of critical digital literacies were more prevalent for each national group and highlighted the disjuncture between how Critical digital literacies (CDL) is defined and perceived in academic research with a stronger emphasis on the “critical” and between the more “twenty-first century skills” oriented policy agendas and curricula which inform teachers’ practice. The paper goes on to discuss the implications of these findings and identifies gaps in relation to teachers’ understandings of critical digital literacies. Last, it offers original insights for future policymaking, research and practice regarding the challenges of supporting teachers with developing critical digital literacies

Temporal pathways to learning: how learning emerges in an open-ended collaborative activity

The learning process depends on the nature of the learning environment, particularly in the case of open-ended learning environments, where the learning process is considered to be non-linear. In this paper, we report on the findings of employing a multimodal Hidden Markov Model (HMM) based methodology to investigate the temporal learning processes of two types of learners that have learning gains and a type that does not have learning gains in an open-ended collaborative learning activity. Considering log data, speech behavior, affective states and gaze patterns, we find that all learners start from a similar state of non-productivity, but once out of it they are unlikely to fall back into that state, especially in the case of the learners that have learning gains. Those who have learning gains shift between two problem solving strategies, each characterized by both exploratory and reflective actions, as well as demonstrate speech and gaze patterns associated with these strategies, that differ from those who don't have learning gains. Further, the teams that have learning gains also differ between themselves in the manner in which they employ the problem solving strategies over the interaction, as well as in the manner they express negative emotions while exhibiting a particular strategy. These outcomes contribute to understanding the multiple pathways of learning in an open-ended collaborative learning environment, and provide actionable insights for designing effective interventions