Proceedings of the 6th Workshop on Awareness and Reflection in Technology Enhanced Learning. In conjunction with the 11th European Conference on Technology Enhanced Learning: Adaptive and Adaptable Learning.

Awareness and reflection are viewed differently across the disciplines informing Technology-Enhanced Learning (CSCW, psychology, educational sciences, computer science and others). The ARTEL workshop series brings together researchers and professionals from different backgrounds to provide a forum for discussing the multi-faceted area of awareness and reflection. 2016 was the 6th workshop in this series. Through the last ARTEL workshops at EC-TEL the topic has gained maturity and questions addresses are converging towards the usage of awareness and reflection in practice, its implementation in modern organisations, its impact on learners and questions of feasibility and sustainability for awareness and reflection in education and work. To reflect the growing maturity of research in ARTEL over the years in conjunction with the latest trends in TEL, this year's topic particularly invited contributions that deal with the contribution and impact of Learning Analytics on awareness and reflection. The motto of the workshop this year was: 'Learning Analytics for Awareness and Reflection: How can Learning Analytics methodologies and tools support awareness and reflection in different learning contexts?

Instruments for visualization of self, co, and socially shared regulation of learning using multimodal analytics:a systematic review

Abstract. This thesis presents a systematic literature review in the intersection of multimodal learning analytics, regulation theories of learning, and visual analytics literature of the last decade (2011- 2021). This review is to collect existing research-based instruments designed to visualize Self-Regulation of Learning (SRL), Co-Regulation of learning (CoRL), and Socially Shared Regulation of learning (SSRL) using dashboards and multimodal data. The inclusion and exclusion criteria used in this review addressed two main aims. First, to distil settings, instruments, constructs, and audiences. Second, to identify visualization used for targets (i.e., cognition, motivation, and emotion), phases (i.e., forethought, performance, and reflection), and types of regulation (i.e., SRL, CoRL, and SSRL). By following the Preferred Reporting Items for Systematic Reviews and MetaAnalyses (PRISMA) guidelines, this thesis included 23 peer-reviewed articles out of 383 articles retrieved from 5 different databases searched in April 2021. The main findings from this literature review are (a) the included articles used theoretical grounding of SRL in all articles while CoRL is used only in 3 articles and SSRL only in 2 articles; (b) most articles used both teachers and students as the audience for visual feedback and operated in online learning settings; (c) selected articles focused mainly on visualizing cognition and motivation (17 articles each) as targets of regulation, while emotion as the target was applied only in 6 articles; (d) The performance phase was common to most of the articles and used various visualizations followed by reflection and forethought phases respectively. Simple visualizations, i.e., progress bar chart, line chart, color coding, are used more frequently than bubble chart, stacked column chart, funnel chart, heat maps, and Sankey diagram. Most of the dashboard instruments identified in the review are still improving their designs. Therefore, the results of this review should be put into the context of future studies to be utilized by researchers and teachers in recognizing the missing targets and phases of SRL, CoRL, and SSRL in visualized feedback. Addressing these could also assist them in giving timely feedback on students’ learning strategies to improve their regulatory skills

Indicators needed to design a student dashboard from lecturers’ perspectives: a qualitative study

The number of students’ enrolled in Higher Education online courses is increasing, and as a result, more data about their learning process is generated. The data produced can be displayed on a dashboard and help students in their learning process. However, lecturers’ perspective should be taken into account to define the indicators of the dashboard as the design of the courses could impact on the elements included on it. And that is precisely the aim of this paper: to define the indicators needed to design a student dashboard in online courses taking into account lecturers' perspectives. This study was carried out with 10 lecturers from the Faculty of Humanities and Education from Mondragon Unibertsitatea. Online qualitative questionnaires were used to gather participants’ perceptions. Results show that most of the lecturers participating in the research study identified four indicators to design a student dashboard: number of times students access the course forum, amount of contributions in the forum, number of times students consult the information booklet, and number of times each student has accessed the course in a week time. Conclusions drawn from this study highlight the importance of training lecturers and students on the pedagogical use of data visualization

Collocated Collaboration Analytics: Principles and Dilemmas for Mining Multimodal Interaction Data

© 2019, Copyright © 2017 Taylor & Francis Group, LLC. Learning to collaborate effectively requires practice, awareness of group dynamics, and reflection; often it benefits from coaching by an expert facilitator. However, in physical spaces it is not always easy to provide teams with evidence to support collaboration. Emerging technology provides a promising opportunity to make collocated collaboration visible by harnessing data about interactions and then mining and visualizing it. These collocated collaboration analytics can help researchers, designers, and users to understand the complexity of collaboration and to find ways they can support collaboration. This article introduces and motivates a set of principles for mining collocated collaboration data and draws attention to trade-offs that may need to be negotiated en route. We integrate Data Science principles and techniques with the advances in interactive surface devices and sensing technologies. We draw on a 7-year research program that has involved the analysis of six group situations in collocated settings with more than 500 users and a variety of surface technologies, tasks, grouping structures, and domains. The contribution of the article includes the key insights and themes that we have identified and summarized in a set of principles and dilemmas that can inform design of future collocated collaboration analytics innovations

Towards a social learning space for open educational resources

We identify a number of meanings of “Open”, as part of the motivating rationale for a social media space tuned for learning, called SocialLearn. We discuss why online social learning seems to be emerging so strongly at this point, explore features of social learning, and identify some of the dimensions that we believe characterize the social learning design space, before describing the emerging design concept and implementation

Unleashing Process Mining for Education: Designing an IT-Tool for Students to Self-Monitor their Personal Learning Paths

The ability of students to self-monitor their learning paths is in demand as never before due to the recent rise of online education formats, which entails less interaction with lecturers. Recent advantages in educational process mining (EPM) offer new opportunities to monitor students’ learning paths by processing log data captured by technology-mediated learning environments. However, current literature falls short on providing user-centered design principles for ITtools which can monitor learning paths using EPM. Hence, in this paper, we examine how to design a self-monitoring tool that supports students to evaluate their learning paths. Based on theoretical insights of 66 papers and nine user interviews, we propose seven design principles for an IT-tool which facilitates self-monitoring for students based on EPM. Further, we evaluate the design principles with seven potential users. Our results demonstrate a promising approach to help students improve their self-efficacy in their individual learning process using EPM

Learning Analytics Dashboard for Teaching with Twitter

As social media takes root in our society, more University instructors are incorporating platforms like Twitter into their classroom. However, few of the current Learning Analytics (LA) systems process social media data for instructional interventions and evaluation. As a result, instructors who are using social media cannot easily assess their students’ learning progress or use the data to adjust their lessons in real time. We surveyed 54 university instructors to better understand how they use social media in the classroom; we then used these results to design and evaluate our own Twitter-centric LA dashboard. The overarching goals for this project were to 1) assist instructors in determining whether their particular use of Twitter met their teaching objectives, and 2) help system designers navigate the nuance of designing LA dashboards for social media platforms

An Open Learner Model Dashboard for Adaptive Learning

The thesis describes the design process of the independent OLM dashboard, MittFagkart, that visualizes student activity data across digital math tools used in Norwegian classrooms for teachers.Masteroppgave i informasjonsvitenskapINFO390MASV-INF