Integrating knowledge tracing and item response theory: A tale of two frameworks

Traditionally, the assessment and learning science commu-nities rely on different paradigms to model student performance. The assessment community uses Item Response Theory which allows modeling different student abilities and problem difficulties, while the learning science community uses Knowledge Tracing, which captures skill acquisition. These two paradigms are complementary - IRT cannot be used to model student learning, while Knowledge Tracing assumes all students and problems are the same. Recently, two highly related models based on a principled synthesis of IRT and Knowledge Tracing were introduced. However, these two models were evaluated on different data sets, using different evaluation metrics and with different ways of splitting the data into training and testing sets. In this paper we reconcile the models' results by presenting a unified view of the two models, and by evaluating the models under a common evaluation metric. We find that both models are equivalent and only differ in their training procedure. Our results show that the combined IRT and Knowledge Tracing models offer the best of assessment and learning sciences - high prediction accuracy like the IRT model, and the ability to model student learning like Knowledge Tracing

The student-produced electronic portfolio in craft education

The authors studied primary school students’ experiences of using an electronic portfolio in their craft education over four years. A stimulated recall interview was applied to collect user experiences and qualitative content analysis to analyse the collected data. The results indicate that the electronic portfolio was experienced as a multipurpose tool to support learning. It makes the learning process visible and in that way helps focus on and improves the quality of learning. © ISLS.Peer reviewe

From procrastination to engagement? An experimental exploration of the effects of an adaptive virtual assistant on self-regulation in online learning

Compared to traditional classroom learning, success in online learning tends to depend more on the learner’s skill to self-regulate. Self-regulation is a complex meta-cognitive skill set that can be acquired. This study explores the effectiveness of a virtual learning assistant in terms of (a) developmental, (b) general compensatory, and (c) differential compensatory effects on learners’ self-regulatory skills in a sample of N = 157 online learners using an experimental intervention-control group design. Methods employed include behavioural trace data as well as self-reporting measures. Participants provided demographic information and responded to a 24-item self-regulation questionnaire and a 20-item personality trait questionnaire. Results indicate that the adaptive assistance did not lead to substantial developmental shifts as captured in learners’ perceived levels of self-regulation. However, various patterns of behavioural changes emerged in response to the intervention. This suggests that the virtual learning assistant has the potential to help online learners effectively compensate for deficits (in contrast to developmental shifts) in self-regulatory skills that might not yet have been developed

The Role of Support Units in Digital Transformation: How Institutional Entrepreneurs Build Capacity for Online Learning in Higher Education

This study used New Institutional Theory to explore how entrepreneurial activities in support units contribute to digital transformation in higher education in Norway. We describe how entrepreneurs initiated and operationalized support for Massive Open Online Courses (MOOCs), micro-credentials and fully online courses in pockets of innovation within existing institutional arrangements. An ambition was to understand why capacity building for digital transformation in a country described by the Organization for Economic Cooperation and Development (OECD) as digitally mature is lagging behind other countries. We obtained our data from qualitative interviews with faculties and staf involved in fully online course production. The informants were chosen through strategic sampling from support units and faculties, where they flled diferent roles in the production of such online courses. Our fndings describe entrepreneurial activities that strongly contributed to the emerging social feld of digital transformation. Located in pockets of innovation, the entrepreneurs provided open digital platforms, a pedagogy for online course design and support for faculties who engaged in online course production. Yet, the fndings also confrm previous research pointing out how the lack of supportive leadership may impede successful digital transformation in higher education institutions. The study concludes with a model for digital maturity which may be useful to researchers and stakeholders. The model can also support entrepreneurial processes in online environments.publishedVersio