Measuring self-regulated learning and online learning events to predict student academic performance

The aim of this study is to identify whether the combination of self-reported data that measure self-regulated learning (SRL) and computer-Assisted data that capture student engagement with an online learning environment could be used to predict student academic achievement. Personally engaged study strategies focused on deep-level learning, the process of taking control, and the evaluation of students' own learning characterize SRL. Diverse theories on how students benefit from SRL underline its positive impact on student academic outcomes. Similarly, there is no doubt that the future trend in education leans towards the integration of technolog y into teaching in order to exploit its full potential. To benefit from both approaches, a combination of self-reported data and detailed online learning events obtained from an online learning environment were investigated in relation to their ability to predict student academic achievement. A case study of 54 university students enrolled in a blended-learning course showed that of the tested SRL variables and observed learning activities, student interaction with auxiliary materials that were part of the course helped to predict academic outcomes. Despite the relatively low ability of the model to explain why some students were able to become successful learners, the presented results highlight the importance of analysing online learning events in computer-Assisted teaching and learning. © 2018 Masaryk University, Faculty of Arts. All rights reserved

Student learning experiences in higher education in Hong Kong: An investigation of students’ experiences of academic engagement in relation to the affective dimension of learning

Academic engagement is positioned as an important determinant of student success in higher education for it is positively linked with academic performance and other positive qualities such as Psychological Capital (PsyCap) and students’ wellbeing. The positive link between academic engagement and PsyCap, as a positive psychological capacity, also indicates the importance role of the affective dimension of learning in influencing students’ academic engagement, however this dimension is under-represented in the current literature. Adopting a mixed methods approach, this study aims to examine the process of academic engagement in relation to the role of the affective dimension of learning, particularly in terms of students’ experiences and perception of their engagement in study. The present study was conducted in a private university in Hong Kong, where 270 students participated in a self-reported survey and 20 of them in the subsequent semi-structured interviews. Findings from the survey indicated a positive and reciprocal relationship between academic engagement and PsyCap that the two constructs have mutually influenced each other. The interview findings revealed the influence of various affective elements in promoting students’ academic engagement, which were characterised by affective-cognitive processes as students reported their experiences in detail. All these findings substantiate the influence of the affective dimension of learning on students’ academic engagement and expand the current understanding of academic engagement in higher education students, adding to the body of knowledge in the extant literature. It is hope that findings from the present study would illuminate possible avenues for educators to develop appropriate practices to promote academic engagement and the subsequent academic performance in university students

Exploring Relations Between Motivation, Metacognition, and Academic Achievement Through Variable-Centered, Person-Centered and Learning Analytic Methodologies

The three studies that comprise this dissertation examine relations between student characteristics, motivations, metacognitive learning processes, and academic achievement. Methodologically, the dissertation demonstrated the potential of multiple types of approaches and data resource types. By employing multiple approaches including variable-centered, person-centered, and learning analytics, researchers can understand learning processes from various angles. In addition, through this triangulation by multiple types of methodological approaches, educational theories could be more thoroughly verified and supported by various empirical findings. Multiple types of data resources are related to analytical methods. The purpose of the first paper was to examine relations between achievement goals and metacognitive learning behaviors using a clustering analysis and visualization. A clustering analysis conducted with achievement goals produced three goal profiles; 1) mastery-approach, 2) performance-approach, and 3) performance-avoidance identified three goal profiles. The profiles include High Approach, High Mastery, and High Goal Endorsement groups. The finding demonstrated that students in the High Mastery group, who had greater use of the self-assessment tool, obtained higher final grades than other groups could be explained from the perspective of SRL. In addition, learners motivated by mastery approach goals engaged in the greater use of self-assessment quizzes. Students in the High Mastery group also used the tools earlier than other two groups for exam 2. As the most frequently used pattern, sequential pattern mining discovered the repeated use of self-assessment quizzes to monitor their learning. More students in the High Mastery group employ this pattern of metacognitive events than students in the High Performance and High-Goal endorsement groups, particularly during sessions in weeks before exams. A subsequent analysis revealed that for all exams, students who conducted a repeated behavior pattern indicative of metacognitive monitoring and control outperformed those who did not. From the research, it is confirmed that the person-centered analysis provided authentic and generalizable groups and afforded observation of the learning behaviors of learners with typical combinations of goals. In addition, sequential patterns provide instructor more interesting information on learning processes than the frequency of accesses. The purpose of the second research was to identify motivational profiles based on multiple types of motivations including self-efficacy, achievement goals, and expectancy-value from an integrative perspective. For this research, a LPA was conducted with ten types of motivational constructs and three kinds of metacognitive learning processes. The LPA identified four motivational profiles; 1) High Cost, 2) High Performance Goals, 3) High Goals and Values, and 4) Low Performance Goals, and three metacognitive profiles; 1) Infrequent metacognitive processing. 2) Checking performance and planning, and 3) Self-assessment. Student demographic information significantly influenced the membership of motivational profiles. Older students tend to have higher self-efficacy, mastery-approach, and values, but low cost than younger ones. In addition, compared to Caucasian and Asian students, underrepresented students tend to be more motivated by higher goals and values than high cost or high performance goals. Lastly, female students are more likely to be members of High performance goals and High goals and values than High cost oriented and Low performance goals and cost than males. In terms of the relations profiles with academic achievement, Low Performance Goals group showed the best performance. Among metacognitive profile groups, students in Checking performance and planning, and Self-assessment demonstrated similar academic performance. The investigation of relations between two profile groups demonstrated that students in the High cost group are more likely to be a member of self-assessment group than checking performance and planning as well as of a member of an infrequent metacognitive process than checking performance and planning. In addition, students in high performance and goals and high goals and values groups relative to the low performance goals group more likely to be a member of the infrequent metacognitive process than checking performance and planning. The findings of this research provide authentic motivation status and metacognition learning process as well as their relations. Addition, this research figured out specific motivational profiles through the multiple types of motivations from the integrative perspective. Therefore, instructors can provide more effective and specific interventions to students who have difficulty utilizing metacognitive learning processes, considering motivational status based on multiple motivations. In addition, instructors can understand motivational profiles by demographics so at the beginning of the semester in which the information on students is not enough to identify students learning processes, they intervene students based on demographic information. The purpose of the third paper was to consider the relative importance of capturing demographic, motivational and metacognitive processes as potential predictors of learning outcomes, and appraises them alongside both traditional prediction modeling approaches in higher education, and emergent methods, sequence pattern mining, arising from the field of educational data mining. The sequence pattern mining discovered the repeated use of self-assessment quizzes in Biology and repeated use of planning contents in Math. A regression model with combined resource types demonstrated the improved predictive power than models with individual resource types. Also, theory-aligned behaviors designed based on metacognitive learning processes better improved the accuracy of the model than non-theory-aligned behaviors automatically provided by the system. Lastly, when applying the same prediction model, the model better explained the variance of academic achievement in Biology in which metacognitive supporting tools designed based on an educational theory than that in Math that has few theory-aligned behavior variables. Therefore, this study emphasizes the importance of existing ambient data from university systems. Also, log data generated by systems such as LMS allows researchers to examine the same data in different ways with no need for additional data collection. Lastly, educational theory and contexts should be taken into consideration in designing courses and developing the prediction models. Therefore, instructors and researchers, in designing courses, the consideration of educational theories and contexts is the essential process. This dissertation provides insight regarding authentic relations between motivation, metacognition, and academic achievement. Specifically, instructors can understand how multiple types of motivations work together, and the motivational profiles influence metacognitive learning strategies. In courses, by examining motivational profiles, instructors can provide more effective intervention with which students change their resolve their weak learning easier. Practically, by investigating each type of predictor from data resources including demographic, motivation, and behavioral variables, findings from this dissertation can enable researchers to prioritize development of prediction models to identify students who are more likely to experience failure in courses. Additionally, instructors can figure out the importance of interpreting variables through educational theories and in context through the comparison of courses with differing instructional designs. Further, by appraising these results in light of theory, instructors can take action to improve student’s learning outcomes by adjusting the design of their courses

Quality in MOOCs: Surveying the Terrain

The purpose of this review is to identify quality measures and to highlight some of the tensions surrounding notions of quality, as well as the need for new ways of thinking about and approaching quality in MOOCs. It draws on the literature on both MOOCs and quality in education more generally in order to provide a framework for thinking about quality and the different variables and questions that must be considered when conceptualising quality in MOOCs. The review adopts a relativist approach, positioning quality as a measure for a specific purpose. The review draws upon Biggs’s (1993) 3P model to explore notions and dimensions of quality in relation to MOOCs — presage, process and product variables — which correspond to an input–environment–output model. The review brings together literature examining how quality should be interpreted and assessed in MOOCs at a more general and theoretical level, as well as empirical research studies that explore how these ideas about quality can be operationalised, including the measures and instruments that can be employed. What emerges from the literature are the complexities involved in interpreting and measuring quality in MOOCs and the importance of both context and perspective to discussions of quality

Adaptability, Engagement, and Degree Completion:A Longitudinal Investigation of University Students

© 2018, © 2018 Informa UK Limited, trading as Taylor & Francis Group. University entry and the passage through university is a time of great change. The extent to which students are able to adjust to successfully navigate this change (adaptability) is likely to influence their academic outcomes. Prior research has identified a link between university students’ adaptability and academic achievement via behavioural engagement. The current longitudinal study extends this research by examining whether university students’ adaptability predicts degree completion via behavioural engagement. Undergraduate students (N = 186) were surveyed for their adaptability and behavioural engagement at degree commencement. Their completion status was extracted from the University Records System at the end of the degree. Findings showed that adaptability predicts both positive and negative behavioural engagement, and that negative (but not positive) behavioural engagement predicts degree completion. Adaptability was also found to influence degree completion indirectly via negative behavioural engagement. These findings hold important theoretical and practical implications for educators and researchers seeking to understand how students manage the transition to university and the extent to, and mechanisms by which students’ adaptability is associated with university degree completion

Toward Precision Education: Educational Data Mining and Learning Analytics for Identifying Students’ Learning Patterns with Ebook Systems

Precision education is now recognized as a new challenge of applying artificial intelligence, machine learning, and learning analytics to improve both learning performance and teaching quality. To promote precision education, digital learning platforms have been widely used to collect educational records of students’ behavior, performance, and other types of interaction. On the other hand, the increasing volume of students’ learning behavioral data in virtual learning environments provides opportunities for mining data on these students’ learning patterns. Accordingly, identifying students’ online learning patterns on various digital learning platforms has drawn the interest of the learning analytics and educational data mining research communities. In this study, the authors applied data analytics methods to examine the learning patterns of students using an ebook system for one semester in an undergraduate course. The authors used a clustering approach to identify subgroups of students with different learning patterns. Several subgroups were identified, and the students’ learning patterns in each subgroup were determined accordingly. In addition, the association between these students’ learning patterns and their learning outcomes from the course was investigated. The findings of this study provide educators opportunities to predict students’ learning outcomes by analyzing their online learning behaviors and providing timely intervention for improving their learning experience, which achieves one of the goals of learning analytics as part of precision education

A Prediction-Based Framework to Reduce Procrastination in Adaptive Learning Systems

Procrastination and other types of dilatory behaviour are common in online learning, especially in higher education. While procrastination is associated with worse performance and discomfort, positive forms of delay can be used as a deliberate strategy without any such consequences. Although dilatory behaviour has received attention in research, it has to my knowledge never been included as an integral part of an adaptive learning system. Differentiating between different types of delay within such a system would allow for tailored interventions to be provided in the future without alienating students who use delay as a successful strategy. In this thesis, I present four studies that provide the basis for such an endeavour. I first discuss the results of two studies that focussed on the prediction of the extent of dilatory behaviour in online assignments. The results of both studies revealed an advantage of objective predictors based on log data over subjective variables based on questionnaires. The predictive performance slightly improved when both sets of predictors were combined. In one of these studies, we implemented Bayesian multilevel models while the other aimed at comparing various machine learning algorithms to determine the best candidates for a future inclusion in real-time predictive models. The results reveal that the most suitable algorithm depended on the type of predictor, implying that multiple models should be implemented in the field, rather than selecting just one. I then present a framework for an adaptive learning system based on the other two studies, where I highlight how dilatory behaviour can be incorporated into such a system, in light of the previously discussed results. I conclude this thesis by providing an outlook into the necessary next steps before an adaptive learning system focussing on delay can be established