Development of a recommender System for adaptive e-learning

Recent years have seen the web as an essential mean for Learning and Education, thanks to the almost infinite amount of information shared and to the explosion in development and adoption of e-Learning platforms that allow people to study any topic without the barriers of time, geography and physical participation. In addition to traditional learning content, online platforms allow user-centered approaches, creating an interactive and consequently very effective learning environment. The objective of the thesis is to develop an adaptive learning system for an Italian e-Learning Platform, leader on the market, being able to recommend an optimized learning path for each user. The developed system will be based on machine learning algorithms, which will learn from users’ performance and Learning characteristics – e.g. time spent learning a single topic, speed of improvement and learning abilities, test scores and completion times – in order to drive the user toward the next best new topic to study or the review on the most appropriate past topics to fill his/her knowledge gap.The focus will be mainly on mathematics courses, which are, currently, the most requested on the platform

The role of machine learning in personalised instructional sequencing for language learning

The origins of personalised instructional sequencing can be dated back to the times of the Ancient Greeks to the times of Alexander The Great's tutor, Aristotle. However, over the centuries the demand for education and growth of students has been disproportionately greater than the number of teachers in training. Therefore, there has been a longstanding interest in finding a way to scale education without negatively affecting learning outcomes. This interest was fuelled further with the advent of computers and artificial intelligence, where a plethora of systems and models were built to bring technology driven personalised instructional sequencing to the world. Unfortunately, results were far from groundbreaking and many challenges still remain. In my thesis, I investigate three aspects of personalised instructional sequencing: the personalised instructional sequencing mechanism, the student knowledge representation, and human forgetting. While I do not cover the entirety of personalised instructional sequencing, I cover what I consider the foundational components. I link psychological theory to model selection and design in each of my systems and present experiments to illustrate their impact. I show how reinforcement learning can be used for vocabulary learning. I also present a model that uses neural collaborative filtering to learn student knowledge representations. Lastly, I present a state-of-the-art model to predict the probability of vocabulary word recall for students learning English as a second language. The system's novelty lies in the use of word complexity to adapt the forgetting curve as well as its incorporation of psychological theory to select an appropriate model

A Framework for Personalized Content Recommendations to Support Informal Learning in Massively Diverse Information WIKIS

Personalization has proved to achieve better learning outcomes by adapting to specific learners’ needs, interests, and/or preferences. Traditionally, most personalized learning software systems focused on formal learning. However, learning personalization is not only desirable for formal learning, it is also required for informal learning, which is self-directed, does not follow a specified curriculum, and does not lead to formal qualifications. Wikis among other informal learning platforms are found to attract an increasing attention for informal learning, especially Wikipedia. The nature of wikis enables learners to freely navigate the learning environment and independently construct knowledge without being forced to follow a predefined learning path in accordance with the constructivist learning theory. Nevertheless, navigation on information wikis suffer from several limitations. To support informal learning on Wikipedia and similar environments, it is important to provide easy and fast access to relevant content. Recommendation systems (RSs) have long been used to effectively provide useful recommendations in different technology enhanced learning (TEL) contexts. However, the massive diversity of unstructured content as well as user base on such information oriented websites poses major challenges when designing recommendation models for similar environments. In addition to these challenges, evaluation of TEL recommender systems for informal learning is rather a challenging activity due to the inherent difficulty in measuring the impact of recommendations on informal learning with the absence of formal assessment and commonly used learning analytics. In this research, a personalized content recommendation framework (PCRF) for information wikis as well as an evaluation framework that can be used to evaluate the impact of personalized content recommendations on informal learning from wikis are proposed. The presented recommendation framework models learners’ interests by continuously extrapolating topical navigation graphs from learners’ free navigation and applying graph structural analysis algorithms to extract interesting topics for individual users. Then, it integrates learners’ interest models with fuzzy thesauri for personalized content recommendations. Our evaluation approach encompasses two main activities. First, the impact of personalized recommendations on informal learning is evaluated by assessing conceptual knowledge in users’ feedback. Second, web analytics data is analyzed to get an insight into users’ progress and focus throughout the test session. Our evaluation revealed that PCRF generates highly relevant recommendations that are adaptive to changes in user’s interest using the HARD model with rank-based mean average precision (MAP@k) scores ranging between 100% and 86.4%. In addition, evaluation of informal learning revealed that users who used Wikipedia with personalized support could achieve higher scores on conceptual knowledge assessment with average score of 14.9 compared to 10.0 for the students who used the encyclopedia without any recommendations. The analysis of web analytics data show that users who used Wikipedia with personalized recommendations visited larger number of relevant pages compared to the control group, 644 vs 226 respectively. In addition, they were also able to make use of a larger number of concepts and were able to make comparisons and state relations between concepts

Новый подход к процессу автоматизации обучения на основе данных о поведении пользователей в цифровых библиотеках

The author introduces the mathematical model of recurrent neural network with external memory. It is intended for predicting efficient education trajectory in digital information environments, e. g. digital libraries. The goal of computer-aided learning based on neural networks is to personalize user trajectories. In the study, user behavior is modeled for the more precise personalization in various aspects using recurrent neural networks. The method is designed for two types of recurrent neural networks, i. e. the classic one with sigmoidal activation function and that with LSTM (Long Short-Term Memory). The experiments demonstrated serious advantages of recurrent neural networks over analogous methods in predicting education trajectory. Thus, the proposed model is the more efficient in predictive accuracy (by 15–20% higher than analogous methods). Its prime application area is prediction of optimum user education trajectory in the digital information environment, and digital library, in particulПредставлена математическая модель применения рекуррентной сети с внешней памятью. Она предназначена для предсказания оптимальной образовательной траектории пользователя в цифровых информационных средах, к которым могут быть отнесены цифровые библиотеки. Основная задача, решаемая с помо щью метода машинного обучения, основанного на применении нейронных сетей, – индивидуализация образовательных траекторий пользователя. Цель работы – моделирование различных аспектов деятельности обучающегося с использованием рекуррентных нейронных сетей для более точной индивидуализации образовательной траектории. В основе метода лежат две разновидности рекуррентных нейронных сетей: классическая с сигмоидальной функцией активации и сеть с долгой краткосрочной памятью LSTM (Long Short-Term Memory). Результаты проведённых экспериментов показали существенные преимущества применения рекуррентных нейронных сетей для предсказания шагов образовательной траектории по сравнению с аналогичными методами. Таким образом, разработанная модель имеет более высокую точность предсказания (на 15–20% выше относительно аналогов). Основная область её применения – предсказание оптимальной образовательной траектории пользователя в цифровой информационной среде, в частности – цифровой библиотеке

Data-driven Methods for Course Selection and Sequencing

University of Minnesota Ph.D. dissertation.May 2019. Major: Computer Science. Advisor: George Karypis. 1 computer file (PDF); xiii, 115 pages.Learning analytics in higher education is an emerging research field that combines data mining, machine learning, statistics, and education on learning-related data, in order to develop methods that can improve the learning environment for learners and allow educators and administrators to be more effective. The vast amount of data available about students' interactions and their performance in classrooms has motivated researchers to analyze this data in order to gain insights about the learning environment for the ultimate goal of improving undergraduate education and student retention rates. In this thesis, we focus on the problem of course selection and sequencing, where we would like to help students make informed decisions about which courses to register for in their following terms. By analyzing the historical enrollment and grades data, this thesis studies the two main problems of course selection and sequencing, namely grade prediction and course recommendation. In addition, it analyzes the relationship between degree planning in terms of course timing and ordering and the students' GPA and time to degree. First, we focus on predicting the grades that students will obtain on future courses so that they can make informed decisions about which courses to register for in their following terms. We model the grade prediction problem as cumulative knowledge-based linear regression models that learn the courses' required and provided knowledge components and use them to estimate a student's knowledge state at each term and predict the grades that he/she can obtain on future courses. Second, we focus on improving the knowledge-based regression models we previously developed by modeling the complex interactions among prior courses using non-linear and neural attentive models, in order to have more accurate estimation of a student's knowledge state. In addition, we model the interactions between a target course, which we would like to predict its grade, and the other courses taken concurrently with it. We hypothesize that concurrently-taken courses can affect a student's performance in a target course, and thus modeling their interactions with that course should lead to better predictions. Third, we focus on analyzing the degree plans of students to gain more insights about how course timing and sequencing relate to their GPAs and time to degree. Toward this end, we define several course timing and course sequencing metrics and compare different sub-groups of students who have achieved high vs low GPA as well as sub-groups of students who have graduated on time vs over time. Fourth, we focus on improving course recommendation by recommending to each student a set of courses which he/she is prepared for and expected to perform well in. We model this problem as a grade-aware course recommendation problem, where we propose two different approaches. The first approach ranks the courses by using an objective function that differentiates between courses that are expected to increase or decrease a student's GPA. The second approach combines the grades predicted by grade prediction methods with the rankings produced by course recommendation methods to improve the final course rankings. To obtain the course rankings in both approaches, we adapted two widely-used representation learning techniques to learn the optimal temporal ordering between courses. In summary, this thesis addresses two closely related problems by: (1) developing cumulative knowledge-based regression models for grade prediction; % (2) developing context-aware non-linear and neural attentive knowledge-based models for grade prediction; % (3) analyzing degree planning and how the time when students take courses and how they sequence them relate to their GPAs and time to degree; and % (4) developing novel approaches for grade-aware course recommendation.