A review on massive e-learning (MOOC) design, delivery and assessment

MOOCs or Massive Online Open Courses based on Open Educational Resources (OER) might be one of the most versatile ways to offer access to quality education, especially for those residing in far or disadvantaged areas. This article analyzes the state of the art on MOOCs, exploring open research questions and setting interesting topics and goals for further research. Finally, it proposes a framework that includes the use of software agents with the aim to improve and personalize management, delivery, efficiency and evaluation of massive online courses on an individual level basis.Peer ReviewedPostprint (author's final draft

Discovering the Impact of Knowledge in Recommender Systems: A Comparative Study

Recommender systems engage user profiles and appropriate filtering techniques to assist users in finding more relevant information over the large volume of information. User profiles play an important role in the success of recommendation process since they model and represent the actual user needs. However, a comprehensive literature review of recommender systems has demonstrated no concrete study on the role and impact of knowledge in user profiling and filtering approache. In this paper, we review the most prominent recommender systems in the literature and examine the impression of knowledge extracted from different sources. We then come up with this finding that semantic information from the user context has substantial impact on the performance of knowledge based recommender systems. Finally, some new clues for improvement the knowledge-based profiles have been proposed.Comment: 14 pages, 3 tables; International Journal of Computer Science & Engineering Survey (IJCSES) Vol.2, No.3, August 201

Hybrid human-AI driven open personalized education

Attaining those skills that match labor market demand is getting increasingly complicated as prerequisite knowledge, skills, and abilities are evolving dynamically through an uncontrollable and seemingly unpredictable process. Furthermore, people's interests in gaining knowledge pertaining to their personal life (e.g., hobbies and life-hacks) are also increasing dramatically in recent decades. In this situation, anticipating and addressing the learning needs are fundamental challenges to twenty-first century education. The need for such technologies has escalated due to the COVID-19 pandemic, where online education became a key player in all types of training programs. The burgeoning availability of data, not only on the demand side but also on the supply side (in the form of open/free educational resources) coupled with smart technologies, may provide a fertile ground for addressing this challenge. Therefore, this thesis aims to contribute to the literature about the utilization of (open and free-online) educational resources toward goal-driven personalized informal learning, by developing a novel Human-AI based system, called eDoer. In this thesis, we discuss all the new knowledge that was created in order to complete the system development, which includes 1) prototype development and qualitative user validation, 2) decomposing the preliminary requirements into meaningful components, 3) implementation and validation of each component, and 4) a final requirement analysis followed by combining the implemented components in order develop and validate the planned system (eDoer). All in all, our proposed system 1) derives the skill requirements for a wide range of occupations (as skills and jobs are typical goals in informal learning) through an analysis of online job vacancy announcements, 2) decomposes skills into learning topics, 3) collects a variety of open/free online educational resources that address those topics, 4) checks the quality of those resources and topic relevance using our developed intelligent prediction models, 5) helps learners to set their learning goals, 6) recommends personalized learning pathways and learning content based on individual learning goals, and 7) provides assessment services for learners to monitor their progress towards their desired learning objectives. Accordingly, we created a learning dashboard focusing on three Data Science related jobs and conducted an initial validation of eDoer through a randomized experiment. Controlling for the effects of prior knowledge as assessed by the pretest, the randomized experiment provided tentative support for the hypothesis that learners who engaged with personal eDoer recommendations attain higher scores on the posttest than those who did not. The hypothesis that learners who received personalized content in terms of format, length, level of detail, and content type, would achieve higher scores than those receiving non-personalized content was not supported as a statistically significant result

Towards a hybrid recommendation approach using a community detection and evaluation algorithm

In social learning platforms, community detection algorithms are used to identify groups of learners with similar interests, behavior, and levels. While, recommendation algorithms personalize the learning experience based on learners' profile information, including interests and past behavior. Combining these algorithms can improve the recommendation quality by identifying learners with similar needs and interests for more accurate and relevant suggestions. Community detection enhances recommendations by identifying groups of learners with similar needs and interests. Leveraging their similarities, recommendation algorithms generate more accurate suggestions. In this article, we propose a novel approach that combines community detection and recommendation algorithms into a single framework to provide learners with personalized recommendations and opportunities for collaborative learning. Our proposed approach consists of three steps: first, applying the maximal clique-based algorithm to detect learning communities with common characteristics and interests; second, evaluating learners within their communities using static and dynamic evaluation; and third, generating personalized recommendations within each detected cluster using a recommendation system based on correlation and co-occurrence. To evaluate the effectiveness of our proposed approach, we conducted experiments on a real-world dataset. Our results show that our approach outperforms existing methods in terms of modularity, precision, and accuracy

Design of an E-learning system using semantic information and cloud computing technologies

Humanity is currently suffering from many difficult problems that threaten the life and survival of the human race. It is very easy for all mankind to be affected, directly or indirectly, by these problems. Education is a key solution for most of them. In our thesis we tried to make use of current technologies to enhance and ease the learning process. We have designed an e-learning system based on semantic information and cloud computing, in addition to many other technologies that contribute to improving the educational process and raising the level of students. The design was built after much research on useful technology, its types, and examples of actual systems that were previously discussed by other researchers. In addition to the proposed design, an algorithm was implemented to identify topics found in large textual educational resources. It was tested and proved to be efficient against other methods. The algorithm has the ability of extracting the main topics from textual learning resources, linking related resources and generating interactive dynamic knowledge graphs. This algorithm accurately and efficiently accomplishes those tasks even for bigger books. We used Wikipedia Miner, TextRank, and Gensim within our algorithm. Our algorithm‘s accuracy was evaluated against Gensim, largely improving its accuracy. Augmenting the system design with the implemented algorithm will produce many useful services for improving the learning process such as: identifying main topics of big textual learning resources automatically and connecting them to other well defined concepts from Wikipedia, enriching current learning resources with semantic information from external sources, providing student with browsable dynamic interactive knowledge graphs, and making use of learning groups to encourage students to share their learning experiences and feedback with other learners.Programa de Doctorado en Ingeniería Telemática por la Universidad Carlos III de MadridPresidente: Luis Sánchez Fernández.- Secretario: Luis de la Fuente Valentín.- Vocal: Norberto Fernández Garcí

Layered evaluation of interactive adaptive systems : framework and formative methods

Peer reviewedPostprin

SPOC online video learning clustering analysis: Identifying learners' group behavior characteristics

With the widespread of Small Private Online Courses (SPOC) in colleges and universities, course organizers who provide high-quality personalized course activities need to understand learners' learning status and characteristics, and then optimize the course teaching. However, little research has been done on different learners' group behavior characteristics, such as which indicators can reflect learner groups' behavior, and what are the typical behavior characteristics of different learner groups. In this work, we established a Python Language Foundation self-built SPOC course, and 109 undergraduates' learning behavior data were collected and analyzed. From 74-dimensional behavior log data consisting of 72 video-viewing, course video score, and comprehensive score, Principal Component Analysis was performed to reduce dimensionality. Agglomerative hierarchical clustering was used to divide learners into different categories, and the results showed that 15 groups are clustered. According to the analysis of the four indicators for group characteristics, which are the completion and viewing-stability of task-point videos, unit test excellence, and comprehensive score, it is identified into five primary types, including positive type, regular type, negative type, semi-negative type, and a fluctuation type. Experiments conducted on a real data set across different academic years and courses show that the proposed approach has better clustering accuracy and practicability. It is expected that this work may be used to strengthen the personalized learning support services system in educational institutions and develop a tool that integrates exploration and analysis work onto the web platform

A Framework for Personalized Content Recommendations to Support Informal Learning in Massively Diverse Information WIKIS

Personalization has proved to achieve better learning outcomes by adapting to specific learners’ needs, interests, and/or preferences. Traditionally, most personalized learning software systems focused on formal learning. However, learning personalization is not only desirable for formal learning, it is also required for informal learning, which is self-directed, does not follow a specified curriculum, and does not lead to formal qualifications. Wikis among other informal learning platforms are found to attract an increasing attention for informal learning, especially Wikipedia. The nature of wikis enables learners to freely navigate the learning environment and independently construct knowledge without being forced to follow a predefined learning path in accordance with the constructivist learning theory. Nevertheless, navigation on information wikis suffer from several limitations. To support informal learning on Wikipedia and similar environments, it is important to provide easy and fast access to relevant content. Recommendation systems (RSs) have long been used to effectively provide useful recommendations in different technology enhanced learning (TEL) contexts. However, the massive diversity of unstructured content as well as user base on such information oriented websites poses major challenges when designing recommendation models for similar environments. In addition to these challenges, evaluation of TEL recommender systems for informal learning is rather a challenging activity due to the inherent difficulty in measuring the impact of recommendations on informal learning with the absence of formal assessment and commonly used learning analytics. In this research, a personalized content recommendation framework (PCRF) for information wikis as well as an evaluation framework that can be used to evaluate the impact of personalized content recommendations on informal learning from wikis are proposed. The presented recommendation framework models learners’ interests by continuously extrapolating topical navigation graphs from learners’ free navigation and applying graph structural analysis algorithms to extract interesting topics for individual users. Then, it integrates learners’ interest models with fuzzy thesauri for personalized content recommendations. Our evaluation approach encompasses two main activities. First, the impact of personalized recommendations on informal learning is evaluated by assessing conceptual knowledge in users’ feedback. Second, web analytics data is analyzed to get an insight into users’ progress and focus throughout the test session. Our evaluation revealed that PCRF generates highly relevant recommendations that are adaptive to changes in user’s interest using the HARD model with rank-based mean average precision (MAP@k) scores ranging between 100% and 86.4%. In addition, evaluation of informal learning revealed that users who used Wikipedia with personalized support could achieve higher scores on conceptual knowledge assessment with average score of 14.9 compared to 10.0 for the students who used the encyclopedia without any recommendations. The analysis of web analytics data show that users who used Wikipedia with personalized recommendations visited larger number of relevant pages compared to the control group, 644 vs 226 respectively. In addition, they were also able to make use of a larger number of concepts and were able to make comparisons and state relations between concepts

MyLearningMentor: a mobile App to support learners participating in MOOCs

MOOCs have brought a revolution to education. However, their impact is mainly benefiting people with Higher Education degrees. The lack of support and personalized advice in MOOCs is causing that many of the learners that have not developed work habits and self-learning skills give them up at the first obstacle, and do not see MOOCs as an alternative for their education and training. My Learning Mentor (MLM) is a mobile application that addresses the lack of support and personalized advice for learners in MOOCs. This paper presents the architecture of MLM and practical examples of use. The architecture of MLM is designed to provide MOOC participants with a personalized planning that facilitates them following up the MOOCs they enroll. This planning is adapted to learners' profiles, preferences, priorities and previous performance (measured in time devoted to each task). The architecture of MLM is also designed to provide tips and hints aimed at helping learners develop work habits and study skills, and eventually become self-learners.This work has been funded by the Spanish Ministry of Economy and Competitiveness Project TIN2011-28308-C03-01, the Regional Government of Madrid project S2013/ICE-2715, and the postdoctoral fellowship Alliance 4 Universities. The authors would also like to thank Israel Gutiérrez-Rojas for his contributions to the ideas behind MLM and Ricardo García Pericuesta and Carlos de Frutos Plaza for their work implementing different parts of the architecture

Enriching e-learning metadata through digital library usage analysis

Purpose: In this paper we propose an evaluation framework for analyzing learning objects usage, with the aim of extracting useful information for improving the quality of the metadata used to describe the learning objects, but also for personalization purposes, including user models and adaptive itineraries. Methodology: We present experimental results from the log usage analysis during one academic semester of two different subjects, 350 students. The experiment looks into raw server log data generated from the interactions of the students with the classroom learning objects, in order to find relevant information that can be used to improve the metadata used for describing both the learning objects and the learning process. Findings: Preliminary studies have been carried out in order to obtain an initial picture of the interactions between learners and the virtual campus, including both services and resources usage. These studies try to establish elationships between user profiles and their information and navigational behavior in the virtual campus, with the aim of promoting personalization and improving the understanding of what learning in virtual environments means. Research limitations: During the formal learning process, students use learning resources from the virtual classroom provided by the academic library, but they also search for information outside the virtual campus. Not all of these usage data are considered in the model we propose. Further research needs to be done in order to get a complete view of the information search behavior of students for improving the users’ profile and creating better personalized services. Practical implications: In this paper we suggest how a selection of fields used in the LOM standard could be used for enriching the description of learning objects, automatically in some cases, from the learning objects usage performed by an academic community. Originality: Ever since the beginnings of libraries, they have been a “quiet storage place”. With the development of digital libraries, they become a meeting place where explicit and implicit recommendations about information sources can be shared among users. Social and learning process interactions, therefore, can be considered another knowledge source