Interactive and multimedia contents associated with a system for computer-aided assessment

This paper presents a research study addressing the development, implementation, evaluation and use of Interactive Modules for Online Training (MITO) of mathematics in higher education. This work was carried out in the context of the MITO project, which combined several features of the learning and management system Moodle, the computer-aided assessment for mathematics STACK, the mathematical software GeoGebra, several packages from the type-setting program LaTeX, and tutorial videos. A total of 1962 students participated in this study. Two groups of students taking a Calculus course were selected for a deeper analysis. In regard to usability and functionality, the results indicate that MITO scored well in almost all aspects, which is fundamental for their introduction into formal university courses. The analysis of the data reveals that the use of MITO educational contents by students mainly occurs about one week and a half prior the evaluations. Moreover, there is a strong correlation between the results of online assessments on MITO in a continuous assessment model and the final grade on the course

Exploring indicators of engagement: applications for gamification of online training systems

In recent years, gamification is being used in business organization for an increased employee engagement in the work place. However, less has been said about engagement of employees in online training to learn new skills and knowledge that may help or improve status quo in the organization. This paper explores the engagement indicators and game elements that may foster employee engagement in online training. The study employs an iterative step-by-step methodology that is used in information technology for the development of artefacts. As a result, a framework to implement the gamification technique in online training is proposed. The framework consists of a gamification construct that contains a set of commonly used game elements such as points, levels, challenges, rewards, competition, progress bar, leaderboard, badges, and feedback. The framework also contains three engagement dimensions including behavioural, emotional, and cognitive dimensions. To achieve the main objective of the study, an iterative process used by information technology researchers to develop new artefacts and their constructs is employed. As for the formulation of the hypothesis, for the evaluation of gamification’s influence on employee engagement when attending an online training, Technology Acceptance Model (TAM) is employed

Análisis de los docentes en el uso de recursos digitales en la enseñanza y evaluación en línea en tiempos de COVID

The study considered the use of online learning applications for instructional delivery and assessment purposes in higher institutions of learning that stimulates a new atmosphere where lecturers could utilize these facilities to promote learning. The study also determined the gender difference between lecturers use of online learning applications for instructional delivery and classroom assessment in a post-covid context. The digital applications analyzed in this study include Google classroom, Email, Moodle, Canvas, Google, Microsoft Team, Zoom, Google Meet, Cisco Webinar, Facebook groups, Open Educational Resources (OERs), Google docs, Google slide, WhatsApp and Telegram Channel. At present, however, opinions are divided over the extent to which lecturers utilize these online learning applications in instruction and assessment. A descriptive survey research design was adopted with 152 participants (n = 88 males and n = 64 females) for the study and the instrument used for data collection was Utilization of Online Leaning Applications in Classroom Instruction and Continuous Assessment Questionnaire (UOLACICAQ). On December 2021, the participants completed the Questionnaire. The internal consistency of the instrument was determined using Cronbach’s Alpha and the reliability index of .93 was obtained. Results of the study show a low extent of utilization of online learning applications in classroom instruction and continuous assessment (Canvas, Microsoft Team, Google Meet, Cisco Webinar, OERs, Google slide, Telegram Channel, Facebook groups, Moodle, Google Classroom, learning management systems, Google forms and Google sheet). There was however, a significant difference between male and female lecturers' use of online learning applications for continuous assessment. Lecturers’ utilization of online learning applications in instruction and assessment of learning will expose them to different online learning applications used in delivery instructions and assessing students’ learning. The research supplies good idea of the instrument for measuring those staked learning outcomes in higher institution. However, lecturers do not differ in terms of the extent to which they use online learning applications while delivering instructions in the classroom based on gender.El estudio consideró el uso de aplicaciones de aprendizaje en línea con fines de enseñanza y evaluación en instituciones de aprendizaje superiores que estimulan una nueva atmósfera en la que los profesores pueden utilizar estas instalaciones para promover el aprendizaje. El estudio también determinó la diferencia de género entre los profesores que usan aplicaciones de aprendizaje en línea para la enseñanza y la evaluación en el aula en un contexto post-covid. Las aplicaciones digitales analizadas en este estudio incluyen el aula de Google, Correo electrónico, Moodle, Canvas, Google, Microsoft Team, Zoom, Google Meet, Seminario web de Cisco, grupos de Facebook, recursos educativos abiertos (REA), documentos de Google, diapositivas de Google, canal de WhatsApp y Telegram. En la actualidad, sin embargo, las opiniones están divididas sobre la medida en que los profesores utilizan estas aplicaciones de aprendizaje en línea en la instrucción y la evaluación. Se adoptó un diseño de investigación de encuesta descriptiva con 152 participantes (n = 88 hombres y n = 64 mujeres) para el estudio y el instrumento utilizado para la recolección de datos fue la Utilización de Aplicaciones de Aprendizaje en Línea en la Instrucción en el Aula y el Cuestionario de Evaluación Continua (UOLACICAQ). En diciembre de 2021, los participantes completaron el Cuestionario. La consistencia interna del instrumento se determinó mediante el Alfa de Cronbach y se obtuvo el índice de confiabilidad de .93.Los resultados del estudio muestran un bajo grado de utilización de las aplicaciones de aprendizaje en línea en la instrucción en el aula y la evaluación continua (Canvas, Microsoft Team, Google Meet, Cisco Webinar, OER, Google slide, Telegram Channel, grupos de Facebook, Moodle, Google Classroom, sistemas de gestión de aprendizaje, formularios de Google y hoja de Google). Sin embargo, hubo una diferencia significativa entre el uso de aplicaciones de aprendizaje en línea para la evaluación continua por parte de profesores masculinos y femeninos. La utilización de las aplicaciones de aprendizaje en línea por parte de los profesores en la instrucción y la evaluación del aprendizaje los expondrá a diferentes aplicaciones de aprendizaje en línea utilizadas para impartir docencia y evaluar el aprendizaje de los estudiantes. La investigación proporciona una buena idea del instrumento para medir los resultados de aprendizaje en juego en la institución superior. Sin embargo, los profesores no difieren en cuanto a la medida en que utilizan aplicaciones de aprendizaje en línea mientras imparten instrucciones en el aula según el género

Towards A Massive Open Online Course for Cybersecurity in Smart Grids – A Roadmap Strategy

The major trends and transformations in energy systems have brought many challenges, and cybersecurity and operational security are among the most important issues to consider. First, due to the criticality of the energy sector. Second, due to the lack of smart girds’ cybersecurity professionals. Previous research has highlighted skill gaps and shortage in cybersecurity training and education in this sector. Accordingly, we proceeded by crafting a roadmap strategy to foster cybersecurity education in smart grids. This paper outlines the methodology of teaching cybersecurity in smart grids to a large group of students in selected European universities via implementing a Massive Open Online Course. Unlike other solutions, this one focuses on hands-on practical skills without trading-off theoretical knowledge. Thus, flipped learning methodology and gamification practices were used to maximize retention rate. Also, a remote lab that includes a real-time simulator was established for training. Here, the process, outcome, and obstacles to overcome in future deployments, are presented.©2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.fi=vertaisarvioitu|en=peerReviewed

Intelligent tutorial system based on personalized system of instruction to teach or remind mathematical concepts

The growth of the higher education population and different school paths to access an academic degree has increased the heterogeneity of students inside the classroom. Consequently, the effectiveness of traditional teaching methods has reduced. This paper describes the design, development, implementation and evaluation of a tutorial system (TS) to improve student's engagement in higher mathematics. The TS design was based on the Personalized System of Instruction of the Mastery Learning pedagogical approach and can be implemented in any higher education course with mathematics needs. The TS consists on small self-paced modularized units of educational contents, including tutorial videos, notes and formative e-assessment with personalized feedback. The TS ensures that the student is only allowed to proceed to the next unit after he or she achieves the required mastery criterion of the current unit. The TS was implemented in the Quantitative Methods course of an undergraduate degree and received good acceptance from students. It was also recognized that TS contributed to learning and engagement with the discipline. Through an experimental research experience it has been shown that the imposition of restrictions on the advance to the next level by a mastery criterion leads to a significant improvement in student’s engagement and performance

Data Mining for Studying the Impact of Reflection on Learning

Title: Data Mining for Studying the Impact of Reflection on Learning Keywords: educational data mining, Reflect, learning behaviour, impact Abstract On-line Web-based education learning systems generate a large amount of students' log data and profiles that could be useful for educators and students. Hence, data mining techniques that enable the extraction of hidden and potentially useful information in educational databases have been employed to explore educational data. A new promising area of research called educational data mining (EDM) has emerged. Reflect is a Web-based learning system that supports learning by reflection. Reflection is a process in which individuals explore their experiences in order to gain new understanding and appreciation, and research suggests that reflection improves learning. The Reflect system has been used at the University of Sydney’s School of Information Technology for several years as a source of learning and practice in addition to the classroom teaching. Using the data from a system that promotes reflection for learning (such as the Reflect system), this thesis focuses on the investigation of how reflection helps students in their learning. The main objective is to study students' learning behaviour associated with positive and negative outcomes (in exams) by utilising data mining techniques to search for previously unknown, potentially useful hidden information in the database. The approach in this study was, first, to explore the data by means of statistical analyses. Then, popular data mining algorithms such as the K-means and J48 algorithms were utilised to cluster and classify students according to their learning behaviours in using Reflect. The Apriori algorithm was also employed to find associations among the data attributes that lead to success. We were able to group and classify students according to their activities in the Reflect system, and identified some activities associated with student performance and learning outcomes (high, moderate or low exam marks). We concluded that the approach resulted in the identification of some learning behaviours that have important impacts on student performance

Assessment and evaluation in higher education

This book compiles relevant research on students’ learning processes in Higher Education. It presents different dimensions and forms of learning, crucial to understand and tackle diversity and integration regarding more sustainable and inclusive goals. Major challenges have taken place recently considering assessment within higher education and its known impact on students’ learning processes. The application of different assessment methods, considering a general public desire to focus on more skills development and assessment has brought higher education challenges regarding students learning processes and its assessment that are bringing severe changes towards academia. Higher education institutions should act as knowledge and research drivers, and the consideration about the learning processes and assessment methods are key. Special attention is given to assessment methods and purposes, assessment rubrics and the assessment of learning outcomes (knowledge and skills). Research on the challenges, strengths, and opportunities of online and virtual assessment, as well as best practices and recommendations for assessment and evaluation in higher education, are also explored and discussed in this book. This book, which consists of 15 articles written by research experts in their topic of interest, reports the most recent research concerning assessment and evaluation in higher education. The book includes changes in education and higher education that can lead to a systematic modification of higher education. Topic one—Pedagogical innovation Jung Hee Park, Woo Sok Han, Jinkyung Kim and Hyunjung Lee—Strategies for Flipped Learning in the Health Professions Education in South Korea and Their Effects: A Systematic Review; https://doi.org/10.3390/educsci11010009. William Swart and Ken MacLeod—Evaluating Learning Space Designs for Flipped and Collaborative Learning: A Transactional Distance Approach; https://doi.org/10.3390/ educsci11060292. Jiří Bečica and Roman Vavrek—A Qualitative Assessment of the Pedagogical Process at Czech Public Universities; https://doi.org/10.3390/educsci11080389. Salleh Amat, Harizah Izyan Samsudin, Abu Yazid Abu Bakar, Mohd Izwan Mahmud and Mohd Hasrul Kamarulzaman—Needs Analysis of Psychosocial Module Development Based on Psychoeducation Approach for Public University Students in Malaysia; https://doi.org/10.3390/educsci11100604. Humberto Arruda and Édison Renato Silva—Assessment and Evaluation in Active Learning Implementations: Introducing the Engineering Education Active Learning Maturity Model; https://doi.org/10.3390/educsci11110690. We begin the book by introducing the reader to a very interesting work in which Park et al. develops a student-centred approach considering the real advantages in developing students learning abilities. The effect and strategies of flipped learning in the health professions education xii were assessed through a Participant–intervention-comparator-outcome (PICO). Findings suggests that implementing flipped learning design based on class characteristics and appropriate post-class activities can enhance students’ learning abilities. The topic continues with the work from Swart et al. where they evaluate Learning Space Designs for Flipped and Collaborative Learning. A highly revealing study considering the relevance of the classroom´s design as a relevant mainframe for collaborative work. They developed a very interesting study where they present that from a student perspective the investment in high-tech classrooms is not necessarily directly associated with more student engagement. Amat and colleagues presents a research which showed a highly positive response from the students toward the development of a psychosocial module in order to strengthen the assertiveness, social skills, and psychological well-being. Assessment and Evaluation in Active Learning Implementations has been widely worked on engineering Education. Arruda and colleagues present a paper where they propose a framework that assesses the maturity of Active Learning implementation in a program or a course. A valuable tool to be implemented and replicated, on diagnosis and practical improvements in real settings. Topic Two—Assessment Fidel Salas Vicente, Ángel Vicente Escuder, Miguel Ángel Pérez Puig and Francisco Segovia López—Effect on Procrastination and Learning of Mistakes in the Design of the Formative and Summative Assessments: A Case Study; https://doi.org/10.3390/educsci11080428. Eddy Sutadji, Herawati Susilo, Aji Prasetya Wibawa, Nidal A.M. Jabari and Syaiful Nur Rohmad—Authentic Assessment Implementation in Natural and Social Science; https://doi.org/10.3390/educsci11090534 Jurgita Lenkauskaitė, Remigijus Bubnys, Erika Masiliauskienė and Daiva Malinauskienė— Participation in the Assessment Processes in Problem-Based Learning: Experiences of the Students of Social Sciences in Lithuania; https://doi.org/10.3390/educsci11110678. Tatiana Baranova, Dmitriy Mokhorov, Aleksandra Kobicheva and Elena Tokareva— Assessment of the Application of Content and Language Integrated Learning in a Multilingual Classroom; https://doi.org/10.3390/educsci11120808. Another interesting research is the one presented by Vicent et al. where we are guided through students’ procrastination processes, the formative assessments and the summative evaluation. This case study presents the unexpected and undesirable effects of both on the behavior of students and on both grading and learning. Authentic assessment is another pedagogical approach based on real world impact. Sutadji and colleagues presented a research paper where they debate epistemological and scientific constructions to social and natural sciences. Lenkauskaitė and colleagues explored the idea of change in the higher educational process using a problem-based learning strategy. The need we have in education institutions to empower students is reflected in this study that shows empowerment and enhancement of critical thinking from students when they assess and are involved in the assessment strategy. xi To end this topic Baranova and colleagues present a research based on the introduction of content and language into classes with a multilingual approach, which will allow students to use several foreign languages in the process of professional communication. The purpose of the paper is to evaluate the efficiency of a newly introduced integrated learning model from the perspective of students and to understand its impact on students. Topic three—Digitalization- and peer-support-technology-based Rana Saeed Al-Maroof, Khadija Alhumaid and Said Salloum—The Continuous Intention to Use E-Learning, from Two Different Perspectives; https://doi.org/10.3390/educsci 11010006. Isabel López-Tocón—Moodle Quizzes as a Continuous Assessment in Higher Education: An Exploratory Approach in Physical Chemistry; https://doi.org/10.3390/educsci11090500. Mehdi Berriri, Sofiane Djema, Gaëtan Rey and Christel Dartigues-Pallez—Multi-Class Assessment Based on Random Forests.; https://doi.org/10.3390/educsci11030092. In Topic 3, the book presents relevant pos pandemic strategies like e-learning methods. The paper by Al-Maroof et al. show that teachers’ and students’ perceived technology self-efficacy, ease of use and usefulness are the main factors directly affecting the continuous intention to use technology. Their relevant findings also bring about intrinsic and extrinsic motivation associated and developed throughout the process of learning. Considered the key factors that support the use of technology continuously. The chapter continues with López-Tocón and colleagues work on Moodle Quizzes as a Continuous Assessment. Moodle quizzes were explored in this study, and they acted as a reliable practice for teaching and learning. This topic regards crucial aspects that intend to enhance the need for higher education institutions to support additional student-centred dynamics not based on the teacher and its role as the main actor in the classroom or even as main facilitator of knowledge. In this chapter it is explored by the work of Berriri, a novel study that tried to provide relevant information regarding counseling processes. Additionally, it is explored how teaching staff can propose training courses adapted to students by anticipating their possible difficulties using new technologies, a machine learning algorithm called Random Forest, allowing for the classification of the students depending on their results. Topic four—Organizations and governance Cristina Checa-Morales, Carmen De-Pablos-Heredero, Angela Lorena Carreño, Sajid Haider and Antón García—Organizational Differences among Universities in Three Socioeconomic Contexts: Finland, Spain and Ecuador. Relational Coordination Approach; https://doi.org/10.3390/educsci11080445. Hue Thi Truong, Hung Manh Le, Duc Anh Do, Duc Anh Le, Huyen Thi Nguyen and Thanh Kim Nguyen—Impact of Governance Factors over Lecturers’ Scientific Research Output: An Empirical Evidence; https://doi.org/10.3390/educsci11090553. xii Cecília Guerra and Nilza Costa—Can Pedagogical Innovations Be Sustainable? One Evaluation Outlook for Research Developed in Portuguese Higher Education; https://doi.org/10.3390/educsci11110725. The book also presents institutional research, conducted in a macro level approach that can be very helpful to the reader that is interested in more information regarding the assessment of pedagogical innovation at an institutional level. Bečica and colleagues present a relevant qualitative Assessment of the Pedagogical Process at Czech Public Universities. This work increments the debate towards more quality-based measures considering that the monitoring and quantification of quality in education is a very demanding and controverse topic. Checa-Morales and colleagues presented an institutional study that focus on organizational differences Universities in Three Socioeconomic Contexts: Finland, Spain and Ecuador. Results show that shared goals with among faculty members and problem-solving communication among students were key. Organizational practices show relevant differences among the three universities. Truong and colleagues analysed governance factors that influence the scientific research output of lecturers. The results reveal that resources for scientific research have the most impact on lecturers’ scientific research output, followed by policies for lecturers, support for scientific research activities, scientific research objectives of HEIs, and finally, leadership. Pedagogical innovation is key in order to develop society. Guerra and colleagues introduce a very interesting and critical approach to the topic, conducting research that focused on the extent to which funded national research-based education projects, developed in public Portuguese higher education institutions (universities and polytechnic institutes), have considered the sustainability of research results (e.g., pedagogical innovations), after funding ends. We believe there is a need for this book to provide clear and relevant scientific research which takes into consideration pedagogical innovation, assessment processes and institutional models. The aim of this book is to provide the reader with key and updated research on the information necessary to understand students learning and teaching, innovation at assessment, the need to assess involving the students and also to understand global macro level research, national level and institutional level. Therefore, we hope to reach policy makers, educators, researchers, teachers, students and a global community of people that are interested and concerned with the research agenda, acting in student’s empowerment, knowledge and updated skills.info:eu-repo/semantics/publishedVersio

Machine Learning applications to e-learning courses

The Ph.D. thesis project is aimed at improving the quality and the effectiveness of on-line teaching in scientific degree courses at the University Level that required the use of E-learning platform, based on the Moodle Content Management System. The aim of this research project is to assist the teacher, through the development of new tools based on Artificial Intelligence, to design innovative successful e-learning courses to give to the students the opportunity to improve their learning outcomes. These originals tools overcome the limitations of the standard Moodle activities applying machine learning techniques by analysing large amount of students’ data extracted by Moodle log data. Recently many e-learning resources have been developed for university students, are available on the Web. The increase of LMS (Learning Management System) as Moodle and their ease of use led many teachers to realize e-learning paths for their students, often supporting them with some frontal activities, giving to them the advantages of on-line learning. The aim was to deepen the topics discussed in class through the consultation of additional materials, video recordings of lessons, and other activities to exploiting the potentials of on-line courses