Stability and sensitivity of Learning Analytics based prediction models

Learning analytics seek to enhance the learning processes through systematic measurements of learning related data and to provide informative feedback to learners and educators. Track data from Learning Management Systems (LMS) constitute a main data source for learning analytics. This empirical contribution provides an application of Buckingham Shum and Deakin Crick’s theoretical framework of dispositional learning analytics: an infrastructure that combines learning dispositions data with data extracted from computer-assisted, formative assessments and LMSs. In two cohorts of a large introductory quantitative methods module, 2049 students were enrolled in a module based on principles of blended learning, combining face-to-face Problem-Based Learning sessions with e-tutorials. We investigated the predictive power of learning dispositions, outcomes of continuous formative assessments and other system generated data in modelling student performance and their potential to generate informative feedback. Using a dynamic, longitudinal perspective, computer-assisted formative assessments seem to be the best predictor for detecting underperforming students and academic performance, while basic LMS data did not substantially predict learning. If timely feedback is crucial, both use-intensity related track data from e-tutorial systems, and learning dispositions, are valuable sources for feedback generation

What learning analytics based prediction models tell us about feedback preferences of students

Learning analytics (LA) seeks to enhance learning processes through systematic measurements of learning related data and to provide informative feedback to learners and educators (Siemens & Long, 2011). This study examined the use of preferred feedback modes in students by using a dispositional learning analytics framework, combining learning disposition data with data extracted from digital systems. We analyzed the use of feedback of 1062 students taking an introductory mathematics and statistics course, enhanced with digital tools. Our findings indicated that compared with hints, fully worked-out solutions demonstrated a stronger effect on academic performance and acted as a better mediator between learning dispositions and academic performance. This study demonstrated how e-learners and their data can be effectively re-deployed to provide meaningful insights to both educators and learners

Networked Living: a new approach to teaching introductory ICT

The course T175 Networked Living is a 300 hour, multiple media, distance learning course offered by the UK Open University. The first presentation of the course, in 2005, attracted over 1600 students. T175 introduces students to general concepts of information and communication technology in a range of contexts, including: communication and identity; entertainment and information; and health, transport and government. It is an introductory (level 1) course for a variety of bachelors’ degrees, including the BSc programmes in: Information and Communication Technology; IT and Computing; and Technology; as well as the BEng engineering programme. The course was designed with a focus on retention of students and preparing them for further study. Student workload and pacing was carefully planned and there is a significant study skills component. The course uses a range of media, including: text, audio, computer animation and other software, and a website. Active learning is encouraged by means of activities, online quizzes, animations, spreadsheets and a learning journal. Continuous assessment is carried out via a mix of multiple-choice assignments (to test factual and numerical skills) and written assignments (which include elementary research into new topics). The course culminates with a written end-of-course assessment. This includes a major reflective component, as well as more traditional questions designed to test knowledge and understanding

Staying the course: retention and participation in on-line learning in Singapore and the UK

In 2001 the Singapore Institute of Management (SIM) in collaboration with the British Open University (OU) ran a successful presentation of the Level 1 Technology Course 'You, Your Computer and the Net'. The 30 point foundation level course was delivered to 9,000 students in 13 UK regions and simultaneously to a cohort of 200 students in Singapore. One of the striking factors about the results of this course was the difference in retention and ultimately the final pass rates of the two cohorts of students. This paper will describe the course and its delivery in the two countries, attempting to offer some explanations for this discrepancy in drop out rates using a cross cultural perspective

A multi-modal study into students’ timing and learning regulation: time is ticking

Purpose This empirical study aims to demonstrate how the combination of trace data derived from technology-enhanced learning environments and self-response survey data can contribute to the investigation of self-regulated learning processes. Design/methodology/approach Using a showcase based on 1,027 students’ learning in a blended introductory quantitative course, the authors analysed the learning regulation and especially the timing of learning by trace data. Next, the authors connected these learning patterns with self-reports based on multiple contemporary social-cognitive theories. Findings The authors found that several behavioural facets of maladaptive learning orientations, such as lack of regulation, self-sabotage or disengagement negatively impacted the amount of practising, as well as timely practising. On the adaptive side of learning dispositions, the picture was less clear. Where some adaptive dispositions, such as the willingness to invest efforts in learning and self-perceived planning skills, positively impacted learning regulation and timing of learning, other dispositions such as valuing school or academic buoyancy lacked the expected positive effects. Research limitations/implications Due to the blended design, there is a strong asymmetry between what one can observe on learning in both modes. Practical implications This study demonstrates that in a blended setup, one needs to distinguish the grand effect on learning from the partial effect on learning in the digital mode: the most adaptive students might be less dependent for their learning on the use of the digital learning mode. Originality/value The paper presents an application of embodied motivation in the context of blended learning

Secondary implementation of interactive engagement teaching techniques: Choices and challenges in a Gulf Arab context

We report on a "Collaborative Workshop Physics" instructional strategy to deliver the first IE calculus-based physics course at Khalifa University, UAE. To these authors' knowledge, this is the first such course on the Arabian Peninsula using PER-based instruction. A brief history of general university and STEM teaching in the UAE is given. We present this secondary implementation (SI) as a case study of a novel context and use it to determine if PER-based instruction can be successfully implemented far from the cultural context of the primary developer and, if so, how might such SIs differ from SIs within the US. With these questions in view, a pre-reform baseline of MPEX, FCI, course exam and English language proficiency data are used to design a hybrid implementation of Cooperative Group Problem Solving. We find that for students with high English proficiency, normalized gain on FCI improves from = 0.16+/-0.10 pre- to = 0.47+/-0.08 post-reform, indicating successful SI. We also find that is strongly modulated by language proficiency and discuss likely causes. Regardless of language skill, problem-solving skill is also improved and course DFW rates drop from 50% to 24%. In particular, we find evidence in post-reform student interviews that prior classroom experiences, and not broader cultural expectations about education, are the more significant cause of expectations at odds with the classroom norms of well-functioning PER-based instruction. This result is evidence that PER-based innovations can be implemented across great changes in cultural context, provided that the method is thoughtfully adapted in anticipation of context and culture-specific student expectations. This case study should be valuable for future reforms at other institutions, both in the Gulf Region and developing world, facing similar challenges involving SI of PER-based instruction outside the US.Comment: v1: 28 pages, 9 figures. v2: 19 pages, 6 figures, includes major reorganization and revisions based on anonymous peer review. v3: 19 pages, 6 figures, minor revisions based on anonymous peer revie

EVALUATION OF THE IMPLEMENTATION OF OFFICE365 PROGRAM FOR ONLINE TUTORIAL DELIVERY OF A COLLEGE MATHEMATICS COURSE

This study is intended to improve the distance learning online tutorial services for students who participate in online tutorial offered by Universitas Terbuka (UT), specifically courses offered by Department of Mathematics, School of Mathematics and Natural Science. Since 2013 UT has offered the online tutorial services that integrate the Office365 program and the Learning Management System MOODLE. Office365 program can support the distance learning activities, for example the availability of digital interactive whiteboard and webinar can support synchronous interactions between students and tutor. These two features of Office365 can facilitate the explanation of mathematical concepts, equations, and symbols which are not supported by MOODLE. The Mathematics department adds the graphic tablet which is connected to the PC or laptop for the tutor to better utilized the digital interactive whiteboard feature. This study utilizes a research and development approach especially the ADDIE (Analyze, Design, Development, Implementation and Evaluation) model in developing the improved online tutorial program. The aim of this study is to apply the features of Office365 in line with the MOODLE system. The two programs are observed when offered the online tutorial of Introductory to Mathematic course. The result of the evaluation of the trial is that for the webinar and the interactive whiteboard features, students say that they are beneficial to them in getting the explanation about introductory mathematics concepts. However, the obstacle to utilize the program smoothly is internet connection that is up and down, and the limit time of the webinar. In the future the webinar time will be increase to 4 times instead of three times, on Saturdays or Sundays in the two months of the online tutorial. Keywords: Office365, MOODLE, Mathematics online learnin

Using Data in Undergraduate Science Classrooms

Provides pedagogical insight concerning the skill of using data The resource being annotated is: http://www.dlese.org/dds/catalog_DATA-CLASS-000-000-000-007.htm