Effects of Automated Interventions in Programming Assignments: Evidence from a Field Experiment

A typical problem in MOOCs is the missing opportunity for course conductors to individually support students in overcoming their problems and misconceptions. This paper presents the results of automatically intervening on struggling students during programming exercises and offering peer feedback and tailored bonus exercises. To improve learning success, we do not want to abolish instructionally desired trial and error but reduce extensive struggle and demotivation. Therefore, we developed adaptive automatic just-in-time interventions to encourage students to ask for help if they require considerably more than average working time to solve an exercise. Additionally, we offered students bonus exercises tailored for their individual weaknesses. The approach was evaluated within a live course with over 5,000 active students via a survey and metrics gathered alongside. Results show that we can increase the call outs for help by up to 66% and lower the dwelling time until issuing action. Learnings from the experiments can further be used to pinpoint course material to be improved and tailor content to be audience specific.Comment: 10 page

Service-Learning Community Partner Impact Assessment Report

In the summer of 2017, VCU’s Office of Service-Learning conducted an evaluation of the impact of service-learning on community partner organizations. This assessment aimed to collect actionable feedback from partners and to inform improvements to service-learning courses at VCU that successfully address partners’ concerns. An external researcher conducted phone interviews with a representative sample of 22 community partners. Partners were asked how a specific service-learning course impacted their organization in three areas: organizational capacity, economically, and socially. Partners were also asked about faculty interactions and the likelihood of recommending the service-learning course to other organizations like their own. This report presents the findings of this community partner impact assessment, outlines an assessment model for a three-year continuous improvement cycle, and offers key recommendations and next steps that emerged from this assessment

Leadership Curriculum Evaluation: Final Report DFE- RR639

Evaluation report of the National College for Teaching and Leadership's Leadership Curriculum commissioned by Department for Education (2013-2016

Data Mining Applications in Higher Education and Academic Intelligence Management

Higher education institutions are nucleus of research and future development acting in a competitive environment, with the prerequisite mission to generate, accumulate and share knowledge. The chain of generating knowledge inside and among external organizations (such as companies, other universities, partners, community) is considered essential to reduce the limitations of internal resources and could be plainly improved with the use of data mining technologies. Data mining has proven to be in the recent years a pioneering field of research and investigation that faces a large variety of techniques applied in a multitude of areas, both in business and higher education, relating interdisciplinary studies and development and covering a large variety of practice. Universities require an important amount of significant knowledge mined from its past and current data sets using special methods and processes. The ways in which information and knowledge are represented and delivered to the university managers are in a continuous transformation due to the involvement of the information and communication technologies in all the academic processes. Higher education institutions have long been interested in predicting the paths of students and alumni (Luan, 2004), thus identifying which students will join particular course programs (Kalathur, 2006), and which students will require assistance in order to graduate. Another important preoccupation is the academic failure among students which has long fuelled a large number of debates. Researchers (Vandamme et al., 2007) attempted to classify students into different clusters with dissimilar risks in exam failure, but also to detect with realistic accuracy what and how much the students know, in order to deduce specific learning gaps (Piementel & Omar, 2005). The distance and on-line education, together with the intelligent tutoring systems and their capability to register its exchanges with students (Mostow et al., 2005) present various feasible information sources for the data mining processes. Studies based on collecting and interpreting the information from several courses could possibly assist teachers and students in the web-based learning setting (Myller et al., 2002). Scientists (Anjewierden et al., 2007) derived models for classifying chat messages using data mining techniques, in order to offer learners real-time adaptive feedback which could result in the improvement of learning environments. In scientific literature there are some studies which seek to classify students in order to predict their final grade based on features extracted from logged data ineducational web-based systems (Minaei-Bidgoli & Punch, 2003). A combination of multiple classifiers led to a significant improvement in classification performance through weighting the feature vectors. The author’s research directions through the data mining practices consist in finding feasible ways to offer the higher education institutions’ managers ample knowledge to prepare new hypothesis, in a short period of time, which was formerly rigid or unachievable, in view of large datasets and earlier methods. Therefore, the aim is to put forward a way to understand the students’ opinions, satisfactions and discontentment in the each element of the educational process, and to predict their preference in certain fields of study, the choice in continuing education, academic failure, and to offer accurate correlations between their knowledge and the requirements in the labor market. Some of the most interesting data mining processes in the educational field are illustrated in the present chapter, in which the author adds own ideas and applications in educational issues using specific data mining techniques. The organization of this chapter is as follows. Section 2 offers an insight of how data mining processes are being applied in the large spectrum of education, presenting recent applications and studies published in the scientific literature, significant to the development of this emerging science. In Section 3 the author introduces his work through a number of new proposed directions and applications conducted over data collected from the students of the Babes-Bolyai University, using specific data mining classification learning and clustering methods. Section 4 presents the integration of data mining processes and their particular role in higher education issues and management, for the conception of an Academic Intelligence Management. Interrelated future research and plans are discussed as a conclusion in Section 5.data mining,data clustering, higher education, decision trees, C4.5 algorithm, k-means, decision support, academic intelligence management

Navigating the Turbulent Waters of School Reform Guided by Complexity Theory

The goal of this research study has been to develop, implement, and evaluate a school reform design experiment at a continuation high school with low-income, low-performing underrepresented minority students. The complexity sciences served as a theoretical framework for this design experiment. Treating an innovative college preparatory program as a nested complex adaptive system within a larger complex adaptive system, the school, we used features of complex adaptive systems (equilibrium, emergence, self-organization, and feedback loops) as a framework to design a strategy for school reform. The goal was to create an environment for change by pulling the school far from equilibrium using a strategy we call “purposeful perturbations” to disrupt the stable state of the school in a purposeful way. Over the four years of the study, several tipping points were reached, and we developed agent-based simulation models that capture important dynamic properties of the reform at these points. The study draws upon complexity theory in multiple ways that have supported improved education for low-achieving students