Stereotype modeling for problem-solving performance predictions in moocs and traditional courses

Stereotypes are frequently used in real life to classify students according to their performance in class. In literature, we can find many references to weaker students, fast learners, struggling students, etc. Given the lack of detailed data about students, these or other kinds of stereotypes could be potentially used for user modeling and personalization in the educational context. Recent research in MOOC context demonstrated that data-driven learner stereotypes could work well for detecting and preventing student dropouts. In this paper, we are exploring the application of stereotype-based modeling to a more challenging task - predicting student problemsolving and learning in two programming courses and two MOOCs. We explore traditional stereotypes based on readily available factors like gender or education level as well as some advanced data-driven approaches to group students based on their problem-solving behavior. Each of the approaches to form student stereotype cohorts is validated by comparing models of student learning: do students in different groups learn differently? In the search for the stereotypes that could be used for adaptation, the paper examines ten approaches. We compare the performance of these approaches and draw conclusions for future research

Predicting Student Success in a Self-Paced Mathematics MOOC

abstract: While predicting completion in Massive Open Online Courses (MOOCs) has been an active area of research in recent years, predicting completion in self-paced MOOCS, the fastest growing segment of open online courses, has largely been ignored. Using learning analytics and educational data mining techniques, this study examined data generated by over 4,600 individuals working in a self-paced, open enrollment college algebra MOOC over a period of eight months. Although just 4% of these students completed the course, models were developed that could predict correctly nearly 80% of the time which students would complete the course and which would not, based on each student’s first day of work in the online course. Logistic regression was used as the primary tool to predict completion and focused on variables associated with self-regulated learning (SRL) and demographic variables available from survey information gathered as students begin edX courses (the MOOC platform employed). The strongest SRL predictor was the amount of time students spent in the course on their first day. The number of math skills obtained the first day and the pace at which these skills were gained were also predictors, although pace was negatively correlated with completion. Prediction models using only SRL data obtained on the first day in the course correctly predicted course completion 70% of the time, whereas models based on first-day SRL and demographic data made correct predictions 79% of the time.Dissertation/ThesisDoctoral Dissertation Educational Technology 201

Predicting Academic Performance: A Systematic Literature Review

The ability to predict student performance in a course or program creates opportunities to improve educational outcomes. With effective performance prediction approaches, instructors can allocate resources and instruction more accurately. Research in this area seeks to identify features that can be used to make predictions, to identify algorithms that can improve predictions, and to quantify aspects of student performance. Moreover, research in predicting student performance seeks to determine interrelated features and to identify the underlying reasons why certain features work better than others. This working group report presents a systematic literature review of work in the area of predicting student performance. Our analysis shows a clearly increasing amount of research in this area, as well as an increasing variety of techniques used. At the same time, the review uncovered a number of issues with research quality that drives a need for the community to provide more detailed reporting of methods and results and to increase efforts to validate and replicate work.Peer reviewe

Keeping Data Science Broad: Negotiating the Digital and Data Divide Among Higher Education Institutions

The goal of the “Keeping Data Science Broad” series of webinars and workshops was to garner community input into pathways for keeping data science education broadly inclusive across sectors, institutions, and populations. Input was collected from data science programs across the nation, either traditional or alternative, and from a range of institution types including community colleges, minority-led and minority-serving institutions, liberal arts colleges, tribal colleges, universities, and industry partners. The series consisted of two webinars (August 2017 and September 2017) leading up to a workshop (November 2017) exploring the future of data science education and workforce at institutions of higher learning that are primarily teaching-focused. A third follow-up webinar was held after the workshop (January 2018) to report on outcomes and next steps. Program committee members were chosen to represent a broad spectrum of communities with a diversity of geography (West, Northeast, Midwest, and South), discipline (Computer Science, Math, Statistics, and Domains), as well as institution type (Historically Black Colleges and Universities (HBCU’s), Hispanic-Serving Institutions (HSI’s), other Minority-Serving Institutions (MSI\u27s), Community College\u27s (CC’s), 4-year colleges, Tribal Colleges, R1 Universities, Government and Industry Partners)

IMPACT OF EVIDENCE-BASED ACTIVE-ENGAGEMENT COURSES ON STUDENT PERFORMANCE AND GENDER GAP IN INTRODUCTORY PHYSICS

This thesis explores impact of evidence-based active-engagement courses (EBAE) on student achievement and gender gap in introductory physics. The first study is about the pedagogical content knowledge (PCK) of the physics teaching assistants (TAs) at identifying introductory students’ difficulties using the Conceptual Survey of Electricity and Magnetism, which is important for implementing evidence-based pedagogy. The second study focuses on EBAE physics classes in which there are potential opportunities for instructors and TAs to apply their PCK and other research-based instructional strategies to improve student learning. We investigated whether EBAE classes improved student performance compared to traditional lecture-lased (LB) classes and whether EBAE classes helped improve student performance. We used the Force Concept Inventory (FCI) in physics I and the Conceptual Survey of Electricity and Magnetism (CSEM) in physics II as assessment instruments. Our findings suggest that, on average, students in EBAE classes outperformed students in LB classes in conceptual posttests although their scores on pretests were not statistically significantly different. Moreover, on average, both male and female students in EBAE classes outperformed those of the same gender in LB classes on posttests although there was no difference on the pretests. However, no reduction in the gender gap in EBAE classes was observed. We also investigated the impact of stereotype threat in introductory physics classes. When students were asked to indicate their gender immediately before taking standardized physics tests, no deterioration in female students’ performance on standardized test was observed compared to the case when gender was not indicated. Moreover, we also investigated the extent to which agreeing with the stereotype that men to generally perform better in physics than women was correlated with students’ performance and found that this type of belief is not very common (~10%). However, in some situations, female students who agreed with the stereotype performed worse than female students who did not agree with it. This effect appears to be stronger in the calculus-based courses compared to the algebra-based courses. Finally, we propose that implementing interventions to improve female students’ social belongingness, self-efficacy and growth mindset may help reduce the gender gap in physics courses

Keeping Data Science Broad: Negotiating the Digital and Data Divide Among Higher Education Institutions

The goal of the “Keeping Data Science Broad” series of webinars and workshops was to garner community input into pathways for keeping data science education broadly inclusive across sectors, institutions, and populations. Input was collected from data science programs across the nation, either traditional or alternative, and from a range of institution types including community colleges, minority-led and minority-serving institutions, liberal arts colleges, tribal colleges, universities, and industry partners. The series consisted of two webinars (August 2017 and September 2017) leading up to a workshop (November 2017) exploring the future of data science education and workforce at institutions of higher learning that are primarily teaching-focused. A third follow-up webinar was held after the workshop (January 2018) to report on outcomes and next steps. Program committee members were chosen to represent a broad spectrum of communities with a diversity of geography (West, Northeast, Midwest, and South), discipline (Computer Science, Math, Statistics, and Domains), as well as institution type (Historically Black Colleges and Universities (HBCU’s), Hispanic-Serving Institutions (HSI’s), other Minority-Serving Institutions (MSI\u27s), Community College\u27s (CC’s), 4-year colleges, Tribal Colleges, R1 Universities, Government and Industry Partners)

Algorithms, applications and systems towards interpretable pattern mining from multi-aspect data

How do humans move around in the urban space and how do they differ when the city undergoes terrorist attacks? How do users behave in Massive Open Online courses~(MOOCs) and how do they differ if some of them achieve certificates while some of them not? What areas in the court elite players, such as Stephen Curry, LeBron James, like to make their shots in the course of the game? How can we uncover the hidden habits that govern our online purchases? Are there unspoken agendas in how different states pass legislation of certain kinds? At the heart of these seemingly unconnected puzzles is this same mystery of multi-aspect mining, i.g., how can we mine and interpret the hidden pattern from a dataset that simultaneously reveals the associations, or changes of the associations, among various aspects of the data (e.g., a shot could be described with three aspects, player, time of the game, and area in the court)? Solving this problem could open gates to a deep understanding of underlying mechanisms for many real-world phenomena. While much of the research in multi-aspect mining contribute broad scope of innovations in the mining part, interpretation of patterns from the perspective of users (or domain experts) is often overlooked. Questions like what do they require for patterns, how good are the patterns, or how to read them, have barely been addressed. Without efficient and effective ways of involving users in the process of multi-aspect mining, the results are likely to lead to something difficult for them to comprehend. This dissertation proposes the M^3 framework, which consists of multiplex pattern discovery, multifaceted pattern evaluation, and multipurpose pattern presentation, to tackle the challenges of multi-aspect pattern discovery. Based on this framework, we develop algorithms, applications, and analytic systems to enable interpretable pattern discovery from multi-aspect data. Following the concept of meaningful multiplex pattern discovery, we propose PairFac to close the gap between human information needs and naive mining optimization. We demonstrate its effectiveness in the context of impact discovery in the aftermath of urban disasters. We develop iDisc to target the crossing of multiplex pattern discovery with multifaceted pattern evaluation. iDisc meets the specific information need in understanding multi-level, contrastive behavior patterns. As an example, we use iDisc to predict student performance outcomes in Massive Open Online Courses given users' latent behaviors. FacIt is an interactive visual analytic system that sits at the intersection of all three components and enables for interpretable, fine-tunable, and scrutinizable pattern discovery from multi-aspect data. We demonstrate each work's significance and implications in its respective problem context. As a whole, this series of studies is an effort to instantiate the M^3 framework and push the field of multi-aspect mining towards a more human-centric process in real-world applications