Data Mining Applications in Higher Education and Academic Intelligence Management

Higher education institutions are nucleus of research and future development acting in a competitive environment, with the prerequisite mission to generate, accumulate and share knowledge. The chain of generating knowledge inside and among external organizations (such as companies, other universities, partners, community) is considered essential to reduce the limitations of internal resources and could be plainly improved with the use of data mining technologies. Data mining has proven to be in the recent years a pioneering field of research and investigation that faces a large variety of techniques applied in a multitude of areas, both in business and higher education, relating interdisciplinary studies and development and covering a large variety of practice. Universities require an important amount of significant knowledge mined from its past and current data sets using special methods and processes. The ways in which information and knowledge are represented and delivered to the university managers are in a continuous transformation due to the involvement of the information and communication technologies in all the academic processes. Higher education institutions have long been interested in predicting the paths of students and alumni (Luan, 2004), thus identifying which students will join particular course programs (Kalathur, 2006), and which students will require assistance in order to graduate. Another important preoccupation is the academic failure among students which has long fuelled a large number of debates. Researchers (Vandamme et al., 2007) attempted to classify students into different clusters with dissimilar risks in exam failure, but also to detect with realistic accuracy what and how much the students know, in order to deduce specific learning gaps (Piementel & Omar, 2005). The distance and on-line education, together with the intelligent tutoring systems and their capability to register its exchanges with students (Mostow et al., 2005) present various feasible information sources for the data mining processes. Studies based on collecting and interpreting the information from several courses could possibly assist teachers and students in the web-based learning setting (Myller et al., 2002). Scientists (Anjewierden et al., 2007) derived models for classifying chat messages using data mining techniques, in order to offer learners real-time adaptive feedback which could result in the improvement of learning environments. In scientific literature there are some studies which seek to classify students in order to predict their final grade based on features extracted from logged data ineducational web-based systems (Minaei-Bidgoli & Punch, 2003). A combination of multiple classifiers led to a significant improvement in classification performance through weighting the feature vectors. The author’s research directions through the data mining practices consist in finding feasible ways to offer the higher education institutions’ managers ample knowledge to prepare new hypothesis, in a short period of time, which was formerly rigid or unachievable, in view of large datasets and earlier methods. Therefore, the aim is to put forward a way to understand the students’ opinions, satisfactions and discontentment in the each element of the educational process, and to predict their preference in certain fields of study, the choice in continuing education, academic failure, and to offer accurate correlations between their knowledge and the requirements in the labor market. Some of the most interesting data mining processes in the educational field are illustrated in the present chapter, in which the author adds own ideas and applications in educational issues using specific data mining techniques. The organization of this chapter is as follows. Section 2 offers an insight of how data mining processes are being applied in the large spectrum of education, presenting recent applications and studies published in the scientific literature, significant to the development of this emerging science. In Section 3 the author introduces his work through a number of new proposed directions and applications conducted over data collected from the students of the Babes-Bolyai University, using specific data mining classification learning and clustering methods. Section 4 presents the integration of data mining processes and their particular role in higher education issues and management, for the conception of an Academic Intelligence Management. Interrelated future research and plans are discussed as a conclusion in Section 5.data mining,data clustering, higher education, decision trees, C4.5 algorithm, k-means, decision support, academic intelligence management

Signaling the Competencies of High School Students to Employers

[Excerpt] The fundamental cause of the low effort level of American students, parents, and voters in school elections is the absence of good signals of effort and accomplishment and the consequent lack of rewards for learning. In most other advanced countries mastery of the curriculum is assessed by examinations that are set and graded at the national or regional level. Grades on these exams signal the student\u27s achievement to employers and colleges and influence the jobs that graduates get and the universities and programs to which they are admitted. Exam results also influence school reputations and in some countries the number of students applying for admission to the school. In the United States, by contrast, students take aptitude tests that are not intended to assess the learning that has occurred in most of the classes taken in high school. The primary signals of academic achievement are diplomas awarded for time spent in school and grades and rank in class—criteria that assess achievement relative to other students in the school or classroom, not relative to an external standard

From Gatekeeping to Engagement: A Multicontextual, Mixed Method Study of Student Academic Engagement in Introductory STEM Courses.

The lack of academic engagement in introductory science courses is considered by some to be a primary reason why students switch out of science majors. This study employed a sequential, explanatory mixed methods approach to provide a richer understanding of the relationship between student engagement and introductory science instruction. Quantitative survey data were drawn from 2,873 students within 73 introductory science, technology, engineering, and mathematics (STEM) courses across 15 colleges and universities, and qualitative data were collected from 41 student focus groups at eight of these institutions. The findings indicate that students tended to be more engaged in courses where the instructor consistently signaled an openness to student questions and recognizes her/his role in helping students succeed. Likewise, students who reported feeling comfortable asking questions in class, seeking out tutoring, attending supplemental instruction sessions, and collaborating with other students in the course were also more likely to be engaged. Instructional implications for improving students' levels of academic engagement are discussed

The effectiveness of synchronous massive online courses at The University of Texas at Austin

Is online education an effective and viable alternative to face-to-face education? The purpose of this dissertation was to evaluate the effectiveness of online education at The University of Texas at Austin (UT-Austin). The dissertation focused on Synchronous Massive Online Courses (SMOCs) at The University of Texas at Austin since 2012. This dissertation analyzed the extent to which course effectiveness varies as a function of lecture environment, comparing SMOCs to similar face-to-face (FTF) courses. In total, 25,726 students across 53 courses at UT-Austin were included in analyses. Researchers compiled all relevant student and course data archived in university databases and merged that with course data compiled from archived course syllabi. Then, Hierarchical Linear Modeling was used to test how (a) final course grades vary as a function of lecture environment (SMOC or FTF), controlling for socioeconomic status, scholastic aptitude, and course exam frequency, (b) subsequent semester grades vary as a function of lecture environment (SMOC or FTF), controlling for socioeconomic status, scholastic aptitude, and course exam frequency, and (c) course completion rates vary as a function of lecture environment (SMOC or FTF), controlling for socioeconomic status, scholastic aptitude, and course exam frequency. The primary goal of this project was to examine the effectiveness of SMOCs in comparison to FTFs. Course effectiveness was operationally defined with three objective outcomes: final course grades, subsequent semester GPAs, and course completions. Findings show that there were no significant differences between SMOCs and FTFs on any of these objective measures. That is, SMOCs neither outperform nor underperform FTFs in final grades, subsequent semester GPAs, or course completions. Because previous studies propose that increasing exam frequency may reduce SES-based achievement gaps (e.g., Pennebaker, Gosling, & Ferrell, 2013), and there are some mixed results in the literature about the effectiveness of frequent testing (e.g., Bell, Simone, & Whitfield, 2015), a secondary goal of this dissertation focused on the interaction of SES and exam frequency in the context of course effectiveness outcomes. Exam frequency interacted with lecture environment; such that for FTFs, there was no substantial difference in final course grades by exam frequency; however, for SMOCs, students with more exams had higher final course grades than students with fewer exams. The highest final grades were earned by students in SMOCs that provided the highest exam frequencies (while accounting for control variables). Exam frequency also interacted with socioeconomic status (SES); such that for lower SES students, when exam frequencies are lower the probabilities of course completion are lower than when exam frequencies are higher; and when exam frequencies are higher, the probabilities of course completion are higher than when exam frequencies are lower. For higher SES students, the probabilities of course completion did not vary by exam frequency. Given these findings, increasing exam frequencies in course structures is recommended. Looking across a wide range of course topics and courses, and large number of students, this dissertation provides evidence that SMOCs are as effective as FTFs on objective course outcomes, both short- and long-term. This includes final course grades, subsequent semester GPAs, and course completion rates as course effectiveness measures. Economically, SMOCs are able to reach thousands of students by relying on fewer faculty without the need for large classrooms. At the same time, it frees faculty to teach more and smaller upper division courses. Although the results of the SMOC and FTF courses were generally similar, the additional payoffs of the SMOCs make them a promising tool for the future of undergraduate education. If the high standard of educational course effectiveness is based in the traditional FTF course, then a comparable SMOC course meets that high standard.Psycholog

Data Mining Applications in Higher Education and Academic Intelligence Management

Higher education institutions are nucleus of research and future development acting in a competitive environment, with the prerequisite mission to generate, accumulate and share knowledge. The chain of generating knowledge inside and among external organizations (such as companies, other universities, partners, community) is considered essential to reduce the limitations of internal resources and could be plainly improved with the use of data mining technologies. Data mining has proven to be in the recent years a pioneering field of research and investigation that faces a large variety of techniques applied in a multitude of areas, both in business and higher education, relating interdisciplinary studies and development and covering a large variety of practice. Universities require an important amount of significant knowledge mined from its past and current data sets using special methods and processes. The ways in which information and knowledge are represented and delivered to the university managers are in a continuous transformation due to the involvement of the information and communication technologies in all the academic processes. Higher education institutions have long been interested in predicting the paths of students and alumni (Luan, 2004), thus identifying which students will join particular course programs (Kalathur, 2006), and which students will require assistance in order to graduate. Another important preoccupation is the academic failure among students which has long fuelled a large number of debates. Researchers (Vandamme et al., 2007) attempted to classify students into different clusters with dissimilar risks in exam failure, but also to detect with realistic accuracy what and how much the students know, in order to deduce specific learning gaps (Piementel & Omar, 2005). The distance and on-line education, together with the intelligent tutoring systems and their capability to register its exchanges with students (Mostow et al., 2005) present various feasible information sources for the data mining processes. Studies based on collecting and interpreting the information from several courses could possibly assist teachers and students in the web-based learning setting (Myller et al., 2002). Scientists (Anjewierden et al., 2007) derived models for classifying chat messages using data mining techniques, in order to offer learners real-time adaptive feedback which could result in the improvement of learning environments. In scientific literature there are some studies which seek to classify students in order to predict their final grade based on features extracted from logged data ineducational web-based systems (Minaei-Bidgoli & Punch, 2003). A combination of multiple classifiers led to a significant improvement in classification performance through weighting the feature vectors. The author’s research directions through the data mining practices consist in finding feasible ways to offer the higher education institutions’ managers ample knowledge to prepare new hypothesis, in a short period of time, which was formerly rigid or unachievable, in view of large datasets and earlier methods. Therefore, the aim is to put forward a way to understand the students’ opinions, satisfactions and discontentment in the each element of the educational process, and to predict their preference in certain fields of study, the choice in continuing education, academic failure, and to offer accurate correlations between their knowledge and the requirements in the labor market. Some of the most interesting data mining processes in the educational field are illustrated in the present chapter, in which the author adds own ideas and applications in educational issues using specific data mining techniques. The organization of this chapter is as follows. Section 2 offers an insight of how data mining processes are being applied in the large spectrum of education, presenting recent applications and studies published in the scientific literature, significant to the development of this emerging science. In Section 3 the author introduces his work through a number of new proposed directions and applications conducted over data collected from the students of the Babes-Bolyai University, using specific data mining classification learning and clustering methods. Section 4 presents the integration of data mining processes and their particular role in higher education issues and management, for the conception of an Academic Intelligence Management. Interrelated future research and plans are discussed as a conclusion in Section 5

Psychometrics in Practice at RCEC

A broad range of topics is dealt with in this volume: from combining the psychometric generalizability and item response theories to the ideas for an integrated formative use of data-driven decision making, assessment for learning and diagnostic testing. A number of chapters pay attention to computerized (adaptive) and classification testing. Other chapters treat the quality of testing in a general sense, but for topics like maintaining standards or the testing of writing ability, the quality of testing is dealt with more specifically.\ud All authors are connected to RCEC as researchers. They present one of their current research topics and provide some insight into the focus of RCEC. The selection of the topics and the editing intends that the book should be of special interest to educational researchers, psychometricians and practitioners in educational assessment

Question-type Identification for Academic Questions in Online Learning Platform

Online learning platforms provide learning materials and answers to students' academic questions by experts, peers, or systems. This paper explores question-type identification as a step in content understanding for an online learning platform. The aim of the question-type identifier is to categorize question types based on their structure and complexity, using the question text, subject, and structural features. We have defined twelve question-type classes, including Multiple-Choice Question (MCQ), essay, and others. We have compiled an internal dataset of students' questions and used a combination of weak-supervision techniques and manual annotation. We then trained a BERT-based ensemble model on this dataset and evaluated this model on a separate human-labeled test set. Our experiments yielded an F1-score of 0.94 for MCQ binary classification and promising results for 12-class multilabel classification. We deployed the model in our online learning platform as a crucial enabler for content understanding to enhance the student learning experience.Comment: 18 pages, 6 figures, 4th International Conference on Semantic & Natural Language Processing (SNLP 2023

Ranking relations using analogies in biological and information networks

Analogical reasoning depends fundamentally on the ability to learn and generalize about relations between objects. We develop an approach to relational learning which, given a set of pairs of objects $\mathbf{S}=\{A^{(1)}:B^{(1)},A^{(2)}:B^{(2)},\ldots,A^{(N)}:B ^{(N)}\}$, measures how well other pairs A:B fit in with the set $\mathbf{S}$. Our work addresses the following question: is the relation between objects A and B analogous to those relations found in $\mathbf{S}$? Such questions are particularly relevant in information retrieval, where an investigator might want to search for analogous pairs of objects that match the query set of interest. There are many ways in which objects can be related, making the task of measuring analogies very challenging. Our approach combines a similarity measure on function spaces with Bayesian analysis to produce a ranking. It requires data containing features of the objects of interest and a link matrix specifying which relationships exist; no further attributes of such relationships are necessary. We illustrate the potential of our method on text analysis and information networks. An application on discovering functional interactions between pairs of proteins is discussed in detail, where we show that our approach can work in practice even if a small set of protein pairs is provided.Comment: Published in at http://dx.doi.org/10.1214/09-AOAS321 the Annals of Applied Statistics (http://www.imstat.org/aoas/) by the Institute of Mathematical Statistics (http://www.imstat.org