Performance Analysis of Tree-Based Algorithms in Predicting Employee Attrition

Based on data throughout 2022, there have been many reductions in employees both globally and Indonesia. The reduction was made due to adjustments with developments to keep the business afloat in increasingly fierce competition. However, reducing the number of employees is not an easy decision to make. This decision can have an impact on many aspects of the development and course of a business or company. To make a decision especially related to the aspect of termination of employment, it is necessary to consider carefully and thoroughly. Assessment and decision-making cannot be based on just one aspect, other aspects need to be seen to be taken into consideration. Additional aspects that can be selected to strengthen decision-making can be taken from the data. Data will not have any value without processing it with various approaches, one of which is the prediction process. Starting from the data, the prediction results will be more appropriate to make a decision. This study made a comparison of 3 decision tree algorithms, and produced a comparison of the three methods in terms of accuracy. The results of this study are the best accuracy for each algorithm C.45 = 83.44; Random Forests = 85.85; LMT = 88.29 with a linear precision value, and the best algorithm model with the highest accuracy is the Logistic Model Tree (LMT) algorithm

A Hybrid Machine Learning Framework for Predicting Students’ Performance in Virtual Learning Environment

Virtual Learning Environments (VLE), such as Moodle and Blackboard, store vast data to help identify students\u27 performance and engagement. As a result, researchers have been focusing their efforts on assisting educational institutions in providing machine learning models to predict at-risk students and improve their performance. However, it requires an efficient approach to construct a model that can ultimately provide accurate predictions. Consequently, this study proposes a hybrid machine learning framework to predict students\u27 performance using eight classification algorithms and three ensemble methods (Bagging, Boosting, Voting) to determine the best-performing predictive model. In addition, this study used filter-based and wrapper-based feature selection techniques to select the best features of the dataset related to students\u27 performance. The obtained results reveal that the ensemble methods recorded higher predictive accuracy when compared to single classifiers. Furthermore, the accuracy of the models improved due to the feature selection techniques utilized in this study

Exploring Support Seeking Behaviours of First-Year Students to Predict Academic Performance

Academic performance during first year is critical in determining student retention rates, later undergraduate performance, and career related prospects. Previous literature has assessed importance of predictors individually. This study combined predictors to develop a model to predict academic performance of first-year students (n = 90) based on motivated learning strategies and on-campus resource use. An online survey was created to evaluate students’ help-seeking (HS), peer learning (PL), self-efficacy (SE), perceived social support (PSS) and access to social support (SSA) and academic support (ASA) resources. Consistent with previous research, SE was the strongest predictor of academic performance. Additionally, HS, SE, ASA, and SSA combined contributed to a significant model accounting for 37% of variance in students’ academic performance. The results observed low levels of resource access. These results contribute to the furthering of predictive modeling algorithms, improving access to resource use on-campus, and enhancing academic performance of first-year students during the adjustment to university life

Exploring the Impact of Students Demographic Attributes on Performance Prediction through Binary Classification in the KDP Model

During the course of this research, binary classification and the Knowledge Discovery Process (KDP) were used. The experimental and analytical capabilities of Rapid Miner's 9.10.010 instructional environment are supported by five different classifiers. Included in the analysis were 2334 entries, 17 characteristics, and one class variable containing the students' average score for the semester. There were twenty experiments carried out. During the studies, 10-fold cross-validation and ratio split validation, together with bootstrap sampling, were used. It was determined whether or not to use the Random Forest (RF), Rule Induction (RI), Naive Bayes (NB), Logistic Regression (LR), or Deep Learning (DL) methods. RF outperformed the other four methods in all six selection measures, with an accuracy of 93.96%. According to the RF classifier model, the level of education that a child's parents have is a major factor in that child's academic performance before entering higher education

The development of a predictive model for students’ final grades using machine learning techniques

As per research, utilizing predictive analytics in education can be very beneficial. It can help educators improve students' performance by analyzing historical data through various approaches such as data mining and machine learning. However, there is a scarcity of studies on using machine learning and predictive analytics to enhance student performance in Malaysian higher education. This study used the records of 450 students enrolled in the Business Statistics course at Universiti Islam Pahang Sultan Ahmad Shah (UnIPSAS) from 2013, obtained from UnIPSAS's Learning Management System. The aim was to develop the best predictive model for forecasting students' final grades based on their performance levels, using machine learning techniques such as Decision Tree, k-Nearest Neighbor, and Naïve Bayes. The final model was developed using Python software. The results showed a strong negative correlation between the students' carry marks and their final grades, with an r-value of -0.8. Naïve Bayes was found to be the best model, with an AUC score of 0.79