Intelligent Ensemble Learning Framework for Prediction of Students Academic Performance Using Extreme Gradient Boosting and Random Forest Algorithms (Published)
A key component of educational data mining (EDM) and learning analytics is the prediction of students’ academic achievement. Institutions can increase overall learning results, identify at-risk students, and carry out focused interventions by utilizing machine learning approaches. The Intelligent Ensemble Learning Framework presented in this paper combines Extreme Gradient Boosting (XGBoost) and Random Forest (RF) to increase prediction accuracy. XGBoost a powerful boosting strategy noted for its effectiveness in managing huge datasets and minimizing overfitting, combines multiple decision trees to reduce variation and improve model stability. The study uses information gathered from Federal Polytechnic Ukana, including attendance, demographics, and academic records of 400 students, among other pertinent characteristics. 16 important features were found based on eigenvalues and explained variance following data preprocessing, which included normalization and feature selection using Principal Component Analysis (PCA). The dataset was divided into subsets for testing (20%) and training (80%), and a bagging technique was used to create the ensemble model. Experimental results demonstrate that the ensemble model outperforms individual RF and XGBoost models in predicting students’ cumulative grade point average (CGPA). The performance evaluation, based on standard regression metrics such as Mean Squared Error (MSE), Mean Absolute Error (MAE), R-Squared Score (R2), Explained Variance Score (EVS), and Median Absolute Error (MedAE), indicates superior predictive accuracy. The ensemble model achieved an R2 score of 0.9900, outperforming RF (0.9888) and XGBoost (0.9800). Visualizations using scatter plots, grouped bar charts, and heat maps further validate the effectiveness of the proposed approach. This research contributes to the growing body of work in machine learning applications in education, demonstrating the potential of ensemble regression models in academic performance prediction. The findings underscore the importance of advanced predictive models in educational institutions, facilitating proactive decision-making and student support strategies to enhance academic success.
Keywords: : Academic Performance, Ensemble learning, Framework, Intelligence, Prediction, extreme gradient boosting and random forest
Dynamic Decision Tree Based Ensembled Learning Model to Forecast Flight Status (Published)
This paper explains the development of an enhanced predictive classifier for flight status that will reduce over fitting observed in existing models. A dynamic approach from ensemble learning technique called bagging algorithm was used to train a number of base learners using a base learning algorithm. The results of the various classifiers were combined, voting was done, by majority the most voted class was picked as the final output. This output was subjected to the decision tree algorithm to produce various replica sets generated from the training set to create various decision tree models. Object-Oriented Analysis and Design (OO-AD) methodology was adopted for the design and implementation was done with C# programming language. The result achieved was favorable as it was found to predict at an accuracy of 78.3% as against 68.2% accuracy of the existing systems which indicated an enhancement.
Keywords: : Flight Status, Bagging Algorithm, Classification, Ensemble learning, Prediction