Keywords
Feature Selection
Xgboost
Class Imbalance
Breast Cancer
Heart Disease
Machine Learning
Medical Diagnosis.
Article Number
040Abstract
Medical datasets frequently face issues with class imbalance and redundant features, which can undermine the accuracy and reliability of predictive diagnostic models. This research conducts a performance comparison of four variants of the Synthetic Minority Oversampling Technique (SMOTE)—SMOTE-ENN, Borderline SMOTE, ADASYN, and SMOTE-Tomek Links—when paired with feature selection and the Extreme Gradient Boosting (XGBoost) classifier for predicting breast cancer and heart disease. The publicly available datasets underwent preprocessing to eliminate noise, balance class distributions, and identify the most significant diagnostic features. Model performance was assessed using standard metrics, including accuracy, precision, recall, F1-score, and Cohen’s kappa. For the heart disease dataset, the SMOTE-ENN technique produced the highest results, achieving an accuracy of 56.15%, a recall of 44.50%, and an F1-score of 27.46%, which underscored improved detection of minority class cases. Conversely, in the breast cancer dataset, ADASYN, Borderline SMOTE, and SMOTE-Tomek Links showed better performance, reaching an accuracy of 96.49%, an F1-score of 97.30%, a recall of 100%, and a kappa score of 0.9231.References
Allugunti, V. R. (2022). Breast cancer detection based on thermographic images using machine learning and deep learning algorithms. International Journal of Engineering in Computer Science, 4(1), 49–56.
Amethiya, Y., Pipariya, P., Patel, S., & Shah, M. (2022). Comparative analysis of breast cancer detection using machine learning and biosensors. Intelligent Medicine, 2, 69–81. https://doi.org/10.1016/j.imed.2021.08.004
Chen, H., Wang, N., Du, X., Mei, K., Zhou, Y., & Cai, G. (2023). Classification Prediction of Breast Cancer Based on Machine Learning. Computational Intelligence and Neuroscience, 2023(650719). https://doi.org/10.1155/2023/6530719
Elreedy, D., Atiya, A. F., & Kamalov, F. (2023). A theoretical distribution analysis of synthetic minority oversampling technique (SMOTE) for imbalanced learning. Machine Learning. https://doi.org/https://doi.org/10.1007/s10994-022-06296-4
Hu, H., Qiao, S., Hao, Y., Bai, Y., Cheng, R., Zhang, W., & Zhang, G. (2022). Breast cancer histopathological images recognition based on two-stage nuclei segmentation strategy. PLoS ONE, 17(4), e0266973. https://doi.org/10.1371/journal.pone.0266973
Ishaq, A., Sadiq, S., Umer, M., Ullah, S., Mirjalili, S., Rupapara, V., & Nappi, M. (2021). Improving the Prediction of Heart Failure Patients’ Survival Using SMOTE and Effective Data Mining Techniques. IEEE Access, 9, 39707–39716. https://doi.org/10.1109/ACCESS.2021.3064084
Joloudari, J. H., Marefat, A., Nematollahi, M. A., Oyelere, S. S., & Hussain, S. (2023). Effective Class-Imbalance Learning Based on SMOTE and Convolutional Neural Networks. Applied Sciences, 13, 4006. https://doi.org/https:// doi.org/10.3390/app13064006
Li, J., Zhu, Q., Wu, Q., & Fan, Z. (2021). A novel oversampling technique for class-imbalanced learning based on SMOTE and natural neighbors. Information Sciences, 565, 438–455. https://doi.org/10.1016/j.ins.2021.03.041
Liang, X. W., Jiang, A. P., Li, T., Xue, Y. Y., & Wang, G. T. (2020). Knowledge-Based Systems LR-SMOTE — An improved unbalanced data set oversampling based on K-means and SVM. Knowledge-Based Systems, 196, 105845. https://doi.org/https://doi.org/10.1016/j.knosys.2020.105845
Nasir, M. U., Ghazal, T. M., Khan, M. A., Zubair, M., Rahman, A., Ahmed, R., Hamadi, H. Al, & Yeun, C. Y. (2022). Breast Cancer Prediction Empowered with Fine-Tuning. Computational Intelligence and Neuroscience, 2022(5918686), 1–9.
Oliveira, A. R., Ramos, T. B., & Neves, R. (2023). Streamflow Estimation in a Mediterranean Watershed Using Neural Network Models: A Detailed Description of the Implementation and Optimization. Water, 15, 947.
Ran, S., Yang, X., Liu, M., Zhang, Y., Cheng, C., Zhu, H., & Yuan, Y. (2022). Homecare-oriented ECG diagnosis with large-scale deep neural network for continuous monitoring on embedded devices. IEEE Transactions on Instrumentation and Measurement, 71, 1–13.
Wang, X., Ren, J., Ren, H., Song, W., Qiao, Y., Zhao, Y., Linghu, L., Cui, Y., Zhao, Z., Chen, L., & Qiu, L. (2023). Diabetes mellitus early warning and factor analysis using ensemble Bayesian networks with SMOTE‑ENN and Boruta. Scientific Reports, 13(12718), 1–15. https://doi.org/10.1038/s41598-023-40036-5
Zhou, J., Wu, Y., Chen, J., Cui, M., Gao, Y., Meng, K., Wu, M., Guo, X., & Wen, W. (2023). Maize Stem Contour Extraction and Diameter Measurement Based on Adaptive Threshold Segmentation in Field Conditions. Agriculture, 13, 678.
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Copyright (c) 2026 Yusuf, A. K, Hassan, Adam, Yusuf A (Author)