Proceedings of TUSUR University / Archive / Issue of Journal № 4, t. 28, 2025 / Feature selection in Angelov-Yager binary classification fuzzy systems in the process of stream data processing

Feature selection in Angelov-Yager binary classification fuzzy systems in the process of stream data processing

DOI: 10.21293/1818-0442-2025-28-4-50-56

Download article in PDF format

JATS xml

Abstract: An important problem in machine learning is keeping trained models up to date using data streams, as existing solutions are not always capable of updating and processing data incrementally. One of the existing solutions with incremental learning support is first-order Angelov-Yager-type fuzzy binary classification systems. The disadvantage of this system is that in inference mode the system operates on a full set of features, even if not all features are relevant. This paper proposes a comprehensive method for calculating feature importance for the specified fuzzy system and presents an experimental study results of feature selection for processing data streams on datasets, thematically dedicated to spam detection, phishing sites, and network connection attacks. A statistically significant difference in accuracy and number of rules was found in favor of using the proposed method for calculating feature importance.

Keywords: Angelov-Yager fuzzy systems, feature selection, data streams, binary classification

Funding: This study was supported by grant No. 24-21-00168 from the Russian Science Foundation, https://rscf.ru/project/24-21-00168/.

For citation:
Svetlakov M. O., Borovskoy I. G. Feature selection in Angelov-Yager binary classification fuzzy systems in the process of stream data processing. Doklady Tomskogo gosudarstvennogo universiteta sistem upravleniya i radioelektroniki, 2025, vol. 28, no. 4, pp. 50–56. DOI: 10.21293/1818-0442-2025-28-4-50-56

Authors and copyright holders:

Svetlakov M. O. , Tomsk State University of Control Systems and Radioelectronics (Tomsk, Russia)
Borovskoy I. G. , Tomsk State University of Control Systems and Radioelectronics (Tomsk, Russia)

1. Xiaolan W., Ahmed M.M., Husex M.N., Qian Z. Evolving anomaly detection for network streaming data. Information Sciences, 2022, vol. 608, pp. 757–777.
2. Vázquez F.I., Hartl A., Zseby T., Zimek A. Anomaly detection in streaming data: A comparison and evaluation study. Expert Systems with Applications, 2023, vol. 233, pp. 120994.
3. Himaja D., Dondeti V., Uppalapati S., Virupaksha S. Cluster based active learning for classification of evolving streams. Evol. Intel., 2023, vol. 17, no. 4, pp. 2167–2191.
4. Orlov A.A., Abramova E.S. Development and research of a neural network alternate incremental learning algorithm. Computer Optics, 2023, vol. 47, no. 3, pp. 491–498.
5. Angelov P., Gu X. Autonomous learning multi-model classifier of 0-Order (ALMMo-0). 2017 Evolving and Adaptive Intelligent Systems (EAIS), 2017, pp. 1–7.
6. Angelov P., Gu X., Principe J.C. Autonomous Learning Multimodel Systems from Data Streams. IEEE Trans. Fuzzy Syst., 2018, vol. 26, no. 4, pp. 2213–2224.
7. Angelov P., Gu X., Kangin D. Empirical Data Analytics. Int. J. Intell. Syst., 2017. vol. 32, no. 12, pp. 1261–1284.
8. Hochma Y., Last M. Fast online feature selection in streaming data. Mach Learn., 2025, vol. 114, no. 1, pp. 1–35.
9. Angelov P. Autonomous Learning Systems. Hoboken, John Wiley and Sons, 2001. 224 p.
10. Moustafa N., Slay J. UNSW-NB15: a comprehensive data set for network intrusion detection systems (UNSW-NB15 network data set). 2015 Military Communications and Information Systems Conference (MilCIS), Canberra, Australia, 2015, pp. 1–6.
11. Vrbančič G., Fister I.Jr., Podgorelec V. Datasets for phishing websites detection. Data in Brief., 2020, vol. 33, pp. 106438.
12. Spambase. Available at: https://archive.ics.uci.edu/dataset/94/spambase (Accessed: 02.10.2025).
13. James G., Witten D., Hastie R., Tibshirani R. Statistical Learning. Springer Texts in Statistics, 2021, pp. 15–57.
14. Din S.U., Shao J., Kumar J., Mawuli C.B. Data stream classification with novel class detection: a review, comparison and challenges. Knowl. Inf. Syst., 2021, vol. 63, no. 9, pp. 2231–2276.
15. Losing V., Hammer B., Wersing H. Incremental online learning: A review and comparison of state of the art algorithms. Neurocomputing, 2018, vol. 275, pp. 1261–1274.