A Novel Improved Binary Optimization Algorithm and Its Application in FS Problems
With the rapid advancement of artificial intelligence (AI) technology, the demand for vast amounts of data for training AI algorithms to attain intelligence has become indispensable. However, in the realm of big data technology, the high feature dimensions of the data frequently give rise to overfit...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-02-01
|
| Series: | Mathematics |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2227-7390/13/4/675 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850082116022304768 |
|---|---|
| author | Boyuan Wu Jia Luo |
| author_facet | Boyuan Wu Jia Luo |
| author_sort | Boyuan Wu |
| collection | DOAJ |
| description | With the rapid advancement of artificial intelligence (AI) technology, the demand for vast amounts of data for training AI algorithms to attain intelligence has become indispensable. However, in the realm of big data technology, the high feature dimensions of the data frequently give rise to overfitting issues during training, thereby diminishing model accuracy. To enhance model prediction accuracy, feature selection (FS) methods have arisen with the goal of eliminating redundant features within datasets. In this paper, a highly efficient FS method with advanced FS performance, called EMEPO, is proposed. It combines three learning strategies on the basis of the Parrot Optimizer (PO) to better ensure FS performance. Firstly, a novel exploitation strategy is introduced, which integrates randomness, optimality, and Levy flight to enhance the algorithm’s local exploitation capabilities, reduce execution time in solving FS problems, and enhance classification accuracy. Secondly, a multi-population evolutionary strategy is introduced, which takes into account the diversity of individuals based on fitness values to optimize the balance between exploration and exploitation stages of the algorithm, ultimately improving the algorithm’s capability to explore the FS solution space globally. Finally, a unique exploration strategy is introduced, focusing on individual diversity learning to boost population diversity in solving FS problems. This approach improves the algorithm’s capacity to avoid local suboptimal feature subsets. The EMEPO-based FS method is tested on 23 FS datasets spanning low-, medium-, and high-dimensional data. The results show exceptional performance in classification accuracy, feature reduction, execution efficiency, convergence speed, and stability. This indicates the high promise of the EMEPO-based FS method as an effective and efficient approach for feature selection. |
| format | Article |
| id | doaj-art-6d2fec6743264c0db087617ee3d97ecc |
| institution | DOAJ |
| issn | 2227-7390 |
| language | English |
| publishDate | 2025-02-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Mathematics |
| spelling | doaj-art-6d2fec6743264c0db087617ee3d97ecc2025-08-20T02:44:35ZengMDPI AGMathematics2227-73902025-02-0113467510.3390/math13040675A Novel Improved Binary Optimization Algorithm and Its Application in FS ProblemsBoyuan Wu0Jia Luo1School of Statistics and Data Science, Jiangxi University of Finance and Economics, Nanchang 330013, ChinaSchool of Electrical Engineering, Shandong University, Jinan 250061, ChinaWith the rapid advancement of artificial intelligence (AI) technology, the demand for vast amounts of data for training AI algorithms to attain intelligence has become indispensable. However, in the realm of big data technology, the high feature dimensions of the data frequently give rise to overfitting issues during training, thereby diminishing model accuracy. To enhance model prediction accuracy, feature selection (FS) methods have arisen with the goal of eliminating redundant features within datasets. In this paper, a highly efficient FS method with advanced FS performance, called EMEPO, is proposed. It combines three learning strategies on the basis of the Parrot Optimizer (PO) to better ensure FS performance. Firstly, a novel exploitation strategy is introduced, which integrates randomness, optimality, and Levy flight to enhance the algorithm’s local exploitation capabilities, reduce execution time in solving FS problems, and enhance classification accuracy. Secondly, a multi-population evolutionary strategy is introduced, which takes into account the diversity of individuals based on fitness values to optimize the balance between exploration and exploitation stages of the algorithm, ultimately improving the algorithm’s capability to explore the FS solution space globally. Finally, a unique exploration strategy is introduced, focusing on individual diversity learning to boost population diversity in solving FS problems. This approach improves the algorithm’s capacity to avoid local suboptimal feature subsets. The EMEPO-based FS method is tested on 23 FS datasets spanning low-, medium-, and high-dimensional data. The results show exceptional performance in classification accuracy, feature reduction, execution efficiency, convergence speed, and stability. This indicates the high promise of the EMEPO-based FS method as an effective and efficient approach for feature selection.https://www.mdpi.com/2227-7390/13/4/675Parrot Optimizerexploitation strategymulti-population evolutionary strategyexploration strategyfeature selection |
| spellingShingle | Boyuan Wu Jia Luo A Novel Improved Binary Optimization Algorithm and Its Application in FS Problems Mathematics Parrot Optimizer exploitation strategy multi-population evolutionary strategy exploration strategy feature selection |
| title | A Novel Improved Binary Optimization Algorithm and Its Application in FS Problems |
| title_full | A Novel Improved Binary Optimization Algorithm and Its Application in FS Problems |
| title_fullStr | A Novel Improved Binary Optimization Algorithm and Its Application in FS Problems |
| title_full_unstemmed | A Novel Improved Binary Optimization Algorithm and Its Application in FS Problems |
| title_short | A Novel Improved Binary Optimization Algorithm and Its Application in FS Problems |
| title_sort | novel improved binary optimization algorithm and its application in fs problems |
| topic | Parrot Optimizer exploitation strategy multi-population evolutionary strategy exploration strategy feature selection |
| url | https://www.mdpi.com/2227-7390/13/4/675 |
| work_keys_str_mv | AT boyuanwu anovelimprovedbinaryoptimizationalgorithmanditsapplicationinfsproblems AT jialuo anovelimprovedbinaryoptimizationalgorithmanditsapplicationinfsproblems AT boyuanwu novelimprovedbinaryoptimizationalgorithmanditsapplicationinfsproblems AT jialuo novelimprovedbinaryoptimizationalgorithmanditsapplicationinfsproblems |