A Feature Selection Approach Based on Archimedes’ Optimization Algorithm for Optimal Data Classification

Feature selection is an active research area in data mining and machine learning, especially with the increase in the amount of numerical data. FS is a search strategy to find the best subset of features among a large number of subsets of features. Thus, FS is applied in most modern applications and...

Full description

Saved in:
Bibliographic Details
Main Authors: Lahbib Khrissi, Nabil El Akkad, Hassan Satori, Khalid Satori
Format: Article
Language:English
Published: Universidad Internacional de La Rioja (UNIR) 2025-01-01
Series:International Journal of Interactive Multimedia and Artificial Intelligence
Subjects:
Online Access:https://www.ijimai.org/journal/bibcite/reference/3246
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841560789075361792
author Lahbib Khrissi
Nabil El Akkad
Hassan Satori
Khalid Satori
author_facet Lahbib Khrissi
Nabil El Akkad
Hassan Satori
Khalid Satori
author_sort Lahbib Khrissi
collection DOAJ
description Feature selection is an active research area in data mining and machine learning, especially with the increase in the amount of numerical data. FS is a search strategy to find the best subset of features among a large number of subsets of features. Thus, FS is applied in most modern applications and in various domains, which requires the search for a powerful FS technique to process and classify high-dimensional data. In this paper, we propose a new technique for dimension reduction in feature selection. This approach is based on a recent metaheuristic called Archimedes’ Optimization Algorithm (AOA) to select an optimal subset of features to improve the classification accuracy. The idea of the AOA is based on the steps of Archimedes' principle in physics. It explains the behavior of the force exerted when an object is partially or fully immersed in a fluid. AOA optimization maintains a balance between exploration and exploitation, keeping a population of solutions and studying a large area to find the best overall solution. In this study, AOA is exploited as a search technique to find an optimal feature subset that reduces the number of features to maximize classification accuracy. The K-nearest neighbor (K-NN) classifier was used to evaluate the classification performance of selected feature subsets. To demonstrate the superiority of the proposed method, 16 benchmark datasets from the UCI repository are used and also compared by well-known and recently introduced meta-heuristics in this context, such as: sine-cosine algorithm (SCA), whale optimization algorithm (WOA), butterfly optimization algorithm (BAO), and butterfly flame optimization algorithm (MFO). The results prove the effectiveness of the proposed algorithm over the other algorithms based on several performance measures used in this paper.
format Article
id doaj-art-8efd1323435541cd967d30e249619180
institution Kabale University
issn 1989-1660
language English
publishDate 2025-01-01
publisher Universidad Internacional de La Rioja (UNIR)
record_format Article
series International Journal of Interactive Multimedia and Artificial Intelligence
spelling doaj-art-8efd1323435541cd967d30e2496191802025-01-03T15:20:35ZengUniversidad Internacional de La Rioja (UNIR)International Journal of Interactive Multimedia and Artificial Intelligence1989-16602025-01-0191283810.9781/ijimai.2023.01.005ijimai.2023.01.005A Feature Selection Approach Based on Archimedes’ Optimization Algorithm for Optimal Data ClassificationLahbib KhrissiNabil El AkkadHassan SatoriKhalid SatoriFeature selection is an active research area in data mining and machine learning, especially with the increase in the amount of numerical data. FS is a search strategy to find the best subset of features among a large number of subsets of features. Thus, FS is applied in most modern applications and in various domains, which requires the search for a powerful FS technique to process and classify high-dimensional data. In this paper, we propose a new technique for dimension reduction in feature selection. This approach is based on a recent metaheuristic called Archimedes’ Optimization Algorithm (AOA) to select an optimal subset of features to improve the classification accuracy. The idea of the AOA is based on the steps of Archimedes' principle in physics. It explains the behavior of the force exerted when an object is partially or fully immersed in a fluid. AOA optimization maintains a balance between exploration and exploitation, keeping a population of solutions and studying a large area to find the best overall solution. In this study, AOA is exploited as a search technique to find an optimal feature subset that reduces the number of features to maximize classification accuracy. The K-nearest neighbor (K-NN) classifier was used to evaluate the classification performance of selected feature subsets. To demonstrate the superiority of the proposed method, 16 benchmark datasets from the UCI repository are used and also compared by well-known and recently introduced meta-heuristics in this context, such as: sine-cosine algorithm (SCA), whale optimization algorithm (WOA), butterfly optimization algorithm (BAO), and butterfly flame optimization algorithm (MFO). The results prove the effectiveness of the proposed algorithm over the other algorithms based on several performance measures used in this paper.https://www.ijimai.org/journal/bibcite/reference/3246optimizationclassificationfeature selectionmachine learning classifier
spellingShingle Lahbib Khrissi
Nabil El Akkad
Hassan Satori
Khalid Satori
A Feature Selection Approach Based on Archimedes’ Optimization Algorithm for Optimal Data Classification
International Journal of Interactive Multimedia and Artificial Intelligence
optimization
classification
feature selection
machine learning classifier
title A Feature Selection Approach Based on Archimedes’ Optimization Algorithm for Optimal Data Classification
title_full A Feature Selection Approach Based on Archimedes’ Optimization Algorithm for Optimal Data Classification
title_fullStr A Feature Selection Approach Based on Archimedes’ Optimization Algorithm for Optimal Data Classification
title_full_unstemmed A Feature Selection Approach Based on Archimedes’ Optimization Algorithm for Optimal Data Classification
title_short A Feature Selection Approach Based on Archimedes’ Optimization Algorithm for Optimal Data Classification
title_sort feature selection approach based on archimedes optimization algorithm for optimal data classification
topic optimization
classification
feature selection
machine learning classifier
url https://www.ijimai.org/journal/bibcite/reference/3246
work_keys_str_mv AT lahbibkhrissi afeatureselectionapproachbasedonarchimedesoptimizationalgorithmforoptimaldataclassification
AT nabilelakkad afeatureselectionapproachbasedonarchimedesoptimizationalgorithmforoptimaldataclassification
AT hassansatori afeatureselectionapproachbasedonarchimedesoptimizationalgorithmforoptimaldataclassification
AT khalidsatori afeatureselectionapproachbasedonarchimedesoptimizationalgorithmforoptimaldataclassification
AT lahbibkhrissi featureselectionapproachbasedonarchimedesoptimizationalgorithmforoptimaldataclassification
AT nabilelakkad featureselectionapproachbasedonarchimedesoptimizationalgorithmforoptimaldataclassification
AT hassansatori featureselectionapproachbasedonarchimedesoptimizationalgorithmforoptimaldataclassification
AT khalidsatori featureselectionapproachbasedonarchimedesoptimizationalgorithmforoptimaldataclassification