Feature representation via graph-regularized entropy-weighted nonnegative matrix factorization
Feature extraction plays a crucial role in dimensionality reduction in machine learning applications. Nonnegative Matrix Factorization (NMF) has emerged as a powerful technique for dimensionality reduction; however, its equal treatment of all features may limit accuracy. To address this challenge, t...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Amirkabir University of Technology
2024-10-01
|
| Series: | AUT Journal of Mathematics and Computing |
| Subjects: | |
| Online Access: | https://ajmc.aut.ac.ir/article_5535_3112c9212ca8838f81402e7dd4358c84.pdf |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850146819791650816 |
|---|---|
| author | Hazhir Sohrabi Shahrokh Esmaeili Parham Moradi |
| author_facet | Hazhir Sohrabi Shahrokh Esmaeili Parham Moradi |
| author_sort | Hazhir Sohrabi |
| collection | DOAJ |
| description | Feature extraction plays a crucial role in dimensionality reduction in machine learning applications. Nonnegative Matrix Factorization (NMF) has emerged as a powerful technique for dimensionality reduction; however, its equal treatment of all features may limit accuracy. To address this challenge, this paper introduces Graph-Regularized Entropy-Weighted Nonnegative Matrix Factorization (GEWNMF) for enhanced feature representation. The proposed method improves feature extraction through two key innovations: optimizable feature weights and graph regularization. GEWNMF uses optimizable weights to prioritize the extraction of crucial features that best describe the underlying data structure. These weights, determined using entropy measures, ensure a diverse selection of features, thereby enhancing the fidelity of the data representation. This adaptive weighting not only improves interpretability but also strengthens the model against noisy or outlier-prone datasets. Furthermore, GEWNMF integrates robust graph regularization techniques to preserve local data relationships. By constructing an adjacency graph that captures these relationships, the method enhances its ability to discern meaningful patterns amid noise and variability. This regularization not only stabilizes the method but also ensures that nearby data points appropriately influence feature extraction. Thus, GEWNMF produces representations that capture both global trends and local nuances, making it applicable across various domains. Extensive experiments on four widely used datasets validate the efficacy of GEWNMF compared to existing methods, demonstrating its superior performance in capturing meaningful data patterns and enhancing interpretability. |
| format | Article |
| id | doaj-art-01dd658dcda84d85a8786b971e07a09e |
| institution | OA Journals |
| issn | 2783-2449 2783-2287 |
| language | English |
| publishDate | 2024-10-01 |
| publisher | Amirkabir University of Technology |
| record_format | Article |
| series | AUT Journal of Mathematics and Computing |
| spelling | doaj-art-01dd658dcda84d85a8786b971e07a09e2025-08-20T02:27:45ZengAmirkabir University of TechnologyAUT Journal of Mathematics and Computing2783-24492783-22872024-10-015428930410.22060/ajmc.2024.23353.12525535Feature representation via graph-regularized entropy-weighted nonnegative matrix factorizationHazhir Sohrabi0Shahrokh Esmaeili1Parham Moradi2Department of Applied Mathematics, University of Kurdistan, Sanandaj, IranDepartment of Applied Mathematics, University of Kurdistan, Sanandaj, IranDepartment of Computer Engineering, University of Kurdistan, Sanandaj, IranFeature extraction plays a crucial role in dimensionality reduction in machine learning applications. Nonnegative Matrix Factorization (NMF) has emerged as a powerful technique for dimensionality reduction; however, its equal treatment of all features may limit accuracy. To address this challenge, this paper introduces Graph-Regularized Entropy-Weighted Nonnegative Matrix Factorization (GEWNMF) for enhanced feature representation. The proposed method improves feature extraction through two key innovations: optimizable feature weights and graph regularization. GEWNMF uses optimizable weights to prioritize the extraction of crucial features that best describe the underlying data structure. These weights, determined using entropy measures, ensure a diverse selection of features, thereby enhancing the fidelity of the data representation. This adaptive weighting not only improves interpretability but also strengthens the model against noisy or outlier-prone datasets. Furthermore, GEWNMF integrates robust graph regularization techniques to preserve local data relationships. By constructing an adjacency graph that captures these relationships, the method enhances its ability to discern meaningful patterns amid noise and variability. This regularization not only stabilizes the method but also ensures that nearby data points appropriately influence feature extraction. Thus, GEWNMF produces representations that capture both global trends and local nuances, making it applicable across various domains. Extensive experiments on four widely used datasets validate the efficacy of GEWNMF compared to existing methods, demonstrating its superior performance in capturing meaningful data patterns and enhancing interpretability.https://ajmc.aut.ac.ir/article_5535_3112c9212ca8838f81402e7dd4358c84.pdffeature extractionsubspace learning weighted nmf entropy regularizer |
| spellingShingle | Hazhir Sohrabi Shahrokh Esmaeili Parham Moradi Feature representation via graph-regularized entropy-weighted nonnegative matrix factorization AUT Journal of Mathematics and Computing feature extraction subspace learning weighted nmf entropy regularizer |
| title | Feature representation via graph-regularized entropy-weighted nonnegative matrix factorization |
| title_full | Feature representation via graph-regularized entropy-weighted nonnegative matrix factorization |
| title_fullStr | Feature representation via graph-regularized entropy-weighted nonnegative matrix factorization |
| title_full_unstemmed | Feature representation via graph-regularized entropy-weighted nonnegative matrix factorization |
| title_short | Feature representation via graph-regularized entropy-weighted nonnegative matrix factorization |
| title_sort | feature representation via graph regularized entropy weighted nonnegative matrix factorization |
| topic | feature extraction subspace learning weighted nmf entropy regularizer |
| url | https://ajmc.aut.ac.ir/article_5535_3112c9212ca8838f81402e7dd4358c84.pdf |
| work_keys_str_mv | AT hazhirsohrabi featurerepresentationviagraphregularizedentropyweightednonnegativematrixfactorization AT shahrokhesmaeili featurerepresentationviagraphregularizedentropyweightednonnegativematrixfactorization AT parhammoradi featurerepresentationviagraphregularizedentropyweightednonnegativematrixfactorization |