Optimization of classifier ensemble diversity
Ensemble diversity was investigated for 12 classifiers and 16 datasets using a generalization error and ambiguity decomposition of the model bias-variance relationship. Diversity was optimized using a genetic algorithm and particle swarm optimization. Classifiers with the greatest contrib...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Academia.edu Journals
2024-07-01
|
| Series: | Academia Molecular Biology and Genomics |
| Online Access: | https://www.academia.edu/122458962/Optimization_of_Classifier_Ensemble_Diversity |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850105009732059136 |
|---|---|
| author | Leif E. Peterson |
| author_facet | Leif E. Peterson |
| author_sort | Leif E. Peterson |
| collection | DOAJ |
| description |
Ensemble diversity was investigated for 12 classifiers and 16 datasets using a generalization error and ambiguity decomposition of the model bias-variance relationship. Diversity was optimized using a genetic algorithm and particle swarm optimization. Classifiers with the greatest contribution to ensemble diversity were learning vector quantization, naïve Bayes classifier, and supervised neural gas, whereas the supervised artificial neural network (SANN) and support vector machines (SVM) classifiers were among the least informative for diversity. An important observation was that classifiers with the greatest optimized employment weights in diverse ensembles also had the greatest association between individual unoptimized diversity, D, and number of classes among datasets, with little association with dataset number of objects or features. The SANN and SVM classifiers had a significant association with the number of objects in datasets and were employed infrequently in diverse ensembles. In conclusion, the diversity of a classifier is more dependent on the number of classes of datasets and less dependent on the number of objects or features. A greater ensemble employment weight for a classifier also occurs when its range of generalization error and ambiguity over all datasets overlap. |
| format | Article |
| id | doaj-art-cde0db9c0ca9420fa406254cedea6b5b |
| institution | DOAJ |
| issn | 3064-9765 |
| language | English |
| publishDate | 2024-07-01 |
| publisher | Academia.edu Journals |
| record_format | Article |
| series | Academia Molecular Biology and Genomics |
| spelling | doaj-art-cde0db9c0ca9420fa406254cedea6b5b2025-08-20T02:39:12ZengAcademia.edu JournalsAcademia Molecular Biology and Genomics3064-97652024-07-011110.20935/AcadMolBioGen7288Optimization of classifier ensemble diversityLeif E. Peterson0Department of Statistics, Rice University, Houston, TX 77030, USA. Ensemble diversity was investigated for 12 classifiers and 16 datasets using a generalization error and ambiguity decomposition of the model bias-variance relationship. Diversity was optimized using a genetic algorithm and particle swarm optimization. Classifiers with the greatest contribution to ensemble diversity were learning vector quantization, naïve Bayes classifier, and supervised neural gas, whereas the supervised artificial neural network (SANN) and support vector machines (SVM) classifiers were among the least informative for diversity. An important observation was that classifiers with the greatest optimized employment weights in diverse ensembles also had the greatest association between individual unoptimized diversity, D, and number of classes among datasets, with little association with dataset number of objects or features. The SANN and SVM classifiers had a significant association with the number of objects in datasets and were employed infrequently in diverse ensembles. In conclusion, the diversity of a classifier is more dependent on the number of classes of datasets and less dependent on the number of objects or features. A greater ensemble employment weight for a classifier also occurs when its range of generalization error and ambiguity over all datasets overlap.https://www.academia.edu/122458962/Optimization_of_Classifier_Ensemble_Diversity |
| spellingShingle | Leif E. Peterson Optimization of classifier ensemble diversity Academia Molecular Biology and Genomics |
| title | Optimization of classifier ensemble diversity |
| title_full | Optimization of classifier ensemble diversity |
| title_fullStr | Optimization of classifier ensemble diversity |
| title_full_unstemmed | Optimization of classifier ensemble diversity |
| title_short | Optimization of classifier ensemble diversity |
| title_sort | optimization of classifier ensemble diversity |
| url | https://www.academia.edu/122458962/Optimization_of_Classifier_Ensemble_Diversity |
| work_keys_str_mv | AT leifepeterson optimizationofclassifierensemblediversity |