Application of embeddings for multi-class classification with optional extendability
This study investigates the feasibility of an expandable image classification method utilizing a convolutional neural network to generate embeddings for use with simpler machine learning algorithms. The possibility of utilizing this approach to add new classes by additional training without modifyi...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Igor Sikorsky Kyiv Polytechnic Institute
2024-10-01
|
| Series: | Adaptivni Sistemi Avtomatičnogo Upravlinnâ |
| Subjects: | |
| Online Access: | https://asac.kpi.ua/article/view/313198 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849420302552924160 |
|---|---|
| author | Ф. Смілянець |
| author_facet | Ф. Смілянець |
| author_sort | Ф. Смілянець |
| collection | DOAJ |
| description |
This study investigates the feasibility of an expandable image classification method utilizing a convolutional neural network to generate embeddings for use with simpler machine learning algorithms. The possibility of utilizing this approach to add new classes by additional training without modifying the topology of the vectorization network was shown on two datasets: MNIST and Fashion-MNIST. To achieve this, a straight classificational CNN was trained on both datasets using three first classes. The respective trained networks were then modified to generate embeddings instead of classification results. The added embedding generation layers for both networks were then trained using Triplet Loss to extract the features from the output of the convolutional layers, while maintaining distinction between classes. Several simpler machine learning algorithms were then trained to classify on the produced embeddings. To test the expandability hypothesis, fourth class was added to training datasets of both networks, and the embedding generation networks were subjected to additional training, with corresponding other machine learning algorithms retrained from scratch. The accuracy of machine learning algorithms on 3-class and 4-class networks was measured with the respective test datasets converted to embeddings. The time expenses were analyzed for both simple classification networks and the proposed method. The findings indicate that this approach can reduce retraining time and complexity, particularly for more complex image classification tasks, and also offers additional capabilities such as similarity search in vector databases. However, for simpler tasks, conventional classification networks remain more time-efficient.
Ref. 8, fig. 4, tab. 2.
|
| format | Article |
| id | doaj-art-2fb1cc1b17404e17b5b92dedc42fa30c |
| institution | Kabale University |
| issn | 1560-8956 2522-9575 |
| language | English |
| publishDate | 2024-10-01 |
| publisher | Igor Sikorsky Kyiv Polytechnic Institute |
| record_format | Article |
| series | Adaptivni Sistemi Avtomatičnogo Upravlinnâ |
| spelling | doaj-art-2fb1cc1b17404e17b5b92dedc42fa30c2025-08-20T03:31:47ZengIgor Sikorsky Kyiv Polytechnic InstituteAdaptivni Sistemi Avtomatičnogo Upravlinnâ1560-89562522-95752024-10-0124510.20535/1560-8956.45.2024.313198351732Application of embeddings for multi-class classification with optional extendabilityФ. Смілянець0Igor Sikorsky Kyiv Polytechnic Institute This study investigates the feasibility of an expandable image classification method utilizing a convolutional neural network to generate embeddings for use with simpler machine learning algorithms. The possibility of utilizing this approach to add new classes by additional training without modifying the topology of the vectorization network was shown on two datasets: MNIST and Fashion-MNIST. To achieve this, a straight classificational CNN was trained on both datasets using three first classes. The respective trained networks were then modified to generate embeddings instead of classification results. The added embedding generation layers for both networks were then trained using Triplet Loss to extract the features from the output of the convolutional layers, while maintaining distinction between classes. Several simpler machine learning algorithms were then trained to classify on the produced embeddings. To test the expandability hypothesis, fourth class was added to training datasets of both networks, and the embedding generation networks were subjected to additional training, with corresponding other machine learning algorithms retrained from scratch. The accuracy of machine learning algorithms on 3-class and 4-class networks was measured with the respective test datasets converted to embeddings. The time expenses were analyzed for both simple classification networks and the proposed method. The findings indicate that this approach can reduce retraining time and complexity, particularly for more complex image classification tasks, and also offers additional capabilities such as similarity search in vector databases. However, for simpler tasks, conventional classification networks remain more time-efficient. Ref. 8, fig. 4, tab. 2. https://asac.kpi.ua/article/view/313198multiclass classificationconvolutional neural networksembeddingsembedding-based classificationimage classification |
| spellingShingle | Ф. Смілянець Application of embeddings for multi-class classification with optional extendability Adaptivni Sistemi Avtomatičnogo Upravlinnâ multiclass classification convolutional neural networks embeddings embedding-based classification image classification |
| title | Application of embeddings for multi-class classification with optional extendability |
| title_full | Application of embeddings for multi-class classification with optional extendability |
| title_fullStr | Application of embeddings for multi-class classification with optional extendability |
| title_full_unstemmed | Application of embeddings for multi-class classification with optional extendability |
| title_short | Application of embeddings for multi-class classification with optional extendability |
| title_sort | application of embeddings for multi class classification with optional extendability |
| topic | multiclass classification convolutional neural networks embeddings embedding-based classification image classification |
| url | https://asac.kpi.ua/article/view/313198 |
| work_keys_str_mv | AT fsmílânecʹ applicationofembeddingsformulticlassclassificationwithoptionalextendability |