Performance evaluation of reduced complexity deep neural networks.
Deep Neural Networks (DNN) have achieved state-of-the-art performance in medical image classification and are increasingly being used for disease diagnosis. However, these models are quite complex and that necessitates the need to reduce the model complexity for their use in low-power edge applicati...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2025-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://doi.org/10.1371/journal.pone.0319859 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850129580093865984 |
|---|---|
| author | Shahrukh Agha Sajid Nazir Mohammad Kaleem Faisal Najeeb Rehab Talat |
| author_facet | Shahrukh Agha Sajid Nazir Mohammad Kaleem Faisal Najeeb Rehab Talat |
| author_sort | Shahrukh Agha |
| collection | DOAJ |
| description | Deep Neural Networks (DNN) have achieved state-of-the-art performance in medical image classification and are increasingly being used for disease diagnosis. However, these models are quite complex and that necessitates the need to reduce the model complexity for their use in low-power edge applications that are becoming common. The model complexity reduction techniques in most cases comprise of time-consuming operations and are often associated with a loss of model performance in proportion to the model size reduction. In this paper, we propose a simplified model complexity reduction technique based on reducing the number of channels for any DNN and demonstrate the complexity reduction approaches for the ResNet-50 model integration in low-power devices. The model performance of the proposed models was evaluated for multiclass classification of CXR images, as normal, pneumonia, and COVID-19 classes. We demonstrate successive size reductions down to 75%, 87%, and 93% reduction with an acceptable classification performance reduction of 0.5%, 0.5%, and 0.8% respectively. We also provide the results for the model generalization, and visualization with Grad-CAM at an acceptable performance and interpretable level. In addition, a theoretical VLSI architecture for the best performing architecture has been presented. |
| format | Article |
| id | doaj-art-512b7ea6f33b434fa4516aa3be68704c |
| institution | OA Journals |
| issn | 1932-6203 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj-art-512b7ea6f33b434fa4516aa3be68704c2025-08-20T02:32:56ZengPublic Library of Science (PLoS)PLoS ONE1932-62032025-01-01203e031985910.1371/journal.pone.0319859Performance evaluation of reduced complexity deep neural networks.Shahrukh AghaSajid NazirMohammad KaleemFaisal NajeebRehab TalatDeep Neural Networks (DNN) have achieved state-of-the-art performance in medical image classification and are increasingly being used for disease diagnosis. However, these models are quite complex and that necessitates the need to reduce the model complexity for their use in low-power edge applications that are becoming common. The model complexity reduction techniques in most cases comprise of time-consuming operations and are often associated with a loss of model performance in proportion to the model size reduction. In this paper, we propose a simplified model complexity reduction technique based on reducing the number of channels for any DNN and demonstrate the complexity reduction approaches for the ResNet-50 model integration in low-power devices. The model performance of the proposed models was evaluated for multiclass classification of CXR images, as normal, pneumonia, and COVID-19 classes. We demonstrate successive size reductions down to 75%, 87%, and 93% reduction with an acceptable classification performance reduction of 0.5%, 0.5%, and 0.8% respectively. We also provide the results for the model generalization, and visualization with Grad-CAM at an acceptable performance and interpretable level. In addition, a theoretical VLSI architecture for the best performing architecture has been presented.https://doi.org/10.1371/journal.pone.0319859 |
| spellingShingle | Shahrukh Agha Sajid Nazir Mohammad Kaleem Faisal Najeeb Rehab Talat Performance evaluation of reduced complexity deep neural networks. PLoS ONE |
| title | Performance evaluation of reduced complexity deep neural networks. |
| title_full | Performance evaluation of reduced complexity deep neural networks. |
| title_fullStr | Performance evaluation of reduced complexity deep neural networks. |
| title_full_unstemmed | Performance evaluation of reduced complexity deep neural networks. |
| title_short | Performance evaluation of reduced complexity deep neural networks. |
| title_sort | performance evaluation of reduced complexity deep neural networks |
| url | https://doi.org/10.1371/journal.pone.0319859 |
| work_keys_str_mv | AT shahrukhagha performanceevaluationofreducedcomplexitydeepneuralnetworks AT sajidnazir performanceevaluationofreducedcomplexitydeepneuralnetworks AT mohammadkaleem performanceevaluationofreducedcomplexitydeepneuralnetworks AT faisalnajeeb performanceevaluationofreducedcomplexitydeepneuralnetworks AT rehabtalat performanceevaluationofreducedcomplexitydeepneuralnetworks |