Enhancing brain tumor MRI classification with an ensemble of deep learning models and transformer integration

Brain tumors are widely recognized as the primary cause of cancer-related mortality globally, necessitating precise detection to enhance patient survival rates. The early identification of brain tumor is presented with significant challenges in the healthcare domain, necessitating the implementation...

Full description

Saved in:
Bibliographic Details
Main Authors: Nawal Benzorgat, Kewen Xia, Mustapha Noure Eddine Benzorgat
Format: Article
Language:English
Published: PeerJ Inc. 2024-11-01
Series:PeerJ Computer Science
Subjects:
Online Access:https://peerj.com/articles/cs-2425.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1846149538077736960
author Nawal Benzorgat
Kewen Xia
Mustapha Noure Eddine Benzorgat
author_facet Nawal Benzorgat
Kewen Xia
Mustapha Noure Eddine Benzorgat
author_sort Nawal Benzorgat
collection DOAJ
description Brain tumors are widely recognized as the primary cause of cancer-related mortality globally, necessitating precise detection to enhance patient survival rates. The early identification of brain tumor is presented with significant challenges in the healthcare domain, necessitating the implementation of precise and efficient diagnostic methodologies. The manual identification and analysis of extensive MRI data are presented as a challenging and laborious task, compounded by the importance of early tumor detection in reducing mortality rates. Prompt initiation of treatment hinges upon identifying the specific tumor type in patients, emphasizing the urgency for a dependable deep learning methodology for precise diagnosis. In this research, a hybrid model is presented which integrates the strengths of both transfer learning and the transformer encoder mechanism. After the performance evaluation of the efficacy of six pre-existing deep learning model, both individually and in combination, it was determined that an ensemble of three pretrained models achieved the highest accuracy. This ensemble, comprising DenseNet201, GoogleNet (InceptionV3), and InceptionResNetV2, is selected as the feature extraction framework for the transformer encoder network. The transformer encoder module integrates a Shifted Window-based Self-Attention mechanism, sequential Self-Attention, with a multilayer perceptron layer (MLP). These experiments were conducted on three publicly available research datasets for evaluation purposes. The Cheng dataset, BT-large-2c, and BT-large-4c dataset, each designed for various classification tasks with differences in sample number, planes, and contrast. The model gives consistent results on all three datasets and reaches an accuracy of 99.34%, 99.16%, and 98.62%, respectively, which are improved compared to other techniques.
format Article
id doaj-art-78d69dd145964868b7589eca2c3fc086
institution Kabale University
issn 2376-5992
language English
publishDate 2024-11-01
publisher PeerJ Inc.
record_format Article
series PeerJ Computer Science
spelling doaj-art-78d69dd145964868b7589eca2c3fc0862024-11-29T15:05:16ZengPeerJ Inc.PeerJ Computer Science2376-59922024-11-0110e242510.7717/peerj-cs.2425Enhancing brain tumor MRI classification with an ensemble of deep learning models and transformer integrationNawal Benzorgat0Kewen Xia1Mustapha Noure Eddine Benzorgat2School of Electronics and Information Engineering, Hebei University of Technology, Tianjin, ChinaSchool of Electronics and Information Engineering, Hebei University of Technology, Tianjin, ChinaSchool of Electronics and Information Engineering, Hebei University of Technology, Tianjin, ChinaBrain tumors are widely recognized as the primary cause of cancer-related mortality globally, necessitating precise detection to enhance patient survival rates. The early identification of brain tumor is presented with significant challenges in the healthcare domain, necessitating the implementation of precise and efficient diagnostic methodologies. The manual identification and analysis of extensive MRI data are presented as a challenging and laborious task, compounded by the importance of early tumor detection in reducing mortality rates. Prompt initiation of treatment hinges upon identifying the specific tumor type in patients, emphasizing the urgency for a dependable deep learning methodology for precise diagnosis. In this research, a hybrid model is presented which integrates the strengths of both transfer learning and the transformer encoder mechanism. After the performance evaluation of the efficacy of six pre-existing deep learning model, both individually and in combination, it was determined that an ensemble of three pretrained models achieved the highest accuracy. This ensemble, comprising DenseNet201, GoogleNet (InceptionV3), and InceptionResNetV2, is selected as the feature extraction framework for the transformer encoder network. The transformer encoder module integrates a Shifted Window-based Self-Attention mechanism, sequential Self-Attention, with a multilayer perceptron layer (MLP). These experiments were conducted on three publicly available research datasets for evaluation purposes. The Cheng dataset, BT-large-2c, and BT-large-4c dataset, each designed for various classification tasks with differences in sample number, planes, and contrast. The model gives consistent results on all three datasets and reaches an accuracy of 99.34%, 99.16%, and 98.62%, respectively, which are improved compared to other techniques.https://peerj.com/articles/cs-2425.pdfBrain tumor detectionDeep learningTransfer learningTransformer encoderShifted window-based self-attentionMultilayer perceptron (MLP)
spellingShingle Nawal Benzorgat
Kewen Xia
Mustapha Noure Eddine Benzorgat
Enhancing brain tumor MRI classification with an ensemble of deep learning models and transformer integration
PeerJ Computer Science
Brain tumor detection
Deep learning
Transfer learning
Transformer encoder
Shifted window-based self-attention
Multilayer perceptron (MLP)
title Enhancing brain tumor MRI classification with an ensemble of deep learning models and transformer integration
title_full Enhancing brain tumor MRI classification with an ensemble of deep learning models and transformer integration
title_fullStr Enhancing brain tumor MRI classification with an ensemble of deep learning models and transformer integration
title_full_unstemmed Enhancing brain tumor MRI classification with an ensemble of deep learning models and transformer integration
title_short Enhancing brain tumor MRI classification with an ensemble of deep learning models and transformer integration
title_sort enhancing brain tumor mri classification with an ensemble of deep learning models and transformer integration
topic Brain tumor detection
Deep learning
Transfer learning
Transformer encoder
Shifted window-based self-attention
Multilayer perceptron (MLP)
url https://peerj.com/articles/cs-2425.pdf
work_keys_str_mv AT nawalbenzorgat enhancingbraintumormriclassificationwithanensembleofdeeplearningmodelsandtransformerintegration
AT kewenxia enhancingbraintumormriclassificationwithanensembleofdeeplearningmodelsandtransformerintegration
AT mustaphanoureeddinebenzorgat enhancingbraintumormriclassificationwithanensembleofdeeplearningmodelsandtransformerintegration