Optimizing Pre-Trained Models for Medical Dataset Classification with a Fine-Tuning Approach

Medical organizations struggle to deal with huge high-dimensional datasets that need powerful machine learning systems to produce precise healthcare outcomes. Traditional analytical techniques prove inadequate when dealing with extraction from features and performance of classifiers in this specifi...

Full description

Saved in:
Bibliographic Details
Main Authors: N. Kumar, T. Christopher
Format: Article
Language:English
Published: International Transactions on Electrical Engineering and Computer Science 2025-04-01
Series:International Transactions on Electrical Engineering and Computer Science
Subjects:
Online Access:https://iteecs.com/index.php/iteecs/article/view/126
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850049929123201024
author N. Kumar
T. Christopher
author_facet N. Kumar
T. Christopher
author_sort N. Kumar
collection DOAJ
description Medical organizations struggle to deal with huge high-dimensional datasets that need powerful machine learning systems to produce precise healthcare outcomes. Traditional analytical techniques prove inadequate when dealing with extraction from features and performance of classifiers in this specific setting. The research introduces an algorithm which enhances Stacked Autoencoders (SAEs) by combining them with a customized Logistic Regression model intended for medical high-dimensional data analysis. This approach implements a Hybrid Imputation Method using MICE and KNN Imputation which precedes other stages and helps process missing values and outliers in medical data. We use CNNs and SAEs together for deep feature extraction before using Feature Fusion to assemble a robust feature collection. A set of the most important features is identified by executing Advanced Ensemble Feature Selection (EFS) procedures which include Few-shot Learning and Model-Agnostic Meta-Learning Algorithm (MAML) and Genetic Algorithm-Based Feature Selection (GAFS). The procedure of fine-tuning pre-trained models represents an effective enhancement for classification tasks particularly in situations of limited dataset availability. The experimental outcomes demonstrate remarkable performance gains in terms of accuracy and sensitivity and specificity as well as reduced execution time as compared to current techniques. Upcoming work for this study involves speeding up algorithm processing abilities and scalability alongside the integration of robust deep learning structures with self-supervised learning methodologies together with upgrade transfer learning approaches for medical dataset variety applications. The study will concentrate on enhancing model transparency through explainable AI and real-time validation for clinical deployment and ethical and regulatory compliance to develop this technique for practical healthcare settings.
format Article
id doaj-art-a9541f9ac6d54ca4bfeed0c8c1f6bcd4
institution DOAJ
issn 2583-6471
language English
publishDate 2025-04-01
publisher International Transactions on Electrical Engineering and Computer Science
record_format Article
series International Transactions on Electrical Engineering and Computer Science
spelling doaj-art-a9541f9ac6d54ca4bfeed0c8c1f6bcd42025-08-20T02:53:37ZengInternational Transactions on Electrical Engineering and Computer ScienceInternational Transactions on Electrical Engineering and Computer Science2583-64712025-04-014110.62760/iteecs.4.1.2025.126Optimizing Pre-Trained Models for Medical Dataset Classification with a Fine-Tuning ApproachN. Kumar0https://orcid.org/0000-0001-5107-0488T. Christopher1Department of Computer Science, Government Arts College, Udumalpet, Tamil Nadu – 642126, India | Department of Computer Science, Dr. N. G. P Arts and Science College, Coimbatore – 641035, IndiaDepartment of Computer Science, Government Arts College, Coimbatore- 641018, Tamil Nadu, India Medical organizations struggle to deal with huge high-dimensional datasets that need powerful machine learning systems to produce precise healthcare outcomes. Traditional analytical techniques prove inadequate when dealing with extraction from features and performance of classifiers in this specific setting. The research introduces an algorithm which enhances Stacked Autoencoders (SAEs) by combining them with a customized Logistic Regression model intended for medical high-dimensional data analysis. This approach implements a Hybrid Imputation Method using MICE and KNN Imputation which precedes other stages and helps process missing values and outliers in medical data. We use CNNs and SAEs together for deep feature extraction before using Feature Fusion to assemble a robust feature collection. A set of the most important features is identified by executing Advanced Ensemble Feature Selection (EFS) procedures which include Few-shot Learning and Model-Agnostic Meta-Learning Algorithm (MAML) and Genetic Algorithm-Based Feature Selection (GAFS). The procedure of fine-tuning pre-trained models represents an effective enhancement for classification tasks particularly in situations of limited dataset availability. The experimental outcomes demonstrate remarkable performance gains in terms of accuracy and sensitivity and specificity as well as reduced execution time as compared to current techniques. Upcoming work for this study involves speeding up algorithm processing abilities and scalability alongside the integration of robust deep learning structures with self-supervised learning methodologies together with upgrade transfer learning approaches for medical dataset variety applications. The study will concentrate on enhancing model transparency through explainable AI and real-time validation for clinical deployment and ethical and regulatory compliance to develop this technique for practical healthcare settings. https://iteecs.com/index.php/iteecs/article/view/126Medical Dataset ClassificationReal-Time Clinical ImplementationConvolutional Neural NetworkStacked AutoencodersLogistic Regression classification model
spellingShingle N. Kumar
T. Christopher
Optimizing Pre-Trained Models for Medical Dataset Classification with a Fine-Tuning Approach
International Transactions on Electrical Engineering and Computer Science
Medical Dataset Classification
Real-Time Clinical Implementation
Convolutional Neural Network
Stacked Autoencoders
Logistic Regression classification model
title Optimizing Pre-Trained Models for Medical Dataset Classification with a Fine-Tuning Approach
title_full Optimizing Pre-Trained Models for Medical Dataset Classification with a Fine-Tuning Approach
title_fullStr Optimizing Pre-Trained Models for Medical Dataset Classification with a Fine-Tuning Approach
title_full_unstemmed Optimizing Pre-Trained Models for Medical Dataset Classification with a Fine-Tuning Approach
title_short Optimizing Pre-Trained Models for Medical Dataset Classification with a Fine-Tuning Approach
title_sort optimizing pre trained models for medical dataset classification with a fine tuning approach
topic Medical Dataset Classification
Real-Time Clinical Implementation
Convolutional Neural Network
Stacked Autoencoders
Logistic Regression classification model
url https://iteecs.com/index.php/iteecs/article/view/126
work_keys_str_mv AT nkumar optimizingpretrainedmodelsformedicaldatasetclassificationwithafinetuningapproach
AT tchristopher optimizingpretrainedmodelsformedicaldatasetclassificationwithafinetuningapproach