Facial Feature Recognition with Multi-task Learning and Attention-based Enhancements

Facial feature recognition (FFR) has witnessed a remarkable surge in recent years, driven by its extensive applications in identity recognition, security, and intelligent imaging. The UTKFace dataset plays a pivotal role in advancing FFR by providing a rich dataset of facial images with accurate age...

Full description

Saved in:
Bibliographic Details
Main Authors: M. Rohani, H. Farsi, S. Mohamadzadeh
Format: Article
Language:English
Published: Babol Noshirvani University of Technology 2025-01-01
Series:Iranica Journal of Energy and Environment
Subjects:
Online Access:https://www.ijee.net/article_193778_e1259ed3fc391a5d0e79fc9e83537058.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850250948591484928
author M. Rohani
H. Farsi
S. Mohamadzadeh
author_facet M. Rohani
H. Farsi
S. Mohamadzadeh
author_sort M. Rohani
collection DOAJ
description Facial feature recognition (FFR) has witnessed a remarkable surge in recent years, driven by its extensive applications in identity recognition, security, and intelligent imaging. The UTKFace dataset plays a pivotal role in advancing FFR by providing a rich dataset of facial images with accurate age, gender, and race labels. This paper proposes a novel multi-task learning (MTL) model that leverages the powerful Efficient-Net architecture and incorporates attention-based learning with two key innovations. First, we introduce an age-specific loss function that minimizes the impact of errors in less critical cases while focusing the learning process on accurate age estimation within sensitive age ranges. This innovation is trained using the UTKFace dataset and is specifically optimized to improve accuracy in age estimation across different age groups. Second, we present an enhanced attention mechanism that guides the model to prioritize features that contribute to more robust FFR. This mechanism is trained on the diverse and challenging images of UTKFace and is capable of identifying subtle and discriminative features in faces for more accurate gender, race, and age recognition. Furthermore, our proposed method achieves a 30% reduction in model parameters compared to the baseline network while maintaining accuracy. Extensive comparisons with existing state-of-the-art methods demonstrate the efficiency and effectiveness of our proposed approach. Using the UTKFace dataset as the evaluation benchmark, our model achieves a 0.62% improvement in gender recognition accuracy, a 2.35% improvement in race recognition accuracy, and a noteworthy 3.23-year reduction in mean absolute error for age estimation.
format Article
id doaj-art-397e756e24fc4166b4c8a5335156a764
institution OA Journals
issn 2079-2115
2079-2123
language English
publishDate 2025-01-01
publisher Babol Noshirvani University of Technology
record_format Article
series Iranica Journal of Energy and Environment
spelling doaj-art-397e756e24fc4166b4c8a5335156a7642025-08-20T01:58:03ZengBabol Noshirvani University of TechnologyIranica Journal of Energy and Environment2079-21152079-21232025-01-0116113614410.5829/ijee.2025.16.01.14193778Facial Feature Recognition with Multi-task Learning and Attention-based EnhancementsM. Rohani0H. Farsi1S. Mohamadzadeh2Department of Electrical and Computer Engineering, University of Birjand, Birjand, IranDepartment of Electrical and Computer Engineering, University of Birjand, Birjand, IranDepartment of Electrical and Computer Engineering, University of Birjand, Birjand, IranFacial feature recognition (FFR) has witnessed a remarkable surge in recent years, driven by its extensive applications in identity recognition, security, and intelligent imaging. The UTKFace dataset plays a pivotal role in advancing FFR by providing a rich dataset of facial images with accurate age, gender, and race labels. This paper proposes a novel multi-task learning (MTL) model that leverages the powerful Efficient-Net architecture and incorporates attention-based learning with two key innovations. First, we introduce an age-specific loss function that minimizes the impact of errors in less critical cases while focusing the learning process on accurate age estimation within sensitive age ranges. This innovation is trained using the UTKFace dataset and is specifically optimized to improve accuracy in age estimation across different age groups. Second, we present an enhanced attention mechanism that guides the model to prioritize features that contribute to more robust FFR. This mechanism is trained on the diverse and challenging images of UTKFace and is capable of identifying subtle and discriminative features in faces for more accurate gender, race, and age recognition. Furthermore, our proposed method achieves a 30% reduction in model parameters compared to the baseline network while maintaining accuracy. Extensive comparisons with existing state-of-the-art methods demonstrate the efficiency and effectiveness of our proposed approach. Using the UTKFace dataset as the evaluation benchmark, our model achieves a 0.62% improvement in gender recognition accuracy, a 2.35% improvement in race recognition accuracy, and a noteworthy 3.23-year reduction in mean absolute error for age estimation.https://www.ijee.net/article_193778_e1259ed3fc391a5d0e79fc9e83537058.pdfage estimationattention based learningconvolutional neural networkgender recognitionmulti-task learningrace classification
spellingShingle M. Rohani
H. Farsi
S. Mohamadzadeh
Facial Feature Recognition with Multi-task Learning and Attention-based Enhancements
Iranica Journal of Energy and Environment
age estimation
attention based learning
convolutional neural network
gender recognition
multi-task learning
race classification
title Facial Feature Recognition with Multi-task Learning and Attention-based Enhancements
title_full Facial Feature Recognition with Multi-task Learning and Attention-based Enhancements
title_fullStr Facial Feature Recognition with Multi-task Learning and Attention-based Enhancements
title_full_unstemmed Facial Feature Recognition with Multi-task Learning and Attention-based Enhancements
title_short Facial Feature Recognition with Multi-task Learning and Attention-based Enhancements
title_sort facial feature recognition with multi task learning and attention based enhancements
topic age estimation
attention based learning
convolutional neural network
gender recognition
multi-task learning
race classification
url https://www.ijee.net/article_193778_e1259ed3fc391a5d0e79fc9e83537058.pdf
work_keys_str_mv AT mrohani facialfeaturerecognitionwithmultitasklearningandattentionbasedenhancements
AT hfarsi facialfeaturerecognitionwithmultitasklearningandattentionbasedenhancements
AT smohamadzadeh facialfeaturerecognitionwithmultitasklearningandattentionbasedenhancements