Scalable Context-Based Facial Emotion Recognition Using Facial Landmarks and Attention Mechanism

Deciphering emotions from a person’s perspective is critical for meaningful human relationships. Enabling computers to interpret emotional cues similarly could significantly improve human-machine interaction. Accurate emotion recognition involves more than just analyzing facial expression...

Full description

Saved in:
Bibliographic Details
Main Authors: Savina Jassica Colaco, Dong Seog Han
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10854474/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832575615821152256
author Savina Jassica Colaco
Dong Seog Han
author_facet Savina Jassica Colaco
Dong Seog Han
author_sort Savina Jassica Colaco
collection DOAJ
description Deciphering emotions from a person’s perspective is critical for meaningful human relationships. Enabling computers to interpret emotional cues similarly could significantly improve human-machine interaction. Accurate emotion recognition involves more than just analyzing facial expressions; it requires situational context and facial landmarks, which together reveal a broader range of emotional states. Existing emotion recognition frameworks primarily focus on facial imaging, often overlooking the contextual elements and the subtle significance of facial landmarks. This paper proposes a scalable approach to emotion recognition that combines situational context comprehension, accurate facial landmark detection, and facial feature analysis. Due to its scalability, our model can be applied across diverse computational platforms and operational circumstances while maintaining high performance. The model’s robustness and utility were validated against the EMOTIC benchmark, achieving an impressive overall accuracy of 84%. The findings underscore the importance of incorporating contextual information and facial landmarks to enhance emotion recognition accuracy. This advancement is expected to contribute substantially to fields such as augmented reality, medical imaging, and sophisticated human-computer interaction systems.
format Article
id doaj-art-ca10e9d7d89d4d7180846ff75b67333a
institution Kabale University
issn 2169-3536
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-ca10e9d7d89d4d7180846ff75b67333a2025-01-31T23:04:31ZengIEEEIEEE Access2169-35362025-01-0113207782079110.1109/ACCESS.2025.353432810854474Scalable Context-Based Facial Emotion Recognition Using Facial Landmarks and Attention MechanismSavina Jassica Colaco0https://orcid.org/0000-0002-5608-3891Dong Seog Han1https://orcid.org/0000-0002-7769-0236Center for ICT and Automotive Convergence, Kyungpook National University, Daegu, Republic of KoreaSchool of Electronic and Electrical Engineering, Kyungpook National University, Daegu, Republic of KoreaDeciphering emotions from a person’s perspective is critical for meaningful human relationships. Enabling computers to interpret emotional cues similarly could significantly improve human-machine interaction. Accurate emotion recognition involves more than just analyzing facial expressions; it requires situational context and facial landmarks, which together reveal a broader range of emotional states. Existing emotion recognition frameworks primarily focus on facial imaging, often overlooking the contextual elements and the subtle significance of facial landmarks. This paper proposes a scalable approach to emotion recognition that combines situational context comprehension, accurate facial landmark detection, and facial feature analysis. Due to its scalability, our model can be applied across diverse computational platforms and operational circumstances while maintaining high performance. The model’s robustness and utility were validated against the EMOTIC benchmark, achieving an impressive overall accuracy of 84%. The findings underscore the importance of incorporating contextual information and facial landmarks to enhance emotion recognition accuracy. This advancement is expected to contribute substantially to fields such as augmented reality, medical imaging, and sophisticated human-computer interaction systems.https://ieeexplore.ieee.org/document/10854474/Contextual cuesdeep learningemotion recognitionfacial landmarksscalable models
spellingShingle Savina Jassica Colaco
Dong Seog Han
Scalable Context-Based Facial Emotion Recognition Using Facial Landmarks and Attention Mechanism
IEEE Access
Contextual cues
deep learning
emotion recognition
facial landmarks
scalable models
title Scalable Context-Based Facial Emotion Recognition Using Facial Landmarks and Attention Mechanism
title_full Scalable Context-Based Facial Emotion Recognition Using Facial Landmarks and Attention Mechanism
title_fullStr Scalable Context-Based Facial Emotion Recognition Using Facial Landmarks and Attention Mechanism
title_full_unstemmed Scalable Context-Based Facial Emotion Recognition Using Facial Landmarks and Attention Mechanism
title_short Scalable Context-Based Facial Emotion Recognition Using Facial Landmarks and Attention Mechanism
title_sort scalable context based facial emotion recognition using facial landmarks and attention mechanism
topic Contextual cues
deep learning
emotion recognition
facial landmarks
scalable models
url https://ieeexplore.ieee.org/document/10854474/
work_keys_str_mv AT savinajassicacolaco scalablecontextbasedfacialemotionrecognitionusingfaciallandmarksandattentionmechanism
AT dongseoghan scalablecontextbasedfacialemotionrecognitionusingfaciallandmarksandattentionmechanism