Analysis of Gender Differences in Facial Expression Recognition Based on Deep Learning Using Explainable Artificial Intelligence

Potential uses of automated Facial Expression Recognition (FER) cover a wide range of applications such as customer behavior analysis, healthcare applications or providing personalized services. Data for machine learning play a fundamental role, therefore, understanding the relevancy of the data in...

Full description

Saved in:
Bibliographic Details
Main Authors: Cristina Manresa-Yee, Silvia Ramis, José M. Buades
Format: Article
Language:English
Published: Universidad Internacional de La Rioja (UNIR) 2025-01-01
Series:International Journal of Interactive Multimedia and Artificial Intelligence
Subjects:
Online Access:https://www.ijimai.org/journal/bibcite/reference/3300
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850151296704708608
author Cristina Manresa-Yee
Silvia Ramis
José M. Buades
author_facet Cristina Manresa-Yee
Silvia Ramis
José M. Buades
author_sort Cristina Manresa-Yee
collection DOAJ
description Potential uses of automated Facial Expression Recognition (FER) cover a wide range of applications such as customer behavior analysis, healthcare applications or providing personalized services. Data for machine learning play a fundamental role, therefore, understanding the relevancy of the data in the outcomes is of utmost importance. In this work we present a study on how gender influences the learning of a FER system. We analyze with Explainable Artificial intelligence (XAI) techniques how gender contributes to the learning and assess which facial expressions are more similar regarding face regions that impact on the classification. Results show that there exist common regions in some expressions both for females and males with different intensities (e.g. happiness); however, there are other expressions like disgust, where important face regions differ. The insights of this work will help improving FER systems and understand the source of any inequality.
format Article
id doaj-art-4b5d2a2cd2cb4d58974b87a676732588
institution OA Journals
issn 1989-1660
language English
publishDate 2025-01-01
publisher Universidad Internacional de La Rioja (UNIR)
record_format Article
series International Journal of Interactive Multimedia and Artificial Intelligence
spelling doaj-art-4b5d2a2cd2cb4d58974b87a6767325882025-08-20T02:26:19ZengUniversidad Internacional de La Rioja (UNIR)International Journal of Interactive Multimedia and Artificial Intelligence1989-16602025-01-0191182710.9781/ijimai.2023.04.003ijimai.2023.04.003Analysis of Gender Differences in Facial Expression Recognition Based on Deep Learning Using Explainable Artificial IntelligenceCristina Manresa-YeeSilvia RamisJosé M. BuadesPotential uses of automated Facial Expression Recognition (FER) cover a wide range of applications such as customer behavior analysis, healthcare applications or providing personalized services. Data for machine learning play a fundamental role, therefore, understanding the relevancy of the data in the outcomes is of utmost importance. In this work we present a study on how gender influences the learning of a FER system. We analyze with Explainable Artificial intelligence (XAI) techniques how gender contributes to the learning and assess which facial expressions are more similar regarding face regions that impact on the classification. Results show that there exist common regions in some expressions both for females and males with different intensities (e.g. happiness); however, there are other expressions like disgust, where important face regions differ. The insights of this work will help improving FER systems and understand the source of any inequality.https://www.ijimai.org/journal/bibcite/reference/3300explainable artificial intelligencefacial expressiongender differencesxai
spellingShingle Cristina Manresa-Yee
Silvia Ramis
José M. Buades
Analysis of Gender Differences in Facial Expression Recognition Based on Deep Learning Using Explainable Artificial Intelligence
International Journal of Interactive Multimedia and Artificial Intelligence
explainable artificial intelligence
facial expression
gender differences
xai
title Analysis of Gender Differences in Facial Expression Recognition Based on Deep Learning Using Explainable Artificial Intelligence
title_full Analysis of Gender Differences in Facial Expression Recognition Based on Deep Learning Using Explainable Artificial Intelligence
title_fullStr Analysis of Gender Differences in Facial Expression Recognition Based on Deep Learning Using Explainable Artificial Intelligence
title_full_unstemmed Analysis of Gender Differences in Facial Expression Recognition Based on Deep Learning Using Explainable Artificial Intelligence
title_short Analysis of Gender Differences in Facial Expression Recognition Based on Deep Learning Using Explainable Artificial Intelligence
title_sort analysis of gender differences in facial expression recognition based on deep learning using explainable artificial intelligence
topic explainable artificial intelligence
facial expression
gender differences
xai
url https://www.ijimai.org/journal/bibcite/reference/3300
work_keys_str_mv AT cristinamanresayee analysisofgenderdifferencesinfacialexpressionrecognitionbasedondeeplearningusingexplainableartificialintelligence
AT silviaramis analysisofgenderdifferencesinfacialexpressionrecognitionbasedondeeplearningusingexplainableartificialintelligence
AT josembuades analysisofgenderdifferencesinfacialexpressionrecognitionbasedondeeplearningusingexplainableartificialintelligence