Neural network-based ensemble approach for multi-view facial expression recognition.

In this paper, we developed a pose-aware facial expression recognition technique. The proposed technique employed K nearest neighbor for pose detection and a neural network-based extended stacking ensemble model for pose-aware facial expression recognition. For pose-aware facial expression classific...

Full description

Saved in:
Bibliographic Details
Main Authors: Muhammad Faheem Altaf, Muhammad Waseem Iqbal, Ghulam Ali, Khlood Shinan, Hanan E Alhazmi, Fatmah Alanazi, M Usman Ashraf
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2025-01-01
Series:PLoS ONE
Online Access:https://doi.org/10.1371/journal.pone.0316562
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850129560246419456
author Muhammad Faheem Altaf
Muhammad Waseem Iqbal
Ghulam Ali
Khlood Shinan
Hanan E Alhazmi
Fatmah Alanazi
M Usman Ashraf
author_facet Muhammad Faheem Altaf
Muhammad Waseem Iqbal
Ghulam Ali
Khlood Shinan
Hanan E Alhazmi
Fatmah Alanazi
M Usman Ashraf
author_sort Muhammad Faheem Altaf
collection DOAJ
description In this paper, we developed a pose-aware facial expression recognition technique. The proposed technique employed K nearest neighbor for pose detection and a neural network-based extended stacking ensemble model for pose-aware facial expression recognition. For pose-aware facial expression classification, we have extended the stacking ensemble technique from a two-level ensemble model to three-level ensemble model: base-level, meta-level and predictor. The base-level classifier is the binary neural network. The meta-level classifier is a pool of binary neural networks. The outputs of binary neural networks are combined using probability distribution to build the neural network ensemble. A pool of neural network ensembles is trained to learn the similarity between multi-pose facial expressions, where each neural network ensemble represents the presence or absence of a facial expression. The predictor is the Naive Bayes classifier, it takes the binary output of stacked neural network ensembles and classifies the unknown facial image as one of the facial expressions. The facial concentration region was detected using the Voila-Jones face detector. The Radboud faces database was used for stacked ensembles' training and testing purpose. The experimental results demonstrate that the proposed technique achieved 90% accuracy using Eigen features with 160 stacked neural network ensembles and Naive Bayes classifier. It demonstrates that the proposed techniques performed significantly as compare to state of the art pose-ware facial expression recognition techniques.
format Article
id doaj-art-2be788a74c944f98a8050aef2afa020e
institution OA Journals
issn 1932-6203
language English
publishDate 2025-01-01
publisher Public Library of Science (PLoS)
record_format Article
series PLoS ONE
spelling doaj-art-2be788a74c944f98a8050aef2afa020e2025-08-20T02:32:56ZengPublic Library of Science (PLoS)PLoS ONE1932-62032025-01-01203e031656210.1371/journal.pone.0316562Neural network-based ensemble approach for multi-view facial expression recognition.Muhammad Faheem AltafMuhammad Waseem IqbalGhulam AliKhlood ShinanHanan E AlhazmiFatmah AlanaziM Usman AshrafIn this paper, we developed a pose-aware facial expression recognition technique. The proposed technique employed K nearest neighbor for pose detection and a neural network-based extended stacking ensemble model for pose-aware facial expression recognition. For pose-aware facial expression classification, we have extended the stacking ensemble technique from a two-level ensemble model to three-level ensemble model: base-level, meta-level and predictor. The base-level classifier is the binary neural network. The meta-level classifier is a pool of binary neural networks. The outputs of binary neural networks are combined using probability distribution to build the neural network ensemble. A pool of neural network ensembles is trained to learn the similarity between multi-pose facial expressions, where each neural network ensemble represents the presence or absence of a facial expression. The predictor is the Naive Bayes classifier, it takes the binary output of stacked neural network ensembles and classifies the unknown facial image as one of the facial expressions. The facial concentration region was detected using the Voila-Jones face detector. The Radboud faces database was used for stacked ensembles' training and testing purpose. The experimental results demonstrate that the proposed technique achieved 90% accuracy using Eigen features with 160 stacked neural network ensembles and Naive Bayes classifier. It demonstrates that the proposed techniques performed significantly as compare to state of the art pose-ware facial expression recognition techniques.https://doi.org/10.1371/journal.pone.0316562
spellingShingle Muhammad Faheem Altaf
Muhammad Waseem Iqbal
Ghulam Ali
Khlood Shinan
Hanan E Alhazmi
Fatmah Alanazi
M Usman Ashraf
Neural network-based ensemble approach for multi-view facial expression recognition.
PLoS ONE
title Neural network-based ensemble approach for multi-view facial expression recognition.
title_full Neural network-based ensemble approach for multi-view facial expression recognition.
title_fullStr Neural network-based ensemble approach for multi-view facial expression recognition.
title_full_unstemmed Neural network-based ensemble approach for multi-view facial expression recognition.
title_short Neural network-based ensemble approach for multi-view facial expression recognition.
title_sort neural network based ensemble approach for multi view facial expression recognition
url https://doi.org/10.1371/journal.pone.0316562
work_keys_str_mv AT muhammadfaheemaltaf neuralnetworkbasedensembleapproachformultiviewfacialexpressionrecognition
AT muhammadwaseemiqbal neuralnetworkbasedensembleapproachformultiviewfacialexpressionrecognition
AT ghulamali neuralnetworkbasedensembleapproachformultiviewfacialexpressionrecognition
AT khloodshinan neuralnetworkbasedensembleapproachformultiviewfacialexpressionrecognition
AT hananealhazmi neuralnetworkbasedensembleapproachformultiviewfacialexpressionrecognition
AT fatmahalanazi neuralnetworkbasedensembleapproachformultiviewfacialexpressionrecognition
AT musmanashraf neuralnetworkbasedensembleapproachformultiviewfacialexpressionrecognition