A Video-Based Cognitive Emotion Recognition Method Using an Active Learning Algorithm Based on Complexity and Uncertainty
The cognitive emotions of individuals during tasks largely determine the success or failure of tasks in various fields such as the military, medical, industrial fields, etc. Facial video data can carry more emotional information than static images because emotional expression is a temporal process....
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-01-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/15/1/462 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841549361653219328 |
|---|---|
| author | Hongduo Wu Dong Zhou Ziyue Guo Zicheng Song Yu Li Xingzheng Wei Qidi Zhou |
| author_facet | Hongduo Wu Dong Zhou Ziyue Guo Zicheng Song Yu Li Xingzheng Wei Qidi Zhou |
| author_sort | Hongduo Wu |
| collection | DOAJ |
| description | The cognitive emotions of individuals during tasks largely determine the success or failure of tasks in various fields such as the military, medical, industrial fields, etc. Facial video data can carry more emotional information than static images because emotional expression is a temporal process. Video-based Facial Expression Recognition (FER) has received increasing attention from the relevant scholars in recent years. However, due to the high cost of marking and training video samples, feature extraction is inefficient and ineffective, which leads to a low accuracy and poor real-time performance. In this paper, a cognitive emotion recognition method based on video data is proposed, in which 49 emotion description points were initially defined, and the spatial–temporal features of cognitive emotions were extracted from the video data through a feature extraction method that combines geodesic distances and sample entropy. Then, an active learning algorithm based on complexity and uncertainty was proposed to automatically select the most valuable samples, thereby reducing the cost of sample labeling and model training. Finally, the effectiveness, superiority, and real-time performance of the proposed method were verified utilizing the MMI Facial Expression Database and some real-time-collected data. Through comparisons and testing, the proposed method showed satisfactory real-time performance and a higher accuracy, which can effectively support the development of a real-time monitoring system for cognitive emotions. |
| format | Article |
| id | doaj-art-8cbaee28d4e747fb8ddd3ef351aac8f7 |
| institution | Kabale University |
| issn | 2076-3417 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj-art-8cbaee28d4e747fb8ddd3ef351aac8f72025-01-10T13:15:38ZengMDPI AGApplied Sciences2076-34172025-01-0115146210.3390/app15010462A Video-Based Cognitive Emotion Recognition Method Using an Active Learning Algorithm Based on Complexity and UncertaintyHongduo Wu0Dong Zhou1Ziyue Guo2Zicheng Song3Yu Li4Xingzheng Wei5Qidi Zhou6State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing 100191, ChinaState Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing 100191, ChinaState Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing 100191, ChinaState Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing 100191, ChinaState Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing 100191, ChinaState Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing 100191, ChinaState Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing 100191, ChinaThe cognitive emotions of individuals during tasks largely determine the success or failure of tasks in various fields such as the military, medical, industrial fields, etc. Facial video data can carry more emotional information than static images because emotional expression is a temporal process. Video-based Facial Expression Recognition (FER) has received increasing attention from the relevant scholars in recent years. However, due to the high cost of marking and training video samples, feature extraction is inefficient and ineffective, which leads to a low accuracy and poor real-time performance. In this paper, a cognitive emotion recognition method based on video data is proposed, in which 49 emotion description points were initially defined, and the spatial–temporal features of cognitive emotions were extracted from the video data through a feature extraction method that combines geodesic distances and sample entropy. Then, an active learning algorithm based on complexity and uncertainty was proposed to automatically select the most valuable samples, thereby reducing the cost of sample labeling and model training. Finally, the effectiveness, superiority, and real-time performance of the proposed method were verified utilizing the MMI Facial Expression Database and some real-time-collected data. Through comparisons and testing, the proposed method showed satisfactory real-time performance and a higher accuracy, which can effectively support the development of a real-time monitoring system for cognitive emotions.https://www.mdpi.com/2076-3417/15/1/462cognitive emotion recognitionfacial expression recognitionspatial–temporal feature extractionactive learningcomplexity and uncertainty |
| spellingShingle | Hongduo Wu Dong Zhou Ziyue Guo Zicheng Song Yu Li Xingzheng Wei Qidi Zhou A Video-Based Cognitive Emotion Recognition Method Using an Active Learning Algorithm Based on Complexity and Uncertainty Applied Sciences cognitive emotion recognition facial expression recognition spatial–temporal feature extraction active learning complexity and uncertainty |
| title | A Video-Based Cognitive Emotion Recognition Method Using an Active Learning Algorithm Based on Complexity and Uncertainty |
| title_full | A Video-Based Cognitive Emotion Recognition Method Using an Active Learning Algorithm Based on Complexity and Uncertainty |
| title_fullStr | A Video-Based Cognitive Emotion Recognition Method Using an Active Learning Algorithm Based on Complexity and Uncertainty |
| title_full_unstemmed | A Video-Based Cognitive Emotion Recognition Method Using an Active Learning Algorithm Based on Complexity and Uncertainty |
| title_short | A Video-Based Cognitive Emotion Recognition Method Using an Active Learning Algorithm Based on Complexity and Uncertainty |
| title_sort | video based cognitive emotion recognition method using an active learning algorithm based on complexity and uncertainty |
| topic | cognitive emotion recognition facial expression recognition spatial–temporal feature extraction active learning complexity and uncertainty |
| url | https://www.mdpi.com/2076-3417/15/1/462 |
| work_keys_str_mv | AT hongduowu avideobasedcognitiveemotionrecognitionmethodusinganactivelearningalgorithmbasedoncomplexityanduncertainty AT dongzhou avideobasedcognitiveemotionrecognitionmethodusinganactivelearningalgorithmbasedoncomplexityanduncertainty AT ziyueguo avideobasedcognitiveemotionrecognitionmethodusinganactivelearningalgorithmbasedoncomplexityanduncertainty AT zichengsong avideobasedcognitiveemotionrecognitionmethodusinganactivelearningalgorithmbasedoncomplexityanduncertainty AT yuli avideobasedcognitiveemotionrecognitionmethodusinganactivelearningalgorithmbasedoncomplexityanduncertainty AT xingzhengwei avideobasedcognitiveemotionrecognitionmethodusinganactivelearningalgorithmbasedoncomplexityanduncertainty AT qidizhou avideobasedcognitiveemotionrecognitionmethodusinganactivelearningalgorithmbasedoncomplexityanduncertainty AT hongduowu videobasedcognitiveemotionrecognitionmethodusinganactivelearningalgorithmbasedoncomplexityanduncertainty AT dongzhou videobasedcognitiveemotionrecognitionmethodusinganactivelearningalgorithmbasedoncomplexityanduncertainty AT ziyueguo videobasedcognitiveemotionrecognitionmethodusinganactivelearningalgorithmbasedoncomplexityanduncertainty AT zichengsong videobasedcognitiveemotionrecognitionmethodusinganactivelearningalgorithmbasedoncomplexityanduncertainty AT yuli videobasedcognitiveemotionrecognitionmethodusinganactivelearningalgorithmbasedoncomplexityanduncertainty AT xingzhengwei videobasedcognitiveemotionrecognitionmethodusinganactivelearningalgorithmbasedoncomplexityanduncertainty AT qidizhou videobasedcognitiveemotionrecognitionmethodusinganactivelearningalgorithmbasedoncomplexityanduncertainty |