Human Color Perception: The Impact of Color Perception on Fine-Grained Emotion Prediction in Movie and Television Videos

This article investigates the impact of visual color perception on fine-grained emotion prediction in videos, analyzing the contribution of color perception features in fine-grained emotion prediction. A total of 20 subjects were involved in this experiment. First, 10 subjects conducted a fine-grain...

Full description

Saved in:
Bibliographic Details
Main Authors: Shuang Wang, Jinyu Liu, Yiming Feng, Xiaomeng Ren, Huibo Hu, Mengfei Zhang, Zhibin Su
Format: Article
Language:English
Published: MDPI AG 2024-12-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/24/23/7770
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850106584806457344
author Shuang Wang
Jinyu Liu
Yiming Feng
Xiaomeng Ren
Huibo Hu
Mengfei Zhang
Zhibin Su
author_facet Shuang Wang
Jinyu Liu
Yiming Feng
Xiaomeng Ren
Huibo Hu
Mengfei Zhang
Zhibin Su
author_sort Shuang Wang
collection DOAJ
description This article investigates the impact of visual color perception on fine-grained emotion prediction in videos, analyzing the contribution of color perception features in fine-grained emotion prediction. A total of 20 subjects were involved in this experiment. First, 10 subjects conducted a fine-grained emotional subjective evaluation experiment on 50 video clips. Then, another 10 subjects conducted a subjective evaluation experiment of color perception annotation for these 50 video clips. On this basis, the correlation and mechanism between color perceptual features and fine-grained emotions were analyzed. Finally, a fine-grained emotion prediction model was established based on the combination of objective features and color perceptual features. It was also observed that, compared to using only objective features, incorporating perceptual features enhanced the model’s accuracy. This article also compared the importance of different perceptual features for each emotion and explained the mechanism between color perception and fine-grained emotions. By selecting the top 24 important features to predict emotions, the association between perceptual features and emotions was more effectively captured.
format Article
id doaj-art-7cb36dbd704a406189d31471dbcba28a
institution OA Journals
issn 1424-8220
language English
publishDate 2024-12-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj-art-7cb36dbd704a406189d31471dbcba28a2025-08-20T02:38:48ZengMDPI AGSensors1424-82202024-12-012423777010.3390/s24237770Human Color Perception: The Impact of Color Perception on Fine-Grained Emotion Prediction in Movie and Television VideosShuang Wang0Jinyu Liu1Yiming Feng2Xiaomeng Ren3Huibo Hu4Mengfei Zhang5Zhibin Su6State Key Laboratory of Media Convergence and Communication, Communication University of China, Beijing 100024, ChinaKey Laboratory of Acoustic Visual Technology and Intelligent Control System, Communication University of China, Ministry of Culture and Tourism, Beijing 100024, ChinaKey Laboratory of Acoustic Visual Technology and Intelligent Control System, Communication University of China, Ministry of Culture and Tourism, Beijing 100024, ChinaKey Laboratory of Acoustic Visual Technology and Intelligent Control System, Communication University of China, Ministry of Culture and Tourism, Beijing 100024, ChinaKey Laboratory of Acoustic Visual Technology and Intelligent Control System, Communication University of China, Ministry of Culture and Tourism, Beijing 100024, ChinaKey Laboratory of Acoustic Visual Technology and Intelligent Control System, Communication University of China, Ministry of Culture and Tourism, Beijing 100024, ChinaState Key Laboratory of Media Convergence and Communication, Communication University of China, Beijing 100024, ChinaThis article investigates the impact of visual color perception on fine-grained emotion prediction in videos, analyzing the contribution of color perception features in fine-grained emotion prediction. A total of 20 subjects were involved in this experiment. First, 10 subjects conducted a fine-grained emotional subjective evaluation experiment on 50 video clips. Then, another 10 subjects conducted a subjective evaluation experiment of color perception annotation for these 50 video clips. On this basis, the correlation and mechanism between color perceptual features and fine-grained emotions were analyzed. Finally, a fine-grained emotion prediction model was established based on the combination of objective features and color perceptual features. It was also observed that, compared to using only objective features, incorporating perceptual features enhanced the model’s accuracy. This article also compared the importance of different perceptual features for each emotion and explained the mechanism between color perception and fine-grained emotions. By selecting the top 24 important features to predict emotions, the association between perceptual features and emotions was more effectively captured.https://www.mdpi.com/1424-8220/24/23/7770subjective evaluation experimentrandom forest
spellingShingle Shuang Wang
Jinyu Liu
Yiming Feng
Xiaomeng Ren
Huibo Hu
Mengfei Zhang
Zhibin Su
Human Color Perception: The Impact of Color Perception on Fine-Grained Emotion Prediction in Movie and Television Videos
Sensors
subjective evaluation experiment
random forest
title Human Color Perception: The Impact of Color Perception on Fine-Grained Emotion Prediction in Movie and Television Videos
title_full Human Color Perception: The Impact of Color Perception on Fine-Grained Emotion Prediction in Movie and Television Videos
title_fullStr Human Color Perception: The Impact of Color Perception on Fine-Grained Emotion Prediction in Movie and Television Videos
title_full_unstemmed Human Color Perception: The Impact of Color Perception on Fine-Grained Emotion Prediction in Movie and Television Videos
title_short Human Color Perception: The Impact of Color Perception on Fine-Grained Emotion Prediction in Movie and Television Videos
title_sort human color perception the impact of color perception on fine grained emotion prediction in movie and television videos
topic subjective evaluation experiment
random forest
url https://www.mdpi.com/1424-8220/24/23/7770
work_keys_str_mv AT shuangwang humancolorperceptiontheimpactofcolorperceptiononfinegrainedemotionpredictioninmovieandtelevisionvideos
AT jinyuliu humancolorperceptiontheimpactofcolorperceptiononfinegrainedemotionpredictioninmovieandtelevisionvideos
AT yimingfeng humancolorperceptiontheimpactofcolorperceptiononfinegrainedemotionpredictioninmovieandtelevisionvideos
AT xiaomengren humancolorperceptiontheimpactofcolorperceptiononfinegrainedemotionpredictioninmovieandtelevisionvideos
AT huibohu humancolorperceptiontheimpactofcolorperceptiononfinegrainedemotionpredictioninmovieandtelevisionvideos
AT mengfeizhang humancolorperceptiontheimpactofcolorperceptiononfinegrainedemotionpredictioninmovieandtelevisionvideos
AT zhibinsu humancolorperceptiontheimpactofcolorperceptiononfinegrainedemotionpredictioninmovieandtelevisionvideos