Personality Trait Prediction From Facial Sketch Leveraged by Expression Muscles
This work explores whether facial sketches can be used to predict personality traits, representing, to our knowledge, the first systematic investigation of this approach in the literature. Unlike traditional RGB facial images that capture detailed features, sketch-based images emphasize the structur...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10909541/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850069580292030464 |
|---|---|
| author | Lifen Weng Jiangbin Guo Qibing Zhu |
| author_facet | Lifen Weng Jiangbin Guo Qibing Zhu |
| author_sort | Lifen Weng |
| collection | DOAJ |
| description | This work explores whether facial sketches can be used to predict personality traits, representing, to our knowledge, the first systematic investigation of this approach in the literature. Unlike traditional RGB facial images that capture detailed features, sketch-based images emphasize the structure and movement of facial expression muscles, thereby providing a novel perspective for personality prediction. Our approach introduces three key innovations: expression muscle-guided feature weighting to improve prediction accuracy by prioritizing biologically relevant patterns; data augmentation through intermediate sketches generated via the 25-Step Sketching Approach to mitigate data scarcity; and comprehensive validation on a dataset of 12,320 individuals. Experimental results demonstrate that our sketch-based model achieves comparable accuracy to image-based models for specific personality traits, while ablation studies confirm the complementary benefits of both expression muscle weighting and sketch augmentation strategies. These findings, coupled with the newly constructed sketch datasets, offer valuable multimodal resources and methodological insights for researchers in affective computing and behavioral science. |
| format | Article |
| id | doaj-art-a54f910de06f411e9a7353a8b145b57e |
| institution | DOAJ |
| issn | 2169-3536 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-a54f910de06f411e9a7353a8b145b57e2025-08-20T02:47:45ZengIEEEIEEE Access2169-35362025-01-0113415244153210.1109/ACCESS.2025.354795910909541Personality Trait Prediction From Facial Sketch Leveraged by Expression MusclesLifen Weng0https://orcid.org/0000-0001-6115-0713Jiangbin Guo1https://orcid.org/0009-0007-4015-6471Qibing Zhu2College of Design and Art, Xiamen University of Technology, Xiamen, ChinaCollege of Computer and Information Engineering, Xiamen University of Technology, Xiamen, ChinaCollege of Computer and Information Engineering, Xiamen University of Technology, Xiamen, ChinaThis work explores whether facial sketches can be used to predict personality traits, representing, to our knowledge, the first systematic investigation of this approach in the literature. Unlike traditional RGB facial images that capture detailed features, sketch-based images emphasize the structure and movement of facial expression muscles, thereby providing a novel perspective for personality prediction. Our approach introduces three key innovations: expression muscle-guided feature weighting to improve prediction accuracy by prioritizing biologically relevant patterns; data augmentation through intermediate sketches generated via the 25-Step Sketching Approach to mitigate data scarcity; and comprehensive validation on a dataset of 12,320 individuals. Experimental results demonstrate that our sketch-based model achieves comparable accuracy to image-based models for specific personality traits, while ablation studies confirm the complementary benefits of both expression muscle weighting and sketch augmentation strategies. These findings, coupled with the newly constructed sketch datasets, offer valuable multimodal resources and methodological insights for researchers in affective computing and behavioral science.https://ieeexplore.ieee.org/document/10909541/Personality traits estimationfacial sketchconvolutional neural network |
| spellingShingle | Lifen Weng Jiangbin Guo Qibing Zhu Personality Trait Prediction From Facial Sketch Leveraged by Expression Muscles IEEE Access Personality traits estimation facial sketch convolutional neural network |
| title | Personality Trait Prediction From Facial Sketch Leveraged by Expression Muscles |
| title_full | Personality Trait Prediction From Facial Sketch Leveraged by Expression Muscles |
| title_fullStr | Personality Trait Prediction From Facial Sketch Leveraged by Expression Muscles |
| title_full_unstemmed | Personality Trait Prediction From Facial Sketch Leveraged by Expression Muscles |
| title_short | Personality Trait Prediction From Facial Sketch Leveraged by Expression Muscles |
| title_sort | personality trait prediction from facial sketch leveraged by expression muscles |
| topic | Personality traits estimation facial sketch convolutional neural network |
| url | https://ieeexplore.ieee.org/document/10909541/ |
| work_keys_str_mv | AT lifenweng personalitytraitpredictionfromfacialsketchleveragedbyexpressionmuscles AT jiangbinguo personalitytraitpredictionfromfacialsketchleveragedbyexpressionmuscles AT qibingzhu personalitytraitpredictionfromfacialsketchleveragedbyexpressionmuscles |