Caricature-visual face recognition based on jigsaw solving and modal decoupling
Abstract In recent years, face recognition technology has made significant progress in the field of real visual images, yet face recognition involving caricature-visual images remains a challenge due to the exaggerated and unrealistic features of caricature faces. To tackle this issue, this paper in...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2024-11-01
|
| Series: | Scientific Reports |
| Subjects: | |
| Online Access: | https://doi.org/10.1038/s41598-024-80032-x |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850128983388061696 |
|---|---|
| author | Yajun Yao Chongwen Wang |
| author_facet | Yajun Yao Chongwen Wang |
| author_sort | Yajun Yao |
| collection | DOAJ |
| description | Abstract In recent years, face recognition technology has made significant progress in the field of real visual images, yet face recognition involving caricature-visual images remains a challenge due to the exaggerated and unrealistic features of caricature faces. To tackle this issue, this paper introduces the Caricature-visual Face Recognition Model Based on Jigsaw Solving and Modal Decoupling (CVF-JSM). The CVF-JSM consists of two modules: feature extraction and decoupling. The feature extraction module incorporates a graph attention network at the intermediate stage of the backbone network, which constructs and solves jigsaw puzzles to enable the network to extract shape features. The feature decoupling module features a three-branch structure that divides the features into modal and identity features. The real and caricature face recognition branches separate identity features for recognition through parameter sharing and orthogonality constraints. The feature common subspace alignment branch maps the anchor image, as well as the positive and negative sample images, into a common subspace to isolate identity features. Subsequently, by aligning the features, it further refines the effective identity features. The experimental results conducted on multiple datasets demonstrate that the CVF-JSM model outperforms existing technologies in the realm of caricature-visual face recognition. |
| format | Article |
| id | doaj-art-1c830877bba84854b327c507cf3b14aa |
| institution | OA Journals |
| issn | 2045-2322 |
| language | English |
| publishDate | 2024-11-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Scientific Reports |
| spelling | doaj-art-1c830877bba84854b327c507cf3b14aa2025-08-20T02:33:08ZengNature PortfolioScientific Reports2045-23222024-11-0114111410.1038/s41598-024-80032-xCaricature-visual face recognition based on jigsaw solving and modal decouplingYajun Yao0Chongwen Wang1Zhengzhou Power Supply Company, State Grid Henan Electric Power CompanySchool of Computer Science, Beijing Institute of TechnologyAbstract In recent years, face recognition technology has made significant progress in the field of real visual images, yet face recognition involving caricature-visual images remains a challenge due to the exaggerated and unrealistic features of caricature faces. To tackle this issue, this paper introduces the Caricature-visual Face Recognition Model Based on Jigsaw Solving and Modal Decoupling (CVF-JSM). The CVF-JSM consists of two modules: feature extraction and decoupling. The feature extraction module incorporates a graph attention network at the intermediate stage of the backbone network, which constructs and solves jigsaw puzzles to enable the network to extract shape features. The feature decoupling module features a three-branch structure that divides the features into modal and identity features. The real and caricature face recognition branches separate identity features for recognition through parameter sharing and orthogonality constraints. The feature common subspace alignment branch maps the anchor image, as well as the positive and negative sample images, into a common subspace to isolate identity features. Subsequently, by aligning the features, it further refines the effective identity features. The experimental results conducted on multiple datasets demonstrate that the CVF-JSM model outperforms existing technologies in the realm of caricature-visual face recognition.https://doi.org/10.1038/s41598-024-80032-xCaricature-visual face recognitionJigsaw solvingFeature decoupling |
| spellingShingle | Yajun Yao Chongwen Wang Caricature-visual face recognition based on jigsaw solving and modal decoupling Scientific Reports Caricature-visual face recognition Jigsaw solving Feature decoupling |
| title | Caricature-visual face recognition based on jigsaw solving and modal decoupling |
| title_full | Caricature-visual face recognition based on jigsaw solving and modal decoupling |
| title_fullStr | Caricature-visual face recognition based on jigsaw solving and modal decoupling |
| title_full_unstemmed | Caricature-visual face recognition based on jigsaw solving and modal decoupling |
| title_short | Caricature-visual face recognition based on jigsaw solving and modal decoupling |
| title_sort | caricature visual face recognition based on jigsaw solving and modal decoupling |
| topic | Caricature-visual face recognition Jigsaw solving Feature decoupling |
| url | https://doi.org/10.1038/s41598-024-80032-x |
| work_keys_str_mv | AT yajunyao caricaturevisualfacerecognitionbasedonjigsawsolvingandmodaldecoupling AT chongwenwang caricaturevisualfacerecognitionbasedonjigsawsolvingandmodaldecoupling |