Generating 3D Virtual Human Animation Based on Facial Expression and Human Posture Captured by Dual Cameras

In order to generate 3D virtual human animation with smoother actions and richer and more vivid expressions, this article proposes a system based on dual cameras to synchronously capture human facial expressions and human posture, so as to better generate 3D virtual human animation. Firstly, the 2D...

Full description

Saved in:
Bibliographic Details
Main Authors: Junming Wang, Xiaojie Chai, Guo Han, Jixia Wang
Format: Article
Language:English
Published: Wiley 2022-01-01
Series:Advances in Multimedia
Online Access:http://dx.doi.org/10.1155/2022/4833436
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832553011131449344
author Junming Wang
Xiaojie Chai
Guo Han
Jixia Wang
author_facet Junming Wang
Xiaojie Chai
Guo Han
Jixia Wang
author_sort Junming Wang
collection DOAJ
description In order to generate 3D virtual human animation with smoother actions and richer and more vivid expressions, this article proposes a system based on dual cameras to synchronously capture human facial expressions and human posture, so as to better generate 3D virtual human animation. Firstly, the 2D features of the image are extracted through facial expression, and the benchmark is provided for the standard 3D coordinate values. At the same time, the 3D pose fusion is realized by using the pose measurement algorithm for human motion capture. Through the test, it is found that the two fusion algorithms can meet the requirements of the static accuracy of 0.5° and the dynamic accuracy of 0°, and the three-dimensional model of a virtual human body has a good effect in data-driven animation. The experiments show that the system can better capture facial expressions and human posture synchronously, and the frame rate in the experimental test can reach 20 fps, which can generate more natural and realistic 3D virtual human animation in real time.
format Article
id doaj-art-c9cf3f4032c04a7c9f1c79da9a92e1bd
institution Kabale University
issn 1687-5699
language English
publishDate 2022-01-01
publisher Wiley
record_format Article
series Advances in Multimedia
spelling doaj-art-c9cf3f4032c04a7c9f1c79da9a92e1bd2025-02-03T05:57:23ZengWileyAdvances in Multimedia1687-56992022-01-01202210.1155/2022/4833436Generating 3D Virtual Human Animation Based on Facial Expression and Human Posture Captured by Dual CamerasJunming Wang0Xiaojie Chai1Guo Han2Jixia Wang3Yantai Nanshan UniversityYantai Nanshan UniversityNanshan Tourism Group Co., Ltd.Yantai Nanshan UniversityIn order to generate 3D virtual human animation with smoother actions and richer and more vivid expressions, this article proposes a system based on dual cameras to synchronously capture human facial expressions and human posture, so as to better generate 3D virtual human animation. Firstly, the 2D features of the image are extracted through facial expression, and the benchmark is provided for the standard 3D coordinate values. At the same time, the 3D pose fusion is realized by using the pose measurement algorithm for human motion capture. Through the test, it is found that the two fusion algorithms can meet the requirements of the static accuracy of 0.5° and the dynamic accuracy of 0°, and the three-dimensional model of a virtual human body has a good effect in data-driven animation. The experiments show that the system can better capture facial expressions and human posture synchronously, and the frame rate in the experimental test can reach 20 fps, which can generate more natural and realistic 3D virtual human animation in real time.http://dx.doi.org/10.1155/2022/4833436
spellingShingle Junming Wang
Xiaojie Chai
Guo Han
Jixia Wang
Generating 3D Virtual Human Animation Based on Facial Expression and Human Posture Captured by Dual Cameras
Advances in Multimedia
title Generating 3D Virtual Human Animation Based on Facial Expression and Human Posture Captured by Dual Cameras
title_full Generating 3D Virtual Human Animation Based on Facial Expression and Human Posture Captured by Dual Cameras
title_fullStr Generating 3D Virtual Human Animation Based on Facial Expression and Human Posture Captured by Dual Cameras
title_full_unstemmed Generating 3D Virtual Human Animation Based on Facial Expression and Human Posture Captured by Dual Cameras
title_short Generating 3D Virtual Human Animation Based on Facial Expression and Human Posture Captured by Dual Cameras
title_sort generating 3d virtual human animation based on facial expression and human posture captured by dual cameras
url http://dx.doi.org/10.1155/2022/4833436
work_keys_str_mv AT junmingwang generating3dvirtualhumananimationbasedonfacialexpressionandhumanposturecapturedbydualcameras
AT xiaojiechai generating3dvirtualhumananimationbasedonfacialexpressionandhumanposturecapturedbydualcameras
AT guohan generating3dvirtualhumananimationbasedonfacialexpressionandhumanposturecapturedbydualcameras
AT jixiawang generating3dvirtualhumananimationbasedonfacialexpressionandhumanposturecapturedbydualcameras