A Virtual View Acquisition Technique for Complex Scenes of Monocular Images Based on Layered Depth Images
With the rapid development of stereoscopic display technology, how to generate high-quality virtual view images has become the key in the applications of 3D video, 3D TV and virtual reality. The traditional virtual view rendering technology maps the reference view into the virtual view by means of 3...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2024-11-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/14/22/10557 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850149506525429760 |
|---|---|
| author | Qi Wang Yan Piao |
| author_facet | Qi Wang Yan Piao |
| author_sort | Qi Wang |
| collection | DOAJ |
| description | With the rapid development of stereoscopic display technology, how to generate high-quality virtual view images has become the key in the applications of 3D video, 3D TV and virtual reality. The traditional virtual view rendering technology maps the reference view into the virtual view by means of 3D transformation, but when the background area is occluded by the foreground object, the content of the occluded area cannot be inferred. To solve this problem, we propose a virtual view acquisition technique for complex scenes of monocular images based on a layered depth image (LDI). Firstly, the depth discontinuities of the edge of the occluded area are reasonably grouped by using the multilayer representation of the LDI, and the depth edge of the occluded area is inpainted by the edge inpainting network. Then, the generative adversarial network (GAN) is used to fill the information of color and depth in the occluded area, and the inpainting virtual view is generated. Finally, GAN is used to optimize the color and depth of the virtual view, and the high-quality virtual view is generated. The effectiveness of the proposed method is proved by experiments, and it is also applicable to complex scenes. |
| format | Article |
| id | doaj-art-0d549736c8f548cfb312909f9cfbf596 |
| institution | OA Journals |
| issn | 2076-3417 |
| language | English |
| publishDate | 2024-11-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj-art-0d549736c8f548cfb312909f9cfbf5962025-08-20T02:26:54ZengMDPI AGApplied Sciences2076-34172024-11-0114221055710.3390/app142210557A Virtual View Acquisition Technique for Complex Scenes of Monocular Images Based on Layered Depth ImagesQi Wang0Yan Piao1College of Electronic and Information Engineering, Changchun University of Science and Technology, Changchun 130022, ChinaCollege of Electronic and Information Engineering, Changchun University of Science and Technology, Changchun 130022, ChinaWith the rapid development of stereoscopic display technology, how to generate high-quality virtual view images has become the key in the applications of 3D video, 3D TV and virtual reality. The traditional virtual view rendering technology maps the reference view into the virtual view by means of 3D transformation, but when the background area is occluded by the foreground object, the content of the occluded area cannot be inferred. To solve this problem, we propose a virtual view acquisition technique for complex scenes of monocular images based on a layered depth image (LDI). Firstly, the depth discontinuities of the edge of the occluded area are reasonably grouped by using the multilayer representation of the LDI, and the depth edge of the occluded area is inpainted by the edge inpainting network. Then, the generative adversarial network (GAN) is used to fill the information of color and depth in the occluded area, and the inpainting virtual view is generated. Finally, GAN is used to optimize the color and depth of the virtual view, and the high-quality virtual view is generated. The effectiveness of the proposed method is proved by experiments, and it is also applicable to complex scenes.https://www.mdpi.com/2076-3417/14/22/10557virtual viewlayered depth imagegenerative adversarial networkedge inpainting |
| spellingShingle | Qi Wang Yan Piao A Virtual View Acquisition Technique for Complex Scenes of Monocular Images Based on Layered Depth Images Applied Sciences virtual view layered depth image generative adversarial network edge inpainting |
| title | A Virtual View Acquisition Technique for Complex Scenes of Monocular Images Based on Layered Depth Images |
| title_full | A Virtual View Acquisition Technique for Complex Scenes of Monocular Images Based on Layered Depth Images |
| title_fullStr | A Virtual View Acquisition Technique for Complex Scenes of Monocular Images Based on Layered Depth Images |
| title_full_unstemmed | A Virtual View Acquisition Technique for Complex Scenes of Monocular Images Based on Layered Depth Images |
| title_short | A Virtual View Acquisition Technique for Complex Scenes of Monocular Images Based on Layered Depth Images |
| title_sort | virtual view acquisition technique for complex scenes of monocular images based on layered depth images |
| topic | virtual view layered depth image generative adversarial network edge inpainting |
| url | https://www.mdpi.com/2076-3417/14/22/10557 |
| work_keys_str_mv | AT qiwang avirtualviewacquisitiontechniqueforcomplexscenesofmonocularimagesbasedonlayereddepthimages AT yanpiao avirtualviewacquisitiontechniqueforcomplexscenesofmonocularimagesbasedonlayereddepthimages AT qiwang virtualviewacquisitiontechniqueforcomplexscenesofmonocularimagesbasedonlayereddepthimages AT yanpiao virtualviewacquisitiontechniqueforcomplexscenesofmonocularimagesbasedonlayereddepthimages |