Real-time holographic camera for obtaining real 3D scene hologram

Abstract As a frontier technology, holography has important research values in fields such as bio-micrographic imaging, light field modulation and data storage. However, the real-time acquisition of 3D scenes and high-fidelity reconstruction technology has not yet made a breakthrough, which has seri...

Full description

Saved in:
Bibliographic Details
Main Authors: Zhao-Song Li, Chao Liu, Xiao-Wei Li, Yi Zheng, Qian Huang, Yi-Wei Zheng, Ye-Hao Hou, Chen-Liang Chang, Da-Wei Zhang, Song-Lin Zhuang, Di Wang, Qiong-Hua Wang
Format: Article
Language:English
Published: Nature Publishing Group 2025-02-01
Series:Light: Science & Applications
Online Access:https://doi.org/10.1038/s41377-024-01730-9
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1823861520480600064
author Zhao-Song Li
Chao Liu
Xiao-Wei Li
Yi Zheng
Qian Huang
Yi-Wei Zheng
Ye-Hao Hou
Chen-Liang Chang
Da-Wei Zhang
Song-Lin Zhuang
Di Wang
Qiong-Hua Wang
author_facet Zhao-Song Li
Chao Liu
Xiao-Wei Li
Yi Zheng
Qian Huang
Yi-Wei Zheng
Ye-Hao Hou
Chen-Liang Chang
Da-Wei Zhang
Song-Lin Zhuang
Di Wang
Qiong-Hua Wang
author_sort Zhao-Song Li
collection DOAJ
description Abstract As a frontier technology, holography has important research values in fields such as bio-micrographic imaging, light field modulation and data storage. However, the real-time acquisition of 3D scenes and high-fidelity reconstruction technology has not yet made a breakthrough, which has seriously hindered the development of holography. Here, a novel holographic camera is proposed to solve the above inherent problems completely. The proposed holographic camera consists of the acquisition end and the calculation end. At the acquisition end of the holographic camera, specially configured liquid materials and liquid lens structure based on voice-coil motor-driving are used to produce the liquid camera, so that the liquid camera can quickly capture the focus stack of the real 3D scene within 15 ms. At the calculation end, a new structured focus stack network (FS-Net) is designed for hologram calculation. After training the FS-Net with the focus stack renderer and learnable Zernike phase, it enables hologram calculation within 13 ms. As the first device to achieve real-time incoherent acquisition and high-fidelity holographic reconstruction of a real 3D scene, our proposed holographic camera breaks technical bottlenecks of difficulty in acquiring the real 3D scene, low quality of the holographic reconstructed image, and incorrect defocus blur. The experimental results demonstrate the effectiveness of our holographic camera in the acquisition of focal plane information and hologram calculation of the real 3D scene. The proposed holographic camera opens up a new way for the application of holography in fields such as 3D display, light field modulation, and 3D measurement.
format Article
id doaj-art-00053cf0b5344b739da62562ccad0f52
institution Kabale University
issn 2047-7538
language English
publishDate 2025-02-01
publisher Nature Publishing Group
record_format Article
series Light: Science & Applications
spelling doaj-art-00053cf0b5344b739da62562ccad0f522025-02-09T12:54:58ZengNature Publishing GroupLight: Science & Applications2047-75382025-02-0114111110.1038/s41377-024-01730-9Real-time holographic camera for obtaining real 3D scene hologramZhao-Song Li0Chao Liu1Xiao-Wei Li2Yi Zheng3Qian Huang4Yi-Wei Zheng5Ye-Hao Hou6Chen-Liang Chang7Da-Wei Zhang8Song-Lin Zhuang9Di Wang10Qiong-Hua Wang11School of Instrumentation and Optoelectronic Engineering, Beihang UniversitySchool of Instrumentation and Optoelectronic Engineering, Beihang UniversitySchool of Instrumentation and Optoelectronic Engineering, Beihang UniversitySchool of Instrumentation and Optoelectronic Engineering, Beihang UniversitySchool of Instrumentation and Optoelectronic Engineering, Beihang UniversitySchool of Instrumentation and Optoelectronic Engineering, Beihang UniversitySchool of Instrumentation and Optoelectronic Engineering, Beihang UniversitySchool of Optical-Electrical and Computer Engineering, University of Shanghai for Science and TechnologySchool of Optical-Electrical and Computer Engineering, University of Shanghai for Science and TechnologySchool of Optical-Electrical and Computer Engineering, University of Shanghai for Science and TechnologySchool of Instrumentation and Optoelectronic Engineering, Beihang UniversitySchool of Instrumentation and Optoelectronic Engineering, Beihang UniversityAbstract As a frontier technology, holography has important research values in fields such as bio-micrographic imaging, light field modulation and data storage. However, the real-time acquisition of 3D scenes and high-fidelity reconstruction technology has not yet made a breakthrough, which has seriously hindered the development of holography. Here, a novel holographic camera is proposed to solve the above inherent problems completely. The proposed holographic camera consists of the acquisition end and the calculation end. At the acquisition end of the holographic camera, specially configured liquid materials and liquid lens structure based on voice-coil motor-driving are used to produce the liquid camera, so that the liquid camera can quickly capture the focus stack of the real 3D scene within 15 ms. At the calculation end, a new structured focus stack network (FS-Net) is designed for hologram calculation. After training the FS-Net with the focus stack renderer and learnable Zernike phase, it enables hologram calculation within 13 ms. As the first device to achieve real-time incoherent acquisition and high-fidelity holographic reconstruction of a real 3D scene, our proposed holographic camera breaks technical bottlenecks of difficulty in acquiring the real 3D scene, low quality of the holographic reconstructed image, and incorrect defocus blur. The experimental results demonstrate the effectiveness of our holographic camera in the acquisition of focal plane information and hologram calculation of the real 3D scene. The proposed holographic camera opens up a new way for the application of holography in fields such as 3D display, light field modulation, and 3D measurement.https://doi.org/10.1038/s41377-024-01730-9
spellingShingle Zhao-Song Li
Chao Liu
Xiao-Wei Li
Yi Zheng
Qian Huang
Yi-Wei Zheng
Ye-Hao Hou
Chen-Liang Chang
Da-Wei Zhang
Song-Lin Zhuang
Di Wang
Qiong-Hua Wang
Real-time holographic camera for obtaining real 3D scene hologram
Light: Science & Applications
title Real-time holographic camera for obtaining real 3D scene hologram
title_full Real-time holographic camera for obtaining real 3D scene hologram
title_fullStr Real-time holographic camera for obtaining real 3D scene hologram
title_full_unstemmed Real-time holographic camera for obtaining real 3D scene hologram
title_short Real-time holographic camera for obtaining real 3D scene hologram
title_sort real time holographic camera for obtaining real 3d scene hologram
url https://doi.org/10.1038/s41377-024-01730-9
work_keys_str_mv AT zhaosongli realtimeholographiccameraforobtainingreal3dscenehologram
AT chaoliu realtimeholographiccameraforobtainingreal3dscenehologram
AT xiaoweili realtimeholographiccameraforobtainingreal3dscenehologram
AT yizheng realtimeholographiccameraforobtainingreal3dscenehologram
AT qianhuang realtimeholographiccameraforobtainingreal3dscenehologram
AT yiweizheng realtimeholographiccameraforobtainingreal3dscenehologram
AT yehaohou realtimeholographiccameraforobtainingreal3dscenehologram
AT chenliangchang realtimeholographiccameraforobtainingreal3dscenehologram
AT daweizhang realtimeholographiccameraforobtainingreal3dscenehologram
AT songlinzhuang realtimeholographiccameraforobtainingreal3dscenehologram
AT diwang realtimeholographiccameraforobtainingreal3dscenehologram
AT qionghuawang realtimeholographiccameraforobtainingreal3dscenehologram