A real-time interactive system of surface reconstruction and dynamic projection mapping with RGB-depth sensor and projector
Reconstruction and projection mapping enable us to bring virtual worlds into real spaces, which can give spectators an immersive augmented reality experience. Based on an interactive system with RGB-depth sensor and projector, we present a combined hardware and software solution for surface reconstr...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2018-07-01
|
| Series: | International Journal of Distributed Sensor Networks |
| Online Access: | https://doi.org/10.1177/1550147718790853 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850174754430910464 |
|---|---|
| author | Yundong Guo Shu-Chuan Chu Zhenyu Liu Chan Qiu Hao Luo Jianrong Tan |
| author_facet | Yundong Guo Shu-Chuan Chu Zhenyu Liu Chan Qiu Hao Luo Jianrong Tan |
| author_sort | Yundong Guo |
| collection | DOAJ |
| description | Reconstruction and projection mapping enable us to bring virtual worlds into real spaces, which can give spectators an immersive augmented reality experience. Based on an interactive system with RGB-depth sensor and projector, we present a combined hardware and software solution for surface reconstruction and dynamic projection mapping in real time. In this article, a novel and adaptable calibration scheme is proposed, which is used to estimate approximate models to correct and transform raw depth data. Besides, our system allows for smooth real-time performance using an optimization framework, including denoising and stabilizing. In the entire pipeline, markers are only used in the calibration procedure, and any priors are not needed. Our approach enables us to interact with the target surface in real time, while maintaining correct illumination. It is easy and fast to develop different applications for our system, and some interesting cases are demonstrated at last. |
| format | Article |
| id | doaj-art-c79b9c598cd14a3588b1ee57114ddd53 |
| institution | OA Journals |
| issn | 1550-1477 |
| language | English |
| publishDate | 2018-07-01 |
| publisher | Wiley |
| record_format | Article |
| series | International Journal of Distributed Sensor Networks |
| spelling | doaj-art-c79b9c598cd14a3588b1ee57114ddd532025-08-20T02:19:36ZengWileyInternational Journal of Distributed Sensor Networks1550-14772018-07-011410.1177/1550147718790853A real-time interactive system of surface reconstruction and dynamic projection mapping with RGB-depth sensor and projectorYundong Guo0Shu-Chuan Chu1Zhenyu Liu2Chan Qiu3Hao Luo4Jianrong Tan5State Key Lab of CAD&CG, Zhejiang University, Hangzhou, ChinaSchool of Computer Science, Engineering and Mathematics, Flinders University, Adelaide, SA, AustraliaState Key Lab of CAD&CG, Zhejiang University, Hangzhou, ChinaState Key Lab of CAD&CG, Zhejiang University, Hangzhou, ChinaSchool of Aeronautics and Astronautics, Zhejiang University, Hangzhou, ChinaState Key Lab of CAD&CG, Zhejiang University, Hangzhou, ChinaReconstruction and projection mapping enable us to bring virtual worlds into real spaces, which can give spectators an immersive augmented reality experience. Based on an interactive system with RGB-depth sensor and projector, we present a combined hardware and software solution for surface reconstruction and dynamic projection mapping in real time. In this article, a novel and adaptable calibration scheme is proposed, which is used to estimate approximate models to correct and transform raw depth data. Besides, our system allows for smooth real-time performance using an optimization framework, including denoising and stabilizing. In the entire pipeline, markers are only used in the calibration procedure, and any priors are not needed. Our approach enables us to interact with the target surface in real time, while maintaining correct illumination. It is easy and fast to develop different applications for our system, and some interesting cases are demonstrated at last.https://doi.org/10.1177/1550147718790853 |
| spellingShingle | Yundong Guo Shu-Chuan Chu Zhenyu Liu Chan Qiu Hao Luo Jianrong Tan A real-time interactive system of surface reconstruction and dynamic projection mapping with RGB-depth sensor and projector International Journal of Distributed Sensor Networks |
| title | A real-time interactive system of surface reconstruction and dynamic projection mapping with RGB-depth sensor and projector |
| title_full | A real-time interactive system of surface reconstruction and dynamic projection mapping with RGB-depth sensor and projector |
| title_fullStr | A real-time interactive system of surface reconstruction and dynamic projection mapping with RGB-depth sensor and projector |
| title_full_unstemmed | A real-time interactive system of surface reconstruction and dynamic projection mapping with RGB-depth sensor and projector |
| title_short | A real-time interactive system of surface reconstruction and dynamic projection mapping with RGB-depth sensor and projector |
| title_sort | real time interactive system of surface reconstruction and dynamic projection mapping with rgb depth sensor and projector |
| url | https://doi.org/10.1177/1550147718790853 |
| work_keys_str_mv | AT yundongguo arealtimeinteractivesystemofsurfacereconstructionanddynamicprojectionmappingwithrgbdepthsensorandprojector AT shuchuanchu arealtimeinteractivesystemofsurfacereconstructionanddynamicprojectionmappingwithrgbdepthsensorandprojector AT zhenyuliu arealtimeinteractivesystemofsurfacereconstructionanddynamicprojectionmappingwithrgbdepthsensorandprojector AT chanqiu arealtimeinteractivesystemofsurfacereconstructionanddynamicprojectionmappingwithrgbdepthsensorandprojector AT haoluo arealtimeinteractivesystemofsurfacereconstructionanddynamicprojectionmappingwithrgbdepthsensorandprojector AT jianrongtan arealtimeinteractivesystemofsurfacereconstructionanddynamicprojectionmappingwithrgbdepthsensorandprojector AT yundongguo realtimeinteractivesystemofsurfacereconstructionanddynamicprojectionmappingwithrgbdepthsensorandprojector AT shuchuanchu realtimeinteractivesystemofsurfacereconstructionanddynamicprojectionmappingwithrgbdepthsensorandprojector AT zhenyuliu realtimeinteractivesystemofsurfacereconstructionanddynamicprojectionmappingwithrgbdepthsensorandprojector AT chanqiu realtimeinteractivesystemofsurfacereconstructionanddynamicprojectionmappingwithrgbdepthsensorandprojector AT haoluo realtimeinteractivesystemofsurfacereconstructionanddynamicprojectionmappingwithrgbdepthsensorandprojector AT jianrongtan realtimeinteractivesystemofsurfacereconstructionanddynamicprojectionmappingwithrgbdepthsensorandprojector |