3D reconstruction of spherical images: a review of techniques, applications, and prospects

3D reconstruction plays an increasingly important role in modern photogrammetric systems. Conventional satellite or aerial-based remote sensing (RS) platforms can provide the necessary data sources for the 3D reconstruction of large-scale landforms and cities. Even with low-altitude Unmanned Aerial...

Full description

Saved in:
Bibliographic Details
Main Authors: San Jiang, Kan You, Yaxin Li, Duojie Weng, Wu Chen
Format: Article
Language:English
Published: Taylor & Francis Group 2024-11-01
Series:Geo-spatial Information Science
Subjects:
Online Access:https://www.tandfonline.com/doi/10.1080/10095020.2024.2313328
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850247513194364928
author San Jiang
Kan You
Yaxin Li
Duojie Weng
Wu Chen
author_facet San Jiang
Kan You
Yaxin Li
Duojie Weng
Wu Chen
author_sort San Jiang
collection DOAJ
description 3D reconstruction plays an increasingly important role in modern photogrammetric systems. Conventional satellite or aerial-based remote sensing (RS) platforms can provide the necessary data sources for the 3D reconstruction of large-scale landforms and cities. Even with low-altitude Unmanned Aerial Vehicles (UAVs), 3D reconstruction in complicated situations, such as urban canyons and indoor scenes, is challenging due to frequent tracking failures between camera frames and high data collection costs. Recently, spherical images have been extensively used due to the capability of recording surrounding environments from one image. In contrast to perspective images with limited Field of View (FOV), spherical images can cover the whole scene with full horizontal and vertical FOV and facilitate camera tracking and data acquisition in these complex scenes. With the rapid evolution and extensive use of professional and consumer-grade spherical cameras, spherical images show great potential for the 3D modeling of urban and indoor scenes. Classical 3D reconstruction pipelines, however, cannot be directly used for spherical images. Besides, there exist few software packages that are designed for the 3D reconstruction from spherical images. As a result, this research provides a thorough survey of the state-of-the-art for 3D reconstruction from spherical images in terms of data acquisition, feature detection and matching, image orientation, and dense matching as well as presenting promising applications and discussing potential prospects. We anticipate that this study offers insightful clues to direct future research.
format Article
id doaj-art-1216aa5671e246ea86afadfae449a738
institution OA Journals
issn 1009-5020
1993-5153
language English
publishDate 2024-11-01
publisher Taylor & Francis Group
record_format Article
series Geo-spatial Information Science
spelling doaj-art-1216aa5671e246ea86afadfae449a7382025-08-20T01:58:55ZengTaylor & Francis GroupGeo-spatial Information Science1009-50201993-51532024-11-012761959198810.1080/10095020.2024.23133283D reconstruction of spherical images: a review of techniques, applications, and prospectsSan Jiang0Kan You1Yaxin Li2Duojie Weng3Wu Chen4School of Computer Science, China University of Geosciences, Wuhan, ChinaSchool of Computer Science, China University of Geosciences, Wuhan, ChinaDepartment of Land Surveying and Geo-Informatics, The Hong Kong Polytechnic University, Hong Kong, ChinaDepartment of Land Surveying and Geo-Informatics, The Hong Kong Polytechnic University, Hong Kong, ChinaDepartment of Land Surveying and Geo-Informatics, The Hong Kong Polytechnic University, Hong Kong, China3D reconstruction plays an increasingly important role in modern photogrammetric systems. Conventional satellite or aerial-based remote sensing (RS) platforms can provide the necessary data sources for the 3D reconstruction of large-scale landforms and cities. Even with low-altitude Unmanned Aerial Vehicles (UAVs), 3D reconstruction in complicated situations, such as urban canyons and indoor scenes, is challenging due to frequent tracking failures between camera frames and high data collection costs. Recently, spherical images have been extensively used due to the capability of recording surrounding environments from one image. In contrast to perspective images with limited Field of View (FOV), spherical images can cover the whole scene with full horizontal and vertical FOV and facilitate camera tracking and data acquisition in these complex scenes. With the rapid evolution and extensive use of professional and consumer-grade spherical cameras, spherical images show great potential for the 3D modeling of urban and indoor scenes. Classical 3D reconstruction pipelines, however, cannot be directly used for spherical images. Besides, there exist few software packages that are designed for the 3D reconstruction from spherical images. As a result, this research provides a thorough survey of the state-of-the-art for 3D reconstruction from spherical images in terms of data acquisition, feature detection and matching, image orientation, and dense matching as well as presenting promising applications and discussing potential prospects. We anticipate that this study offers insightful clues to direct future research.https://www.tandfonline.com/doi/10.1080/10095020.2024.2313328Spherical imageequirectangular projection3D reconstructionstructure from motionsimultaneous localization and mappingdense matching
spellingShingle San Jiang
Kan You
Yaxin Li
Duojie Weng
Wu Chen
3D reconstruction of spherical images: a review of techniques, applications, and prospects
Geo-spatial Information Science
Spherical image
equirectangular projection
3D reconstruction
structure from motion
simultaneous localization and mapping
dense matching
title 3D reconstruction of spherical images: a review of techniques, applications, and prospects
title_full 3D reconstruction of spherical images: a review of techniques, applications, and prospects
title_fullStr 3D reconstruction of spherical images: a review of techniques, applications, and prospects
title_full_unstemmed 3D reconstruction of spherical images: a review of techniques, applications, and prospects
title_short 3D reconstruction of spherical images: a review of techniques, applications, and prospects
title_sort 3d reconstruction of spherical images a review of techniques applications and prospects
topic Spherical image
equirectangular projection
3D reconstruction
structure from motion
simultaneous localization and mapping
dense matching
url https://www.tandfonline.com/doi/10.1080/10095020.2024.2313328
work_keys_str_mv AT sanjiang 3dreconstructionofsphericalimagesareviewoftechniquesapplicationsandprospects
AT kanyou 3dreconstructionofsphericalimagesareviewoftechniquesapplicationsandprospects
AT yaxinli 3dreconstructionofsphericalimagesareviewoftechniquesapplicationsandprospects
AT duojieweng 3dreconstructionofsphericalimagesareviewoftechniquesapplicationsandprospects
AT wuchen 3dreconstructionofsphericalimagesareviewoftechniquesapplicationsandprospects