libBICOS – An Open Source GPU-Accelerated Library implementing BInary COrrespondence Search for 3D Reconstruction

In this paper, we present an implementation and publish an open source library for binary correspondence search (BICOS), an efficient method for accurate 3D reconstruction from structured light stereo imagery. Starting with two stacks of stereo-rectified images of a scene illuminated by a statistica...

Full description

Saved in:
Bibliographic Details
Main Authors: C. Liebender, M. Bleier, A. Nüchter
Format: Article
Language:English
Published: Copernicus Publications 2024-12-01
Series:The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Online Access:https://isprs-archives.copernicus.org/articles/XLVIII-2-W7-2024/57/2024/isprs-archives-XLVIII-2-W7-2024-57-2024.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850248009190735872
author C. Liebender
M. Bleier
A. Nüchter
author_facet C. Liebender
M. Bleier
A. Nüchter
author_sort C. Liebender
collection DOAJ
description In this paper, we present an implementation and publish an open source library for binary correspondence search (BICOS), an efficient method for accurate 3D reconstruction from structured light stereo imagery. Starting with two stacks of stereo-rectified images of a scene illuminated by a statistical light pattern the proposed method solves the problem of a pixelwise correspondence search. Our GPU-accelerated implementation reduces the latency of disparity computation using 7MP images on modern hardware down to 20 milliseconds. Based on the algorithm introduced by Dietrich et al. (2019), we extend their approach by increasing the descriptor size while augmenting postprocessing to increase its applicability on other types of pattern projections. Lastly, we provide benchmarks and example reconstructions using a stereo camera setup combined with an off-the-shelf projector to validate the algorithm’s performance. While many state-of-the-art single-shot stereo implementations are included in common computer vision libraries, high performance multi-shot methods are not broadly available. By publishing this method as a freely available library, in both a CUDA and CPU implementation, we hope for others to quickly gain traction in this field. The source code with build instructions and command-line tooling is available at https://github.com/JMUWRobotics/libBICOS under the GNU LGPLv3.
format Article
id doaj-art-d783851aba43433593d3accb3e99bf2b
institution OA Journals
issn 1682-1750
2194-9034
language English
publishDate 2024-12-01
publisher Copernicus Publications
record_format Article
series The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
spelling doaj-art-d783851aba43433593d3accb3e99bf2b2025-08-20T01:58:48ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342024-12-01XLVIII-2-W7-2024576410.5194/isprs-archives-XLVIII-2-W7-2024-57-2024libBICOS – An Open Source GPU-Accelerated Library implementing BInary COrrespondence Search for 3D ReconstructionC. Liebender0M. Bleier1A. Nüchter2Computer Science XVII - Robotics, Julius-Maximilians-Universität Würzburg, GermanyComputer Science XVII - Robotics, Julius-Maximilians-Universität Würzburg, GermanyComputer Science XVII - Robotics, Julius-Maximilians-Universität Würzburg, GermanyIn this paper, we present an implementation and publish an open source library for binary correspondence search (BICOS), an efficient method for accurate 3D reconstruction from structured light stereo imagery. Starting with two stacks of stereo-rectified images of a scene illuminated by a statistical light pattern the proposed method solves the problem of a pixelwise correspondence search. Our GPU-accelerated implementation reduces the latency of disparity computation using 7MP images on modern hardware down to 20 milliseconds. Based on the algorithm introduced by Dietrich et al. (2019), we extend their approach by increasing the descriptor size while augmenting postprocessing to increase its applicability on other types of pattern projections. Lastly, we provide benchmarks and example reconstructions using a stereo camera setup combined with an off-the-shelf projector to validate the algorithm’s performance. While many state-of-the-art single-shot stereo implementations are included in common computer vision libraries, high performance multi-shot methods are not broadly available. By publishing this method as a freely available library, in both a CUDA and CPU implementation, we hope for others to quickly gain traction in this field. The source code with build instructions and command-line tooling is available at https://github.com/JMUWRobotics/libBICOS under the GNU LGPLv3.https://isprs-archives.copernicus.org/articles/XLVIII-2-W7-2024/57/2024/isprs-archives-XLVIII-2-W7-2024-57-2024.pdf
spellingShingle C. Liebender
M. Bleier
A. Nüchter
libBICOS – An Open Source GPU-Accelerated Library implementing BInary COrrespondence Search for 3D Reconstruction
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
title libBICOS – An Open Source GPU-Accelerated Library implementing BInary COrrespondence Search for 3D Reconstruction
title_full libBICOS – An Open Source GPU-Accelerated Library implementing BInary COrrespondence Search for 3D Reconstruction
title_fullStr libBICOS – An Open Source GPU-Accelerated Library implementing BInary COrrespondence Search for 3D Reconstruction
title_full_unstemmed libBICOS – An Open Source GPU-Accelerated Library implementing BInary COrrespondence Search for 3D Reconstruction
title_short libBICOS – An Open Source GPU-Accelerated Library implementing BInary COrrespondence Search for 3D Reconstruction
title_sort libbicos an open source gpu accelerated library implementing binary correspondence search for 3d reconstruction
url https://isprs-archives.copernicus.org/articles/XLVIII-2-W7-2024/57/2024/isprs-archives-XLVIII-2-W7-2024-57-2024.pdf
work_keys_str_mv AT cliebender libbicosanopensourcegpuacceleratedlibraryimplementingbinarycorrespondencesearchfor3dreconstruction
AT mbleier libbicosanopensourcegpuacceleratedlibraryimplementingbinarycorrespondencesearchfor3dreconstruction
AT anuchter libbicosanopensourcegpuacceleratedlibraryimplementingbinarycorrespondencesearchfor3dreconstruction