Investigations on 3D reconstruction of bones in surgery using a handheld trinocular camera system

Knee arthroplasty benefits significantly from computer-assisted navigation, which improves the accuracy of prosthesis placement. However, current methods require invasive optical locators to track the position of the knee, which carries risks such as infection and prolonged healing times. To address...

Full description

Saved in:
Bibliographic Details
Main Authors: A. Schierbaum, T. Neiss-Theuerkauff, T. Luhmann, F. Wallhoff, T. Sieberth
Format: Article
Language:English
Published: Copernicus Publications 2024-12-01
Series:The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Online Access:https://isprs-archives.copernicus.org/articles/XLVIII-2-W7-2024/145/2024/isprs-archives-XLVIII-2-W7-2024-145-2024.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850062756563124224
author A. Schierbaum
T. Neiss-Theuerkauff
T. Luhmann
F. Wallhoff
T. Sieberth
author_facet A. Schierbaum
T. Neiss-Theuerkauff
T. Luhmann
F. Wallhoff
T. Sieberth
author_sort A. Schierbaum
collection DOAJ
description Knee arthroplasty benefits significantly from computer-assisted navigation, which improves the accuracy of prosthesis placement. However, current methods require invasive optical locators to track the position of the knee, which carries risks such as infection and prolonged healing times. To address these limitations, this work uses markerless trinocular SLAM to achieve accurate 3D reconstruction of the knee during surgery. The approach integrates SuperGlue for robust feature matching and incorporates segmentation to mask the knee, improving reconstruction accuracy despite challenges such as low-texture surfaces, reflections and spotlight illumination. The accuracy of the handheld trinocular camera system is evaluated under dynamic conditions, simulating camera movement during surgery to ensure accurate reconstruction during real-time surgery. In addition, a robot-guided dataset will be used to assess the repeatability and robustness of the SLAM approach. This research focuses on positional accuracy in motion and aims to advance real-time, non-invasive navigation solutions for knee arthroplasty, contributing to safer and more efficient surgical outcomes.
format Article
id doaj-art-a567f727f7a44208ba41bc5dca3fb5d7
institution DOAJ
issn 1682-1750
2194-9034
language English
publishDate 2024-12-01
publisher Copernicus Publications
record_format Article
series The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
spelling doaj-art-a567f727f7a44208ba41bc5dca3fb5d72025-08-20T02:49:49ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342024-12-01XLVIII-2-W7-202414515110.5194/isprs-archives-XLVIII-2-W7-2024-145-2024Investigations on 3D reconstruction of bones in surgery using a handheld trinocular camera systemA. Schierbaum0T. Neiss-Theuerkauff1T. Luhmann2F. Wallhoff3T. Sieberth4Institute for Applied Photogrammetry and Geoinformatics, Jade University of Applied Sciences, Oldenburg, GermanyInstitute for Technical Assistive Systems, Jade University of Applied Sciences, Oldenburg, GermanyInstitute for Applied Photogrammetry and Geoinformatics, Jade University of Applied Sciences, Oldenburg, GermanyInstitute for Technical Assistive Systems, Jade University of Applied Sciences, Oldenburg, GermanyInstitute for Applied Photogrammetry and Geoinformatics, Jade University of Applied Sciences, Oldenburg, GermanyKnee arthroplasty benefits significantly from computer-assisted navigation, which improves the accuracy of prosthesis placement. However, current methods require invasive optical locators to track the position of the knee, which carries risks such as infection and prolonged healing times. To address these limitations, this work uses markerless trinocular SLAM to achieve accurate 3D reconstruction of the knee during surgery. The approach integrates SuperGlue for robust feature matching and incorporates segmentation to mask the knee, improving reconstruction accuracy despite challenges such as low-texture surfaces, reflections and spotlight illumination. The accuracy of the handheld trinocular camera system is evaluated under dynamic conditions, simulating camera movement during surgery to ensure accurate reconstruction during real-time surgery. In addition, a robot-guided dataset will be used to assess the repeatability and robustness of the SLAM approach. This research focuses on positional accuracy in motion and aims to advance real-time, non-invasive navigation solutions for knee arthroplasty, contributing to safer and more efficient surgical outcomes.https://isprs-archives.copernicus.org/articles/XLVIII-2-W7-2024/145/2024/isprs-archives-XLVIII-2-W7-2024-145-2024.pdf
spellingShingle A. Schierbaum
T. Neiss-Theuerkauff
T. Luhmann
F. Wallhoff
T. Sieberth
Investigations on 3D reconstruction of bones in surgery using a handheld trinocular camera system
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
title Investigations on 3D reconstruction of bones in surgery using a handheld trinocular camera system
title_full Investigations on 3D reconstruction of bones in surgery using a handheld trinocular camera system
title_fullStr Investigations on 3D reconstruction of bones in surgery using a handheld trinocular camera system
title_full_unstemmed Investigations on 3D reconstruction of bones in surgery using a handheld trinocular camera system
title_short Investigations on 3D reconstruction of bones in surgery using a handheld trinocular camera system
title_sort investigations on 3d reconstruction of bones in surgery using a handheld trinocular camera system
url https://isprs-archives.copernicus.org/articles/XLVIII-2-W7-2024/145/2024/isprs-archives-XLVIII-2-W7-2024-145-2024.pdf
work_keys_str_mv AT aschierbaum investigationson3dreconstructionofbonesinsurgeryusingahandheldtrinocularcamerasystem
AT tneisstheuerkauff investigationson3dreconstructionofbonesinsurgeryusingahandheldtrinocularcamerasystem
AT tluhmann investigationson3dreconstructionofbonesinsurgeryusingahandheldtrinocularcamerasystem
AT fwallhoff investigationson3dreconstructionofbonesinsurgeryusingahandheldtrinocularcamerasystem
AT tsieberth investigationson3dreconstructionofbonesinsurgeryusingahandheldtrinocularcamerasystem