Perspective-n-Point in Practice: Performance, Robustness, and Accuracy for Mesh-Based Localisation

Visual localisation, the task of determining camera poses from images, has matured significantly, offering various solutions for handheld device localisation. This paper investigates the Perspective-n-Point (PnP) problem, a crucial step in visual localisation that is often underexplored in practical...

Full description

Saved in:
Bibliographic Details
Main Authors: F. Vultaggio, P. Fanta-Jende, M. Gerke
Format: Article
Language:English
Published: Copernicus Publications 2025-06-01
Series:The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Online Access:https://isprs-archives.copernicus.org/articles/XLVIII-1-W4-2025/131/2025/isprs-archives-XLVIII-1-W4-2025-131-2025.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Visual localisation, the task of determining camera poses from images, has matured significantly, offering various solutions for handheld device localisation. This paper investigates the Perspective-n-Point (PnP) problem, a crucial step in visual localisation that is often underexplored in practical applications. We evaluate the performance of state-of-the-art PnP algorithms with real-world data, analysing their impact on localisation accuracy and robustness. Using a dataset comprising a large-scale aerial mesh and smartphone images, we conduct experiments to assess PnP algorithm performance. Specifically, we examine the effects of PnP algorithms in isolation, followed by the incorporation of RANSAC for outlier rejection, and finally, the addition of non linear pose refinement. By maintaining a fixed set of 2D-3D correspondences, this approach allows us to: assess the true outlier rejection capabilities of PnP algorithms, quantify the accuracy improvement achievable with non linear pose refinement, and identify superior PnP algorithms for robust visual localisation.
ISSN:1682-1750
2194-9034