An Automatic Registration System Based on Augmented Reality to Enhance Civil Infrastructure Inspections
Manual geometric and semantic alignment of inspection data with existing digital models (field-to-model data registration) and on-site access to relevant information (model-to-field data registration) represent cumbersome procedures that cause significant loss of information and fragmentation, hinde...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-03-01
|
| Series: | Buildings |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2075-5309/15/7/1146 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849738479202729984 |
|---|---|
| author | Leonardo Binni Massimo Vaccarini Francesco Spegni Leonardo Messi Berardo Naticchia |
| author_facet | Leonardo Binni Massimo Vaccarini Francesco Spegni Leonardo Messi Berardo Naticchia |
| author_sort | Leonardo Binni |
| collection | DOAJ |
| description | Manual geometric and semantic alignment of inspection data with existing digital models (field-to-model data registration) and on-site access to relevant information (model-to-field data registration) represent cumbersome procedures that cause significant loss of information and fragmentation, hindering the efficiency of civil infrastructure inspections. To address the bidirectional registration challenge, this study introduces a high-accuracy automatic registration method and system based on Augmented Reality (AR) that streamlines data exchange between the field and a knowledge graph-based Digital Twin (DT) platform for infrastructure management, and vice versa. A centimeter-level 6-DoF pose estimation of the AR device in large-scale, open unprepared environments is achieved by implementing a hybrid approach based on Real-Time Kinematic and Visual Inertial Odometry to cope with urban-canyon scenarios. For this purpose, a low-cost and non-invasive RTK receiver was prototyped and firmly attached to an AR device (i.e., Microsoft HoloLens 2). Multiple filters and latency compensation techniques were implemented to enhance registration accuracy. The system was tested in a real-world scenario involving the inspection of a highway viaduct. Throughout the use case inspection, the system seamlessly and automatically provided field operators with on-field access to existing DT information (i.e., open BIM models) such as georeferenced holograms and facilitated the enrichment of the asset’s DT through the automatic registration of inspection data (i.e., images) with the open BIM models included in the DT. This study contributes to DT-based civil infrastructure management by establishing a bidirectional and seamless integration between virtual and physical entities. |
| format | Article |
| id | doaj-art-1c3e5191af5f4670a366e7850569dcbb |
| institution | DOAJ |
| issn | 2075-5309 |
| language | English |
| publishDate | 2025-03-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Buildings |
| spelling | doaj-art-1c3e5191af5f4670a366e7850569dcbb2025-08-20T03:06:32ZengMDPI AGBuildings2075-53092025-03-01157114610.3390/buildings15071146An Automatic Registration System Based on Augmented Reality to Enhance Civil Infrastructure InspectionsLeonardo Binni0Massimo Vaccarini1Francesco Spegni2Leonardo Messi3Berardo Naticchia4Department of Construction, Civil Engineering and Architecture (DICEA), Construction Division, Faculty of Engineering, Università Politecnica delle Marche, 60121 Ancona, ItalyDepartment of Construction, Civil Engineering and Architecture (DICEA), Construction Division, Faculty of Engineering, Università Politecnica delle Marche, 60121 Ancona, ItalyDepartment of Construction, Civil Engineering and Architecture (DICEA), Construction Division, Faculty of Engineering, Università Politecnica delle Marche, 60121 Ancona, ItalyDepartment of Construction, Civil Engineering and Architecture (DICEA), Construction Division, Faculty of Engineering, Università Politecnica delle Marche, 60121 Ancona, ItalyDepartment of Construction, Civil Engineering and Architecture (DICEA), Construction Division, Faculty of Engineering, Università Politecnica delle Marche, 60121 Ancona, ItalyManual geometric and semantic alignment of inspection data with existing digital models (field-to-model data registration) and on-site access to relevant information (model-to-field data registration) represent cumbersome procedures that cause significant loss of information and fragmentation, hindering the efficiency of civil infrastructure inspections. To address the bidirectional registration challenge, this study introduces a high-accuracy automatic registration method and system based on Augmented Reality (AR) that streamlines data exchange between the field and a knowledge graph-based Digital Twin (DT) platform for infrastructure management, and vice versa. A centimeter-level 6-DoF pose estimation of the AR device in large-scale, open unprepared environments is achieved by implementing a hybrid approach based on Real-Time Kinematic and Visual Inertial Odometry to cope with urban-canyon scenarios. For this purpose, a low-cost and non-invasive RTK receiver was prototyped and firmly attached to an AR device (i.e., Microsoft HoloLens 2). Multiple filters and latency compensation techniques were implemented to enhance registration accuracy. The system was tested in a real-world scenario involving the inspection of a highway viaduct. Throughout the use case inspection, the system seamlessly and automatically provided field operators with on-field access to existing DT information (i.e., open BIM models) such as georeferenced holograms and facilitated the enrichment of the asset’s DT through the automatic registration of inspection data (i.e., images) with the open BIM models included in the DT. This study contributes to DT-based civil infrastructure management by establishing a bidirectional and seamless integration between virtual and physical entities.https://www.mdpi.com/2075-5309/15/7/1146civil infrastructuredigital inspectionsbridgesAugmented RealityregistrationDigital Twin |
| spellingShingle | Leonardo Binni Massimo Vaccarini Francesco Spegni Leonardo Messi Berardo Naticchia An Automatic Registration System Based on Augmented Reality to Enhance Civil Infrastructure Inspections Buildings civil infrastructure digital inspections bridges Augmented Reality registration Digital Twin |
| title | An Automatic Registration System Based on Augmented Reality to Enhance Civil Infrastructure Inspections |
| title_full | An Automatic Registration System Based on Augmented Reality to Enhance Civil Infrastructure Inspections |
| title_fullStr | An Automatic Registration System Based on Augmented Reality to Enhance Civil Infrastructure Inspections |
| title_full_unstemmed | An Automatic Registration System Based on Augmented Reality to Enhance Civil Infrastructure Inspections |
| title_short | An Automatic Registration System Based on Augmented Reality to Enhance Civil Infrastructure Inspections |
| title_sort | automatic registration system based on augmented reality to enhance civil infrastructure inspections |
| topic | civil infrastructure digital inspections bridges Augmented Reality registration Digital Twin |
| url | https://www.mdpi.com/2075-5309/15/7/1146 |
| work_keys_str_mv | AT leonardobinni anautomaticregistrationsystembasedonaugmentedrealitytoenhancecivilinfrastructureinspections AT massimovaccarini anautomaticregistrationsystembasedonaugmentedrealitytoenhancecivilinfrastructureinspections AT francescospegni anautomaticregistrationsystembasedonaugmentedrealitytoenhancecivilinfrastructureinspections AT leonardomessi anautomaticregistrationsystembasedonaugmentedrealitytoenhancecivilinfrastructureinspections AT berardonaticchia anautomaticregistrationsystembasedonaugmentedrealitytoenhancecivilinfrastructureinspections AT leonardobinni automaticregistrationsystembasedonaugmentedrealitytoenhancecivilinfrastructureinspections AT massimovaccarini automaticregistrationsystembasedonaugmentedrealitytoenhancecivilinfrastructureinspections AT francescospegni automaticregistrationsystembasedonaugmentedrealitytoenhancecivilinfrastructureinspections AT leonardomessi automaticregistrationsystembasedonaugmentedrealitytoenhancecivilinfrastructureinspections AT berardonaticchia automaticregistrationsystembasedonaugmentedrealitytoenhancecivilinfrastructureinspections |