Toward Robust AR Surgical Navigation: Eliminating External Trackers and Ensuring OST-HMD Alignment Under Various Operating Room Lighting Conditions
Existing integrations of augmented reality (AR) into surgical navigation systems heavily depend on external tracking systems prone to occlusion and increased complexity of setting up the devices. These issues can compromise the accuracy and usability of AR navigation systems in a clinical operating...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10979305/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849313812902051840 |
|---|---|
| author | Nova Eka Diana Deukhee Lee |
| author_facet | Nova Eka Diana Deukhee Lee |
| author_sort | Nova Eka Diana |
| collection | DOAJ |
| description | Existing integrations of augmented reality (AR) into surgical navigation systems heavily depend on external tracking systems prone to occlusion and increased complexity of setting up the devices. These issues can compromise the accuracy and usability of AR navigation systems in a clinical operating room. Additionally, the impact of illumination exposure on AR system performance in a surgical room remains underexplored. Current methods for addressing the misalignment issue of AR contents in optical-see-through head-mounted displays (OST-HMDs) also lack sufficient precision, particularly for depth orientation. This study evaluated two inside-out tracking systems, the monocular tracker and stereo trackers, using the RGB and grayscale cameras of Microsoft HoloLens 2. Experimental assessments showed that the proposed stereo tracker achieved superior accuracy, with translational and rotational error of 0.73 mm and 0.15°, respectively, outperforming the proposed monocular tracker and existing reported literature. The proposed automated method to mitigate the impact of excessive light exposure can maintain a 98% marker detection rate across various lighting conditions and marker configurations. These results showed that the proposed techniques can eliminate the dependence on external trackers by providing robust performance in any surgical setting. A phantom study on AR-guided needle insertion further validated the efficacy of the proposed system, achieving an accuracy of <inline-formula> <tex-math notation="LaTeX">$1.65~\pm ~0.16$ </tex-math></inline-formula> mm and <inline-formula> <tex-math notation="LaTeX">$2.69~\pm ~0.19^{\circ }$ </tex-math></inline-formula>. These results meet the precision requirements for clinical surgeries, highlighting the potential of the proposed AR system to improve surgical outcomes. |
| format | Article |
| id | doaj-art-9ff6838d048844b4bfdbfc751ea3d596 |
| institution | Kabale University |
| issn | 2169-3536 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-9ff6838d048844b4bfdbfc751ea3d5962025-08-20T03:52:38ZengIEEEIEEE Access2169-35362025-01-0113761987621610.1109/ACCESS.2025.356519810979305Toward Robust AR Surgical Navigation: Eliminating External Trackers and Ensuring OST-HMD Alignment Under Various Operating Room Lighting ConditionsNova Eka Diana0https://orcid.org/0000-0002-3470-1628Deukhee Lee1https://orcid.org/0000-0001-7340-897XDivision of AI Robotics, KIST School, University of Science and Technology, Seoul, Republic of KoreaDivision of AI Robotics, KIST School, University of Science and Technology, Seoul, Republic of KoreaExisting integrations of augmented reality (AR) into surgical navigation systems heavily depend on external tracking systems prone to occlusion and increased complexity of setting up the devices. These issues can compromise the accuracy and usability of AR navigation systems in a clinical operating room. Additionally, the impact of illumination exposure on AR system performance in a surgical room remains underexplored. Current methods for addressing the misalignment issue of AR contents in optical-see-through head-mounted displays (OST-HMDs) also lack sufficient precision, particularly for depth orientation. This study evaluated two inside-out tracking systems, the monocular tracker and stereo trackers, using the RGB and grayscale cameras of Microsoft HoloLens 2. Experimental assessments showed that the proposed stereo tracker achieved superior accuracy, with translational and rotational error of 0.73 mm and 0.15°, respectively, outperforming the proposed monocular tracker and existing reported literature. The proposed automated method to mitigate the impact of excessive light exposure can maintain a 98% marker detection rate across various lighting conditions and marker configurations. These results showed that the proposed techniques can eliminate the dependence on external trackers by providing robust performance in any surgical setting. A phantom study on AR-guided needle insertion further validated the efficacy of the proposed system, achieving an accuracy of <inline-formula> <tex-math notation="LaTeX">$1.65~\pm ~0.16$ </tex-math></inline-formula> mm and <inline-formula> <tex-math notation="LaTeX">$2.69~\pm ~0.19^{\circ }$ </tex-math></inline-formula>. These results meet the precision requirements for clinical surgeries, highlighting the potential of the proposed AR system to improve surgical outcomes.https://ieeexplore.ieee.org/document/10979305/Augmented realitysurgical navigationautomatic exposure settinginside-out trackingdisplay calibration |
| spellingShingle | Nova Eka Diana Deukhee Lee Toward Robust AR Surgical Navigation: Eliminating External Trackers and Ensuring OST-HMD Alignment Under Various Operating Room Lighting Conditions IEEE Access Augmented reality surgical navigation automatic exposure setting inside-out tracking display calibration |
| title | Toward Robust AR Surgical Navigation: Eliminating External Trackers and Ensuring OST-HMD Alignment Under Various Operating Room Lighting Conditions |
| title_full | Toward Robust AR Surgical Navigation: Eliminating External Trackers and Ensuring OST-HMD Alignment Under Various Operating Room Lighting Conditions |
| title_fullStr | Toward Robust AR Surgical Navigation: Eliminating External Trackers and Ensuring OST-HMD Alignment Under Various Operating Room Lighting Conditions |
| title_full_unstemmed | Toward Robust AR Surgical Navigation: Eliminating External Trackers and Ensuring OST-HMD Alignment Under Various Operating Room Lighting Conditions |
| title_short | Toward Robust AR Surgical Navigation: Eliminating External Trackers and Ensuring OST-HMD Alignment Under Various Operating Room Lighting Conditions |
| title_sort | toward robust ar surgical navigation eliminating external trackers and ensuring ost hmd alignment under various operating room lighting conditions |
| topic | Augmented reality surgical navigation automatic exposure setting inside-out tracking display calibration |
| url | https://ieeexplore.ieee.org/document/10979305/ |
| work_keys_str_mv | AT novaekadiana towardrobustarsurgicalnavigationeliminatingexternaltrackersandensuringosthmdalignmentundervariousoperatingroomlightingconditions AT deukheelee towardrobustarsurgicalnavigationeliminatingexternaltrackersandensuringosthmdalignmentundervariousoperatingroomlightingconditions |