Mobile-AI-Based Docent System: Navigation and Localization for Visually Impaired Gallery Visitors
Smart guidance systems in museums and galleries are now essential for delivering quality user experiences. Visually impaired visitors face significant barriers when navigating galleries due to existing smart guidance systems’ dependence on visual cues like QR codes, manual numbering, or static beaco...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-05-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/15/9/5161 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850278555417575424 |
|---|---|
| author | Hyeyoung An Woojin Park Philip Liu Soochang Park |
| author_facet | Hyeyoung An Woojin Park Philip Liu Soochang Park |
| author_sort | Hyeyoung An |
| collection | DOAJ |
| description | Smart guidance systems in museums and galleries are now essential for delivering quality user experiences. Visually impaired visitors face significant barriers when navigating galleries due to existing smart guidance systems’ dependence on visual cues like QR codes, manual numbering, or static beacon positioning. These traditional methods often fail to provide adaptive navigation and meaningful content delivery tailored to their needs. In this paper, we propose a novel Mobile-AI-based Smart Docent System that seamlessly integrates real-time navigation and depth of guide services to enrich gallery experiences for visually impaired users. Our system leverages camera-based on-device processing and adaptive BLE-based localization to ensure accurate path guidance and real-time obstacle avoidance. An on-device object detection model reduces delays from large visual data processing, while BLE beacons, fixed across the gallery, dynamically update location IDs for better accuracy. The system further refines positioning by analyzing movement history and direction to minimize navigation errors. By intelligently modulating audio content based on user movement—whether passing by, approaching for more details, or leaving mid-description—the system offers personalized, context-sensitive interpretations while eliminating unnecessary audio clutter. Experimental validation conducted in an authentic gallery environment yielded empirical evidence of user satisfaction, affirming the efficacy of our methodological approach in facilitating enhanced navigational experiences for visually impaired individuals. These findings substantiate the system’s capacity to enable more autonomous, secure, and enriched cultural engagement for visually impaired individuals within complex indoor environments. |
| format | Article |
| id | doaj-art-3c8f726f8f854ce584ee2f372ac41c07 |
| institution | OA Journals |
| issn | 2076-3417 |
| language | English |
| publishDate | 2025-05-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj-art-3c8f726f8f854ce584ee2f372ac41c072025-08-20T01:49:27ZengMDPI AGApplied Sciences2076-34172025-05-01159516110.3390/app15095161Mobile-AI-Based Docent System: Navigation and Localization for Visually Impaired Gallery VisitorsHyeyoung An0Woojin Park1Philip Liu2Soochang Park3Electronics and Telecommunications Research Institute (ETRI), Daejeon 34129, Republic of KoreaDepartment of Computer Engineering, Chungbuk National University, Cheongju 28644, Republic of KoreaGraduate School of Culture Technology, Korea Advanced Institute of Science and Technology, Daejeon 34141, Republic of KoreaDepartment of Computer Engineering, Chungbuk National University, Cheongju 28644, Republic of KoreaSmart guidance systems in museums and galleries are now essential for delivering quality user experiences. Visually impaired visitors face significant barriers when navigating galleries due to existing smart guidance systems’ dependence on visual cues like QR codes, manual numbering, or static beacon positioning. These traditional methods often fail to provide adaptive navigation and meaningful content delivery tailored to their needs. In this paper, we propose a novel Mobile-AI-based Smart Docent System that seamlessly integrates real-time navigation and depth of guide services to enrich gallery experiences for visually impaired users. Our system leverages camera-based on-device processing and adaptive BLE-based localization to ensure accurate path guidance and real-time obstacle avoidance. An on-device object detection model reduces delays from large visual data processing, while BLE beacons, fixed across the gallery, dynamically update location IDs for better accuracy. The system further refines positioning by analyzing movement history and direction to minimize navigation errors. By intelligently modulating audio content based on user movement—whether passing by, approaching for more details, or leaving mid-description—the system offers personalized, context-sensitive interpretations while eliminating unnecessary audio clutter. Experimental validation conducted in an authentic gallery environment yielded empirical evidence of user satisfaction, affirming the efficacy of our methodological approach in facilitating enhanced navigational experiences for visually impaired individuals. These findings substantiate the system’s capacity to enable more autonomous, secure, and enriched cultural engagement for visually impaired individuals within complex indoor environments.https://www.mdpi.com/2076-3417/15/9/5161AI-aided systemindoor navigationgallery experiencesmart docent system |
| spellingShingle | Hyeyoung An Woojin Park Philip Liu Soochang Park Mobile-AI-Based Docent System: Navigation and Localization for Visually Impaired Gallery Visitors Applied Sciences AI-aided system indoor navigation gallery experience smart docent system |
| title | Mobile-AI-Based Docent System: Navigation and Localization for Visually Impaired Gallery Visitors |
| title_full | Mobile-AI-Based Docent System: Navigation and Localization for Visually Impaired Gallery Visitors |
| title_fullStr | Mobile-AI-Based Docent System: Navigation and Localization for Visually Impaired Gallery Visitors |
| title_full_unstemmed | Mobile-AI-Based Docent System: Navigation and Localization for Visually Impaired Gallery Visitors |
| title_short | Mobile-AI-Based Docent System: Navigation and Localization for Visually Impaired Gallery Visitors |
| title_sort | mobile ai based docent system navigation and localization for visually impaired gallery visitors |
| topic | AI-aided system indoor navigation gallery experience smart docent system |
| url | https://www.mdpi.com/2076-3417/15/9/5161 |
| work_keys_str_mv | AT hyeyoungan mobileaibaseddocentsystemnavigationandlocalizationforvisuallyimpairedgalleryvisitors AT woojinpark mobileaibaseddocentsystemnavigationandlocalizationforvisuallyimpairedgalleryvisitors AT philipliu mobileaibaseddocentsystemnavigationandlocalizationforvisuallyimpairedgalleryvisitors AT soochangpark mobileaibaseddocentsystemnavigationandlocalizationforvisuallyimpairedgalleryvisitors |