Visual Impairment Spatial Awareness System for Indoor Navigation and Daily Activities

The integration of artificial intelligence into daily life significantly enhances the autonomy and quality of life of visually impaired individuals. This paper introduces the Visual Impairment Spatial Awareness (VISA) system, designed to holistically assist visually impaired users in indoor activiti...

Full description

Saved in:
Bibliographic Details
Main Authors: Xinrui Yu, Jafar Saniie
Format: Article
Language:English
Published: MDPI AG 2025-01-01
Series:Journal of Imaging
Subjects:
Online Access:https://www.mdpi.com/2313-433X/11/1/9
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832588274922684416
author Xinrui Yu
Jafar Saniie
author_facet Xinrui Yu
Jafar Saniie
author_sort Xinrui Yu
collection DOAJ
description The integration of artificial intelligence into daily life significantly enhances the autonomy and quality of life of visually impaired individuals. This paper introduces the Visual Impairment Spatial Awareness (VISA) system, designed to holistically assist visually impaired users in indoor activities through a structured, multi-level approach. At the foundational level, the system employs augmented reality (AR) markers for indoor positioning, neural networks for advanced object detection and tracking, and depth information for precise object localization. At the intermediate level, it integrates data from these technologies to aid in complex navigational tasks such as obstacle avoidance and pathfinding. The advanced level synthesizes these capabilities to enhance spatial awareness, enabling users to navigate complex environments and locate specific items. The VISA system exhibits an efficient human–machine interface (HMI), incorporating text-to-speech and speech-to-text technologies for natural and intuitive communication. Evaluations in simulated real-world environments demonstrate that the system allows users to interact naturally and with minimal effort. Our experimental results confirm that the VISA system efficiently assists visually impaired users in indoor navigation, object detection and localization, and label and text recognition, thereby significantly enhancing their spatial awareness and independence.
format Article
id doaj-art-5ad30bd382574dc5872041738130768e
institution Kabale University
issn 2313-433X
language English
publishDate 2025-01-01
publisher MDPI AG
record_format Article
series Journal of Imaging
spelling doaj-art-5ad30bd382574dc5872041738130768e2025-01-24T13:36:15ZengMDPI AGJournal of Imaging2313-433X2025-01-01111910.3390/jimaging11010009Visual Impairment Spatial Awareness System for Indoor Navigation and Daily ActivitiesXinrui Yu0Jafar Saniie1Department of Electrical and Computer Engineering, Illinois Institute of Technology, Chicago, IL 60616, USADepartment of Electrical and Computer Engineering, Illinois Institute of Technology, Chicago, IL 60616, USAThe integration of artificial intelligence into daily life significantly enhances the autonomy and quality of life of visually impaired individuals. This paper introduces the Visual Impairment Spatial Awareness (VISA) system, designed to holistically assist visually impaired users in indoor activities through a structured, multi-level approach. At the foundational level, the system employs augmented reality (AR) markers for indoor positioning, neural networks for advanced object detection and tracking, and depth information for precise object localization. At the intermediate level, it integrates data from these technologies to aid in complex navigational tasks such as obstacle avoidance and pathfinding. The advanced level synthesizes these capabilities to enhance spatial awareness, enabling users to navigate complex environments and locate specific items. The VISA system exhibits an efficient human–machine interface (HMI), incorporating text-to-speech and speech-to-text technologies for natural and intuitive communication. Evaluations in simulated real-world environments demonstrate that the system allows users to interact naturally and with minimal effort. Our experimental results confirm that the VISA system efficiently assists visually impaired users in indoor navigation, object detection and localization, and label and text recognition, thereby significantly enhancing their spatial awareness and independence.https://www.mdpi.com/2313-433X/11/1/9indoor positioningindoor navigationobject recognitionvisually impaired
spellingShingle Xinrui Yu
Jafar Saniie
Visual Impairment Spatial Awareness System for Indoor Navigation and Daily Activities
Journal of Imaging
indoor positioning
indoor navigation
object recognition
visually impaired
title Visual Impairment Spatial Awareness System for Indoor Navigation and Daily Activities
title_full Visual Impairment Spatial Awareness System for Indoor Navigation and Daily Activities
title_fullStr Visual Impairment Spatial Awareness System for Indoor Navigation and Daily Activities
title_full_unstemmed Visual Impairment Spatial Awareness System for Indoor Navigation and Daily Activities
title_short Visual Impairment Spatial Awareness System for Indoor Navigation and Daily Activities
title_sort visual impairment spatial awareness system for indoor navigation and daily activities
topic indoor positioning
indoor navigation
object recognition
visually impaired
url https://www.mdpi.com/2313-433X/11/1/9
work_keys_str_mv AT xinruiyu visualimpairmentspatialawarenesssystemforindoornavigationanddailyactivities
AT jafarsaniie visualimpairmentspatialawarenesssystemforindoornavigationanddailyactivities