LoVi App: Android Application-based Image Classification for Low Vision

In Indonesia, many people with visual impairments are drawing public attention to their rights as fellow humans. One of the limitations that individuals with low vision face is their ability to recognize objects and navigate their surroundings due to difficulties in visual perception. In this moder...

Full description

Saved in:
Bibliographic Details
Main Authors: Mitra Sofiyati, Fandi Azam Wiranata, Wervyan Shalannanda, Eueung Mulyana, Isa Anshori, Ardianto Satriawan
Format: Article
Language:English
Published: ITB Journal Publisher 2024-09-01
Series:Journal of ICT Research and Applications
Subjects:
Online Access:https://journals.itb.ac.id/index.php/jictra/article/view/22132
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In Indonesia, many people with visual impairments are drawing public attention to their rights as fellow humans. One of the limitations that individuals with low vision face is their ability to recognize objects and navigate their surroundings due to difficulties in visual perception. In this modern era, deep learning technologies, especially in image classification, can help people with low vision overcome these challenges. In this paper, we discuss a deep learning system that optimizes image classification on users' smartphones to enhance visual support for individuals with low vision. We present an Android-based app, LoVi, designed to assist users with low vision. Powered by core systems within Sherpa models (TrotoarNet, IndoorNet, and CurrencyNet), LoVi has three modes: outdoor, indoor, and currency. The LoVi application provides over 80% accuracy for navigation on sidewalks, indoor object recognition, and currency identification. TrotoarNet aids in sidewalk navigation, IndoorNet assists with indoor object identification, and CurrencyNet recognizes Rupiah banknotes. Additionally, low-vision users can receive voice feedback for further accessibility.
ISSN:2337-5787
2338-5499