Design and Implementation of an EMG-Based Communication Interface for Enhancing Interaction with Deaf Individuals

This paper presents the development of an Electromyography (EMG)-based communication interface aimed at improving interactions with deaf and hard of hearing people. Traditional communication methods often fall short in providing efficient and seamless interaction with the deaf community. To address...

Full description

Saved in:
Bibliographic Details
Main Authors: Oussama EL GHOUL, Amina BEN HAJ AMOR, Mohamed JEMNI
Format: Article
Language:English
Published: Ecole des Sciences de l'Information 2024-12-01
Series:Journal of Information Sciences
Online Access:https://revues.imist.ma/index.php/JIS/article/view/51444
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850051556215357440
author Oussama EL GHOUL
Amina BEN HAJ AMOR
Mohamed JEMNI
author_facet Oussama EL GHOUL
Amina BEN HAJ AMOR
Mohamed JEMNI
author_sort Oussama EL GHOUL
collection DOAJ
description This paper presents the development of an Electromyography (EMG)-based communication interface aimed at improving interactions with deaf and hard of hearing people. Traditional communication methods often fall short in providing efficient and seamless interaction with the deaf community. To address this, our interface utilizes EMG technology to interpret muscle movements and facial expressions, translating them into text and speech in real-time. The core of this system lies in its advanced EMG sensors coupled with a robust machine learning algorithm, which is trained on a dataset of EMG signals corresponding to specific domains. This allows the system to accurately interpret subtle muscle movements and convert them into corresponding textual and auditory outputs. The interface also integrates a feedback loop, where the user receives visual or tactile feedback, ensuring communication accuracy. Our system is designed to be non-invasive and user-friendly, making it accessible to a broad range of users within the deaf community. Preliminary tests have shown promising results in terms of accuracy and ease of use, indicating that this EMG-based interface could be a significant step forward in bridging the communication gap experienced by deaf individuals. Future work will focus on enhancing the system's portability and expanding its vocabulary and expression recognition capabilities to include a broader range of languages and dialects. This paper details the design considerations, development process, and initial testing phases of the EMG-based communication interface, providing insights into its potential impact on enhancing day-to-day interactions for the deaf community. Keywords: Sign language recognition, electromyography, Arabic sign language, Dynamic gestures recognition
format Article
id doaj-art-93a2979c56f142a185e0cbcbb574ce1c
institution DOAJ
issn 1113-4844
2820-6894
language English
publishDate 2024-12-01
publisher Ecole des Sciences de l'Information
record_format Article
series Journal of Information Sciences
spelling doaj-art-93a2979c56f142a185e0cbcbb574ce1c2025-08-20T02:53:06ZengEcole des Sciences de l'InformationJournal of Information Sciences1113-48442820-68942024-12-01232Design and Implementation of an EMG-Based Communication Interface for Enhancing Interaction with Deaf IndividualsOussama EL GHOUL0Amina BEN HAJ AMOR1Mohamed JEMNI2Research Laboratory LaTICE, University of Tunis, Tunis 1008, TunisiaResearch Laboratory LaTICE, University of Tunis, Tunis 1008, Tunisia Research Laboratory LaTICE, University of Tunis, Tunis 1008, Tunisia This paper presents the development of an Electromyography (EMG)-based communication interface aimed at improving interactions with deaf and hard of hearing people. Traditional communication methods often fall short in providing efficient and seamless interaction with the deaf community. To address this, our interface utilizes EMG technology to interpret muscle movements and facial expressions, translating them into text and speech in real-time. The core of this system lies in its advanced EMG sensors coupled with a robust machine learning algorithm, which is trained on a dataset of EMG signals corresponding to specific domains. This allows the system to accurately interpret subtle muscle movements and convert them into corresponding textual and auditory outputs. The interface also integrates a feedback loop, where the user receives visual or tactile feedback, ensuring communication accuracy. Our system is designed to be non-invasive and user-friendly, making it accessible to a broad range of users within the deaf community. Preliminary tests have shown promising results in terms of accuracy and ease of use, indicating that this EMG-based interface could be a significant step forward in bridging the communication gap experienced by deaf individuals. Future work will focus on enhancing the system's portability and expanding its vocabulary and expression recognition capabilities to include a broader range of languages and dialects. This paper details the design considerations, development process, and initial testing phases of the EMG-based communication interface, providing insights into its potential impact on enhancing day-to-day interactions for the deaf community. Keywords: Sign language recognition, electromyography, Arabic sign language, Dynamic gestures recognition https://revues.imist.ma/index.php/JIS/article/view/51444
spellingShingle Oussama EL GHOUL
Amina BEN HAJ AMOR
Mohamed JEMNI
Design and Implementation of an EMG-Based Communication Interface for Enhancing Interaction with Deaf Individuals
Journal of Information Sciences
title Design and Implementation of an EMG-Based Communication Interface for Enhancing Interaction with Deaf Individuals
title_full Design and Implementation of an EMG-Based Communication Interface for Enhancing Interaction with Deaf Individuals
title_fullStr Design and Implementation of an EMG-Based Communication Interface for Enhancing Interaction with Deaf Individuals
title_full_unstemmed Design and Implementation of an EMG-Based Communication Interface for Enhancing Interaction with Deaf Individuals
title_short Design and Implementation of an EMG-Based Communication Interface for Enhancing Interaction with Deaf Individuals
title_sort design and implementation of an emg based communication interface for enhancing interaction with deaf individuals
url https://revues.imist.ma/index.php/JIS/article/view/51444
work_keys_str_mv AT oussamaelghoul designandimplementationofanemgbasedcommunicationinterfaceforenhancinginteractionwithdeafindividuals
AT aminabenhajamor designandimplementationofanemgbasedcommunicationinterfaceforenhancinginteractionwithdeafindividuals
AT mohamedjemni designandimplementationofanemgbasedcommunicationinterfaceforenhancinginteractionwithdeafindividuals