A real-time environmental translator for emotion recognition in autism spectrum disorder

Abstract Autism spectrum disorder (ASD) involves challenges in communication and social interaction, including challenges in recognizing emotions. Existing technological solutions aim to improve social behaviors in individuals with ASD by providing learning aids. This paper presents a real-time envi...

Full description

Saved in:
Bibliographic Details
Main Authors: Lital Levy, Asmare Ambaw, Esther Ben-Itzchak, Eldad Holdengreber
Format: Article
Language:English
Published: Nature Portfolio 2024-12-01
Series:Scientific Reports
Online Access:https://doi.org/10.1038/s41598-024-83229-2
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1846101267008454656
author Lital Levy
Asmare Ambaw
Esther Ben-Itzchak
Eldad Holdengreber
author_facet Lital Levy
Asmare Ambaw
Esther Ben-Itzchak
Eldad Holdengreber
author_sort Lital Levy
collection DOAJ
description Abstract Autism spectrum disorder (ASD) involves challenges in communication and social interaction, including challenges in recognizing emotions. Existing technological solutions aim to improve social behaviors in individuals with ASD by providing learning aids. This paper presents a real-time environmental translator designed to enhance social behaviors in individuals with ASD using sensory substitution. Our system utilizes vibrotactile and visual feedback to interpret and convey emotional states through vibration patterns emitted from small vibration motors on the user’s temple, complemented by color-coded displays of emotional intensity. It can detect seven emotions: neutral, sad, happy, angry, disgust, surprise, and fear. Testing with adults with ASD showed they could adapt to the system in about 19 min, enabling them to intuitively and immediately recognize others’ emotions. This innovative approach presents a promising advancement in emotion recognition technology for individuals with ASD, offering potential benefits in enhancing their social interactions and communication skills.
format Article
id doaj-art-62e233c7f5be4168876241c8ac6b4188
institution Kabale University
issn 2045-2322
language English
publishDate 2024-12-01
publisher Nature Portfolio
record_format Article
series Scientific Reports
spelling doaj-art-62e233c7f5be4168876241c8ac6b41882024-12-29T12:18:16ZengNature PortfolioScientific Reports2045-23222024-12-0114111010.1038/s41598-024-83229-2A real-time environmental translator for emotion recognition in autism spectrum disorderLital Levy0Asmare Ambaw1Esther Ben-Itzchak2Eldad Holdengreber3The Department of Mechanical Engineering and Mechatronics, Ariel UniversityThe Department of Mechanical Engineering and Mechatronics, Ariel UniversityThe Department of Communication Disorders, Ariel UniversityThe Department of Mechanical Engineering and Mechatronics, Ariel UniversityAbstract Autism spectrum disorder (ASD) involves challenges in communication and social interaction, including challenges in recognizing emotions. Existing technological solutions aim to improve social behaviors in individuals with ASD by providing learning aids. This paper presents a real-time environmental translator designed to enhance social behaviors in individuals with ASD using sensory substitution. Our system utilizes vibrotactile and visual feedback to interpret and convey emotional states through vibration patterns emitted from small vibration motors on the user’s temple, complemented by color-coded displays of emotional intensity. It can detect seven emotions: neutral, sad, happy, angry, disgust, surprise, and fear. Testing with adults with ASD showed they could adapt to the system in about 19 min, enabling them to intuitively and immediately recognize others’ emotions. This innovative approach presents a promising advancement in emotion recognition technology for individuals with ASD, offering potential benefits in enhancing their social interactions and communication skills.https://doi.org/10.1038/s41598-024-83229-2
spellingShingle Lital Levy
Asmare Ambaw
Esther Ben-Itzchak
Eldad Holdengreber
A real-time environmental translator for emotion recognition in autism spectrum disorder
Scientific Reports
title A real-time environmental translator for emotion recognition in autism spectrum disorder
title_full A real-time environmental translator for emotion recognition in autism spectrum disorder
title_fullStr A real-time environmental translator for emotion recognition in autism spectrum disorder
title_full_unstemmed A real-time environmental translator for emotion recognition in autism spectrum disorder
title_short A real-time environmental translator for emotion recognition in autism spectrum disorder
title_sort real time environmental translator for emotion recognition in autism spectrum disorder
url https://doi.org/10.1038/s41598-024-83229-2
work_keys_str_mv AT litallevy arealtimeenvironmentaltranslatorforemotionrecognitioninautismspectrumdisorder
AT asmareambaw arealtimeenvironmentaltranslatorforemotionrecognitioninautismspectrumdisorder
AT estherbenitzchak arealtimeenvironmentaltranslatorforemotionrecognitioninautismspectrumdisorder
AT eldadholdengreber arealtimeenvironmentaltranslatorforemotionrecognitioninautismspectrumdisorder
AT litallevy realtimeenvironmentaltranslatorforemotionrecognitioninautismspectrumdisorder
AT asmareambaw realtimeenvironmentaltranslatorforemotionrecognitioninautismspectrumdisorder
AT estherbenitzchak realtimeenvironmentaltranslatorforemotionrecognitioninautismspectrumdisorder
AT eldadholdengreber realtimeenvironmentaltranslatorforemotionrecognitioninautismspectrumdisorder