The impact of visual information in speech perception for individuals with hearing loss: a mini review

This review examines how visual information enhances speech perception in individuals with hearing loss, focusing on the impact of age, linguistic stimuli, and specific hearing loss factors on the effectiveness of audiovisual (AV) integration. While existing studies offer varied and sometimes confli...

Full description

Saved in:
Bibliographic Details
Main Authors: Ahyeon Choi, Hayoon Kim, Mina Jo, Subeen Kim, Haesun Joung, Inyong Choi, Kyogu Lee
Format: Article
Language:English
Published: Frontiers Media S.A. 2024-09-01
Series:Frontiers in Psychology
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fpsyg.2024.1399084/full
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850265308195979264
author Ahyeon Choi
Hayoon Kim
Mina Jo
Subeen Kim
Haesun Joung
Inyong Choi
Inyong Choi
Kyogu Lee
Kyogu Lee
Kyogu Lee
author_facet Ahyeon Choi
Hayoon Kim
Mina Jo
Subeen Kim
Haesun Joung
Inyong Choi
Inyong Choi
Kyogu Lee
Kyogu Lee
Kyogu Lee
author_sort Ahyeon Choi
collection DOAJ
description This review examines how visual information enhances speech perception in individuals with hearing loss, focusing on the impact of age, linguistic stimuli, and specific hearing loss factors on the effectiveness of audiovisual (AV) integration. While existing studies offer varied and sometimes conflicting findings regarding the use of visual cues, our analysis shows that these key factors can distinctly shape AV speech perception outcomes. For instance, younger individuals and those who receive early intervention tend to benefit more from visual cues, particularly when linguistic complexity is lower. Additionally, languages with dense phoneme spaces demonstrate a higher dependency on visual information, underscoring the importance of tailoring rehabilitation strategies to specific linguistic contexts. By considering these influences, we highlight areas where understanding is still developing and suggest how personalized rehabilitation strategies and supportive systems could be tailored to better meet individual needs. Furthermore, this review brings attention to important aspects that warrant further investigation, aiming to refine theoretical models and contribute to more effective, customized approaches to hearing rehabilitation.
format Article
id doaj-art-da968b9c12f848a38f4e2642896e3d4c
institution OA Journals
issn 1664-1078
language English
publishDate 2024-09-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Psychology
spelling doaj-art-da968b9c12f848a38f4e2642896e3d4c2025-08-20T01:54:27ZengFrontiers Media S.A.Frontiers in Psychology1664-10782024-09-011510.3389/fpsyg.2024.13990841399084The impact of visual information in speech perception for individuals with hearing loss: a mini reviewAhyeon Choi0Hayoon Kim1Mina Jo2Subeen Kim3Haesun Joung4Inyong Choi5Inyong Choi6Kyogu Lee7Kyogu Lee8Kyogu Lee9Music and Audio Research Group, Department of Intelligence and Information, Seoul National University, Seoul, Republic of KoreaMusic and Audio Research Group, Department of Intelligence and Information, Seoul National University, Seoul, Republic of KoreaMusic and Audio Research Group, Department of Intelligence and Information, Seoul National University, Seoul, Republic of KoreaMusic and Audio Research Group, Department of Intelligence and Information, Seoul National University, Seoul, Republic of KoreaMusic and Audio Research Group, Department of Intelligence and Information, Seoul National University, Seoul, Republic of KoreaMusic and Audio Research Group, Department of Intelligence and Information, Seoul National University, Seoul, Republic of KoreaDepartment of Communication Sciences and Disorders, University of Iowa, Iowa City, IA, United StatesMusic and Audio Research Group, Department of Intelligence and Information, Seoul National University, Seoul, Republic of KoreaInterdisciplinary Program in Artificial Intelligence, Seoul National University, Seoul, Republic of KoreaArtificial Intelligence Institute, Seoul National University, Seoul, Republic of KoreaThis review examines how visual information enhances speech perception in individuals with hearing loss, focusing on the impact of age, linguistic stimuli, and specific hearing loss factors on the effectiveness of audiovisual (AV) integration. While existing studies offer varied and sometimes conflicting findings regarding the use of visual cues, our analysis shows that these key factors can distinctly shape AV speech perception outcomes. For instance, younger individuals and those who receive early intervention tend to benefit more from visual cues, particularly when linguistic complexity is lower. Additionally, languages with dense phoneme spaces demonstrate a higher dependency on visual information, underscoring the importance of tailoring rehabilitation strategies to specific linguistic contexts. By considering these influences, we highlight areas where understanding is still developing and suggest how personalized rehabilitation strategies and supportive systems could be tailored to better meet individual needs. Furthermore, this review brings attention to important aspects that warrant further investigation, aiming to refine theoretical models and contribute to more effective, customized approaches to hearing rehabilitation.https://www.frontiersin.org/articles/10.3389/fpsyg.2024.1399084/fullspeech perceptionhearing losscochlear implantvisual informationcross-modal plasticitymultisensory integration
spellingShingle Ahyeon Choi
Hayoon Kim
Mina Jo
Subeen Kim
Haesun Joung
Inyong Choi
Inyong Choi
Kyogu Lee
Kyogu Lee
Kyogu Lee
The impact of visual information in speech perception for individuals with hearing loss: a mini review
Frontiers in Psychology
speech perception
hearing loss
cochlear implant
visual information
cross-modal plasticity
multisensory integration
title The impact of visual information in speech perception for individuals with hearing loss: a mini review
title_full The impact of visual information in speech perception for individuals with hearing loss: a mini review
title_fullStr The impact of visual information in speech perception for individuals with hearing loss: a mini review
title_full_unstemmed The impact of visual information in speech perception for individuals with hearing loss: a mini review
title_short The impact of visual information in speech perception for individuals with hearing loss: a mini review
title_sort impact of visual information in speech perception for individuals with hearing loss a mini review
topic speech perception
hearing loss
cochlear implant
visual information
cross-modal plasticity
multisensory integration
url https://www.frontiersin.org/articles/10.3389/fpsyg.2024.1399084/full
work_keys_str_mv AT ahyeonchoi theimpactofvisualinformationinspeechperceptionforindividualswithhearinglossaminireview
AT hayoonkim theimpactofvisualinformationinspeechperceptionforindividualswithhearinglossaminireview
AT minajo theimpactofvisualinformationinspeechperceptionforindividualswithhearinglossaminireview
AT subeenkim theimpactofvisualinformationinspeechperceptionforindividualswithhearinglossaminireview
AT haesunjoung theimpactofvisualinformationinspeechperceptionforindividualswithhearinglossaminireview
AT inyongchoi theimpactofvisualinformationinspeechperceptionforindividualswithhearinglossaminireview
AT inyongchoi theimpactofvisualinformationinspeechperceptionforindividualswithhearinglossaminireview
AT kyogulee theimpactofvisualinformationinspeechperceptionforindividualswithhearinglossaminireview
AT kyogulee theimpactofvisualinformationinspeechperceptionforindividualswithhearinglossaminireview
AT kyogulee theimpactofvisualinformationinspeechperceptionforindividualswithhearinglossaminireview
AT ahyeonchoi impactofvisualinformationinspeechperceptionforindividualswithhearinglossaminireview
AT hayoonkim impactofvisualinformationinspeechperceptionforindividualswithhearinglossaminireview
AT minajo impactofvisualinformationinspeechperceptionforindividualswithhearinglossaminireview
AT subeenkim impactofvisualinformationinspeechperceptionforindividualswithhearinglossaminireview
AT haesunjoung impactofvisualinformationinspeechperceptionforindividualswithhearinglossaminireview
AT inyongchoi impactofvisualinformationinspeechperceptionforindividualswithhearinglossaminireview
AT inyongchoi impactofvisualinformationinspeechperceptionforindividualswithhearinglossaminireview
AT kyogulee impactofvisualinformationinspeechperceptionforindividualswithhearinglossaminireview
AT kyogulee impactofvisualinformationinspeechperceptionforindividualswithhearinglossaminireview
AT kyogulee impactofvisualinformationinspeechperceptionforindividualswithhearinglossaminireview