Speech cues contribute to audiovisual spatial integration.

Speech is the most important form of human communication but ambient sounds and competing talkers often degrade its acoustics. Fortunately the brain can use visual information, especially its highly precise spatial information, to improve speech comprehension in noisy environments. Previous studies...

Full description

Saved in:
Bibliographic Details
Main Authors: Christopher W Bishop, Lee M Miller
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2011-01-01
Series:PLoS ONE
Online Access:https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0024016&type=printable
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849727558283689984
author Christopher W Bishop
Lee M Miller
author_facet Christopher W Bishop
Lee M Miller
author_sort Christopher W Bishop
collection DOAJ
description Speech is the most important form of human communication but ambient sounds and competing talkers often degrade its acoustics. Fortunately the brain can use visual information, especially its highly precise spatial information, to improve speech comprehension in noisy environments. Previous studies have demonstrated that audiovisual integration depends strongly on spatiotemporal factors. However, some integrative phenomena such as McGurk interference persist even with gross spatial disparities, suggesting that spatial alignment is not necessary for robust integration of audiovisual place-of-articulation cues. It is therefore unclear how speech-cues interact with audiovisual spatial integration mechanisms. Here, we combine two well established psychophysical phenomena, the McGurk effect and the ventriloquist's illusion, to explore this dependency. Our results demonstrate that conflicting spatial cues may not interfere with audiovisual integration of speech, but conflicting speech-cues can impede integration in space. This suggests a direct but asymmetrical influence between ventral 'what' and dorsal 'where' pathways.
format Article
id doaj-art-ceeb7aeb81fc41c880f3bf7eabe44e6b
institution DOAJ
issn 1932-6203
language English
publishDate 2011-01-01
publisher Public Library of Science (PLoS)
record_format Article
series PLoS ONE
spelling doaj-art-ceeb7aeb81fc41c880f3bf7eabe44e6b2025-08-20T03:09:48ZengPublic Library of Science (PLoS)PLoS ONE1932-62032011-01-0168e2401610.1371/journal.pone.0024016Speech cues contribute to audiovisual spatial integration.Christopher W BishopLee M MillerSpeech is the most important form of human communication but ambient sounds and competing talkers often degrade its acoustics. Fortunately the brain can use visual information, especially its highly precise spatial information, to improve speech comprehension in noisy environments. Previous studies have demonstrated that audiovisual integration depends strongly on spatiotemporal factors. However, some integrative phenomena such as McGurk interference persist even with gross spatial disparities, suggesting that spatial alignment is not necessary for robust integration of audiovisual place-of-articulation cues. It is therefore unclear how speech-cues interact with audiovisual spatial integration mechanisms. Here, we combine two well established psychophysical phenomena, the McGurk effect and the ventriloquist's illusion, to explore this dependency. Our results demonstrate that conflicting spatial cues may not interfere with audiovisual integration of speech, but conflicting speech-cues can impede integration in space. This suggests a direct but asymmetrical influence between ventral 'what' and dorsal 'where' pathways.https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0024016&type=printable
spellingShingle Christopher W Bishop
Lee M Miller
Speech cues contribute to audiovisual spatial integration.
PLoS ONE
title Speech cues contribute to audiovisual spatial integration.
title_full Speech cues contribute to audiovisual spatial integration.
title_fullStr Speech cues contribute to audiovisual spatial integration.
title_full_unstemmed Speech cues contribute to audiovisual spatial integration.
title_short Speech cues contribute to audiovisual spatial integration.
title_sort speech cues contribute to audiovisual spatial integration
url https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0024016&type=printable
work_keys_str_mv AT christopherwbishop speechcuescontributetoaudiovisualspatialintegration
AT leemmiller speechcuescontributetoaudiovisualspatialintegration