Effects of multisensory simultaneity judgment training on the comprehension and cortical processing of speech in noise: a randomized controlled trial
Abstract Understanding speech in noise can be facilitated by integrating auditory and visual speech cues. Audiovisual temporal acuity, which can be indexed by the temporal binding window (TBW), is critical for this process and can be enhanced through simultaneity judgment training. We hypothesized t...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2025-04-01
|
| Series: | Scientific Reports |
| Subjects: | |
| Online Access: | https://doi.org/10.1038/s41598-025-96121-4 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850146320121069568 |
|---|---|
| author | Ansley J. Kunnath Hannah S. Bertisch Andrew S. Kim René H. Gifford Mark T. Wallace |
| author_facet | Ansley J. Kunnath Hannah S. Bertisch Andrew S. Kim René H. Gifford Mark T. Wallace |
| author_sort | Ansley J. Kunnath |
| collection | DOAJ |
| description | Abstract Understanding speech in noise can be facilitated by integrating auditory and visual speech cues. Audiovisual temporal acuity, which can be indexed by the temporal binding window (TBW), is critical for this process and can be enhanced through simultaneity judgment training. We hypothesized that multisensory training would narrow the TBW and improve speech understanding in noise. Participants were randomized to receive either training and testing (n = 15) or testing-only (n = 15) over three days. Trained participants demonstrated significant narrowing in their mean TBW size (403ms to 345ms; p = 0.030), whereas control participants did not (409ms to 474ms; p = 0.061). Although there were no group-level changes in word recognition scores, trained participants with larger TBW decreases exhibited larger improvements in auditory word recognition in noise (R2 = 0.291; p = 0.038). Individual differences in responses to training were found to be related to differences in cortical speech processing using functional near-infrared spectroscopy. Low audiovisual-evoked activity in the left middle temporal gyrus (R2 = 0.87; p = 0.006), left angular and superior temporal gyrus (R2 = 0.85; p = 0.006), and visual cortices (R2 = 0.74; p = 0.041) was associated with larger improvements in auditory word recognition after training. Multisensory training transfers benefits to speech comprehension in noise, and this effect may be mediated by upregulating activity in multisensory cortical networks for individuals with low baseline activity. |
| format | Article |
| id | doaj-art-bf23e7b62da6492297d7f70d1bf5af33 |
| institution | OA Journals |
| issn | 2045-2322 |
| language | English |
| publishDate | 2025-04-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Scientific Reports |
| spelling | doaj-art-bf23e7b62da6492297d7f70d1bf5af332025-08-20T02:27:53ZengNature PortfolioScientific Reports2045-23222025-04-0115111210.1038/s41598-025-96121-4Effects of multisensory simultaneity judgment training on the comprehension and cortical processing of speech in noise: a randomized controlled trialAnsley J. Kunnath0Hannah S. Bertisch1Andrew S. Kim2René H. Gifford3Mark T. Wallace4Vanderbilt University School of MedicineVanderbilt UniversityVanderbilt UniversityVanderbilt Brain InstituteVanderbilt Brain InstituteAbstract Understanding speech in noise can be facilitated by integrating auditory and visual speech cues. Audiovisual temporal acuity, which can be indexed by the temporal binding window (TBW), is critical for this process and can be enhanced through simultaneity judgment training. We hypothesized that multisensory training would narrow the TBW and improve speech understanding in noise. Participants were randomized to receive either training and testing (n = 15) or testing-only (n = 15) over three days. Trained participants demonstrated significant narrowing in their mean TBW size (403ms to 345ms; p = 0.030), whereas control participants did not (409ms to 474ms; p = 0.061). Although there were no group-level changes in word recognition scores, trained participants with larger TBW decreases exhibited larger improvements in auditory word recognition in noise (R2 = 0.291; p = 0.038). Individual differences in responses to training were found to be related to differences in cortical speech processing using functional near-infrared spectroscopy. Low audiovisual-evoked activity in the left middle temporal gyrus (R2 = 0.87; p = 0.006), left angular and superior temporal gyrus (R2 = 0.85; p = 0.006), and visual cortices (R2 = 0.74; p = 0.041) was associated with larger improvements in auditory word recognition after training. Multisensory training transfers benefits to speech comprehension in noise, and this effect may be mediated by upregulating activity in multisensory cortical networks for individuals with low baseline activity.https://doi.org/10.1038/s41598-025-96121-4Multisensory integrationAudiovisual trainingSimultaneity judgmentSpeech in noisePerceptual plasticityfNIRS |
| spellingShingle | Ansley J. Kunnath Hannah S. Bertisch Andrew S. Kim René H. Gifford Mark T. Wallace Effects of multisensory simultaneity judgment training on the comprehension and cortical processing of speech in noise: a randomized controlled trial Scientific Reports Multisensory integration Audiovisual training Simultaneity judgment Speech in noise Perceptual plasticity fNIRS |
| title | Effects of multisensory simultaneity judgment training on the comprehension and cortical processing of speech in noise: a randomized controlled trial |
| title_full | Effects of multisensory simultaneity judgment training on the comprehension and cortical processing of speech in noise: a randomized controlled trial |
| title_fullStr | Effects of multisensory simultaneity judgment training on the comprehension and cortical processing of speech in noise: a randomized controlled trial |
| title_full_unstemmed | Effects of multisensory simultaneity judgment training on the comprehension and cortical processing of speech in noise: a randomized controlled trial |
| title_short | Effects of multisensory simultaneity judgment training on the comprehension and cortical processing of speech in noise: a randomized controlled trial |
| title_sort | effects of multisensory simultaneity judgment training on the comprehension and cortical processing of speech in noise a randomized controlled trial |
| topic | Multisensory integration Audiovisual training Simultaneity judgment Speech in noise Perceptual plasticity fNIRS |
| url | https://doi.org/10.1038/s41598-025-96121-4 |
| work_keys_str_mv | AT ansleyjkunnath effectsofmultisensorysimultaneityjudgmenttrainingonthecomprehensionandcorticalprocessingofspeechinnoisearandomizedcontrolledtrial AT hannahsbertisch effectsofmultisensorysimultaneityjudgmenttrainingonthecomprehensionandcorticalprocessingofspeechinnoisearandomizedcontrolledtrial AT andrewskim effectsofmultisensorysimultaneityjudgmenttrainingonthecomprehensionandcorticalprocessingofspeechinnoisearandomizedcontrolledtrial AT renehgifford effectsofmultisensorysimultaneityjudgmenttrainingonthecomprehensionandcorticalprocessingofspeechinnoisearandomizedcontrolledtrial AT marktwallace effectsofmultisensorysimultaneityjudgmenttrainingonthecomprehensionandcorticalprocessingofspeechinnoisearandomizedcontrolledtrial |