The impact of monolingual and bilingual subtitles on visual attention, cognitive load, and comprehension
With the proliferation and global dissemination of audiovisual products, subtitles have been widely used as a cost-effective tool to minimise language barriers for audiences of diverse cultural and linguistic backgrounds. However, the effectiveness of subtitles is still a topic of much debate and s...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | deu |
| Published: |
ZHAW
2020-01-01
|
| Series: | JoSTrans: The Journal of Specialised Translation |
| Subjects: | |
| Online Access: | https://www.jostrans.org/article/view/8244 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849683452991897600 |
|---|---|
| author | Sixin Liao Jan-Louis Kruger Stephen Doherty |
| author_facet | Sixin Liao Jan-Louis Kruger Stephen Doherty |
| author_sort | Sixin Liao |
| collection | DOAJ |
| description |
With the proliferation and global dissemination of audiovisual products, subtitles have been widely used as a cost-effective tool to minimise language barriers for audiences of diverse cultural and linguistic backgrounds. However, the effectiveness of subtitles is still a topic of much debate and subject to various conditions, such as the context of use, the subtitle type, and the relationship between the language of the soundtrack and that of the subtitles. Drawing on an analysis of eye movements and a self-reported questionnaire, this study compares the impact of bilingual subtitles to that of monolingual subtitles in terms of viewers’ visual attention distribution, cognitive load, and overall comprehension of video content. Twenty Chinese (L1) native speakers watched four videos with English (L2) audio, each in a different condition: with Chinese subtitles (interlingual/L1 subtitles), with English subtitles (intralingual/L2 subtitles), with both Chinese and English subtitles (bilingual subtitles), and without subtitles. Our results indicate that viewers’ visual attention allocation to L1 subtitles was more stable than to L2 subtitles and less sensitive to the increased visual competition in the bilingual condition, which, we argue, can be attributed to the language dominance of their native language. Bilingual subtitles as a combination of intralingual and interlingual subtitles did not appear to induce more cognitive load or produce more cognitive gain than monolingual subtitles. Compared with the no subtitles condition, however, we found bilingual subtitles to be more beneficial as they provided linguistic support to make the video easier to comprehend and facilitate the learning process.
|
| format | Article |
| id | doaj-art-39feba8ee92c4ea198bf961fcd7f2d62 |
| institution | DOAJ |
| issn | 1740-357X |
| language | deu |
| publishDate | 2020-01-01 |
| publisher | ZHAW |
| record_format | Article |
| series | JoSTrans: The Journal of Specialised Translation |
| spelling | doaj-art-39feba8ee92c4ea198bf961fcd7f2d622025-08-20T03:23:52ZdeuZHAWJoSTrans: The Journal of Specialised Translation1740-357X2020-01-013310.26034/cm.jostrans.2020.549The impact of monolingual and bilingual subtitles on visual attention, cognitive load, and comprehensionSixin LiaoJan-Louis KrugerStephen Doherty With the proliferation and global dissemination of audiovisual products, subtitles have been widely used as a cost-effective tool to minimise language barriers for audiences of diverse cultural and linguistic backgrounds. However, the effectiveness of subtitles is still a topic of much debate and subject to various conditions, such as the context of use, the subtitle type, and the relationship between the language of the soundtrack and that of the subtitles. Drawing on an analysis of eye movements and a self-reported questionnaire, this study compares the impact of bilingual subtitles to that of monolingual subtitles in terms of viewers’ visual attention distribution, cognitive load, and overall comprehension of video content. Twenty Chinese (L1) native speakers watched four videos with English (L2) audio, each in a different condition: with Chinese subtitles (interlingual/L1 subtitles), with English subtitles (intralingual/L2 subtitles), with both Chinese and English subtitles (bilingual subtitles), and without subtitles. Our results indicate that viewers’ visual attention allocation to L1 subtitles was more stable than to L2 subtitles and less sensitive to the increased visual competition in the bilingual condition, which, we argue, can be attributed to the language dominance of their native language. Bilingual subtitles as a combination of intralingual and interlingual subtitles did not appear to induce more cognitive load or produce more cognitive gain than monolingual subtitles. Compared with the no subtitles condition, however, we found bilingual subtitles to be more beneficial as they provided linguistic support to make the video easier to comprehend and facilitate the learning process. https://www.jostrans.org/article/view/8244Bilingual subtitlesvisual attention distributioncognitive loadeye trackingsubtitle mode |
| spellingShingle | Sixin Liao Jan-Louis Kruger Stephen Doherty The impact of monolingual and bilingual subtitles on visual attention, cognitive load, and comprehension JoSTrans: The Journal of Specialised Translation Bilingual subtitles visual attention distribution cognitive load eye tracking subtitle mode |
| title | The impact of monolingual and bilingual subtitles on visual attention, cognitive load, and comprehension |
| title_full | The impact of monolingual and bilingual subtitles on visual attention, cognitive load, and comprehension |
| title_fullStr | The impact of monolingual and bilingual subtitles on visual attention, cognitive load, and comprehension |
| title_full_unstemmed | The impact of monolingual and bilingual subtitles on visual attention, cognitive load, and comprehension |
| title_short | The impact of monolingual and bilingual subtitles on visual attention, cognitive load, and comprehension |
| title_sort | impact of monolingual and bilingual subtitles on visual attention cognitive load and comprehension |
| topic | Bilingual subtitles visual attention distribution cognitive load eye tracking subtitle mode |
| url | https://www.jostrans.org/article/view/8244 |
| work_keys_str_mv | AT sixinliao theimpactofmonolingualandbilingualsubtitlesonvisualattentioncognitiveloadandcomprehension AT janlouiskruger theimpactofmonolingualandbilingualsubtitlesonvisualattentioncognitiveloadandcomprehension AT stephendoherty theimpactofmonolingualandbilingualsubtitlesonvisualattentioncognitiveloadandcomprehension AT sixinliao impactofmonolingualandbilingualsubtitlesonvisualattentioncognitiveloadandcomprehension AT janlouiskruger impactofmonolingualandbilingualsubtitlesonvisualattentioncognitiveloadandcomprehension AT stephendoherty impactofmonolingualandbilingualsubtitlesonvisualattentioncognitiveloadandcomprehension |