Fit for What Purpose? NER Certification of Automatic Captions in English and Spanish
As human and fully automatic live captioning methods coexist and compete against one another, quality analyses and certification become essential. A case in point is LiRICS, the Live Respeaking International Certification Standard created by the Galician Observatory for Media Accessibility (GALMA) t...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-01-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/15/3/1387 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850199340447956992 |
|---|---|
| author | Pablo Romero-Fresco Yanou Van Gauwbergen |
| author_facet | Pablo Romero-Fresco Yanou Van Gauwbergen |
| author_sort | Pablo Romero-Fresco |
| collection | DOAJ |
| description | As human and fully automatic live captioning methods coexist and compete against one another, quality analyses and certification become essential. A case in point is LiRICS, the Live Respeaking International Certification Standard created by the Galician Observatory for Media Accessibility (GALMA) to help maintain high international standards in the live captioning profession. Until now, this certification had only been used to assess human captioners. In this paper, it is applied for the first time to automatic captioning (more specifically to Lexi, the automatic software used by the leading captioning company AI-Media) in order to ascertain whether automatic captions have reached an accuracy level that can match that of human captions. After presenting the materials and the methods (NER model), the paper reports on the results of the analysis of Lexi’s English and Spanish automatic captions. With average accuracy rates of 98.56% in English and 98.26% in Spanish, these captions often manage to reach human levels of quality, except when applied to colloquial content featuring several speakers. A final discussion is devoted to a reflection on how automatic and human live captions can coexist as long as the different purposes they serve are considered, namely the access in bulk provided by automatic captions and the curated access offered by human captions. |
| format | Article |
| id | doaj-art-9eed5c64c1e44dba869f538ef86e7327 |
| institution | OA Journals |
| issn | 2076-3417 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj-art-9eed5c64c1e44dba869f538ef86e73272025-08-20T02:12:38ZengMDPI AGApplied Sciences2076-34172025-01-01153138710.3390/app15031387Fit for What Purpose? NER Certification of Automatic Captions in English and SpanishPablo Romero-Fresco0Yanou Van Gauwbergen1Facultade de Filoloxía e Tradución, Universidade de Vigo, 36310 Vigo, SpainDepartment of Translators and Interpreters, University of Antwerp, 2000 Antwerp, BelgiumAs human and fully automatic live captioning methods coexist and compete against one another, quality analyses and certification become essential. A case in point is LiRICS, the Live Respeaking International Certification Standard created by the Galician Observatory for Media Accessibility (GALMA) to help maintain high international standards in the live captioning profession. Until now, this certification had only been used to assess human captioners. In this paper, it is applied for the first time to automatic captioning (more specifically to Lexi, the automatic software used by the leading captioning company AI-Media) in order to ascertain whether automatic captions have reached an accuracy level that can match that of human captions. After presenting the materials and the methods (NER model), the paper reports on the results of the analysis of Lexi’s English and Spanish automatic captions. With average accuracy rates of 98.56% in English and 98.26% in Spanish, these captions often manage to reach human levels of quality, except when applied to colloquial content featuring several speakers. A final discussion is devoted to a reflection on how automatic and human live captions can coexist as long as the different purposes they serve are considered, namely the access in bulk provided by automatic captions and the curated access offered by human captions.https://www.mdpi.com/2076-3417/15/3/1387accuracyautomatic captionslive captioningNER modelqualityrespeaking |
| spellingShingle | Pablo Romero-Fresco Yanou Van Gauwbergen Fit for What Purpose? NER Certification of Automatic Captions in English and Spanish Applied Sciences accuracy automatic captions live captioning NER model quality respeaking |
| title | Fit for What Purpose? NER Certification of Automatic Captions in English and Spanish |
| title_full | Fit for What Purpose? NER Certification of Automatic Captions in English and Spanish |
| title_fullStr | Fit for What Purpose? NER Certification of Automatic Captions in English and Spanish |
| title_full_unstemmed | Fit for What Purpose? NER Certification of Automatic Captions in English and Spanish |
| title_short | Fit for What Purpose? NER Certification of Automatic Captions in English and Spanish |
| title_sort | fit for what purpose ner certification of automatic captions in english and spanish |
| topic | accuracy automatic captions live captioning NER model quality respeaking |
| url | https://www.mdpi.com/2076-3417/15/3/1387 |
| work_keys_str_mv | AT pabloromerofresco fitforwhatpurposenercertificationofautomaticcaptionsinenglishandspanish AT yanouvangauwbergen fitforwhatpurposenercertificationofautomaticcaptionsinenglishandspanish |