The role of metrics to assess the quality of British teenage language translation into Spanish and Italian using machine translation tools
The rapid evolution of adolescence language, characterized by slang and idiomatic expressions, presents a significant challenge for machine translation systems. Existing research has extensively covered the translation of languages in general; however, there remains a gap in understanding these sys...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Universidade Federal de Santa Catarina
2025-05-01
|
| Series: | Cadernos de Tradução |
| Subjects: | |
| Online Access: | https://periodicos.ufsc.br/index.php/traducao/article/view/101329 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849311764949237760 |
|---|---|
| author | Andrés Canga Alonso Maria Cira Napoletano |
| author_facet | Andrés Canga Alonso Maria Cira Napoletano |
| author_sort | Andrés Canga Alonso |
| collection | DOAJ |
| description |
The rapid evolution of adolescence language, characterized by slang and idiomatic expressions, presents a significant challenge for machine translation systems. Existing research has extensively covered the translation of languages in general; however, there remains a gap in understanding these systems’ ability when faced with adolescent language. This study aims at (i) the evaluation and the comparison of the accuracy of the translations of colloquial language by Bing Translator, DeepL and HelsinkiNLP from English into Spanish and Italian, (ii) the validity and reliability of two different metrics (i.e., BLEU, METEOR) to assess the accuracy and quality of MT tools with informal language, and (iii) the analysis of how specific features of teenage slang influence the ability of online tools to generate precise and comprehensible translations 1000-character excerpts from the Linguistic Innovators Corpus were translated in Spanish and Italian using DeepL, Bing Translator, and HelsinkiNLP and assessed using BLEU and METEOR metrics to verify their quality and reliability. Our findings show that teenage slang poses challenges for all tools, particularly with phrasal verbs and idioms. Our results also reveal that METEOR seems to be more reliable to assess British teenage language into Spanish and Italian.
|
| format | Article |
| id | doaj-art-8583a2c2dc644d19a7c6e3597e644b6e |
| institution | Kabale University |
| issn | 2175-7968 |
| language | English |
| publishDate | 2025-05-01 |
| publisher | Universidade Federal de Santa Catarina |
| record_format | Article |
| series | Cadernos de Tradução |
| spelling | doaj-art-8583a2c2dc644d19a7c6e3597e644b6e2025-08-20T03:53:17ZengUniversidade Federal de Santa CatarinaCadernos de Tradução2175-79682025-05-014510.5007/2175-7968.2025.e101329The role of metrics to assess the quality of British teenage language translation into Spanish and Italian using machine translation tools Andrés Canga Alonso0https://orcid.org/0000-0002-1578-1626Maria Cira Napoletano1https://orcid.org/0009-0003-6644-8000University of La RiojaUniversity of La Rioja The rapid evolution of adolescence language, characterized by slang and idiomatic expressions, presents a significant challenge for machine translation systems. Existing research has extensively covered the translation of languages in general; however, there remains a gap in understanding these systems’ ability when faced with adolescent language. This study aims at (i) the evaluation and the comparison of the accuracy of the translations of colloquial language by Bing Translator, DeepL and HelsinkiNLP from English into Spanish and Italian, (ii) the validity and reliability of two different metrics (i.e., BLEU, METEOR) to assess the accuracy and quality of MT tools with informal language, and (iii) the analysis of how specific features of teenage slang influence the ability of online tools to generate precise and comprehensible translations 1000-character excerpts from the Linguistic Innovators Corpus were translated in Spanish and Italian using DeepL, Bing Translator, and HelsinkiNLP and assessed using BLEU and METEOR metrics to verify their quality and reliability. Our findings show that teenage slang poses challenges for all tools, particularly with phrasal verbs and idioms. Our results also reveal that METEOR seems to be more reliable to assess British teenage language into Spanish and Italian. https://periodicos.ufsc.br/index.php/traducao/article/view/101329machine translationteenage languagequality assessmentBLEUMETEOR |
| spellingShingle | Andrés Canga Alonso Maria Cira Napoletano The role of metrics to assess the quality of British teenage language translation into Spanish and Italian using machine translation tools Cadernos de Tradução machine translation teenage language quality assessment BLEU METEOR |
| title | The role of metrics to assess the quality of British teenage language translation into Spanish and Italian using machine translation tools |
| title_full | The role of metrics to assess the quality of British teenage language translation into Spanish and Italian using machine translation tools |
| title_fullStr | The role of metrics to assess the quality of British teenage language translation into Spanish and Italian using machine translation tools |
| title_full_unstemmed | The role of metrics to assess the quality of British teenage language translation into Spanish and Italian using machine translation tools |
| title_short | The role of metrics to assess the quality of British teenage language translation into Spanish and Italian using machine translation tools |
| title_sort | role of metrics to assess the quality of british teenage language translation into spanish and italian using machine translation tools |
| topic | machine translation teenage language quality assessment BLEU METEOR |
| url | https://periodicos.ufsc.br/index.php/traducao/article/view/101329 |
| work_keys_str_mv | AT andrescangaalonso theroleofmetricstoassessthequalityofbritishteenagelanguagetranslationintospanishanditalianusingmachinetranslationtools AT mariaciranapoletano theroleofmetricstoassessthequalityofbritishteenagelanguagetranslationintospanishanditalianusingmachinetranslationtools AT andrescangaalonso roleofmetricstoassessthequalityofbritishteenagelanguagetranslationintospanishanditalianusingmachinetranslationtools AT mariaciranapoletano roleofmetricstoassessthequalityofbritishteenagelanguagetranslationintospanishanditalianusingmachinetranslationtools |