Evaluating different translation methods: a case study of Chinese graduate students in an MTI program

This paper compares three approaches to translation: (i) from-scratch human translation (HT), (ii) machine translation combined with post-editing (MTPE), both produced by two independent groups of translation students, and (iii) machine translation (MT), produced by Baidu Chinese-to-English Translat...

Full description

Saved in:
Bibliographic Details
Main Authors: Tingting Lei, Jeroen van de Weijer
Format: Article
Language:English
Published: Taylor & Francis Group 2025-12-01
Series:Cogent Arts & Humanities
Subjects:
Online Access:https://www.tandfonline.com/doi/10.1080/23311983.2025.2511386
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper compares three approaches to translation: (i) from-scratch human translation (HT), (ii) machine translation combined with post-editing (MTPE), both produced by two independent groups of translation students, and (iii) machine translation (MT), produced by Baidu Chinese-to-English Translation, employing various evaluation methods. A number of unsupervised automated models (BLEU, METEOR and ROUGE) were used to compare the quality of these three types of translation outputs. Complementary to this, a subjective evaluation method was applied to calculate the frequency of various translation errors in a semi-automatic way. It was found that the quality of the three types of texts assessed by these two methods displayed similar characteristics: In this test, both MT and MTPE significantly outperformed from-scratch human translation in terms of quality, while the differences between MT and MTPE were not significant. Lexical and grammatical mistakes accounted for the highest proportion of errors in the different translated texts and after data and textual analysis different PE styles were identified. The results have implications for translation training and the further development of MT research.
ISSN:2331-1983