Exploring the Efficacy of ChatGPT-Based Feedback Compared With Teacher Feedback and Self-Feedback: Evidence From Chinese-English Translation

ChatGPT, a cutting-edge AI-powered Chatbot, can quickly generate responses to given commands. While ChatGPT was reported to have the capacity to deliver useful feedback, it is still unclear about its effectiveness compared with conventional feedback approaches, such as self-feedback (SF) and teacher...

Full description

Saved in:
Bibliographic Details
Main Authors: Siyi Cao, Tongquan Zhou
Format: Article
Language:English
Published: SAGE Publishing 2025-08-01
Series:SAGE Open
Online Access:https://doi.org/10.1177/21582440251369204
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849223989249966080
author Siyi Cao
Tongquan Zhou
author_facet Siyi Cao
Tongquan Zhou
author_sort Siyi Cao
collection DOAJ
description ChatGPT, a cutting-edge AI-powered Chatbot, can quickly generate responses to given commands. While ChatGPT was reported to have the capacity to deliver useful feedback, it is still unclear about its effectiveness compared with conventional feedback approaches, such as self-feedback (SF) and teacher feedback (TF). To address this issue, this study compared the revised Chinese to English translation texts produced by 45 Chinese Master of Translation and Interpretation (MTI) students, who learned English as a Second Language (ESL), based on three feedback types (i.e., SF, TF, and ChatGPT feedback). The data was analyzed using BLEU score to gauge the overall translation quality as well as Coh-Metrix to examine linguistic features across three dimensions: lexicon, syntax, and cohesion. The findings revealed that SF and TF-guided translation texts surpassed those with ChatGPT feedback, as indicated by the BLEU score. In terms of linguistic features, ChatGPT feedback demonstrated superiority, particularly in enhancing lexical capability and referential cohesion in the translation texts. However, SF and TF proved more effective in developing syntax-related skills, as they addressed instances of incorrect usage of the passive voice. These diverse outcomes indicate ChatGPT’s potential as a supplementary resource, complementing traditional teacher-led methods in translation practice.
format Article
id doaj-art-5de2daafc65b47af86de2ca9fb28f50d
institution Kabale University
issn 2158-2440
language English
publishDate 2025-08-01
publisher SAGE Publishing
record_format Article
series SAGE Open
spelling doaj-art-5de2daafc65b47af86de2ca9fb28f50d2025-08-25T18:03:48ZengSAGE PublishingSAGE Open2158-24402025-08-011510.1177/21582440251369204Exploring the Efficacy of ChatGPT-Based Feedback Compared With Teacher Feedback and Self-Feedback: Evidence From Chinese-English TranslationSiyi Cao0Tongquan Zhou1Hong Kong Polytechnic University, Kowloon, Hong KongSoutheast University, Nanjing, ChinaChatGPT, a cutting-edge AI-powered Chatbot, can quickly generate responses to given commands. While ChatGPT was reported to have the capacity to deliver useful feedback, it is still unclear about its effectiveness compared with conventional feedback approaches, such as self-feedback (SF) and teacher feedback (TF). To address this issue, this study compared the revised Chinese to English translation texts produced by 45 Chinese Master of Translation and Interpretation (MTI) students, who learned English as a Second Language (ESL), based on three feedback types (i.e., SF, TF, and ChatGPT feedback). The data was analyzed using BLEU score to gauge the overall translation quality as well as Coh-Metrix to examine linguistic features across three dimensions: lexicon, syntax, and cohesion. The findings revealed that SF and TF-guided translation texts surpassed those with ChatGPT feedback, as indicated by the BLEU score. In terms of linguistic features, ChatGPT feedback demonstrated superiority, particularly in enhancing lexical capability and referential cohesion in the translation texts. However, SF and TF proved more effective in developing syntax-related skills, as they addressed instances of incorrect usage of the passive voice. These diverse outcomes indicate ChatGPT’s potential as a supplementary resource, complementing traditional teacher-led methods in translation practice.https://doi.org/10.1177/21582440251369204
spellingShingle Siyi Cao
Tongquan Zhou
Exploring the Efficacy of ChatGPT-Based Feedback Compared With Teacher Feedback and Self-Feedback: Evidence From Chinese-English Translation
SAGE Open
title Exploring the Efficacy of ChatGPT-Based Feedback Compared With Teacher Feedback and Self-Feedback: Evidence From Chinese-English Translation
title_full Exploring the Efficacy of ChatGPT-Based Feedback Compared With Teacher Feedback and Self-Feedback: Evidence From Chinese-English Translation
title_fullStr Exploring the Efficacy of ChatGPT-Based Feedback Compared With Teacher Feedback and Self-Feedback: Evidence From Chinese-English Translation
title_full_unstemmed Exploring the Efficacy of ChatGPT-Based Feedback Compared With Teacher Feedback and Self-Feedback: Evidence From Chinese-English Translation
title_short Exploring the Efficacy of ChatGPT-Based Feedback Compared With Teacher Feedback and Self-Feedback: Evidence From Chinese-English Translation
title_sort exploring the efficacy of chatgpt based feedback compared with teacher feedback and self feedback evidence from chinese english translation
url https://doi.org/10.1177/21582440251369204
work_keys_str_mv AT siyicao exploringtheefficacyofchatgptbasedfeedbackcomparedwithteacherfeedbackandselffeedbackevidencefromchineseenglishtranslation
AT tongquanzhou exploringtheefficacyofchatgptbasedfeedbackcomparedwithteacherfeedbackandselffeedbackevidencefromchineseenglishtranslation