The Multidimensional Quality Metrics (MQM) Framework: a new framework for translation quality assessment
Determining translation quality requires a precise measure of the traits being examined. This article evaluates a new framework for translation quality evaluation, Multidimensional Quality Metrics (MQM), to the task of grading student translations. It demonstrates the viability (i.e. the practicali...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | deu |
| Published: |
ZHAW
2015-01-01
|
| Series: | JoSTrans: The Journal of Specialised Translation |
| Online Access: | https://www.jostrans.org/article/view/8074 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849706328375689216 |
|---|---|
| author | Valerie Mariana Troy Cox Alan Melby |
| author_facet | Valerie Mariana Troy Cox Alan Melby |
| author_sort | Valerie Mariana |
| collection | DOAJ |
| description |
Determining translation quality requires a precise measure of the traits being examined. This article evaluates a new framework for translation quality evaluation, Multidimensional Quality Metrics (MQM), to the task of grading student translations. It demonstrates the viability (i.e. the practicality, validity and reliability) of using the MQM framework by novice raters to judge translations based on the American Translators Association’s translator certification exam grading system. The data gathered for this study were drawn from 29 student translations of a single news story that were rated by nine novice and two expert raters. The study used average time on task, correlations between novices and experts and Many-Facet Rasch Measurement to identify the extent to which this use of the MQM framework was viable. The findings indicate that this implementation of MQM can be viable with novice raters under the right conditions.
|
| format | Article |
| id | doaj-art-8b6fc84bd08f44ee9aadebf823c3e404 |
| institution | DOAJ |
| issn | 1740-357X |
| language | deu |
| publishDate | 2015-01-01 |
| publisher | ZHAW |
| record_format | Article |
| series | JoSTrans: The Journal of Specialised Translation |
| spelling | doaj-art-8b6fc84bd08f44ee9aadebf823c3e4042025-08-20T03:16:14ZdeuZHAWJoSTrans: The Journal of Specialised Translation1740-357X2015-01-012310.26034/cm.jostrans.2015.343The Multidimensional Quality Metrics (MQM) Framework: a new framework for translation quality assessmentValerie MarianaTroy CoxAlan Melby Determining translation quality requires a precise measure of the traits being examined. This article evaluates a new framework for translation quality evaluation, Multidimensional Quality Metrics (MQM), to the task of grading student translations. It demonstrates the viability (i.e. the practicality, validity and reliability) of using the MQM framework by novice raters to judge translations based on the American Translators Association’s translator certification exam grading system. The data gathered for this study were drawn from 29 student translations of a single news story that were rated by nine novice and two expert raters. The study used average time on task, correlations between novices and experts and Many-Facet Rasch Measurement to identify the extent to which this use of the MQM framework was viable. The findings indicate that this implementation of MQM can be viable with novice raters under the right conditions. https://www.jostrans.org/article/view/8074 |
| spellingShingle | Valerie Mariana Troy Cox Alan Melby The Multidimensional Quality Metrics (MQM) Framework: a new framework for translation quality assessment JoSTrans: The Journal of Specialised Translation |
| title | The Multidimensional Quality Metrics (MQM) Framework: a new framework for translation quality assessment |
| title_full | The Multidimensional Quality Metrics (MQM) Framework: a new framework for translation quality assessment |
| title_fullStr | The Multidimensional Quality Metrics (MQM) Framework: a new framework for translation quality assessment |
| title_full_unstemmed | The Multidimensional Quality Metrics (MQM) Framework: a new framework for translation quality assessment |
| title_short | The Multidimensional Quality Metrics (MQM) Framework: a new framework for translation quality assessment |
| title_sort | multidimensional quality metrics mqm framework a new framework for translation quality assessment |
| url | https://www.jostrans.org/article/view/8074 |
| work_keys_str_mv | AT valeriemariana themultidimensionalqualitymetricsmqmframeworkanewframeworkfortranslationqualityassessment AT troycox themultidimensionalqualitymetricsmqmframeworkanewframeworkfortranslationqualityassessment AT alanmelby themultidimensionalqualitymetricsmqmframeworkanewframeworkfortranslationqualityassessment AT valeriemariana multidimensionalqualitymetricsmqmframeworkanewframeworkfortranslationqualityassessment AT troycox multidimensionalqualitymetricsmqmframeworkanewframeworkfortranslationqualityassessment AT alanmelby multidimensionalqualitymetricsmqmframeworkanewframeworkfortranslationqualityassessment |