The Multidimensional Quality Metrics (MQM) Framework: a new framework for translation quality assessment

Determining translation quality requires a precise measure of the traits being examined. This article evaluates a new framework for translation quality evaluation, Multidimensional Quality Metrics (MQM), to the task of grading student translations. It demonstrates the viability (i.e. the practicali...

Full description

Saved in:
Bibliographic Details
Main Authors: Valerie Mariana, Troy Cox, Alan Melby
Format: Article
Language:deu
Published: ZHAW 2015-01-01
Series:JoSTrans: The Journal of Specialised Translation
Online Access:https://www.jostrans.org/article/view/8074
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Determining translation quality requires a precise measure of the traits being examined. This article evaluates a new framework for translation quality evaluation, Multidimensional Quality Metrics (MQM), to the task of grading student translations. It demonstrates the viability (i.e. the practicality, validity and reliability) of using the MQM framework by novice raters to judge translations based on the American Translators Association’s translator certification exam grading system. The data gathered for this study were drawn from 29 student translations of a single news story that were rated by nine novice and two expert raters. The study used average time on task, correlations between novices and experts and Many-Facet Rasch Measurement to identify the extent to which this use of the MQM framework was viable. The findings indicate that this implementation of MQM can be viable with novice raters under the right conditions.
ISSN:1740-357X