LDC2008E43 2008 Metrics MATR Partial (MT06) Reference Translations ================================================================== This is the NIST MetricsMATR08 development data set, provided to assist in the development of automated metrics of MT technology that will be evaluated in the 2008 NIST Metrics MATR Evaluation. Please refer to the evaluation plan, available on the NIST Speech Group web site: http://www.nist.gov/speech/tests/metricsmatr/2008 for more information and rules of use for this data. The 'AssessmentTasks' directory contains information on how human assessments were obtained and how they are represented in the data. Please refer to the README.txt file in this directory. The 'mt06' directory contains data from the NIST Open MT 2006 evaluation. It contains system translations, corresponding reference translations, and human assessments of Adequacy and Preference judgments as described in the 'AssessmentTasks' directory. ** NOTE ** Judge identification set to "judgeAdj" represents an adjudicated (or preferred) score. For questions/comments: mt_poc@nist.gov