Multiple-Translation Arabic (MTA) Part 2, Linguistic Data Consortium (LDC) catalog number LDC2005T05 and ISBN 1-58563-328-3, was produced by LDC.
To support the development of automatic means for evaluating translation quality, LDC was sponsored to solicit four sets of human translations for a single set of Arabic source materials. LDC was also asked to produce translations from various commercial-off-the-shelf-systems (COTS, including commercial Machine Translation (MT) systems as well as MT systems available on the Internet). This corpus contains two sets of COTS outputs and one output set from a TIDES 2003 MT Evaluation participant, which is representative for the state-of-the-art research systems.
To determine if automatic evaluation systems such as BLEU track human assessment, LDC also performed human assessment on the two COTS outputs and the TIDES research system. The corpus includes the assessment results for one of the two COTS systems, the assessment result for the TIDES research system, and the specifications used for conducting the assessments.
Source Data Selection:
- Xinhua News Service (Xinhua): 50 news stories
- Agence France Presse (AFP): 50 news stories
(total: 100 stories)
There are 100 source files and 700 translation files. All source data were drawn from January and February 2003 collection of Xinhua Arabic data and AFP Arabic data.
The story selection from the two newswire collections was controlled by story length: all selected stories contain between 700 and 1,500 Arabic characters.
The overall count of Arabic words (excluding markup), by source, is shown in the following table:
- AFP 7,528
- Xinhua 7,551
For samples from this corpus, see this screen shot of the Arabic source file and its translation.
Please contact Xiaoyi Ma with any questions regarding this corpus.
Portions © 2003 Xinhua News Agency, © 2003 Agence France Press, © 2004-2005 Trustees of the University of Pennsylvania