Multiple-Translation Chinese Corpus
|Item Name:||Multiple-Translation Chinese Corpus|
|Author(s):||Shudong Huang, David Graff, George R. Doddington|
|LDC Catalog No.:||LDC2002T01|
|Release Date:||February 04, 2002|
|Language(s):||English, Mandarin Chinese|
|Language ID(s):||eng, cmn|
LDC User Agreement for Non-Members
|Online Documentation:||LDC2002T01 Documents|
|Licensing Instructions:||Subscription & Standard Members, and Non-Members|
|Citation:||Huang, Shudong, David Graff, and George Doddington. Multiple-Translation Chinese Corpus LDC2002T01. Web Download. Philadelphia: Linguistic Data Consortium, 2002.|
Multiple-Translation Chinese Corpus was developed by the Linguistic Data Consortium (LDC) and contains 17 human and machine tranlsations of Chinese newswire and broeadcast data.
To support the development of automatic means for evaluating translation quality, LDC was sponsored to solicit 11 sets of human translations for a single set of Mandarin Chinese source materials. LDC was also asked to produce translations from various commercial machine translation (MT) systems as well as from MT systems available on the Internet.
Three sources of journalistic Mandarin Chinese text were selected from existing LDC corpora:
- Xinhua News Service: 52 news stories
- Zaobao News Service: 27 news stories
- Voice of America Mandarin broadcast transcripts: 26 news stories
for a total of 105 stories.
The Xinhua data were drawn from Chinese Treebank 2.0 (LDC2001T11); the file names and "doc_id" attributes assigned to these stories match the file names used in the Chinese Treebank release.
The Zaobao and VOA data were both drawn from TDT3 Multilanguage Text Version 2.0 (LDC2001T58); their file names and "doc_id" attributes match the "DOCNO" tags assigned to these stories in the TDT3 release.
Selection of stories from the two newswire collections was controlled by story length: all selected stories contain between about 340 and 400 Chinese characters. The selection from VOA broadcasts varied more widely, between 100 and 1,000 characters per story.
The VOA Mandarin transcripts in TDT3 were created manually by a professional transcription service, but with limited editorial quality control -- while generally quite complete, these transcripts were not expected to exceed the quality or accuracy of closed-caption text in television broadcasts.
Zaobao is a news portal from Singapore and many of its news stories are translations from other news agencies' releases.
There are a total of 1,890 data files.
February 23, 2002: Possibly due to segmentation errors, two of the Machine Translation (MT) systems, tb2 and tb3, have output seven instances of obscenities, in files VOM19981114_0900_1588.sgm and chtb_177.sgm