Chinese English News Magazine Parallel Text

Item Name: Chinese English News Magazine Parallel Text
Author(s): Xiaoyi Ma
LDC Catalog No.: LDC2005T10
ISBN: 1-58563-333-X
ISLRN: 629-451-208-314-7
Release Date: June 15, 2005
Member Year(s): 2005
DCMI Type(s): Text
Data Source(s): newswire
Project(s): TIDES, GALE
Application(s): machine translation
Language(s): Mandarin Chinese
Language ID(s): cmn
License(s): LDC User Agreement for Non-Members
Online Documentation: LDC2005T10 Documents
Licensing Instructions: Subscription & Standard Members, and Non-Members
Citation: Ma, Xiaoyi. Chinese English News Magazine Parallel Text LDC2005T10. CD. Philadelphia: Linguistic Data Consortium, 2005.

Introduction

This file contains documentation on the Chinese English News Magazine Parallel Text, Linguistic Data Consortium (LDC) catalog number LDC2005T10 and ISBN 1-58563-333-X.

This corpus contains Chinese news stories and their English translations LDC collected via Sinorama Magazine, Taiwan, from 1976 to 2004. It totals 6,366 story pairs, 365,568 sentence pairs, 20M Chinese characters and 9M English words. The corpus is aligned at sentence level.

Data

Sinorama Magazine is published monthly in several languages, including Chinese, English, Japanese. LDC received its 1976 to 2000 publications on a single CD, and its 2001 to 2004 publications via Sinorama's website.

The Sinorama Chinese text was encoded in Big5. The data came story aligned but were lack of sentence level alignment. The sentence alignment was done at the LDC using Champollion v 1.1.

The final data is put in the data directory, which contains subdirectories for Chinese documents, English documents, and the sentence level alignment, identified as "Chinese," "English," and "alignment."

The English and Chinese files may contain one or more documents, with each document formatted in SGML as follows:

[English or Chinese text]

[English or Chinese text] [English or Chinese text] ...

Notes: * the

and tags are always assigned sequential numeric IDs, starting at one. * the tags are always placed on the same line with their contents, and are always separated from the contents by a space.

* if an English file and a Chinese file share the same file name, they contain the same documents. * all Chinese text is encoded in Big5.

Each alignment file contains the sentence level alignment of multiple documents, each being formatted in SGML as follows: ...

Notes: * the docid in an English file, its Chinese translation and the ALIGNMENT are the same. * EnglishSegId and ChineseSegId may have none, one, or more than one segment IDs.

Samples

The following files provide an example of this corpus:

Portions © 2005 Trustees of the University of Pennsylvania

Available Media

View Fees

Member
Non-Member
Reduced-License
Extra Copy
Login for the applicable fee