Unified Linguistic Annotation Text Collection

Item Name: Unified Linguistic Annotation Text Collection
Author(s): Linguistic Data Consortium
LDC Catalog No.: LDC2009T07
ISBN: 1-58563-511-1
ISLRN: 369-443-379-033-6
Release Date: March 17, 2009
Member Year(s): 2009
DCMI Type(s): Text
Application(s): summarization, sociolinguistics, question-answering, psycholinguistics, pragmatics, information retrieval
Language(s): English, Mandarin Chinese, Standard Arabic, Arabic
Language ID(s): eng, cmn, arb, ara
License(s): LDC User Agreement for Non-Members
Licensing Instructions: Subscription & Standard Members, and Non-Members
Citation: Linguistic Data Consortium. Unified Linguistic Annotation Text Collection LDC2009T07. Web Download. Philadelphia: Linguistic Data Consortium, 2009.

Introduction

The Unified Linguistic Annotation Text Collection, Linguistic Data Consortium (LDC) catalog number LDC2009T07 and isbn 1-58563-511-1, consists of two separate corpora: The Language Understanding Annotation Corpus (LDC2009T10) and REFLEX EntityTranslation Training/DevTest (LDC2009T11).

Most recent annotation efforts for language have focused on small pieces of the larger problem of semantic annotation rather than producing a single unified representation. The Unified Linguistic Annotation (ULA) project, sponsored by the National Science Foundation, seeks to integrate into one framework different layers of annotation (e.g., semantics, discourse, temporal, opinions) using various existing resources, including PropBank, NomBank, TimeBank, Penn Discourse Treebank and coreference and opinion annotations. The project represents a concerted effort of researchers from several institutions to develop a large word corpus with balanced and annotated data. The ULA Text Collection is provided as a resource for the ULA effort. It consists of two datasets, the Language Understanding Annotation Corpus from the Johns Hopkins Center of Excellence in Human Language Technology and ACE Reflex Entity Translation Training Dev/Test developed by LDC.

The Language Understanding Annotation Corpus (LDC2009T10). The Language Understanding Annotation Corpus consists of over 9000 words of English text (6949 words) and Arabic text (2183 words) annotated for committed belief, event and entity coreference, dialog acts and temporal relations. The materials were chosen from various sources to represent "informal input," that is, text that contains colloquial forms. The documents in the corpus include excerpts from newswire stories, telephone conversation transcripts, emails, contracts and written instructions.

REFLEX Entity Translation Training/DevTest (LDC2009T11). REFLEX Entity Translation Training/DevTest is the complete set of training data and development test data for the 2007 REFLEX Entity Translation evaluation sponsored by the National Institute of Standards and Technology (NIST). It contains approximately 67.5k words of newswire and weblog text for each of English, Chinese and Arabic (or approximately22.5k words in each language) translated ito each of the other two languages. The data is annotated for entities and TIMEX2 extents and normalization.

Available Media

View Fees

Member
Non-Member
Reduced-License
Extra Copy
Login for the applicable fee