MWE-Aware English Dependency Corpus 2.0

Item Name: MWE-Aware English Dependency Corpus 2.0
Author(s): Akihiko Kato, Hiroyuki Shindo, Yuji Matsumoto
LDC Catalog No.: LDC2017T16
ISBN: 1-58563-819-6
ISLRN: 386-404-178-211-6
Release Date: October 18, 2017
Member Year(s): 2017
DCMI Type(s): Text
Data Source(s): newswire
Application(s): information extraction, information retrieval, discourse parsing, part of speech tagging, named entity recognition
Language(s): English
Language ID(s): eng
License(s): LDC User Agreement for Non-Members
Online Documentation: LDC2017T16 Documents
Licensing Instructions: Subscription & Standard Members, and Non-Members
Citation: Kato, Akihiko, Hiroyuki Shindo, and Yuji Matsumoto. MWE-Aware English Dependency Corpus 2.0 LDC2017T16. Web Download. Philadelphia: Linguistic Data Consortium, 2017.

Introduction

MWE-Aware English Dependency Corpus Version 2.0 was developed by the Nara Institute of Science and Technology Computational Linguistics Laboratory and consists of English compound function words annotated in dependency format. The data is derived from OntoNotes Release 5.0 (LDC2013T19).

Compound functions words are a type of multiword expression (MWE). MWEs are groups of tokens that can be treated as a single semantic or syntactic unit. Doing so facilitates natural language processing tasks such as constituency and dependency parsing.

Version 2.0 adds annotations of named entities (persons, locations, organizations) into dependency trees that are aware of compound function words. Version 1.0 is available from LDC as MWE-Aware English Dependency Corpus (LDC2017T01).

Data

MWE-Aware English Dependency Corpus Version 2.0 was derived from the Wall Street Journal portion of OntoNotes Release 5.0. MWEs were identified in OntoNotes' phrase structure trees and each MWE was established as a single subtree. Those phrase structure subtrees were then converted to a dependency structure (the Stanford dependencies) in CoNLL format.

The data is split into 1,728 phrase structure trees as *.parse files and a single 14-column tab separated dependency as a *.conll file. Both file types are encoded as UTF-8.

Samples

Please view this sample.

Updates

None at this time.

Available Media

View Fees





Login for the applicable fee