MWE-Aware English Dependency Corpus

Item Name: MWE-Aware English Dependency Corpus
Author(s): Akihiko Kato, Hiroyuki Shindo, Yuji Matsumoto
LDC Catalog No.: LDC2017T01
ISBN: 1-58563-782-3
ISLRN: 484-489-597-064-0
Release Date: January 19, 2017
Member Year(s): 2017
DCMI Type(s): Text
Data Source(s): newswire
Application(s): information extraction, information retrieval, parsing, part of speech tagging
Language(s): English
Language ID(s): eng
License(s): LDC User Agreement for Non-Members
Online Documentation: LDC2017T01 Documents
Licensing Instructions: Subscription & Standard Members, and Non-Members
Citation: Kato, Akihiko, Hiroyuki Shindo, and Yuji Matsumoto. MWE-Aware English Dependency Corpus LDC2017T01. Web Download. Philadelphia: Linguistic Data Consortium, 2017.

Introduction

MWE-Aware English Dependency Corpus was developed by the Nara Institute of Science and Technology Computational Linguistics Laboratory and consists of English compound function words annotated in dependency format. The data is derived from OntoNotes Release 5.0 (LDC2013T19).

Compound function words are a type of multiword expression (MWE). MWEs are groups of tokens that can be treated as a single semantic or syntactic unit. Doing so facilitates natural language processing tasks such as constituency and dependency parsing.

Data

MWE-Aware English Dependency Corpus was derived from the Wall Street Journal portion of OntoNotes Release 5.0. MWEs were identified in OntoNotes' phrase structure trees and each MWE was established as a single subtree. Those phrase structure subtrees were then converted to a dependency structure (the Stanford dependencies) in CoNLL format.

The data is split into 1,728 phrase structure trees as *.parse files and a single 14-column tab separated dependency as a *.conll file. Both file types are encoded as UTF-8.

Samples

Please view this sample.

Updates

None at this time.

Available Media

View Fees





Login for the applicable fee