MWE-Aware English Dependency Corpus
| Item Name: | MWE-Aware English Dependency Corpus |
| Author(s): | Akihiko Kato, Hiroyuki Shindo, Yuji Matsumoto |
| LDC Catalog No.: | LDC2017T01 |
| ISBN: | 1-58563-782-3 |
| ISLRN: | 484-489-597-064-0 |
| DOI: | https://doi.org/10.35111/2zpz-q591 |
| Release Date: | January 19, 2017 |
| Member Year(s): | 2017 |
| DCMI Type(s): | Text |
| Data Source(s): | newswire |
| Application(s): | information extraction, information retrieval, parsing, part of speech tagging |
| Language(s): | English |
| Language ID(s): | eng |
| License(s): |
LDC User Agreement for Non-Members |
| Online Documentation: | LDC2017T01 Documents |
| Licensing Instructions: | Subscription & Standard Members, and Non-Members |
| Citation: | Kato, Akihiko, Hiroyuki Shindo, and Yuji Matsumoto. MWE-Aware English Dependency Corpus LDC2017T01. Web Download. Philadelphia: Linguistic Data Consortium, 2017. |
| Related Works: | View |
Introduction
MWE-Aware English Dependency Corpus was developed by the Nara Institute of Science and Technology Computational Linguistics Laboratory and consists of English compound function words annotated in dependency format. The data is derived from OntoNotes Release 5.0 (LDC2013T19).
Compound function words are a type of multiword expression (MWE). MWEs are groups of tokens that can be treated as a single semantic or syntactic unit. Doing so facilitates natural language processing tasks such as constituency and dependency parsing.
Version 2.0 is available from LDC as MWE-Aware English Dependency Corpus 2.0 (LDC2017T16)
Data
MWE-Aware English Dependency Corpus was derived from the Wall Street Journal portion of OntoNotes Release 5.0. MWEs were identified in OntoNotes' phrase structure trees and each MWE was established as a single subtree. Those phrase structure subtrees were then converted to a dependency structure (the Stanford dependencies) in CoNLL format.
The data is split into 1,728 phrase structure trees as *.parse files and a single 14-column tab separated dependency as a *.conll file. Both file types are encoded as UTF-8.
Samples
Please view this sample.
Updates
None at this time.