MWE-Aware English Dependency Corpus 2.0
| Item Name: | MWE-Aware English Dependency Corpus 2.0 |
| Author(s): | Akihiko Kato, Hiroyuki Shindo, Yuji Matsumoto |
| LDC Catalog No.: | LDC2017T16 |
| ISBN: | 1-58563-819-6 |
| ISLRN: | 386-404-178-211-6 |
| DOI: | https://doi.org/10.35111/m2cs-3954 |
| Release Date: | October 18, 2017 |
| Member Year(s): | 2017 |
| DCMI Type(s): | Text |
| Data Source(s): | newswire |
| Application(s): | information extraction, information retrieval, discourse parsing, part of speech tagging, named entity recognition |
| Language(s): | English |
| Language ID(s): | eng |
| License(s): |
LDC User Agreement for Non-Members |
| Online Documentation: | LDC2017T16 Documents |
| Licensing Instructions: | Subscription & Standard Members, and Non-Members |
| Citation: | Kato, Akihiko, Hiroyuki Shindo, and Yuji Matsumoto. MWE-Aware English Dependency Corpus 2.0 LDC2017T16. Web Download. Philadelphia: Linguistic Data Consortium, 2017. |
| Related Works: | View |
Introduction
MWE-Aware English Dependency Corpus Version 2.0 was developed by the Nara Institute of Science and Technology Computational Linguistics Laboratory and consists of English compound function words annotated in dependency format. The data is derived from OntoNotes Release 5.0 (LDC2013T19).
Compound functions words are a type of multiword expression (MWE). MWEs are groups of tokens that can be treated as a single semantic or syntactic unit. Doing so facilitates natural language processing tasks such as constituency and dependency parsing.
Version 2.0 adds annotations of named entities (persons, locations, organizations) into dependency trees that are aware of compound function words. Version 1.0 is available from LDC as MWE-Aware English Dependency Corpus (LDC2017T01).
Data
MWE-Aware English Dependency Corpus Version 2.0 was derived from the Wall Street Journal portion of OntoNotes Release 5.0. MWEs were identified in OntoNotes' phrase structure trees and each MWE was established as a single subtree. Those phrase structure subtrees were then converted to a dependency structure (the Stanford dependencies) in CoNLL format.
The data is split into 1,728 phrase structure trees as *.parse files and a single 14-column tab separated dependency as a *.conll file. Both file types are encoded as UTF-8.
Samples
Please view this sample.
Updates
None at this time.