ESPADA
| Item Name: | ESPADA |
| Author(s): | Yuki Arase, Junichi Tsujii |
| LDC Catalog No.: | LDC2021T10 |
| ISBN: | 1-58563-964-8 |
| ISLRN: | 305-603-129-084-1 |
| DOI: | https://doi.org/10.35111/31qn-be41 |
| Release Date: | May 17, 2021 |
| Member Year(s): | 2021 |
| DCMI Type(s): | Text |
| Data Source(s): | newswire |
| Application(s): | phrase alignment, syntactic parsing |
| Language(s): | English |
| Language ID(s): | eng |
| License(s): |
LDC User Agreement for Non-Members |
| Online Documentation: | LDC2021T10 Documents |
| Licensing Instructions: | Subscription & Standard Members, and Non-Members |
| Citation: | Arase, Yuki, and Junichi Tsujii. ESPADA LDC2021T10. Web Download. Philadelphia: Linguistic Data Consortium, 2021. |
| Related Works: | View |
Introduction
ESPADA (Extended Syntactic Phrase Alignment DAtaset) consists of annotated parse trees and alignment on English sentential paraphrases extracted from machine translation evaluation corpora. It extends SPADE (LDC2018T09) by adding new annotated data for training/testing phrasal paraphrase detection and phrase representation models to SPADE's development and test sets.
Reference translations from machine translation evaluation corpora were used as sentential paraphrases. They were sourced from the following data sets released by the Linguistic Data Consortium from the NIST (National Institute of Standards and Technology) open machine translation evaluation series (OpenMT): LDC2010T14, LDC2010T17, LDC2010T21, LDC2010T23, and LDC2013T03.
Data
Reference translations were randomly extracted for annotation from NIST OpenMT corpora. Gold standard annotations of HPSG (head-driven phrase structure grammar) trees and phrase alignments were performed, resulting in 251,972 phrase alignments identified in 1,916 sentential paraphrases. Further information about the annotation process is contained in the documentation accompanying this release.
All annotation data is presented as UTF-8 XML.
Samples
Please view this sample (XML).
Updates
None at this time.