|Author(s):||Yuki Arase, Junichi Tsujii|
|LDC Catalog No.:||LDC2021T10|
|Release Date:||May 17, 2021|
|Application(s):||phrase alignment, syntactic parsing|
LDC User Agreement for Non-Members
|Online Documentation:||LDC2021T10 Documents|
|Licensing Instructions:||Subscription & Standard Members, and Non-Members|
|Citation:||Arase, Yuki, and Junichi Tsujii. ESPADA LDC2021T10. Web Download. Philadelphia: Linguistic Data Consortium, 2021.|
ESPADA (Extended Syntactic Phrase Alignment DAtaset) consists of annotated parse trees and alignment on English sentential paraphrases extracted from machine translation evaluation corpora. It extends SPADE (LDC2018T09) by adding new annotated data for training/testing phrasal paraphrase detection and phrase representation models to SPADE's development and test sets.
Reference translations from machine translation evaluation corpora were used as sentential paraphrases. They were sourced from the following data sets released by the Linguistic Data Consortium from the NIST (National Institute of Standards and Technology) open machine translation evaluation series (OpenMT): LDC2010T14, LDC2010T17, LDC2010T21, LDC2010T23, and LDC2013T03.
Reference translations were randomly extracted for annotation from NIST OpenMT corpora. Gold standard annotations of HPSG (head-driven phrase structure grammar) trees and phrase alignments were performed, resulting in 251,972 phrase alignments identified in 1,916 sentential paraphrases. Further information about the annotation process is contained in the documentation accompanying this release.
All annotation data is presented as UTF-8 XML.
Please view this sample (XML).
None at this time.