SPADE
Item Name: | SPADE |
Author(s): | Yuki Arase, Junichi Tsujii |
LDC Catalog No.: | LDC2018T09 |
ISBN: | 1-58563-837-4 |
ISLRN: | 907-641-112-060-3 |
DOI: | https://doi.org/10.35111/eqzb-7x65 |
Release Date: | March 15, 2018 |
Member Year(s): | 2018 |
DCMI Type(s): | Text |
Data Source(s): | newswire |
Application(s): | phrase alignment, syntactic parsing |
Language(s): | English |
Language ID(s): | eng |
License(s): |
LDC User Agreement for Non-Members |
Online Documentation: | LDC2018T09 Documents |
Licensing Instructions: | Subscription & Standard Members, and Non-Members |
Citation: | Arase, Yuki, and Junichi Tsujii. SPADE LDC2018T09. Web Download. Philadelphia: Linguistic Data Consortium, 2018. |
Related Works: | View |
Introduction
SPADE (Syntactic Phrase Alignment Dataset for Evaluation) consists of annotated parse trees and alignment on English sentential paraphrases extracted from machine translation evaluation corpora and separated into development and test sets.
Reference translations from machine translation evaluation corpora were used as sentential paraphrases. They were sourced from the following data sets released by the Linguistic Data Consortium from the NIST (National Institute of Standards and Technology) open machine translation evaluation series (OpenMT): LDC2010T14, LDC2010T17, LDC2010T21, and LDC2013T03.
Data
Reference translations of 10 to 30 words were randomly extracted for annotation from NIST OpenMT corpora. Gold standard annotations of HPSG (head-driven phrase structure grammar) trees and phrase alignments were performed, resulting in 20,276 phrases extracted from 201 sentential paraphrases and 15,721 paraphrase alignments. Further information about the annotation process is contained in the documentation accompanying this release.
All annotation data is presented as UTF-8 XML.
Samples
Please view this sample.
Updates
None at this time.