SPADE

Item Name: SPADE
Author(s): Yuki Arase, Junichi Tsujii
LDC Catalog No.: LDC2018T09
ISBN: 1-58563-837-4
ISLRN: 907-641-112-060-3
Release Date: March 15, 2018
Member Year(s): 2018
DCMI Type(s): Text
Data Source(s): newswire
Application(s): syntactic parsing, phrase alignment
Language(s): English
Language ID(s): eng
License(s): LDC User Agreement for Non-Members
Online Documentation: LDC2018T09 Documents
Licensing Instructions: Subscription & Standard Members, and Non-Members
Citation: Arase, Yuki, and Junichi Tsujii. SPADE LDC2018T09. Web Download. Philadelphia: Linguistic Data Consortium, 2018.

Introduction

SPADE (Syntactic Phrase Alignment Dataset for Evaluation) consists of annotated parse trees and alignment on English sentential paraphrases extracted from machine translation evaluation corpora and separated into development and test sets.

Reference translations from machine translation evaluation corpora were used as sentential paraphrases. They were sourced from the following data sets released by LDC from the NIST (National Institute of Standards and Technology) open machine translation evaluation series (OpenMT): LDC2010T14, LDC2010T17, LDC2010T21, and LDC2013T03.

Data

Reference translations of 10 to 30 words were randomly extracted for annotation from NIST OpenMT corpora. Gold standard annotations of HPSG (head-driven phrase structure grammar) trees and phrase alignments were performed, resulting in 20,276 phrases extracted from 201 sentential paraphrases and 15,721 paraphrase alignments. Further information about the annotation process is contained in the documentation accompanying this release.

All annotation data is presented as UTF-8 XML.

Samples

Please view this sample.

Updates

None at this time.

Available Media

View Fees





Login for the applicable fee