HyTER Networks of Selected OpenMT08/09 Sentences
|Item Name:||HyTER Networks of Selected OpenMT08/09 Sentences|
|Author(s):||Markus Dreyer, Daniel Marcu|
|LDC Catalog No.:||LDC2014T09|
|Release Date:||May 15, 2014|
|Data Source(s):||weblogs, newswire|
|Language(s):||English, Mandarin Chinese, Arabic, Chinese|
|Language ID(s):||eng, cmn, ara, zho|
LDC User Agreement for Non-Members
|Licensing Instructions:||Subscription & Standard Members, and Non-Members|
|Citation:||Dreyer, Markus, and Daniel Marcu. HyTER Networks of Selected OpenMT08/09 Sentences LDC2014T09. Web Download. Philadelphia: Linguistic Data Consortium, 2014.|
HyTER Networks of Selected OpenMT08/09 Progress Set Sentences was developed by SDL and contains HyTER (Hybrid Translation Edit Rate) networks for 102 selected source Arabic and Chinese sentences from OpenMT08 and OpenMT09 Progress Set data. HyTER is an evaluation metric based on large reference networks created by an annotation tool that allows users to develop an exponential number of correct translations for a given sentence. Reference networks can be used as a foundation for developing improved machine translation evaluation metrics and for automating the evaluation of human translation efficiency.
The source material is comprised of Arabic and Chinese newswire and web data collected by LDC in 2007. Annotators created meaning-equivalent annotations under three annotation protocols. In the first protocol, foreign language native speakers built English networks starting from foreign language sentences. In the second, English native speakers built English networks from the best translation of a foreign language sentence as identified by NIST (National Institute of Standards and Technology). In the third protocol, English native speakers built English networks starting from the best translation, but those annotators also had access to three additional, independently produced human translations. Networks created by different annotators for each sentence were combined and evaluated.
This release includes the source sentences and four human reference translations produced by LDC in XML format, along with five machine translation system outputs representing a variety of system architectures and performance, and the human post-edited output of those systems also presented in XML.
Please view this FST sample and Reference XML sample.
None at this time.