LORELEI Amharic Representative Language Pack - Monolingual and Parallel Text

Item Name: LORELEI Amharic Representative Language Pack - Monolingual and Parallel Text
Author(s): Jennifer Tracey, David Graff, Stephanie Strassel, Xiaoyi Ma, Jonathan Wright
LDC Catalog No.: LDC2018T04
ISBN: 1-58563-835-8
ISLRN: 494-818-599-171-5
Release Date: February 16, 2018
Member Year(s): 2018
DCMI Type(s): Text, Software
Data Source(s): newswire, discussion forum, weblogs, web collection
Project(s): LORELEI
Application(s): machine translation, language modeling
Language(s): Amharic, English
Language ID(s): amh, eng
License(s): LDC User Agreement for Non-Members
Online Documentation: LDC2018T04 Documents
Licensing Instructions: Subscription & Standard Members, and Non-Members
Citation: Tracey, Jennifer, et al. LORELEI Amharic Representative Language Pack - Monolingual and Parallel Text LDC2018T04. Web Download. Philadelphia: Linguistic Data Consortium, 2018.
Related Works: Hide View


LORELEI Amharic Representative Language Pack - Monolingual and Parallel Text was developed by the Linguistic Data Consortium and is comprised of approximately 25 million words of monolingual Amharic text, approximately 600,000 of which are translated into English. Another 80,000 words are also translated from English into Amharic.

The LORELEI (Low Resource Languages for Emergent Incidents) Program is concerned with building Human Language Technology for low resource languages in the context of emergent situations like natural disasters or disease outbreaks. Linguistic resources for LORELEI include Representative Language Packs and Incident Language Packs for over two dozen low resource languages, comprising data, annotations, basic natural language processing tools, lexicons and grammatical resources. Representative languages are selected to provide broad typological coverage, while incident languages are selected to evaluate system performance on a language whose identity is disclosed at the start of the evaluation.


Data was collected in the following genres: discussion forums, news, reference, social network and weblog. Both monolingual text collection and parallel text creation involved a combination of manual and automatic methods, which are detailed in the included documentation. All harvested content was initially converted from its original HTML form into a relatively uniform XML format.

XML data is presented in two formats: a "homogenized" XML format that preserves the minimum set of tags needed to represent the structure of the relevant text as seen by the human web-page reader and a fully segmented and tokenized version of the text. All text data is encoded as UTF-8.

Also included in this release are two tools: one to recreate original source data from the processed XML material and the other to condition text data users download from Twitter.


This material is based upon work supported by the Defense Advanced Research Projects Agency (DARPA) under Contract No. HR0011-15-C-0123. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of DARPA.


Please view this Amharic sample and English translation sample.


None at this time.

Available Media

View Fees

Login for the applicable fee