Arabic Treebank: Part 3 v 3.2


Item Name: Arabic Treebank: Part 3 v 3.2
Authors: Mohamed Maamouri, Ann Bies, Seth Kulick, Sondos Krouna, Fatma Gaddeche, Wajdi Zaghouani
LDC Catalog No.: LDC2010T08
ISBN: 1-58563-544-8
Release Date: Apr 19, 2010
Data Type: text
Data Source(s): newswire
Application(s): automatic content extraction, cross-lingual information retrieval, information detection
Language(s): Arabic
Language ID(s): arb
Distribution: 1 CD, Web Download
Member fee: $0 for 2010 members
Non-member Fee: US $4500.00
Reduced-License Fee: US $2250.00
Extra-Copy Fee: US $150.00
Non-member License: yes
Online documentation: yes
Licensing Instructions: Subscription & Standard Members, and Non-Members
Citation: Mohamed Maamouri, et al.
2010
Arabic Treebank: Part 3 v 3.2
Linguistic Data Consortium, Philadelphia

Introduction

Arabic Treebank: Part 3 (ATB3) v 3.2, Linguistic Data Consortium (LDC) catalog number LDC2010T08 and isbn 1-58563-544-8, was developed at LDC. It consists of 599 distinct newswire stories from the Lebanese publication An Nahar with part-of-speech (POS), morphology, gloss and syntactic treebank annotation in accordance with the Penn Arabic Treebank (PATB) Guidelines developed in 2008 and 2009. This release represents a significant revision of LDCs previous ATB3 publications: Arabic Treebank: Part 3 v 1.0 LDC2004T11 and Arabic Treebank: Part 3 (full corpus) v 2.0 (MPG + Syntactic Analysis LDC2005T20.

The ongoing PATB project supports research in Arabic-language natural language processing and human language technology development. The methodology and work leading to the release of this publication are described in detail in the documentation accompanying this corpus and in two research papers, Enhancing the Arabic Treebank: A Collaborative Effort toward New Annotation Guidelines and Consistent and Flexible Integration of Morphological Annotation in the Arabic Treebank.

Data

ATB3 v 3.2 contains a total of 339,710 tokens before clitics are split, and 402,291 tokens after clitics are separated for the treebank annotation. This release includes all files that were previously made available to the DARPA GALE program community (Arabic Treebank Part 3 - Version 3.1, LDC2008E22). A number of inconsistencies in the 3.1 release data have been corrected here. These include changes to certain POS tags with the resulting tree changes. As a result, additional clitics have been separated, and some previously incorrectly split tokens have now been merged.

One file from ATB3 v 2.0, ANN20020715.0063, has been removed from this corpus as that text is an exact duplicate of another file in this release (ANN20020715.0018). This reduces the number of files from 600 files in ATB3 v 2.0 to 599 files in ATB 3 v 3.2.

Sponsorship

This work was supported in part by the Defense Advanced Research Projects Agency, GALE Program Grant No. HR0011-06-1-0003. The content of this publication does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.

Sample

The included data are available in many different formats and files, as described in detail in the corpus documentation. The following is a screenshot excerpt taken from one of the new integrated data files: sample.

Content Copyright

Portions 2002 An Nahar, 2003, 2004, 2005, 2007, 2008, 2009 2010 Trustees of the University of Pennsylvania