Arabic Treebank: Part 1 v 2.0


Item Name: Arabic Treebank: Part 1 v 2.0
Authors: Mohamed Maamouri, Ann Bies, Hubert Jin, and Tim Buckwalter
LDC Catalog No.: LDC2003T06
ISBN: 1-58563-261-9
Release Date: Feb 03, 2003
Data Type: text
Data Source(s): newswire
Project(s): GALE, TIDES
Application(s): automatic content extraction, cross-lingual information retrieval, information detection, natural language processing
Language(s): Modern Standard Arabic
Language ID(s): arb
Distribution: Web Download
Member fee: $0 for 2003 members
Non-member Fee: US $3000.00
Reduced-License Fee: US $1500.00
Extra-Copy Fee: N/A
Non-member License: yes
Online documentation: yes
Licensing Instructions: Subscription & Standard Members, and Non-Members
Citation: Mohamed Maamouri, et al.
2003
Arabic Treebank: Part 1 v 2.0
Linguistic Data Consortium, Philadelphia

Introduction

Arabic Treebank: Part 1 v 2.0 was produced by Linguistic Data Consortium (LDC) catalog number LDC2003T06 and ISBN 1-58563-261-9. This publication is part one of a a corpus of one million words of Arabic Treebank, designed to support language research and development of language technology for Modern Standard Arabic.

Data

The Penn Arabic Treebank, which is part of the DARPA TIDES project, started in the Fall of 2001 with the objective of performing human and computer annotations of a large Arabic machine-readable text corpus (for project background please see POStest.html). As in previous Penn Treebanks, two different kinds of information need to be produced by two different (human and computer) processes. The Arabic Treebank project consists therefore of two distinct phases:

  1. Part-of-Speech (POS) tagging - divides the text into lexical tokens, and gives relevant information about each token such as lexical category, inflectional features, and a gloss
  2. Arabic Treebanking (ArabicTB) - characterizes the constituent structures of word sequences, provides categories for each non-terminal node, and identifies null elements, co-reference, traces, etc.

Both tasks started in November 2001 with an initial pilot consisting of 734 files representing roughly 166K words of written Modern Standard Arabic newswire from the Agence France Presse corpus.

The target of this publication is to provide a description of a written Modern Standard Arabic text corpus. The source data consists of Agence France Presse (AFP) newswire, spanning from July through November of 2000. This publication includes 734 stories representing 140,265 words (168,123 tokens after clitic segmentation in the Treebank).

Updates

There are no updates available at this time.

Content Copyright

Portions 2000 Agence France-Presse, 2002 Trustees of the University of Pennsylvania