Arabic Treebank - Weblog

Item Name: Arabic Treebank - Weblog
Author(s): Mohamed Maamouri, Ann Bies, Seth Kulick, Sondos Krouna, Dalila Tabassi, Michael Ciul
LDC Catalog No.: LDC2016T02
ISBN: 1-58563-741-6
ISLRN: 479-780-942-548-4
Release Date: January 18, 2016
Member Year(s): 2016
DCMI Type(s): Text
Data Source(s): weblogs
Project(s): GALE
Application(s): automatic content extraction, cross-lingual information retrieval, information detection
Language(s): Arabic, Standard Arabic
Language ID(s): ara, arb
License(s): LDC User Agreement for Non-Members
Online Documentation: LDC2016T02 Documents
Licensing Instructions: Subscription & Standard Members, and Non-Members
Citation: Maamouri, Mohamed, et al. Arabic Treebank - Weblog LDC2016T02. Web Download. Philadelphia: Linguistic Data Consortium, 2016.

Introduction

Arabic Treebank - Weblog was developed by the Linguistic Data Consortium (LDC) and consists of Arabic weblog data with part-of-speech, morphology, gloss and syntactic tree annotation.

The ongoing Penn Arabic Treebank Project (PATB) supports research in Arabic-language natural language processing and human language technology development. The methodology and work leading to the release of this publication are described in detail in the documentation accompanying this corpus. Generally, the PATB consists of two distinct phases: (a) part-of-speech (POS) tagging, which divides the text into lexical tokens and gives relevant information about each token such as lexical category, inflectional features, and a gloss (referred to as POS for convenience, although it includes morphological and gloss information not traditionally included with part-of-speech annotation), and (b) Arabic treebanking, which characterizes the constituent structures of word sequences, provides categories for each non-terminal node, and identifies null elements, co-reference, traces and so on.

Data

This release contains 243,117 source tokens before clitics were split, and 308,996 tree tokens after clitics were separated for treebank annotation. The source material is weblogs collected by LDC from various sources.

The data are released as plain-text, tdf and xml files in UTF-8.

Samples

Please view this sample.

Updates

None at this time.

Acknowledgement

This work was supported in part by the Defense Advanced Research Projects Agency, GALE Program Grant No. HR0011-06-1-0003. The content of this publication does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.

Available Media

View Fees





Login for the applicable fee