Arabic Treebank - Weblog
| Item Name: | Arabic Treebank - Weblog |
| Author(s): | Mohamed Maamouri, Ann Bies, Seth Kulick, Sondos Krouna, Dalila Tabassi, Michael Ciul |
| LDC Catalog No.: | LDC2016T02 |
| ISBN: | 1-58563-741-6 |
| ISLRN: | 479-780-942-548-4 |
| DOI: | https://doi.org/10.35111/q7nh-g640 |
| Release Date: | January 18, 2016 |
| Member Year(s): | 2016 |
| DCMI Type(s): | Text |
| Data Source(s): | weblogs |
| Project(s): | GALE |
| Application(s): | automatic content extraction, cross-lingual information retrieval, information detection |
| Language(s): | Arabic, Standard Arabic |
| Language ID(s): | ara, arb |
| License(s): |
LDC User Agreement for Non-Members |
| Online Documentation: | LDC2016T02 Documents |
| Licensing Instructions: | Subscription & Standard Members, and Non-Members |
| Citation: | Maamouri, Mohamed, et al. Arabic Treebank - Weblog LDC2016T02. Web Download. Philadelphia: Linguistic Data Consortium, 2016. |
| Related Works: | View |
Introduction
Arabic Treebank - Weblog was developed by the Linguistic Data Consortium (LDC) and consists of Arabic weblog data with part-of-speech, morphology, gloss and syntactic tree annotation.
The ongoing Penn Arabic Treebank Project (PATB) supports research in Arabic-language natural language processing and human language technology development. The methodology and work leading to the release of this publication are described in detail in the documentation accompanying this corpus. Generally, the PATB consists of two distinct phases: (a) part-of-speech (POS) tagging, which divides the text into lexical tokens and gives relevant information about each token such as lexical category, inflectional features, and a gloss (referred to as POS for convenience, although it includes morphological and gloss information not traditionally included with part-of-speech annotation), and (b) Arabic treebanking, which characterizes the constituent structures of word sequences, provides categories for each non-terminal node, and identifies null elements, co-reference, traces and so on.
Data
This release contains 243,117 source tokens before clitics were split, and 308,996 tree tokens after clitics were separated for treebank annotation. The source material is weblogs collected by LDC from various sources.
The data are released as plain-text, tdf and xml files in UTF-8.
Samples
Please view this sample.
Updates
None at this time.
Acknowledgement
This work was supported in part by the Defense Advanced Research Projects Agency, GALE Program Grant No. HR0011-06-1-0003. The content of this publication does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.