Penn Discourse Treebank Version 3.0

Item Name: Penn Discourse Treebank Version 3.0
Author(s): Rashmi Prasad, Bonnie Webber, Alan Lee, Aravind Joshi
LDC Catalog No.: LDC2019T05
ISBN: 1-58563-877-3
ISLRN: 977-491-842-427-0
Release Date: March 15, 2019
Member Year(s): 2019
DCMI Type(s): Text
Data Source(s): newswire
Application(s): discourse analysis, discourse parsing, information extraction, information retrieval, language generation, linguistic analysis, subjectivity analysis, summarization
Language(s): English
Language ID(s): eng
License(s): LDC User Agreement for Non-Members
Online Documentation: LDC2019T05 Documents
Licensing Instructions: Subscription & Standard Members, and Non-Members
Citation: Prasad, Rashmi, et al. Penn Discourse Treebank Version 3.0 LDC2019T05. Web Download. Philadelphia: Linguistic Data Consortium, 2019.
Related Works: Hide View

Introduction

Penn Discourse Treebank (PDTB) Version 3.0 is the third release in the Penn Discourse Treebank project, the goal of which is to annotate the Wall Street Journal (WSJ) section of Treebank-2 (LDC95T7) with discourse relations. Penn Discourse Treebank Version 2 (LDC2008T05) contains over 40,600 tokens of annotated relations. In Version 3, an additional 13,000 tokens were annotated, certain pairwise annotations were standardized, new senses were included and the corpus was subject to a series of consistency checks. Details concerning the development of PDTB Version 3.0 can be found in the documentation accompanying this release.

Largely because the PDTB project was based on the idea that discourse relations are grounded in an identifiable set of explicit words or phrases (discourse connectives) or simply in the adjacency of two sentences, the PTDB has been used by many researchers in the natural language processing community and more recently, by researchers in psycholinguistics. It has also stimulated the development of similar resources in other languages and domains.

Data

Annotations are provided in the form of separate text files (standoff annotation) that are byte-indexed into the raw WSJ text files in Treebank-2. The raw WSJ files are also included in this release. All text files are plain text, encoded in UTF-8.

This corpus contains two tools: (1) The Annotator, used for annotation and adjudication, and which can also be used for viewing the corpus; and (2) The Conversion Tool for converting Version 2 annotation files into the Version 3 format.

The documentation directory contains a manual describing what is new in Version 3 and how Version 3 differs from Version 2; the methods and guidelines used in annotating PDTB Version 3; and a range of statistics on the tokens, including the frequency of each connective, its sense labels and its modifiers. More information about the corpus and research carried out by the developers and others using the corpus can be found on the PDTB website.

Samples

One can see samples of the annotation of different types of discourse relations, along with their visualization in the Annotator tool at:

Updates

None at this time.

Acknowledgment

This work has been funded by the National Science Foundation, under grant NSF IIS 1422186 to the University of Pennsylvania and grant NSF IIS 1421067 to the University of Wisconsin, Milwaukee. The content of this publication does not necessarily reflect the position or policy of the Government, and no official endorsement should be inferred.

Available Media

View Fees





Login for the applicable fee