DEFT Narrative Text

Item Name: DEFT Narrative Text
Author(s): Jennifer Tracey, Dana Fore, Stephanie Strassel
LDC Catalog No.: LDC2016T07
ISBN: 1-58563-747-5
ISLRN: 732-088-594-631-3
Release Date: March 15, 2016
Member Year(s): 2016
DCMI Type(s): Text
Data Source(s): newswire
Project(s): DEFT
Application(s): language modeling
Language(s): English
Language ID(s): eng
License(s): LDC User Agreement for Non-Members
Online Documentation: LDC2016T07 Documents
Licensing Instructions: Subscription & Standard Members, and Non-Members
Citation: Tracey, Jennifer, Dana Fore, and Stephanie Strassel. DEFT Narrative Text LDC2016T07. Web Download. Philadelphia: Linguistic Data Consortium, 2016.

Introduction

DEFT Narrative Text was developed by the Linguistic Data Consortium (LDC) and contains proxy reports and their source newswire used to support DARPA's Deep Exploration and Filtering of Text (DEFT) program. Among the goals of the DEFT program is to develop technologies that can perform various NLP tasks on data in a variety of genres, both formal and informal.

LDC provided source data and annotations for DEFT system development. DEFT Narrative Text consists of "proxy reports" (and "multi-proxy reports") in English. (Multi-)proxy reports are intended to mimic the format and other features of some types of government analyst reports using content from newswire articles. The corresponding English newswire source documents are also included in the release.

Data

LDC staff manually selected the source newswire from English Gigaword Fifth Edition (LDC2011T07). Articles were selected for topics of potential interest to the intelligence community based on general guidance from DEFT project sponsors.

The newswire source documents are XML files following the Gigaword corpus format. The proxy reports are in plain text format.

Samples

Please view these source xml and proxy text samples.

Updates

None at this time.

Acknowledgement

This material is based on research sponsored by Air Force Research Laboratory and Defense Advance Research Projects Agency under agreement number FA8750-13-2-0045. The U.S. Government is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright notation thereon. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of Air Force Research Laboratory and Defense Advanced Research Projects Agency or the U.S. Government.

Available Media

View Fees





Login for the applicable fee