DEFT Narrative Text
Item Name: | DEFT Narrative Text |
Author(s): | Jennifer Tracey, Dana Fore, Stephanie Strassel |
LDC Catalog No.: | LDC2016T07 |
ISBN: | 1-58563-747-5 |
ISLRN: | 732-088-594-631-3 |
DOI: | https://doi.org/10.35111/s3rq-f204 |
Release Date: | March 15, 2016 |
Member Year(s): | 2016 |
DCMI Type(s): | Text |
Data Source(s): | newswire |
Project(s): | DEFT |
Application(s): | language modeling |
Language(s): | English |
Language ID(s): | eng |
License(s): |
LDC User Agreement for Non-Members |
Online Documentation: | LDC2016T07 Documents |
Licensing Instructions: | Subscription & Standard Members, and Non-Members |
Citation: | Tracey, Jennifer, Dana Fore, and Stephanie Strassel. DEFT Narrative Text LDC2016T07. Web Download. Philadelphia: Linguistic Data Consortium, 2016. |
Related Works: | View |
Introduction
DEFT Narrative Text was developed by the Linguistic Data Consortium (LDC) and contains proxy reports and their source newswire used to support DARPA's Deep Exploration and Filtering of Text (DEFT) program. Among the goals of the DEFT program is to develop technologies that can perform various NLP tasks on data in a variety of genres, both formal and informal.
LDC provided source data and annotations for DEFT system development. DEFT Narrative Text consists of "proxy reports" (and "multi-proxy reports") in English. (Multi-)proxy reports are intended to mimic the format and other features of some types of government analyst reports using content from newswire articles. The corresponding English newswire source documents are also included in the release.
Data
LDC staff manually selected the source newswire from English Gigaword Fifth Edition (LDC2011T07). Articles were selected for topics of potential interest to the intelligence community based on general guidance from DEFT project sponsors.
The newswire source documents are XML files following the Gigaword corpus format. The proxy reports are in plain text format.
Samples
Please view these source xml and proxy text samples.
Updates
None at this time.
Acknowledgement
This material is based on research sponsored by Air Force Research Laboratory and Defense Advance Research Projects Agency under agreement number FA8750-13-2-0045. The U.S. Government is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright notation thereon. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of Air Force Research Laboratory and Defense Advanced Research Projects Agency or the U.S. Government.