DEFT English Committed Belief Annotation
| Item Name: | DEFT English Committed Belief Annotation |
| Author(s): | Jennifer Tracey, Michael Arrigo, Stephanie Strassel |
| LDC Catalog No.: | LDC2019T16 |
| ISBN: | 1-58563-909-5 |
| ISLRN: | 829-913-265-214-2 |
| DOI: | https://doi.org/10.35111/830w-pf92 |
| Release Date: | November 15, 2019 |
| Member Year(s): | 2019 |
| DCMI Type(s): | Text |
| Data Source(s): | discussion forum |
| Project(s): | DEFT |
| Application(s): | anomaly analysis, belief detection |
| Language(s): | English |
| Language ID(s): | eng |
| License(s): |
LDC User Agreement for Non-Members |
| Online Documentation: | LDC2019T16 Documents |
| Licensing Instructions: | Subscription & Standard Members, and Non-Members |
| Citation: | Tracey, Jennifer, Michael Arrigo, and Stephanie Strassel. DEFT English Committed Belief Annotation LDC2019T16. Web Download. Philadelphia: Linguistic Data Consortium, 2019. |
| Related Works: | View |
Introduction
DEFT English Committed Belief Annotation was developed by the Linguistic Data Consortium (LDC) and consists of approximately 950,000 words of English discussion forum text annotated for "committed belief," which marks the level of commitment displayed by the author to the truth of the propositions expressed in the text.
DARPA's Deep Exploration and Filtering of Text (DEFT) program aimed to address remaining capability gaps in state-of-the-art natural language processing technologies related to inference, causal relationships and anomaly detection. LDC supported the DEFT program by collecting, creating and annotating a variety of data sources.
LDC has also released DEFT Chinese Committed Belief Annotation (LDC2019T03) and DEFT Spanish Committed Belief Annotation (LDC2019T09).
Data
The source data is English discussion forum web text collected by LDC. Annotations fall into one of four categories: committed belief, non-committed belief, reported belief and not applicable. Further information about the annotation methodology is contained in the documentation accompanying this release.
This publication contains 1,217 files (952,723 words). Annotation files are stored in XML format, and source documents are stored in plain text format. Both types of files are encoded in UTF-8.
Samples
Please view this source sample and annotation sample.
Updates
None at this time.
Acknowledgement
This material is based on research sponsored by Air Force Research Laboratory and Defense Advance Research Projects Agency under agreement number FA8750-13-2-0045. The U.S. Government is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright notation thereon. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of Air Force Research Laboratory and Defense Advanced Research Projects Agency or the U.S. Government.