TAC KBP English Regular Slot Filling - Comprehensive Training and Evaluation Data 2009-2014

Item Name: TAC KBP English Regular Slot Filling - Comprehensive Training and Evaluation Data 2009-2014
Author(s): Joe Ellis, Jeremy Getman, Stephanie Strassel
LDC Catalog No.: LDC2018T22
ISBN: 1-58563-862-5
ISLRN: 074-325-621-428-8
DOI: https://doi.org/10.35111/pjvt-aj18
Release Date: October 15, 2018
Member Year(s): 2018
DCMI Type(s): Text
Data Source(s): discussion forum, newswire, web collection
Project(s): TAC
Application(s): information extraction, relation extraction, knowledge base population, knowledge representation
Language(s): English
Language ID(s): eng
License(s): LDC User Agreement for Non-Members
Online Documentation: LDC2018T22 Documents
Licensing Instructions: Subscription & Standard Members, and Non-Members
Citation: Ellis, Joe, Jeremy Getman, and Stephanie Strassel. TAC KBP English Regular Slot Filling - Comprehensive Training and Evaluation Data 2009-2014 LDC2018T22. Web Download. Philadelphia: Linguistic Data Consortium, 2018.
Related Works: View


TAC KBP English Regular Slot Filling - Comprehensive Training and Evaluation Data 2009-2014 was developed by the Linguistic Data Consortium (LDC) and contains training and evaluation data produced in support of the TAC KBP Slot Filling evaluation track conducted from 2009 to 2014.

Text Analysis Conference (TAC) is a series of workshops organized by the National Institute of Standards and Technology (NIST). TAC was developed to encourage research in natural language processing and related applications by providing a large test collection, common evaluation procedures, and a forum for researchers to share their results. Through its various evaluations, the Knowledge Base Population (KBP) track of TAC encourages the development of systems that can match entities mentioned in natural texts with those appearing in a knowledge base and extract novel information about entities from a document collection and add it to a new or existing knowledge base.

The regular English Slot Filling evaluation track involved mining information about entities from text. Slot Filling can be viewed as more traditional Information Extraction, or alternatively, as a Question Answering task, in which the questions are static but the targets change. In completing the task, participating systems and LDC annotators searched a corpus for information on certain attributes (slots) of person and organization entities and attempted to return all valid answers (slot fillers) in the source collection. For more information about English Slot Filling, please refer to the 2014 track home page.


This package contains all evaluation and training data developed in support of TAC KBP Slot Filling during the six years in which the track was conducted, from 2009-2014. This includes queries, the 'manual runs' (human-produced responses to the queries), and the final rounds of assessment results. The corresponding source document collections for this release are included in TAC KBP Comprehensive English Source Corpora 2009-2014 (LDC2018T03). The corresponding Knowledge Base (KB) for much of the data - a 2008 snapshot of Wikipedia - is contained in TAC KBP Reference Knowledge Base (LDC2014T16). All text data is encoded as UTF-8.


This material is based on research sponsored by Air Force Research Laboratory and Defense Advance Research Projects Agency under agreement number FA8750-13-2-0045. The U.S. Government is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright notation thereon. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of Air Force Research Laboratory and Defense Advanced Research Projects Agency or the U.S. Government.


Please view the following samples.


None at this time.

Available Media

View Fees

Login for the applicable fee