KAIROS Schema Learning Complex Event Annotation
Item Name: | KAIROS Schema Learning Complex Event Annotation |
Author(s): | Song Chen, Jennifer Tracey, Ann Bies, Christopher Caruso, Stephanie Strassel |
LDC Catalog No.: | LDC2025T07 |
ISLRN: | 547-554-339-324-6 |
DOI: | https://doi.org/10.35111/g7sc-nt96 |
Release Date: | June 16, 2025 |
Member Year(s): | 2025 |
DCMI Type(s): | Image, MovingImage, Software, Sound, StillImage, Text |
Data Source(s): | web collection |
Project(s): | KAIROS |
Application(s): | entity extraction, information extraction |
Language(s): | Spanish, English |
Language ID(s): | spa, eng |
License(s): |
LDC User Agreement for Non-Members |
Online Documentation: | LDC2025T07 Documents |
Licensing Instructions: | Subscription & Standard Members, and Non-Members |
Citation: | Chen, Song, et al. KAIROS Schema Learning Complex Event Annotation LDC2025T07. Web Download. Philadelphia: Linguistic Data Consortium, 2025. |
Introduction
KAIROS Schema Learning Complex Event Annotation was developed by the Linguistic Data Consortium (LDC) to support the DARPA KAIROS program. It contains English and Spanish text, audio, video and image data labeled for 93 real-world complex events (CEs) with event, relation and argument annotations linking to document provenance.
The DARPA KAIROS (Knowledge-directed Artificial Intelligence Reasoning Over Schemas) program aimed to build technology capable of understanding and reasoning about complex real-world events in order to provide actionable insights to end users. KAIROS systems utilized formal event representations in the form of schema libraries that specified the steps, preconditions and constraints for an open set of complex events; schemas were then used in combination with event extraction to characterize and make predictions about real-world events in a large multilingual, multimedia corpus.
Data
Source data was collected from the web by LDC. 3431 root web pages were collected and processed, yielding 1919 text data files, 24019 image files, 1472 video files and 16 audio files. Annotatioan steps included provenance linking (linking events in a document to a CE) and mentions (event and relation frames). Data scouting and annotation guidelines are included in the documentation accompanying this release.
The table below summarizes the number of documents collected and the annotation applied to them:
- Total CEs - total complex events subject to data collection and annotation
- Total Docs Source - CE-relevant root documents collected and processed
- Total Docs for Provlink - root documents labeled for provenance linking
- Total Docs Mention - root documents labeled for events, relations, and schema
linking
Language | Total CEs | Total Docs Source | Total Docs for Provlink | Total Docs Mention |
---|---|---|---|---|
English | 93 | 2,190 | 650 | 216 |
Spanish | 90 | 1,241 | 493 | 122 |
Total | 93 | 3,431 | 1,143 | 338 |
Software tools are also included in this release. The tools recreate original source data from the processed XML material.
- ltf2rsd.perl -- convert ltf.xml files to rsd.txt (raw-source-data)
- ltfzip2rsd.perl -- extract and convert ltf.xml files from zip archives
Sponsorship
KAIROS was sponsored by the Air Force Research Laboratory (AFRL) and the Defense Advanced Research Projects Agency (DARPA) under Contract No. HR0011-19-S-0014.
Samples
Please view the following samples:
- Argument Mentions
- Complex Event Linking
- Event Mention Annotation
- Event Mention Argument Slots
- Provlinking
- Relation Mention Annotation
- Relation Mention Argument Slots
Updates
No updates at this time.