2001 Communicator Dialogue Act Tagged

Item Name: 2001 Communicator Dialogue Act Tagged
Author(s): Rashmi Prasad, Marilyn Walker
LDC Catalog No.: LDC2004T16
ISBN: 1-58563-306-2
ISLRN: 137-996-514-791-4
DOI: https://doi.org/10.35111/r53v-7r46
Release Date: June 15, 2004
Member Year(s): 2004
DCMI Type(s): Text
Data Source(s): telephone conversations
Project(s): Communicator
Application(s): nominal expression generation, speech recognition, spoken dialogue modeling, spoken dialogue systems, summarization, tagging, topic detection and tracking
Language(s): English
Language ID(s): eng
License(s): LDC User Agreement for Non-Members
Online Documentation: LDC2004T16 Documents
Licensing Instructions: Subscription & Standard Members, and Non-Members
Citation: Prasad, Rashmi, and Marilyn Walker. 2001 Communicator Dialogue Act Tagged LDC2004T16. Web Download. Philadelphia: Linguistic Data Consortium, 2004.
Related Works: View

Introduction

2001 Communicator Dialogue Act Tagged was produced by the Linguistic Data Consortium (LDC) and contains approximately 1.15 million words of system and user interactions with entity and dialogue act tagging.

This corpus is an addendum to the 2001 Communicator Evaluation (LDC2003S01) corpus produced by LDC in 2003. This addendum contains annotations on the transcriptions of the system and user utterances as taken from the corrected log files of the 2001 Communicator Evaluation corpus. Corrections were done manually for missing or misaligned time-stamps on turn/utterance boundaries.

Dialogue Act Annotations are provided for system utterances in the dialogues. The dialogue act tags follow the DATE (Dialogue Act Tagging for Evaluation) scheme. In addition, both system and user utterances are tagged for named entities. For further description of the 2001 Communicator Evaluation corpus, please refer to the main publication from 2003 linked above.

Data

The complete Dialogue Act annotated corpus is available as a single XML text file totalling approximately 67 MB.

Here is the breakdown for dialogues and dialogue acts:

Dialogues Dialogue Acts Tagged Dialogue Acts Unique Tags
1,683 85,881 82,277 68

Dialogue Act tagging was done automatically using pattern matching with human-labeled dialogue utterances used by the nine different participating Communicator Systems. Named entity tagging also followed the same methodology.

Each dialogue is segmented into system and user turns. Here is a breakdown of the distribution of turns, utterances, and words:

  System User Total
Turns 39,419 39,299 78,718
Utterances 39,417 50,249 89,666
Words 1,048,311 103,019 1,151,330

Samples

For an example of the data in this corpus, please view this sample (XML).

Sponsorship

This research was conducted using funding from the following grant number and funding agency: DARPA contract MDA972-99-3-0003.

Updates

None at this time.

Available Media

View Fees





Login for the applicable fee