2001 Communicator Dialogue Act Tagged

Item Name: 2001 Communicator Dialogue Act Tagged
Author(s): Rashmi Prasad, Marilyn Walker
LDC Catalog No.: LDC2004T16
ISBN: 1-58563-306-2
ISLRN: 137-996-514-791-4
Release Date: June 15, 2004
Member Year(s): 2004
DCMI Type(s): Text
Data Source(s): telephone conversations
Project(s): Communicator
Application(s): topic detection and tracking, tagging, summarization, spoken dialogue systems, spoken dialogue modeling, speech recognition, nominal expression generation
Language(s): English
Language ID(s): eng
License(s): LDC User Agreement for Non-Members
Online Documentation: LDC2004T16 Documents
Licensing Instructions: Subscription & Standard Members, and Non-Members
Citation: Prasad, Rashmi, and Marilyn Walker. 2001 Communicator Dialogue Act Tagged LDC2004T16. Web Download. Philadelphia: Linguistic Data Consortium, 2004.

Introduction

2001 Communicator Dialogue Act Tagged was produced by Linguistic Data Consortium (LDC) catalog number LDC2004T16 and ISBN 1-58563-306-2.

This corpus is an addendum to the 2001 Communicator Evaluation corpus produced by the LDC in 2003. This addendum contains annotations on the transcriptions of the system and user utterances as taken from the corrected logfiles of the 2001 Communicator Evaluation corpus. Corrections were hand-done for missing or misaligned time-stamps on turn/utterance boundaries.

Dialogue Act Annotations are provided for system utterances in the dialogues. The dialogue act tags follow the DATE (Dialogue Act Tagging for Evaluation) scheme. In addition, both system and user utterances are tagged for named entities. For further description of the 2001 Communicator Evaluation corpus, please refer to the main publication from 2003 (LDC2003S01).

Data

The complete Dialogue Act annotated corpus is available as a single XML text file totalling approximately 67 MB.

The total number of dialogues is 1,683. There are 1,151,330 words (tokens) and 5,343,286 unique words.

Each dialogue is segmented into system and user turns. The total number of turns for the entire corpus is 78,718 (39,419 system turns and 39,299 user turns). Turns were further segmented into utterances in the system logfiles. The total number of utterances is 89,666 (39,417 system utterances and 50,249 user utterances). There are a total of 1,048,311 words in the system utterances and a total of 103,019 words in the user utterances.

The total number of tagged dialogue acts is 82,277 with 68 unique tags. Dialogue Act tagging was done automatically using pattern matching with human-labeled dialogue utterances used by the nine different participating Communicator Systems. Named entity tagging also followed the same methodology.

Sponsorship

This research was conducted using funding from the following grant number and funding agency: DARPA contract MDA972-99-3-0003.

Updates

There are no updates available at this time.

Available Media

View Fees





Login for the applicable fee