2005 Spring NIST Rich Transcription (RT-05S) Evaluation Set
|Item Name:||2005 Spring NIST Rich Transcription (RT-05S) Evaluation Set|
|Author(s):||NIST Multimodal Information Group|
|LDC Catalog No.:||LDC2011S06|
|Release Date:||August 15, 2011|
|Data Source(s):||meeting speech|
|Application(s):||speech recognition, speaker verification, speaker identification, metadata extraction, discourse analysis, diarization|
LDC User Agreement for Non-Members
|Online Documentation:||LDC2011S06 Documents|
|Licensing Instructions:||Subscription & Standard Members, and Non-Members|
|Citation:||NIST Multimodal Information Group. 2005 Spring NIST Rich Transcription (RT-05S) Evaluation Set LDC2011S06. DVD. Philadelphia: Linguistic Data Consortium, 2011.|
2005 Spring NIST Rich Transcription (RT-05S) Conference Meeting Evaluation Set was developed by LDC and NIST (National Institute of Standards and Technology). It contains approximately 78 hours of English meeting speech, reference transcripts and other material used in the RT Spring 2005 evaluation. Rich Transcription (RT) is broadly defined as a fusion of speech-to-text (STT) technology and metadata extraction technologies providing the bases for the generation of more usable transcriptions of human-human speech in meetings. LDC has also released 2004 Spring NIST Rich Transcription (RT-04S) Development Data LDC2007S11 and 2004 Spring NIST Rich Transcription (RT-04S) Evaluation Data LDC2007S12.
RT-05S included the following tasks in the meeting domain:
- Speech-To-Text (STT) -convert spoken words into streams of text
- Speaker Diarization (SPKR) -find the segments of time within a meeting in which each meeting participant is talking
- Speech Activity Detection (SAD) - detect when someone in a meeting space is talking
Further information about the evaluation is available on the RT-05Spring Evaluation Website. Please note the lecture meeting data is not included in this release.
The data in this release consists of portions of meeting speech collected between 2001 and 2005 by the IDIAP Research Institutes Augmented Multi-Party Interaction project (AMI), Martigny, Switzerland International Computer Science Institute (ICSI) at University of California, Berkeley Interactive Systems Laboratories (ISL) at Carnegie Mellon University (CMU), Pittsburgh, PA NIST and Virginia Polytechnic Institute and State University (VT), Blacksburg, VA. Each meeting excerpt contains a head-mic recording for each subject and one or more distant microphone recordings.
Reference transcripts for the evaluation excerpts were prepared by LDC according to its Meeting Recording Careful Transcription Guidelines. Those specifications are designed to provide an accurate, verbatim (word-for-word) transcription, time-aligned with the audio file and including the identification of additional audio and speech signals with special mark-up.