2005 NIST Speaker Recognition Evaluation Test Data


Item Name: 2005 NIST Speaker Recognition Evaluation Test Data
Authors: NIST Multimodal Information Group
LDC Catalog No.: LDC2011S04
ISBN: 1-58563-586-3
Release Date: Jul 15, 2011
Data Type: speech
Sample Rate: 8000 Hz
Sampling Format: ulaw
Data Source(s): telephone speech
Project(s): NIST SRE
Application(s): speech recognition
Language(s): Arabic, English, Mandarin Chinese, Russian, Spanish
Language ID(s): ara, cmn, eng, rus, spa
Distribution: 7 DVD
Member fee: $0 for 2011 members
Non-member Fee: US $2000.00
Reduced-License Fee: US $1400.00
Extra-Copy Fee: US $1400.00
Non-member License: yes
Online documentation: yes
Licensing Instructions: Subscription & Standard Members, and Non-Members
Citation: NIST Multimodal Information Group
2011
2005 NIST Speaker Recognition Evaluation Test Data
Linguistic Data Consortium, Philadelphia

Introduction

NIST 2005 Speaker Recognition Evaluation Test Data, Linguistic Data Consortium (LDC) catalog number LDC2011S04 and isbn 1-58563-586-3, was developed at LDC and NIST (National Institute of Standards and Technology). It consists of 525 hours of conversational telephone speech in English, Arabic, Mandarin Chinese, Russian and Spanish and associated English transcripts used as test data in the NIST-sponsored 2005 Speaker Recognition Evaluation (SRE). The ongoing series of SRE yearly evaluations conducted by NIST are intended to be of interest to researchers working on the general problem of text independent speaker recognition. To that end the evaluations are designed to be simple, to focus on core technology issues, to be fully supported and accessible.

The task of the 2005 SRE evaluation was speaker detection, that is, to determine whether a specified speaker is speaking during a given segment of conversational speech. The task was divided into 20 distinct and separate tests involving one of five training conditions and one of four test conditions. Further information about the task conditions is contained in the The NIST Year 2005 Speaker Recognition Evaluation Plan.

The training data for the 2005 evaluation is available in NIST 2005 Speaker Recognition Evaluation Training Data LDC2011S01.

Data

The speech data consists of conversational telephone speech with multi-channel data collected by LDC simultaneously from a number of auxiliary microphones. The files are organized into two segments: 10 second two-channel excerpts (continuous segments from single conversations that are estimated to contain approximately 10 seconds of actual speech in the channel of interest) and 5 minute two-channel conversations.

The data are stored as 8-bit u-law speech signals in NIST SPHERE format. In addition to the standard header fields, the SPHERE header for each file contains some auxiliary information that includes the language of the conversation and whether the data was recorded over a telephone line.

English language word transcripts in .cmt format were produced using an automatic speech recognition system (ASR) with error rates in the range of 15-30%.

Samples

For an example of the data contained in this corpus, review this audio sample.

Updates

Trials files for the 2005 SRE evaluation were added Jan. 05, 2012 in the LDC2011S04U01 update. These files define the various evaluation tests, with one file for each trial in the evaluation. The index.html and file.tbl files were also updated. All copies of LDC2011S04 ordered after Jan. 05, 2012 should contain those updates. Please contact ldc@ldc.upenn.edu with any questions.

Content Copyright

Portions 2004-2005, 2011 Trustees of the University of Pennsylvania