2003 NIST Language Recognition Evaluation

Item Name: 2003 NIST Language Recognition Evaluation
Author(s): Alvin Martin, Mark Pryzbocki
LDC Catalog No.: LDC2006S31
ISBN: 1-58563-364-X
ISLRN: 610-601-655-546-3
DOI: https://doi.org/10.35111/38cj-3k75
Release Date: June 15, 2006
Member Year(s): 2006
DCMI Type(s): Sound
Sample Type: ulaw
Sample Rate: 8000
Data Source(s): telephone conversations
Project(s): NIST LRE
Application(s): language identification
Language(s): Vietnamese, Tamil, Spanish, Iranian Persian, Korean, Japanese, Hindi, French, English, German, Mandarin Chinese, Egyptian Arabic, Russian
Language ID(s): vie, tam, spa, pes, kor, jpn, hin, fra, eng, deu, cmn, arz, rus
License(s): LDC User Agreement for Non-Members
Online Documentation: LDC2006S31 Documents
Licensing Instructions: Subscription & Standard Members, and Non-Members
Citation: Martin, Alvin, and Mark Pryzbocki. 2003 NIST Language Recognition Evaluation LDC2006S31. Web Download. Philadelphia: Linguistic Data Consortium, 2006.
Related Works: View


2003 NIST Language Recognition Evaluation was developed by the Linguistic Data Consortium (LDC) and the National Institute of Standards and Technology. It consists of 46 hours of telephone conversation speech in Arabic, English, Farsi, French, German, Hindi, Japanese, Korean, Mandarin, Russian, Spanish, Tamil, and Vietnamese.

The goal of NIST's Language Recognition Evaluation (LRE) is to establish the baseline of current performance capability for language recognition of conversational telephone speech and to lay the groundwork for further research efforts in the field. The series had its first evaluation in 1996. 2003 NIST Language Recognition Evaluation (LRE-03) was part of this ongoing series of evaluations of language recognition technology.

The task evaluated was the detection of a given target language. Given a test segment of speech, a target language was assigned as a test hypothesis, and the task was to determine whether this test hypothesis was true or false. This release contains both the 1996 and 2003 NIST Language Recognition Evaluations.

LDC released other LREs as:


Each speech file is one side of a "four wire" telephone conversation represented as 8-bit, 8-kHz mulaw data. There are 11,830 speech files in SPHERE (.sph) format. The speech data was compiled from LDC's CALLFRIEND, CALLHOME, and Switchboard-2 corpora. Each file contains one test segment. The test segments are divided into three-second, 10-second, and 30-second tests, each in its own directory.


For an example of the data in this corpus, please listen to this sample (WAV).


A typo was fixed in the index.html file. There are 11,830 sphere files, not 11,839. The updated index file is available in the online docs folder.

Available Media

View Fees

Login for the applicable fee