2003 NIST Language Recognition Evaluation
| Item Name: | 2003 NIST Language Recognition Evaluation |
| Author(s): | Alvin Martin, Mark Pryzbocki |
| LDC Catalog No.: | LDC2006S31 |
| ISBN: | 1-58563-364-X |
| ISLRN: | 610-601-655-546-3 |
| DOI: | https://doi.org/10.35111/38cj-3k75 |
| Release Date: | June 15, 2006 |
| Member Year(s): | 2006 |
| DCMI Type(s): | Sound |
| Sample Type: | ulaw |
| Sample Rate: | 8000 |
| Data Source(s): | telephone conversations |
| Project(s): | NIST LRE |
| Application(s): | language identification |
| Language(s): | Vietnamese, Tamil, Spanish, Iranian Persian, Korean, Japanese, Hindi, French, English, German, Mandarin Chinese, Egyptian Arabic, Russian |
| Language ID(s): | vie, tam, spa, pes, kor, jpn, hin, fra, eng, deu, cmn, arz, rus |
| License(s): |
LDC User Agreement for Non-Members |
| Online Documentation: | LDC2006S31 Documents |
| Licensing Instructions: | Subscription & Standard Members, and Non-Members |
| Citation: | Martin, Alvin, and Mark Pryzbocki. 2003 NIST Language Recognition Evaluation LDC2006S31. Web Download. Philadelphia: Linguistic Data Consortium, 2006. |
| Related Works: | View |
Introduction
2003 NIST Language Recognition Evaluation was developed by the Linguistic Data Consortium (LDC) and the National Institute of Standards and Technology. It consists of 46 hours of telephone conversation speech in Arabic, English, Farsi, French, German, Hindi, Japanese, Korean, Mandarin, Russian, Spanish, Tamil, and Vietnamese.
The goal of NIST's Language Recognition Evaluation (LRE) is to establish the baseline of current performance capability for language recognition of conversational telephone speech and to lay the groundwork for further research efforts in the field. The series had its first evaluation in 1996. 2003 NIST Language Recognition Evaluation (LRE-03) was part of this ongoing series of evaluations of language recognition technology.
The task evaluated was the detection of a given target language. Given a test segment of speech, a target language was assigned as a test hypothesis, and the task was to determine whether this test hypothesis was true or false. This release contains both the 1996 and 2003 NIST Language Recognition Evaluations.
LDC released other LREs as:
- 2005 NIST Language Recognition Evaluation (LDC2008S05)
- 2007 NIST Language Recognition Evaluation Test Set (LDC2009S04)
- 2007 NIST Language Recognition Evaluation Supplemental Training Set (LDC2009S05)
- 2009 NIST Language Recognition Evaluation Test Set (LDC2014S06)
- 2011 NIST Language Recognition Evaluation Test Set (LDC2018S06)
Data
Each speech file is one side of a "four wire" telephone conversation represented as 8-bit, 8-kHz mulaw data. There are 11,830 speech files in SPHERE (.sph) format. The speech data was compiled from LDC's CALLFRIEND, CALLHOME, and Switchboard-2 corpora. Each file contains one test segment. The test segments are divided into three-second, 10-second, and 30-second tests, each in its own directory.
Samples
For an example of the data in this corpus, please listen to this sample (WAV).
Updates
A typo was fixed in the index.html file. There are 11,830 sphere files, not 11,839. The updated index file is available in the online docs folder.