Second DIHARD Challenge Development - Eleven Sources
| Item Name: | Second DIHARD Challenge Development - Eleven Sources |
| Author(s): | Neville Ryant, Mark Liberman, James Fiumara, Christopher Cieri |
| LDC Catalog No.: | LDC2021S10 |
| ISBN: | 1-58563-979-6 |
| ISLRN: | 415-952-625-445-8 |
| DOI: | https://doi.org/10.35111/4baw-5y14 |
| Release Date: | November 15, 2021 |
| Member Year(s): | 2021 |
| DCMI Type(s): | Software, Sound, Text |
| Sample Type: | pcm |
| Sample Rate: | 16000 |
| Data Source(s): | broadcast conversation, meeting speech, microphone conversation, microphone speech, telephone conversations, telephone speech, web collection |
| Application(s): | diarization, speech activity detection |
| Language(s): | Mandarin Chinese, English |
| Language ID(s): | cmn, eng |
| License(s): |
LDC User Agreement for Non-Members |
| Online Documentation: | LDC2021S10 Documents |
| Licensing Instructions: | Subscription & Standard Members, and Non-Members |
| Citation: | Ryant, Neville, et al. Second DIHARD Challenge Development - Eleven Sources LDC2021S10. Web Download. Philadelphia: Linguistic Data Consortium, 2021. |
| Related Works: | View |
Introduction
Second DIHARD Challenge Development - Eleven Sources was developed by LDC and contains approximately 22 hours of English and Chinese speech data along with corresponding annotations used in support of the Second DIHARD Challenge.
The DIHARD Challenges are a set of shared tasks on diarization focusing on "hard" diarization; that is, speech diarization for challenging corpora where there was an expectation that existing state-of-the-art systems would fare poorly. As with the first challenge, the second development and evaluation sets were drawn from a diverse sampling of sources including monologues, map task dialogues, broadcast interviews, sociolinguistic interviews, meeting speech, speech in restaurants, clinical recordings, extended child language acquisition recordings, and YouTube videos.
Data
This release, when combined with Second DIHARD Challenge Development - SEEDLingS (LDC2021S11), contains the development set audio data and annotation, except for CHiME-5 audio files, which must be obtained from the University of Sheffield.
Data sources used in this release are as follows (all sources are in English unless otherwise indicated):
- Autism Diagnosis Observation Schedule (ADOS) interviews
- CHiME-5 dinner party recordings (annotations only in this release)
- Conversations in Restaurants
- DCIEM/HCRC map task (LDC96S38)
- Audiobook recordings from LibriVox
- Meeting speech from 2004 Spring NIST Rich Transcription (RT-04S) Development (LDC2007S11) and Evaluation (LDC2007S12) releases
- 2001 U.S. Supreme Court oral arguments
- Sociolinguistic interviews from SLX Corpus of Classic Sociolinguistic Interviews (LDC2003T15)
- Mixer 6 Speech (LDC2013S03)
- English and Chinese video collected by LDC as part of the Video Annotation for Speech Technologies (VAST) project
- YouthPoint radio interviews
All audio is provided in the form of 16 kHz, 16-bit, mono-channel FLAC files. The diarization for each recording is stored as a NIST Rich Transcription Time Marked (RTTM) file. RTTM files are space-separated text files containing one turn per line. Segmentation files are stored as HTK label files. Each of these files contains one speech segment per line. Scoring regions for each recording are specific by un-partitioned evaluation map (UEM) files. All annotation file types are encoded as UTF-8. More information about file formats, data sources and domains is contained in the included documentation.
Samples
Please view these samples:
Updates
None at this time.