LDC Corpora ⇔ Projects

Many of the corpora in the Catalog were developed for, or used in, sponsored research projects. Some of those resources were training and test data for benchmark tests of language-based systems developed during the project. A corpus is associated with a given project either because it was developed for the project, it was used in the project or it was considered otherwise relevant to the work of the project.

ACE

LDC2017T10 Abstract Meaning Representation (AMR) Annotation Release 2.0
LDC2020T02 Abstract Meaning Representation (AMR) Annotation Release 3.0
LDC2005T09 ACE 2004 Multilingual Training Corpus
LDC2008T03 ACE 2005 English SpatialML Annotations
LDC2011T02 ACE 2005 English SpatialML Annotations Version 2
LDC2010T09 ACE 2005 Mandarin SpatialML Annotations
LDC2006T06 ACE 2005 Multilingual Training Corpus
LDC2014T18 ACE 2007 Multilingual Training Corpus
LDC2015T20 ACE 2007 Spanish DevTest - Pilot Evaluation
LDC2010T18 ACE Time Normalization (TERN) 2004 English Evaluation Data V1.0
LDC2005T07 ACE Time Normalization (TERN) 2004 English Training Data v 1.0
LDC2003T11 ACE-2 Version 1.0
LDC2024T05 Automatic Content Extraction for Portuguese
LDC2005T33 BBN Pronoun Coreference and Entity Type Corpus
LDC2019T07 Chinese Abstract Meaning Representation 1.0
LDC2011T08 Datasets for Generic Relation Extraction (reACE)
LDC2004T14 Proposition Bank I
LDC2009T11 REFLEX Entity Translation Training/DevTest
LDC2004T09 TIDES Extraction (ACE) 2003 Multilingual Training Data

AIDA

LDC2023T10 AIDA Scenario 1 and 2 Reference Knowledge Base
LDC2024T02 AIDA Scenario 1 Practice Topic Annotation
LDC2023T11 AIDA Scenario 1 Practice Topic Source Data
LDC2024T06 AIDA Scenario 2 Practice Topic Annotation
LDC2024T04 AIDA Scenario 2 Practice Topic Source Data
LDC2023S01 AIDA Ukrainian Broadcast and Telephone Speech Audio and Transcripts

American National Corpus (ANC)

LDC2005T35 American National Corpus (ANC) Second Release
LDC2010T22 Manually Annotated Sub-Corpus First Release
LDC2013T12 Manually Annotated Sub-Corpus Third Release

AQUAINT

LDC2008T25 AQUAINT-2 Information-Retrieval Text Research Collection
LDC2005T33 BBN Pronoun Coreference and Entity Type Corpus

ATIS

LDC2021T04 ATIS - Seven Languages
LDC93S4A ATIS0 Complete
LDC93S4B ATIS0 Pilot
LDC93S4B-2 ATIS0 Read
LDC93S4B-3 ATIS0 SD Read
LDC93S5 ATIS2
LDC95S26 ATIS3 Test Data
LDC94S19 ATIS3 Training Data
LDC2019T04 Multilingual ATIS

BOLT

LDC2014T12 Abstract Meaning Representation (AMR) Annotation Release 1.0
LDC2017T10 Abstract Meaning Representation (AMR) Annotation Release 2.0
LDC2020T02 Abstract Meaning Representation (AMR) Annotation Release 3.0
LDC2020T07 Abstract Meaning Representation 2.0 - Four Translations
LDC2019T01 BOLT Arabic Discussion Forum Parallel Training Data
LDC2018T10 BOLT Arabic Discussion Forums
LDC2021T07 BOLT Chinese Co-reference -- Discussion Forum, SMS/Chat, and Conversational Telephone Speech
LDC2017T05 BOLT Chinese Discussion Forum Parallel Training Data
LDC2016T05 BOLT Chinese Discussion Forums
LDC2018T15 BOLT Chinese SMS/Chat
LDC2021T11 BOLT Chinese SMS/Chat Parallel Training Data
LDC2016T19 BOLT Chinese-English Word Alignment and Tagging -- Discussion Forum Training
LDC2020T15 BOLT Chinese-English Word Alignment and Tagging -- Conversational Telephone Speech Training
LDC2019T13 BOLT Chinese-English Word Alignment and Tagging -- SMS/Chat Training
LDC2021T14 BOLT Egyptian Arabic Co-reference -- Discussion Forum, SMS/Chat, and Conversational Telephone Speech
LDC2021T18 BOLT Egyptian Arabic PropBank and Sense -- Discussion Forum, SMS/Chat, and Conversational Telephone Speech
LDC2017T07 BOLT Egyptian Arabic SMS/Chat and Transliteration
LDC2021T15 BOLT Egyptian Arabic SMS/Chat Parallel Training Data
LDC2021T12 BOLT Egyptian Arabic Treebank - Conversational Telephone Speech
LDC2018T23 BOLT Egyptian Arabic Treebank - Discussion Forum
LDC2021T17 BOLT Egyptian Arabic Treebank - SMS/Chat
LDC2020T05 BOLT Egyptian Arabic-English Word Alignment -- Conversational Telephone Speech Training
LDC2019T18 BOLT Egyptian Arabic-English Word Alignment -- SMS/Chat Training
LDC2019T06 BOLT Egyptian-English Word Alignment -- Discussion Forum Training
LDC2020T20 BOLT English Co-reference -- Discussion Forum, SMS/Chat, and Conversational Telephone Speech
LDC2017T11 BOLT English Discussion Forums
LDC2020T21 BOLT English PropBank and Sense -- Discussion Forum, SMS/Chat, and Conversational Telephone Speech
LDC2018T19 BOLT English SMS/Chat
LDC2020T09 BOLT English Translation Treebank - Chinese Discussion Forum
LDC2021T19 BOLT English Translation Treebank - Chinese SMS/Chat
LDC2022T06 BOLT English Translation Treebank - Egyptian Arabic SMS/Chat
LDC2019T15 BOLT English Treebank - Discussion Forum
LDC2021T03 BOLT English Treebank - SMS/Chat
LDC2018T18 BOLT Information Retrieval Comprehensive Training and Evaluation
LDC2013T21 Chinese Treebank 8.0
LDC2016T13 Chinese Treebank 9.0
LDC2024T03 LoReHLT Hausa Representative Language Pack

CAMIO

LDC2022T07 CAMIO Transcription Languages

CHiME

LDC2017S07 CHiME2 Grid
LDC2017S10 CHiME2 WSJ0
LDC2017S24 CHiME3

Communicator

LDC2004T15 2000 Communicator Dialogue Act Tagged
LDC2002S56 2000 Communicator Evaluation
LDC2004T16 2001 Communicator Dialogue Act Tagged
LDC2003S01 2001 Communicator Evaluation

CoNLL

LDC2015T12 2006 CoNLL Shared Task - Arabic & Czech
LDC2015T11 2006 CoNLL Shared Task - Ten Languages
LDC2018T08 2007 CoNLL Shared Task - Arabic & English
LDC2018T06 2007 CoNLL Shared Task - Basque, Catalan, Czech & Turkish
LDC2018T07 2007 CoNLL Shared Task - Greek, Hungarian & Italian
LDC2012T03 2009 CoNLL Shared Task Part 1
LDC2012T04 2009 CoNLL Shared Task Part 2
LDC2017T13 2015-2016 CoNLL Shared Task

DARPA-CSR

LDC2005S08 BBN/AUB DARPA Babylon Levantine Arabic Speech and Transcripts
LDC93S6A CSR-I (WSJ0) Complete
LDC93S6C CSR-I (WSJ0) Other
LDC93S6B CSR-I (WSJ0) Sennheiser
LDC94S13A CSR-II (WSJ1) Complete
LDC94S13C CSR-II (WSJ1) Other
LDC94S13B CSR-II (WSJ1) Sennheiser
LDC95S23 CSR-III Speech
LDC95T6 CSR-III Text
LDC96S33 CSR-IV HUB3
LDC96S31 CSR-IV HUB4

DASL

LDC2003T15 SLX Corpus of Classic Sociolinguistic Interviews

DEFT

LDC2014T12 Abstract Meaning Representation (AMR) Annotation Release 1.0
LDC2017T10 Abstract Meaning Representation (AMR) Annotation Release 2.0
LDC2020T02 Abstract Meaning Representation (AMR) Annotation Release 3.0
LDC2020T07 Abstract Meaning Representation 2.0 - Four Translations
LDC2020L02 Chinese Lexical Resources for Gender, Number, Animacy
LDC2019T03 DEFT Chinese Committed Belief Annotation
LDC2020T19 DEFT Chinese Light and Rich ERE Annotation
LDC2019T16 DEFT English Committed Belief Annotation
LDC2023T04 DEFT English Light and Rich ERE Annotation
LDC2016T07 DEFT Narrative Text
LDC2019T09 DEFT Spanish Committed Belief Annotation
LDC2018T01 DEFT Spanish Treebank
LDC2016T23 Richer Event Description
LDC2023T13 TAC KBP Belief and Sentiment - Comprehensive Training and Evaluation Data 2016-2017
LDC2017T09 The EventStatus Corpus

DIRHA

LDC2018S01 DIRHA English WSJ Audio

DOE/IRS2008-0256

LDC2023L01 Moroccan Arabic - English Lexical Database

EARS

LDC97S66 1996 English Broadcast News Dev and Eval (HUB4)
LDC97S44 1996 English Broadcast News Speech (HUB4)
LDC97T22 1996 English Broadcast News Transcripts (HUB4)
LDC98S71 1997 English Broadcast News Speech (HUB4)
LDC98T28 1997 English Broadcast News Transcripts (HUB4)
LDC2001S91 1997 HUB4 Broadcast News Evaluation Non-English Test Material
LDC2002S11 1997 HUB4 English Evaluation Speech and Transcripts
LDC2002S22 1997 HUB5 Arabic Evaluation
LDC2002T39 1997 HUB5 Arabic Transcripts
LDC2002S24 1997 HUB5 German Evaluation
LDC2003T03 1997 HUB5 German Transcripts
LDC2002S25 1997 HUB5 Spanish Evaluation
LDC2003T04 1997 HUB5 Spanish Transcripts
LDC98S73 1997 Mandarin Broadcast News Speech (HUB4-NE)
LDC98T24 1997 Mandarin Broadcast News Transcripts (HUB4-NE)
LDC2002S10 1998 HUB5 English Evaluation
LDC2003T02 1998 HUB5 English Transcripts
LDC2002S13 2001 HUB5 English Evaluation
LDC2002S12 2001 HUB5 Mandarin Evaluation
LDC2003T01 2001 HUB5 Mandarin Transcripts
LDC2004S11 2002 Rich Transcription Broadcast News and Conversational Telephone Speech
LDC99L23 American English Spoken Lexicon
LDC2005S07 Arabic CTS Levantine Fisher Training Data Set 3, Speech
LDC2005T03 Arabic CTS Levantine Fisher Training Data Set 3, Transcripts
LDC2003T12 Arabic Gigaword
LDC2001T55 Arabic Newswire Part 1
LDC2005S08 BBN/AUB DARPA Babylon Levantine Arabic Speech and Transcripts
LDC96S46 CALLFRIEND American English-Non-Southern Dialect
LDC2019S21 CALLFRIEND American English-Non-Southern Dialect Second Edition
LDC96S47 CALLFRIEND American English-Southern Dialect
LDC2020S08 CALLFRIEND American English-Southern Dialect Second Edition
LDC2019S18 CALLFRIEND Canadian French Second Edition
LDC96S49 CALLFRIEND Egyptian Arabic
LDC2019S04 CALLFRIEND Egyptian Arabic Second Edition
LDC96S55 CALLFRIEND Mandarin Chinese-Mainland Dialect
LDC2018S09 CALLFRIEND Mandarin Chinese-Mainland Dialect Second Edition
LDC96S56 CALLFRIEND Mandarin Chinese-Taiwan Dialect
LDC2020S06 CALLFRIEND Mandarin Chinese-Taiwan Dialect Second Edition
LDC97L20 CALLHOME American English Lexicon (PRONLEX)
LDC97S42 CALLHOME American English Speech
LDC97T14 CALLHOME American English Transcripts
LDC97S45 CALLHOME Egyptian Arabic Speech
LDC2002S37 CALLHOME Egyptian Arabic Speech Supplement
LDC97T19 CALLHOME Egyptian Arabic Transcripts
LDC2002T38 CALLHOME Egyptian Arabic Transcripts Supplement
LDC96L15 CALLHOME Mandarin Chinese Lexicon
LDC96S34 CALLHOME Mandarin Chinese Speech
LDC96T16 CALLHOME Mandarin Chinese Transcripts
LDC2003T09 Chinese Gigaword
LDC2005T14 Chinese Gigaword Second Edition
LDC2005T08 Discourse Graphbank
LDC99L22 Egyptian Colloquial Arabic Lexicon
LDC2003T05 English Gigaword
LDC2005T12 English Gigaword Second Edition
LDC2005S13 Fisher English Training Part 2, Speech
LDC2005T19 Fisher English Training Part 2, Transcripts
LDC2004S13 Fisher English Training Speech Part 1 Speech
LDC2004T19 Fisher English Training Speech Part 1 Transcripts
LDC2005S15 HKUST Mandarin Telephone Speech, Part 1
LDC2005T32 HKUST Mandarin Telephone Transcript Data, Part 1
LDC2018S18 HUB5 Mandarin Telephone Speech and Transcripts Second Edition
LDC98S69 HUB5 Mandarin Telephone Speech Corpus
LDC98T26 HUB5 Mandarin Transcripts
LDC2005S14 Levantine Arabic QT Training Data Set 4 (Speech + Transcripts)
LDC2006S29 Levantine Arabic QT Training Data Set 5, Speech
LDC2006T07 Levantine Arabic QT Training Data Set 5, Transcripts
LDC95T13 Mandarin Chinese News Text
LDC95T21 North American News Text Corpus
LDC98T30 North American News Text Supplement
LDC2004S08 RT-03 MDE Training Data Speech
LDC2004T12 RT-03 MDE Training Data Text and Annotations
LDC2005S16 RT-04 MDE Training Data Speech
LDC2005T24 RT-04 MDE Training Data Text/Annotations
LDC2004S10 Santa Barbara Corpus of Spoken American English Part III
LDC2005S25 Santa Barbara Corpus of Spoken American English Part IV
LDC2006T12 Spanish Gigaword First Edition
LDC2009T21 Spanish Gigaword Second Edition
LDC2001S13 Switchboard Cellular Part 1 Audio
LDC2001S15 Switchboard Cellular Part 1 Transcribed Audio
LDC2001T14 Switchboard Cellular Part 1 Transcription
LDC2004S07 Switchboard Cellular Part 2 Audio
LDC97S62 Switchboard-1 Release 2
LDC98S75 Switchboard-2 Phase I
LDC99S79 Switchboard-2 Phase II
LDC2002S06 Switchboard-2 Phase III Audio
LDC98S72 Taiwanese Putonghua Speech and Transcripts
LDC98T25 TDT Pilot Study Corpus
LDC2000S92 TDT2 Careful Transcription Audio
LDC2000T44 TDT2 Careful Transcription Text
LDC99S84 TDT2 English Audio
LDC2001S93 TDT2 Mandarin Audio Corpus
LDC2001T57 TDT2 Multilanguage Text Version 4.0
LDC2001S94 TDT3 English Audio
LDC2001S95 TDT3 Mandarin Audio
LDC2001T58 TDT3 Multilanguage Text Version 2.0

GALE

LDC97S66 1996 English Broadcast News Dev and Eval (HUB4)
LDC97S44 1996 English Broadcast News Speech (HUB4)
LDC97T22 1996 English Broadcast News Transcripts (HUB4)
LDC98S71 1997 English Broadcast News Speech (HUB4)
LDC98T28 1997 English Broadcast News Transcripts (HUB4)
LDC2001S91 1997 HUB4 Broadcast News Evaluation Non-English Test Material
LDC2002S11 1997 HUB4 English Evaluation Speech and Transcripts
LDC2002S22 1997 HUB5 Arabic Evaluation
LDC2002T39 1997 HUB5 Arabic Transcripts
LDC2002S24 1997 HUB5 German Evaluation
LDC2003T03 1997 HUB5 German Transcripts
LDC2002S25 1997 HUB5 Spanish Evaluation
LDC2003T04 1997 HUB5 Spanish Transcripts
LDC98S73 1997 Mandarin Broadcast News Speech (HUB4-NE)
LDC98T24 1997 Mandarin Broadcast News Transcripts (HUB4-NE)
LDC2002S10 1998 HUB5 English Evaluation
LDC2003T02 1998 HUB5 English Transcripts
LDC2002S13 2001 HUB5 English Evaluation
LDC2002S12 2001 HUB5 Mandarin Evaluation
LDC2003T01 2001 HUB5 Mandarin Transcripts
LDC2004S11 2002 Rich Transcription Broadcast News and Conversational Telephone Speech
LDC2009T05 2008 NIST Metrics for Machine Translation (MetricsMATR08) Development Data
LDC2011T05 2008/2010 NIST Metrics for Machine Translation (MetricsMaTr) GALE Evaluation Set
LDC2017T10 Abstract Meaning Representation (AMR) Annotation Release 2.0
LDC2020T02 Abstract Meaning Representation (AMR) Annotation Release 3.0
LDC2005T09 ACE 2004 Multilingual Training Corpus
LDC2005T07 ACE Time Normalization (TERN) 2004 English Training Data v 1.0
LDC2003T11 ACE-2 Version 1.0
LDC93T1 ACL/DCI
LDC99L23 American English Spoken Lexicon
LDC2012T21 Annotated English Gigaword
LDC2005S07 Arabic CTS Levantine Fisher Training Data Set 3, Speech
LDC2005T03 Arabic CTS Levantine Fisher Training Data Set 3, Transcripts
LDC2004T18 Arabic English Parallel News Part 1
LDC2003T12 Arabic Gigaword
LDC2011T11 Arabic Gigaword Fifth Edition
LDC2009T30 Arabic Gigaword Fourth Edition
LDC2007T40 Arabic Gigaword Third Edition
LDC2004T17 Arabic News Translation Text Part 1
LDC2001T55 Arabic Newswire Part 1
LDC2012T07 Arabic Treebank - Broadcast News v1.0
LDC2016T02 Arabic Treebank - Weblog
LDC2003T07 Arabic Treebank: Part 1 - 10K-word English Translation
LDC2003T06 Arabic Treebank: Part 1 v 2.0
LDC2005T02 Arabic Treebank: Part 1 v 3.0 (POS with full vocalization + syntactic analysis)
LDC2010T13 Arabic Treebank: Part 1 v 4.1
LDC2004T02 Arabic Treebank: Part 2 v 2.0
LDC2011T09 Arabic Treebank: Part 2 v 3.1
LDC2005T20 Arabic Treebank: Part 3 (full corpus) v 2.0 (MPG + Syntactic Analysis)
LDC2004T11 Arabic Treebank: Part 3 v 1.0
LDC2012T09 Arabic-Dialect/English Parallel Text
LDC2005T33 BBN Pronoun Coreference and Entity Type Corpus
LDC2005S08 BBN/AUB DARPA Babylon Levantine Arabic Speech and Transcripts
LDC2000T43 BLLIP 1987-89 WSJ Corpus Release 1
LDC2002L49 Buckwalter Arabic Morphological Analyzer Version 1.0
LDC2004L02 Buckwalter Arabic Morphological Analyzer Version 2.0
LDC96S46 CALLFRIEND American English-Non-Southern Dialect
LDC2019S21 CALLFRIEND American English-Non-Southern Dialect Second Edition
LDC96S47 CALLFRIEND American English-Southern Dialect
LDC2020S08 CALLFRIEND American English-Southern Dialect Second Edition
LDC2019S18 CALLFRIEND Canadian French Second Edition
LDC96S49 CALLFRIEND Egyptian Arabic
LDC2019S04 CALLFRIEND Egyptian Arabic Second Edition
LDC96S55 CALLFRIEND Mandarin Chinese-Mainland Dialect
LDC2018S09 CALLFRIEND Mandarin Chinese-Mainland Dialect Second Edition
LDC96S56 CALLFRIEND Mandarin Chinese-Taiwan Dialect
LDC2020S06 CALLFRIEND Mandarin Chinese-Taiwan Dialect Second Edition
LDC97L20 CALLHOME American English Lexicon (PRONLEX)
LDC97S42 CALLHOME American English Speech
LDC97T14 CALLHOME American English Transcripts
LDC97S45 CALLHOME Egyptian Arabic Speech
LDC2002S37 CALLHOME Egyptian Arabic Speech Supplement
LDC97T19 CALLHOME Egyptian Arabic Transcripts
LDC2002T38 CALLHOME Egyptian Arabic Transcripts Supplement
LDC96L15 CALLHOME Mandarin Chinese Lexicon
LDC96S34 CALLHOME Mandarin Chinese Speech
LDC96T16 CALLHOME Mandarin Chinese Transcripts
LDC2005T13 CCGbank
LDC96L14 CELEX2
LDC2005T10 Chinese English News Magazine Parallel Text
LDC2003T09 Chinese Gigaword
LDC2011T13 Chinese Gigaword Fifth Edition
LDC2009T27 Chinese Gigaword Fourth Edition
LDC2005T14 Chinese Gigaword Second Edition
LDC2007T38 Chinese Gigaword Third Edition
LDC2005T06 Chinese News Translation Text Part 1
LDC2005T23 Chinese Proposition Bank 1.0
LDC2001T11 Chinese Treebank 2.0
LDC2004T05 Chinese Treebank 4.0
LDC2005T01 Chinese Treebank 5.0
LDC2007T36 Chinese Treebank 6.0
LDC2010T07 Chinese Treebank 7.0
LDC2013T21 Chinese Treebank 8.0
LDC2016T13 Chinese Treebank 9.0
LDC2002L27 Chinese-English Translation Lexicon Version 3.0
LDC2018T20 Concretely Annotated English Gigaword
LDC2005T08 Discourse Graphbank
LDC99L22 Egyptian Colloquial Arabic Lexicon
LDC2009T01 English CTS Treebank with Structural Metadata
LDC2003T05 English Gigaword
LDC2011T07 English Gigaword Fifth Edition
LDC2009T13 English Gigaword Fourth Edition
LDC2005T12 English Gigaword Second Edition
LDC2007T07 English Gigaword Third Edition
LDC2012T02 English Translation Treebank: An-Nahar Newswire
LDC2012T13 English Web Treebank
LDC2006T10 English-Arabic Treebank v 1.0
LDC95T11 European Language Newspaper Text
LDC2005S13 Fisher English Training Part 2, Speech
LDC2005T19 Fisher English Training Part 2, Transcripts
LDC2004S13 Fisher English Training Speech Part 1 Speech
LDC2004T19 Fisher English Training Speech Part 1 Transcripts
LDC2007S02 Fisher Levantine Arabic Conversational Telephone Speech
LDC2007T04 Fisher Levantine Arabic Conversational Telephone Speech, Transcripts
LDC2013T14 GALE Arabic-English Parallel Aligned Treebank -- Broadcast News Part 1
LDC2014T03 GALE Arabic-English Parallel Aligned Treebank -- Broadcast News Part 2
LDC2013T10 GALE Arabic-English Parallel Aligned Treebank -- Newswire
LDC2014T08 GALE Arabic-English Parallel Aligned Treebank -- Web Training
LDC2014T19 GALE Arabic-English Word Alignment -- Broadcast Training Part 1
LDC2014T22 GALE Arabic-English Word Alignment -- Broadcast Training Part 2
LDC2014T05 GALE Arabic-English Word Alignment Training Part 1 -- Newswire and Web
LDC2014T10 GALE Arabic-English Word Alignment Training Part 2 -- Newswire
LDC2014T14 GALE Arabic-English Word Alignment Training Part 3 -- Web
LDC2015T06 GALE Chinese-English Parallel Aligned Treebank -- Training
LDC2013T23 GALE Chinese-English Word Alignment and Tagging -- Broadcast Training Part 1
LDC2014T25 GALE Chinese-English Word Alignment and Tagging -- Broadcast Training Part 2
LDC2015T04 GALE Chinese-English Word Alignment and Tagging -- Broadcast Training Part 3
LDC2015T18 GALE Chinese-English Word Alignment and Tagging -- Broadcast Training Part 4
LDC2012T16 GALE Chinese-English Word Alignment and Tagging Training Part 1 -- Newswire and Web
LDC2012T20 GALE Chinese-English Word Alignment and Tagging Training Part 2 -- Newswire
LDC2012T24 GALE Chinese-English Word Alignment and Tagging Training Part 3 -- Web
LDC2013T05 GALE Chinese-English Word Alignment and Tagging Training Part 4 -- Web
LDC2017T06 GALE English-Chinese Parallel Aligned Treebank -- Training
LDC2008T02 GALE Phase 1 Arabic Blog Parallel Text
LDC2007T24 GALE Phase 1 Arabic Broadcast News Parallel Text - Part 1
LDC2008T09 GALE Phase 1 Arabic Broadcast News Parallel Text - Part 2
LDC2009T03 GALE Phase 1 Arabic Newsgroup Parallel Text - Part 1
LDC2009T09 GALE Phase 1 Arabic Newsgroup Parallel Text - Part 2
LDC2008T06 GALE Phase 1 Chinese Blog Parallel Text
LDC2009T02 GALE Phase 1 Chinese Broadcast Conversation Parallel Text - Part 1
LDC2009T06 GALE Phase 1 Chinese Broadcast Conversation Parallel Text - Part 2
LDC2007T23 GALE Phase 1 Chinese Broadcast News Parallel Text - Part 1
LDC2008T08 GALE Phase 1 Chinese Broadcast News Parallel Text - Part 2
LDC2008T18 GALE Phase 1 Chinese Broadcast News Parallel Text - Part 3
LDC2009T15 GALE Phase 1 Chinese Newsgroup Parallel Text - Part 1
LDC2010T03 GALE Phase 1 Chinese Newsgroup Parallel Text - Part 2
LDC2007T20 GALE Phase 1 Distillation Training
LDC2012T06 GALE Phase 2 Arabic Broadcast Conversation Parallel Text Part 1
LDC2012T14 GALE Phase 2 Arabic Broadcast Conversation Parallel Text Part 2
LDC2013S02 GALE Phase 2 Arabic Broadcast Conversation Speech Part 1
LDC2013S07 GALE Phase 2 Arabic Broadcast Conversation Speech Part 2
LDC2013T04 GALE Phase 2 Arabic Broadcast Conversation Transcripts Part 1
LDC2013T17 GALE Phase 2 Arabic Broadcast Conversation Transcripts Part 2
LDC2012T18 GALE Phase 2 Arabic Broadcast News Parallel Text
LDC2014S07 GALE Phase 2 Arabic Broadcast News Speech Part 1
LDC2015S01 GALE Phase 2 Arabic Broadcast News Speech Part 2
LDC2014T17 GALE Phase 2 Arabic Broadcast News Transcripts Part 1
LDC2015T01 GALE Phase 2 Arabic Broadcast News Transcripts Part 2
LDC2012T17 GALE Phase 2 Arabic Newswire Parallel Text
LDC2013T01 GALE Phase 2 Arabic Web Parallel Text
LDC2013T11 GALE Phase 2 Chinese Broadcast Conversation Parallel Text Part 1
LDC2013T16 GALE Phase 2 Chinese Broadcast Conversation Parallel Text Part 2
LDC2013S04 GALE Phase 2 Chinese Broadcast Conversation Speech
LDC2013T08 GALE Phase 2 Chinese Broadcast Conversation Transcripts
LDC2014T04 GALE Phase 2 Chinese Broadcast News Parallel Text Part 1
LDC2014T11 GALE Phase 2 Chinese Broadcast News Parallel Text Part 2
LDC2013S08 GALE Phase 2 Chinese Broadcast News Speech
LDC2013T20 GALE Phase 2 Chinese Broadcast News Transcripts
LDC2014T15 GALE Phase 2 Chinese Newswire Parallel Text Part 1
LDC2014T20 GALE Phase 2 Chinese Newswire Parallel Text Part 2
LDC2014T26 GALE Phase 2 Chinese Web Parallel Text
LDC2015T05 GALE Phase 3 and 4 Arabic Broadcast Conversation Parallel Text
LDC2015T07 GALE Phase 3 and 4 Arabic Broadcast News Parallel Text
LDC2015T19 GALE Phase 3 and 4 Arabic Newswire Parallel Text
LDC2016T08 GALE Phase 3 and 4 Arabic Web Parallel Text
LDC2016T09 GALE Phase 3 and 4 Chinese Broadcast Conversation Parallel Text
LDC2016T15 GALE Phase 3 and 4 Chinese Broadcast News Parallel Text
LDC2016T25 GALE Phase 3 and 4 Chinese Newswire Parallel Text
LDC2017T02 GALE Phase 3 and 4 Chinese Web Parallel Text
LDC2015S11 GALE Phase 3 Arabic Broadcast Conversation Speech Part 1
LDC2016S01 GALE Phase 3 Arabic Broadcast Conversation Speech Part 2
LDC2015T16 GALE Phase 3 Arabic Broadcast Conversation Transcripts Part 1
LDC2016T06 GALE Phase 3 Arabic Broadcast Conversation Transcripts Part 2
LDC2016S07 GALE Phase 3 Arabic Broadcast News Speech Part 1
LDC2017S02 GALE Phase 3 Arabic Broadcast News Speech Part 2
LDC2016T17 GALE Phase 3 Arabic Broadcast News Transcripts Part 1
LDC2017T04 GALE Phase 3 Arabic Broadcast News Transcripts Part 2
LDC2014S09 GALE Phase 3 Chinese Broadcast Conversation Speech Part 1
LDC2015S06 GALE Phase 3 Chinese Broadcast Conversation Speech Part 2
LDC2014T28 GALE Phase 3 Chinese Broadcast Conversation Transcripts Part 1
LDC2015T09 GALE Phase 3 Chinese Broadcast Conversation Transcripts Part 2
LDC2015S13 GALE Phase 3 Chinese Broadcast News Speech
LDC2015T25 GALE Phase 3 Chinese Broadcast News Transcripts
LDC2016T11 GALE Phase 4 Arabic Broadcast Conversation Parallel Sentences
LDC2017S15 GALE Phase 4 Arabic Broadcast Conversation Speech
LDC2017T12 GALE Phase 4 Arabic Broadcast Conversation Transcripts
LDC2016T20 GALE Phase 4 Arabic Broadcast News Parallel Sentences
LDC2018S05 GALE Phase 4 Arabic Broadcast News Speech
LDC2018T14 GALE Phase 4 Arabic Broadcast News Transcripts
LDC2016T27 GALE Phase 4 Arabic Newswire Parallel Sentences
LDC2016T14 GALE Phase 4 Arabic Weblog Parallel Sentences
LDC2015T14 GALE Phase 4 Chinese Broadcast Conversation Parallel Sentences
LDC2016S03 GALE Phase 4 Chinese Broadcast Conversation Speech
LDC2016T12 GALE Phase 4 Chinese Broadcast Conversation Transcripts
LDC2015T21 GALE Phase 4 Chinese Broadcast News Parallel Sentences
LDC2017S25 GALE Phase 4 Chinese Broadcast News Speech
LDC2017T18 GALE Phase 4 Chinese Broadcast News Transcripts
LDC2015T24 GALE Phase 4 Chinese Newswire Parallel Sentences
LDC2016T04 GALE Phase 4 Chinese Weblog Parallel Sentences
LDC2005S15 HKUST Mandarin Telephone Speech, Part 1
LDC2005T32 HKUST Mandarin Telephone Transcript Data, Part 1
LDC2000T50 Hong Kong Hansards Parallel Text
LDC2000T47 Hong Kong Laws Parallel Text
LDC2000T46 Hong Kong News Parallel Text
LDC2004T08 Hong Kong Parallel Text
LDC2018S18 HUB5 Mandarin Telephone Speech and Transcripts Second Edition
LDC98S69 HUB5 Mandarin Telephone Speech Corpus
LDC98T26 HUB5 Mandarin Transcripts
LDC95T8 Japanese Business News Text
LDC99T34 Japanese Business News Text Supplement
LDC2000T45 Korean Newswire
LDC2005S14 Levantine Arabic QT Training Data Set 4 (Speech + Transcripts)
LDC95T13 Mandarin Chinese News Text
LDC2001T02 Message Understanding Conference (MUC) 7
LDC2003T18 Multiple-Translation Arabic (MTA) Part 1
LDC2005T05 Multiple-Translation Arabic (MTA) Part 2
LDC2003T17 Multiple-Translation Chinese (MTC) Part 2
LDC2004T07 Multiple-Translation Chinese (MTC) Part 3
LDC2002T01 Multiple-Translation Chinese Corpus
LDC2010T21 NIST 2008 Open Machine Translation (OpenMT) Evaluation
LDC2010T01 NIST Open MT 2008 Evaluation (MT08) Selected References and System Translations
LDC95T21 North American News Text Corpus
LDC98T30 North American News Text Supplement
LDC2007T21 OntoNotes Release 1.0
LDC2008T04 OntoNotes Release 2.0
LDC2009T24 OntoNotes Release 3.0
LDC2011T03 OntoNotes Release 4.0
LDC2013T19 OntoNotes Release 5.0
LDC2004T23 Prague Arabic Dependency Treebank 1.0
LDC2004T14 Proposition Bank I
LDC2004S08 RT-03 MDE Training Data Speech
LDC2004T12 RT-03 MDE Training Data Text and Annotations
LDC2005S16 RT-04 MDE Training Data Speech
LDC2005T24 RT-04 MDE Training Data Text/Annotations
LDC2004S10 Santa Barbara Corpus of Spoken American English Part III
LDC2005S25 Santa Barbara Corpus of Spoken American English Part IV
LDC2013T18 Semantic Textual Similarity (STS) 2013 Machine Translation
LDC2006T12 Spanish Gigaword First Edition
LDC2009T21 Spanish Gigaword Second Edition
LDC95T9 Spanish News Text
LDC99T41 Spanish Newswire Text, Volume 2
LDC2001S13 Switchboard Cellular Part 1 Audio
LDC2001S15 Switchboard Cellular Part 1 Transcribed Audio
LDC2001T14 Switchboard Cellular Part 1 Transcription
LDC2004S07 Switchboard Cellular Part 2 Audio
LDC97S62 Switchboard-1 Release 2
LDC98S75 Switchboard-2 Phase I
LDC99S79 Switchboard-2 Phase II
LDC2002S06 Switchboard-2 Phase III Audio
LDC98S72 Taiwanese Putonghua Speech and Transcripts
LDC98T25 TDT Pilot Study Corpus
LDC2000S92 TDT2 Careful Transcription Audio
LDC2000T44 TDT2 Careful Transcription Text
LDC99S84 TDT2 English Audio
LDC2001S93 TDT2 Mandarin Audio Corpus
LDC2001T57 TDT2 Multilanguage Text Version 4.0
LDC2001S94 TDT3 English Audio
LDC2001S95 TDT3 Mandarin Audio
LDC2001T58 TDT3 Multilanguage Text Version 2.0
LDC2005S11 TDT4 Multilingual Broadcast News Speech Corpus
LDC2005T16 TDT4 Multilingual Text and Annotations
LDC2004T09 TIDES Extraction (ACE) 2003 Multilingual Training Data
LDC93T3A TIPSTER Complete
LDC2018T13 TRAD Arabic-French Parallel Text -- Newsgroup
LDC2018T21 TRAD Arabic-French Parallel Text -- Newswire
LDC2018T02 TRAD Chinese-French Parallel Text -- Blog
LDC2018T17 TRAD Chinese-French Parallel Text -- Broadcast News
LDC2000T52 TREC Mandarin
LDC2000T51 TREC Spanish
LDC99T42 Treebank-3
LDC94T4B-1 UN Parallel Text (English)
LDC94T4B-3 UN Parallel Text (Spanish)

GENOA

LDC2004S05 ISL Meeting Speech Part 1
LDC2004T10 ISL Meeting Transcripts Part 1

HAVIC

LDC2018V01 HAVIC MED Event E051-E060 -- Videos, Metadata and Annotation
LDC2022V01 HAVIC MED Novel 1 Test -- Videos, Metadata and Annotation
LDC2022V02 HAVIC MED Novel 2 Test -- Videos, Metadata and Annotation
LDC2019V01 HAVIC MED Progress Test -- Videos, Metadata and Annotation
LDC2021V01 HAVIC MED Training Data -- Videos, Metadata and Annotation
LDC2016V01 HAVIC Pilot Transcription

Hub4

LDC98T31 1996 CSR HUB4 Language Model
LDC97S66 1996 English Broadcast News Dev and Eval (HUB4)
LDC97S44 1996 English Broadcast News Speech (HUB4)
LDC97T22 1996 English Broadcast News Transcripts (HUB4)
LDC98S71 1997 English Broadcast News Speech (HUB4)
LDC98T28 1997 English Broadcast News Transcripts (HUB4)
LDC2001S91 1997 HUB4 Broadcast News Evaluation Non-English Test Material
LDC2002S11 1997 HUB4 English Evaluation Speech and Transcripts
LDC98S73 1997 Mandarin Broadcast News Speech (HUB4-NE)
LDC98T24 1997 Mandarin Broadcast News Transcripts (HUB4-NE)
LDC98S74 1997 Spanish Broadcast News Speech (HUB4-NE)
LDC98T29 1997 Spanish Broadcast News Transcripts (HUB4-NE)
LDC2000S86 1998 HUB4 Broadcast News Evaluation English Test Material
LDC2015S05 Mandarin Chinese Phonetic Segmentation and Tone
LDC95T21 North American News Text Corpus
LDC98T30 North American News Text Supplement

Hub5-LVCSR

LDC2002S22 1997 HUB5 Arabic Evaluation
LDC2002T39 1997 HUB5 Arabic Transcripts
LDC2002S23 1997 HUB5 English Evaluation
LDC2002S24 1997 HUB5 German Evaluation
LDC2003T03 1997 HUB5 German Transcripts
LDC2002S25 1997 HUB5 Spanish Evaluation
LDC2003T04 1997 HUB5 Spanish Transcripts
LDC2002S10 1998 HUB5 English Evaluation
LDC2003T02 1998 HUB5 English Transcripts
LDC2002S09 2000 HUB5 English Evaluation Speech
LDC2002T43 2000 HUB5 English Evaluation Transcripts
LDC2002S13 2001 HUB5 English Evaluation
LDC2002S12 2001 HUB5 Mandarin Evaluation
LDC2003T01 2001 HUB5 Mandarin Transcripts
LDC97L20 CALLHOME American English Lexicon (PRONLEX)
LDC97S42 CALLHOME American English Speech
LDC97T14 CALLHOME American English Transcripts
LDC97S45 CALLHOME Egyptian Arabic Speech
LDC2002S37 CALLHOME Egyptian Arabic Speech Supplement
LDC97T19 CALLHOME Egyptian Arabic Transcripts
LDC2002T38 CALLHOME Egyptian Arabic Transcripts Supplement
LDC97L18 CALLHOME German Lexicon
LDC97S43 CALLHOME German Speech
LDC97T15 CALLHOME German Transcripts
LDC96L17 CALLHOME Japanese Lexicon
LDC96S37 CALLHOME Japanese Speech
LDC96T18 CALLHOME Japanese Transcripts
LDC96L15 CALLHOME Mandarin Chinese Lexicon
LDC96S34 CALLHOME Mandarin Chinese Speech
LDC96T16 CALLHOME Mandarin Chinese Transcripts
LDC96L16 CALLHOME Spanish Lexicon
LDC96S35 CALLHOME Spanish Speech
LDC96T17 CALLHOME Spanish Transcripts
LDC99L22 Egyptian Colloquial Arabic Lexicon
LDC2018S18 HUB5 Mandarin Telephone Speech and Transcripts Second Edition
LDC98S69 HUB5 Mandarin Telephone Speech Corpus
LDC98T26 HUB5 Mandarin Transcripts
LDC98S70 HUB5 Spanish Telephone Speech Corpus
LDC98T27 HUB5 Spanish Transcripts
LDC97S62 Switchboard-1 Release 2
LDC2001T60 Syllable-Final /s/ Lenition

JANUS

LDC2004S05 ISL Meeting Speech Part 1
LDC2004T10 ISL Meeting Transcripts Part 1

LID

LDC96S46 CALLFRIEND American English-Non-Southern Dialect
LDC2019S21 CALLFRIEND American English-Non-Southern Dialect Second Edition
LDC96S47 CALLFRIEND American English-Southern Dialect
LDC2020S08 CALLFRIEND American English-Southern Dialect Second Edition
LDC96S48 CALLFRIEND Canadian French
LDC2019S18 CALLFRIEND Canadian French Second Edition
LDC96S49 CALLFRIEND Egyptian Arabic
LDC2019S04 CALLFRIEND Egyptian Arabic Second Edition
LDC96S50 CALLFRIEND Farsi
LDC2014S01 CALLFRIEND Farsi Second Edition Speech
LDC2014T01 CALLFRIEND Farsi Second Edition Transcripts
LDC96S51 CALLFRIEND German
LDC96S52 CALLFRIEND Hindi
LDC96S53 CALLFRIEND Japanese
LDC96S54 CALLFRIEND Korean
LDC96S55 CALLFRIEND Mandarin Chinese-Mainland Dialect
LDC2018S09 CALLFRIEND Mandarin Chinese-Mainland Dialect Second Edition
LDC96S56 CALLFRIEND Mandarin Chinese-Taiwan Dialect
LDC2020S06 CALLFRIEND Mandarin Chinese-Taiwan Dialect Second Edition
LDC2023S08 CALLFRIEND Russian Speech
LDC2023T09 CALLFRIEND Russian Text
LDC96S57 CALLFRIEND Spanish-Caribbean Dialect
LDC96S58 CALLFRIEND Spanish-Non-Caribbean Dialect
LDC96S59 CALLFRIEND Tamil
LDC96S60 CALLFRIEND Vietnamese

Linguistic Atlas Project

LDC2012S03 Digital Archive of Southern Speech
LDC2016S05 Digital Archive of Southern Speech - NLP Version

LORELEI

LDC2020T02 Abstract Meaning Representation (AMR) Annotation Release 3.0
LDC2023T10 AIDA Scenario 1 and 2 Reference Knowledge Base
LDC2023S01 AIDA Ukrainian Broadcast and Telephone Speech Audio and Transcripts
LDC2024T03 LoReHLT Hausa Representative Language Pack
LDC2021T02 LORELEI Akan Representative Language Pack
LDC2018T04 LORELEI Amharic Representative Language Pack - Monolingual and Parallel Text
LDC2022T05 LORELEI Bengali Representative Language Pack
LDC2020T10 LORELEI Entity Detection and Linking Knowledge Base
LDC2024T01 LORELEI Farsi Representative Language Pack
LDC2023T07 LORELEI Indonesian Representative Language Pack
LDC2022T01 LORELEI Kinyarwanda Incident Language Pack
LDC2020T11 LORELEI Oromo Incident Language Pack
LDC2018T11 LORELEI Somali Representative Language Pack - Monolingual and Parallel Text
LDC2023T01 LORELEI Swahili Representative Language Pack
LDC2023T02 LORELEI Tagalog Representative Language Pack
LDC2023T03 LORELEI Tamil Representative Language Pack
LDC2023T08 LORELEI Thai Representative Language Pack
LDC2020T22 LORELEI Tigrinya Incident Language Pack
LDC2020T24 LORELEI Ukrainian Representative Language Pack
LDC2024T07 LORELEI Uyghur Incident Language Pack
LDC2020T17 LORELEI Vietnamese Representative Language Pack
LDC2022T03 LORELEI Wolof Representative Language Pack
LDC2023T06 LORELEI Zulu Representative Language Pack

Machine Reading

LDC2020T04 Machine Reading Phase 1 IC Training Data
LDC2019T14 Machine Reading Phase 1 NFL Scoring Training Data

MADCAT

LDC2014T13 MADCAT Chinese Pilot Training Set
LDC2012T15 MADCAT Phase 1 Training Set
LDC2013T09 MADCAT Phase 2 Training Set
LDC2013T15 MADCAT Phase 3 Training Set

MALACH

LDC2014S04 USC-SFI MALACH Interviews and Transcripts Czech
LDC2012S05 USC-SFI MALACH Interviews and Transcripts English
LDC2019S11 USC-SFI MALACH Interviews and Transcripts English – Speech Recognition Edition

MIXER

LDC2019S09 First DIHARD Challenge Development - Eight Sources
LDC2019S12 First DIHARD Challenge Evaluation - Nine Sources
LDC2023S02 Mixer 3 Speech
LDC2020S03 Mixer 4 and 5 Speech
LDC2013S03 Mixer 6 Speech
LDC2023S04 Mixer 7 Spanish Speech
LDC2023S09 REMIX Telephone Collection
LDC2022S06 Second DIHARD Challenge Evaluation - Eleven Sources
LDC2022S12 Third DIHARD Challenge Development
LDC2022S14 Third DIHARD Challenge Evaluation

MT08

LDC2010T01 NIST Open MT 2008 Evaluation (MT08) Selected References and System Translations

MUC

LDC2003T13 Message Understanding Conference (MUC) 6
LDC96T10 Message Understanding Conference (MUC) 6 Additional News Text
LDC2001T02 Message Understanding Conference (MUC) 7
LDC2010T15 Message Understanding Conference 7 Timed (MUC7_T)
LDC95T21 North American News Text Corpus
LDC93T3A TIPSTER Complete
LDC93T3B TIPSTER Volume 1
LDC93T3C TIPSTER Volume 2
LDC93T3D TIPSTER Volume 3

NIEUW

LDC2022S09 Xi'an Guanzhong Object Naming

NIST Automatic Meeting Recognition

LDC2004S09 NIST Meeting Pilot Corpus Speech
LDC2004T13 NIST Meeting Pilot Corpus Transcripts and Metadata

NIST LRE

LDC2006S31 2003 NIST Language Recognition Evaluation
LDC2008S05 2005 NIST Language Recognition Evaluation
LDC2009S05 2007 NIST Language Recognition Evaluation Supplemental Training Set
LDC2009S04 2007 NIST Language Recognition Evaluation Test Set
LDC2014S06 2009 NIST Language Recognition Evaluation Test Set
LDC2018S06 2011 NIST Language Recognition Evaluation Test Set
LDC2022S10 2017 NIST Language Recognition Evaluation Training and Development Sets
LDC2023S01 AIDA Ukrainian Broadcast and Telephone Speech Audio and Transcripts
LDC2023S02 Mixer 3 Speech
LDC2019S02 Multi-Language Conversational Telephone Speech 2011 -- Arabic Group
LDC2018S03 Multi-Language Conversational Telephone Speech 2011 -- Central Asian
LDC2018S08 Multi-Language Conversational Telephone Speech 2011 -- Central European
LDC2019S15 Multi-Language Conversational Telephone Speech 2011 -- East Asian
LDC2019S06 Multi-Language Conversational Telephone Speech 2011 -- English Group
LDC2020S05 Multi-Language Conversational Telephone Speech 2011 -- Mandarin Chinese
LDC2016S11 Multi-Language Conversational Telephone Speech 2011 -- Slavic Group
LDC2017S14 Multi-Language Conversational Telephone Speech 2011 -- South Asian
LDC2018S12 Multi-Language Conversational Telephone Speech 2011 -- Spanish
LDC2017S09 Multi-Language Conversational Telephone Speech 2011 -- Turkish

NIST MT

LDC2009T05 2008 NIST Metrics for Machine Translation (MetricsMATR08) Development Data
LDC2014T09 HyTER Networks of Selected OpenMT08/09 Sentences
LDC2010T10 NIST 2002 Open Machine Translation (OpenMT) Evaluation
LDC2010T11 NIST 2003 Open Machine Translation (OpenMT) Evaluation
LDC2010T12 NIST 2004 Open Machine Translation (OpenMT) Evaluation
LDC2010T14 NIST 2005 Open Machine Translation (OpenMT) Evaluation
LDC2010T17 NIST 2006 Open Machine Translation (OpenMT) Evaluation
LDC2010T21 NIST 2008 Open Machine Translation (OpenMT) Evaluation
LDC2013T07 NIST 2008-2012 Open Machine Translation (OpenMT) Progress Test Sets
LDC2010T23 NIST 2009 Open Machine Translation (OpenMT) Evaluation
LDC2013T03 NIST 2012 Open Machine Translation (OpenMT) Evaluation
LDC2014T02 NIST 2012 Open Machine Translation (OpenMT) Progress Test Five Language Source
LDC2013T18 Semantic Textual Similarity (STS) 2013 Machine Translation

NIST OpenSAT

LDC2022S01 2017 NIST OpenSAT Pilot - SSSF
LDC2023S06 2019 OpenSAT Public Safety Communications Simulation

NIST Public Safety

LDC2023S06 2019 OpenSAT Public Safety Communications Simulation

NIST SRE

LDC96S61 1996 Speaker Recognition Benchmark
LDC99S80 1997 Speaker Recognition Benchmark
LDC98S76 1998 Speaker Recognition Benchmark
LDC99S81 1999 Speaker Recognition Benchmark
LDC2001S97 2000 NIST Speaker Recognition Evaluation
LDC2002S34 2001 NIST Speaker Recognition Evaluation Corpus
LDC2004S04 2002 NIST Speaker Recognition Evaluation
LDC2010S03 2003 NIST Speaker Recognition Evaluation
LDC2006S44 2004 NIST Speaker Recognition Evaluation
LDC2011S04 2005 NIST Speaker Recognition Evaluation Test Data
LDC2011S01 2005 NIST Speaker Recognition Evaluation Training Data
LDC2011S10 2006 NIST Speaker Recognition Evaluation Test Set Part 1
LDC2012S01 2006 NIST Speaker Recognition Evaluation Test Set Part 2
LDC2011S09 2006 NIST Speaker Recognition Evaluation Training Set
LDC2011S11 2008 NIST Speaker Recognition Evaluation Supplemental Set
LDC2011S08 2008 NIST Speaker Recognition Evaluation Test Set
LDC2011S05 2008 NIST Speaker Recognition Evaluation Training Set Part 1
LDC2011S07 2008 NIST Speaker Recognition Evaluation Training Set Part 2
LDC2017S06 2010 NIST Speaker Recognition Evaluation Test Set
LDC2019S20 2016 NIST Speaker Recognition Evaluation Test Set
LDC2020S04 2018 NIST Speaker Recognition Evaluation Test Set
LDC2023V01 2019 NIST Speaker Recognition Evaluation Test Set -- Audio-Visual
LDC2023S03 2019 NIST Speaker Recognition Evaluation Test Set -- CTS Challenge
LDC2024S05 Call My Net 1
LDC2019S09 First DIHARD Challenge Development - Eight Sources
LDC2019S12 First DIHARD Challenge Evaluation - Nine Sources
LDC2013S05 Greybeard
LDC2024S01 KASET - Kurmanji and Sorani Kurdish Speech and Transcripts
LDC2023S02 Mixer 3 Speech
LDC2020S03 Mixer 4 and 5 Speech
LDC2013S03 Mixer 6 Speech
LDC2023S04 Mixer 7 Spanish Speech
LDC2009T26 NXT Switchboard Annotations
LDC2023S09 REMIX Telephone Collection
LDC2022S06 Second DIHARD Challenge Evaluation - Eleven Sources
LDC2001S13 Switchboard Cellular Part 1 Audio
LDC2001S15 Switchboard Cellular Part 1 Transcribed Audio
LDC2001T14 Switchboard Cellular Part 1 Transcription
LDC2004S07 Switchboard Cellular Part 2 Audio
LDC93S8 Switchboard Credit Card
LDC97S62 Switchboard-1 Release 2
LDC98S75 Switchboard-2 Phase I
LDC99S79 Switchboard-2 Phase II
LDC2002S06 Switchboard-2 Phase III Audio

OpenHaRT

LDC2012T15 MADCAT Phase 1 Training Set
LDC2013T09 MADCAT Phase 2 Training Set
LDC2013T15 MADCAT Phase 3 Training Set

PEA-TRAD

LDC2018T13 TRAD Arabic-French Parallel Text -- Newsgroup
LDC2018T21 TRAD Arabic-French Parallel Text -- Newswire
LDC2018T02 TRAD Chinese-French Parallel Text -- Blog
LDC2018T17 TRAD Chinese-French Parallel Text -- Broadcast News

RATS

LDC2017S20 RATS Keyword Spotting
LDC2018S10 RATS Language Identification
LDC2024S03 RATS Low Speech Density
LDC2021S08 RATS Speaker Identification
LDC2015S02 RATS Speech Activity Detection

REFLEX-MTE

LDC2009T11 REFLEX Entity Translation Training/DevTest

RM

LDC96S39 RM Isolated and Spelled Word Data

ROAR

LDC2019S09 First DIHARD Challenge Development - Eight Sources
LDC2019S12 First DIHARD Challenge Evaluation - Nine Sources
LDC2004S05 ISL Meeting Speech Part 1
LDC2004T10 ISL Meeting Transcripts Part 1
LDC2022S06 Second DIHARD Challenge Evaluation - Eleven Sources
LDC2022S14 Third DIHARD Challenge Evaluation

RT

LDC2007S12 2004 Spring NIST Rich Transcription (RT-04S) Evaluation Data
LDC2007S11 2004 Spring NIST Rich Transcription (RT-04S) Development Data
LDC2011S06 2005 Spring NIST Rich Transcription (RT-05S) Evaluation Set
LDC2019S09 First DIHARD Challenge Development - Eight Sources
LDC2019S12 First DIHARD Challenge Evaluation - Nine Sources
LDC2022S06 Second DIHARD Challenge Evaluation - Eleven Sources
LDC2022S12 Third DIHARD Challenge Development

SemEval

LDC2016T10 SDP 2014 & 2015: Broad Coverage Semantic Dependency Parsing
LDC2011T01 SemEval-2010 Task 1 OntoNotes English: Coreference Resolution in Multiple Languages

SID

LDC2001S13 Switchboard Cellular Part 1 Audio
LDC2001S15 Switchboard Cellular Part 1 Transcribed Audio
LDC2001T14 Switchboard Cellular Part 1 Transcription
LDC2004S07 Switchboard Cellular Part 2 Audio
LDC98S75 Switchboard-2 Phase I
LDC99S79 Switchboard-2 Phase II
LDC2002S06 Switchboard-2 Phase III Audio

SPINE

LDC2000S96 Speech in Noisy Environments (SPINE) Evaluation Audio
LDC2000T54 Speech in Noisy Environments (SPINE) Evaluation Transcripts
LDC2000S87 Speech in Noisy Environments (SPINE) Training Audio
LDC2000T49 Speech in Noisy Environments (SPINE) Training Transcripts
LDC2001S04 Speech in Noisy Environments (SPINE2) Part 1 Audio
LDC2001T05 Speech in Noisy Environments (SPINE2) Part 1 Transcripts
LDC2001S06 Speech in Noisy Environments (SPINE2) Part 2 Audio
LDC2001T07 Speech in Noisy Environments (SPINE2) Part 2 Transcripts
LDC2001S08 Speech in Noisy Environments (SPINE2) Part 3 Audio
LDC2001T09 Speech in Noisy Environments (SPINE2) Part 3 Transcripts
LDC2001S99 Speech in Noisy Environments 1 (SPINE1 CODED) Coded Audio

TAC

LDC2024T09 MultiTACRED
LDC2023T13 TAC KBP Belief and Sentiment - Comprehensive Training and Evaluation Data 2016-2017
LDC2017T17 TAC KBP Chinese Cross-lingual Entity Linking - Comprehensive Training and Evaluation Data 2011-2014
LDC2019T08 TAC KBP Chinese Regular Slot Filling - Comprehensive Training and Evaluation Data 2014
LDC2019T17 TAC KBP Cold Start - Comprehensive Evaluation Data 2012-2017
LDC2018T03 TAC KBP Comprehensive English Source Corpora 2009-2014
LDC2018T16 TAC KBP English Entity Linking - Comprehensive Training and Evaluation Data 2009-2013
LDC2020T03 TAC KBP English Event Argument - Training and Evaluation Data 2014-2015
LDC2020T13 TAC KBP English Event Nugget Detection and Coreference - Comprehensive Training and Evaluation Data 2014-2015
LDC2018T22 TAC KBP English Regular Slot Filling - Comprehensive Training and Evaluation Data 2009-2014
LDC2021T08 TAC KBP English Sentiment Slot Filling -- Comprehensive Training and Evaluation Data 2013-2014
LDC2021T06 TAC KBP English Surprise Slot Filling -- Comprehensive Training and Evaluation Data 2010
LDC2020T08 TAC KBP English Temporal Slot Filling - Comprehensive Training and Evaluation Data 2011 and 2013
LDC2019T19 TAC KBP Entity Discovery and Linking - Comprehensive Evaluation Data 2016-2017
LDC2019T02 TAC KBP Entity Discovery and Linking - Comprehensive Training and Evaluation Data 2014-2015
LDC2019T12 TAC KBP Evaluation Source Corpora 2016-2017
LDC2020T18 TAC KBP Event Argument - Comprehensive Training and Evaluation Data 2016-2017
LDC2014T16 TAC KBP Reference Knowledge Base
LDC2016T26 TAC KBP Spanish Cross-lingual Entity Linking - Comprehensive Training and Evaluation Data 2012-2014
LDC2018T24 TAC Relation Extraction Dataset

Talkbank

LDC2005T35 American National Corpus (ANC) Second Release
LDC2004V01 FORM1 Kinematic Gesture
LDC2003V01 FORM2 Kinematic Gesture
LDC2003L01 Grassfields Bantu Fieldwork: Dschang Lexicon
LDC2003S02 Grassfields Bantu Fieldwork: Dschang Tone Paradigms
LDC2001S16 Grassfields Bantu Fieldwork: Ngomba Tone Paradigms
LDC2004L01 Klex: Finite-State Lexical Transducer for Korean
LDC2004T03 Morphologically Annotated Korean Text
LDC2003S06 Santa Barbara Corpus of Spoken American English Part II
LDC2004S10 Santa Barbara Corpus of Spoken American English Part III
LDC2005S25 Santa Barbara Corpus of Spoken American English Part IV
LDC2003T15 SLX Corpus of Classic Sociolinguistic Interviews
LDC2004S12 TalkBank Ethology Data: Field Recordings of Vervet Monkey Calls

TDT

LDC2010T18 ACE Time Normalization (TERN) 2004 English Evaluation Data V1.0
LDC98T25 TDT Pilot Study Corpus
LDC2000S92 TDT2 Careful Transcription Audio
LDC2000T44 TDT2 Careful Transcription Text
LDC99S84 TDT2 English Audio
LDC2001S93 TDT2 Mandarin Audio Corpus
LDC2001T57 TDT2 Multilanguage Text Version 4.0
LDC2001S94 TDT3 English Audio
LDC2001S95 TDT3 Mandarin Audio
LDC2001T58 TDT3 Multilanguage Text Version 2.0
LDC2005S11 TDT4 Multilingual Broadcast News Speech Corpus
LDC2005T16 TDT4 Multilingual Text and Annotations
LDC2007V02 TRECVID 2003 Keyframes & Transcripts
LDC2007V01 TRECVID 2005 Keyframes & Transcripts

TERN

LDC2010T18 ACE Time Normalization (TERN) 2004 English Evaluation Data V1.0

TIDES

LDC2005T09 ACE 2004 Multilingual Training Corpus
LDC2010T18 ACE Time Normalization (TERN) 2004 English Evaluation Data V1.0
LDC2005T07 ACE Time Normalization (TERN) 2004 English Training Data v 1.0
LDC2003T11 ACE-2 Version 1.0
LDC93T1 ACL/DCI
LDC2004T18 Arabic English Parallel News Part 1
LDC2003T12 Arabic Gigaword
LDC2004T17 Arabic News Translation Text Part 1
LDC2001T55 Arabic Newswire Part 1
LDC2003T07 Arabic Treebank: Part 1 - 10K-word English Translation
LDC2003T06 Arabic Treebank: Part 1 v 2.0
LDC2005T02 Arabic Treebank: Part 1 v 3.0 (POS with full vocalization + syntactic analysis)
LDC2004T02 Arabic Treebank: Part 2 v 2.0
LDC2005T20 Arabic Treebank: Part 3 (full corpus) v 2.0 (MPG + Syntactic Analysis)
LDC2004T11 Arabic Treebank: Part 3 v 1.0
LDC2005T33 BBN Pronoun Coreference and Entity Type Corpus
LDC2000T43 BLLIP 1987-89 WSJ Corpus Release 1
LDC2002L49 Buckwalter Arabic Morphological Analyzer Version 1.0
LDC2004L02 Buckwalter Arabic Morphological Analyzer Version 2.0
LDC2005T13 CCGbank
LDC96L14 CELEX2
LDC2005T10 Chinese English News Magazine Parallel Text
LDC2003T09 Chinese Gigaword
LDC2005T14 Chinese Gigaword Second Edition
LDC2005T06 Chinese News Translation Text Part 1
LDC2005T23 Chinese Proposition Bank 1.0
LDC2001T11 Chinese Treebank 2.0
LDC2004T05 Chinese Treebank 4.0
LDC2005T01 Chinese Treebank 5.0
LDC2007T36 Chinese Treebank 6.0
LDC2010T07 Chinese Treebank 7.0
LDC2013T21 Chinese Treebank 8.0
LDC2002L27 Chinese-English Translation Lexicon Version 3.0
LDC2007T02 English Chinese Translation Treebank v 1.0
LDC2003T05 English Gigaword
LDC2005T12 English Gigaword Second Edition
LDC95T11 European Language Newspaper Text
LDC2000T50 Hong Kong Hansards Parallel Text
LDC2000T47 Hong Kong Laws Parallel Text
LDC2000T46 Hong Kong News Parallel Text
LDC2004T08 Hong Kong Parallel Text
LDC95T8 Japanese Business News Text
LDC99T34 Japanese Business News Text Supplement
LDC2000T45 Korean Newswire
LDC95T13 Mandarin Chinese News Text
LDC2001T02 Message Understanding Conference (MUC) 7
LDC2003T18 Multiple-Translation Arabic (MTA) Part 1
LDC2005T05 Multiple-Translation Arabic (MTA) Part 2
LDC2003T17 Multiple-Translation Chinese (MTC) Part 2
LDC2004T07 Multiple-Translation Chinese (MTC) Part 3
LDC2006T04 Multiple-Translation Chinese (MTC) Part 4
LDC2002T01 Multiple-Translation Chinese Corpus
LDC95T21 North American News Text Corpus
LDC98T30 North American News Text Supplement
LDC2004T23 Prague Arabic Dependency Treebank 1.0
LDC2004T14 Proposition Bank I
LDC2006T12 Spanish Gigaword First Edition
LDC2009T21 Spanish Gigaword Second Edition
LDC95T9 Spanish News Text
LDC99T41 Spanish Newswire Text, Volume 2
LDC98T25 TDT Pilot Study Corpus
LDC2000S92 TDT2 Careful Transcription Audio
LDC2000T44 TDT2 Careful Transcription Text
LDC99S84 TDT2 English Audio
LDC2001S93 TDT2 Mandarin Audio Corpus
LDC2001T57 TDT2 Multilanguage Text Version 4.0
LDC2001S94 TDT3 English Audio
LDC2001S95 TDT3 Mandarin Audio
LDC2001T58 TDT3 Multilanguage Text Version 2.0
LDC2005S11 TDT4 Multilingual Broadcast News Speech Corpus
LDC2005T16 TDT4 Multilingual Text and Annotations
LDC2004T09 TIDES Extraction (ACE) 2003 Multilingual Training Data
LDC93T3A TIPSTER Complete
LDC2000T52 TREC Mandarin
LDC2000T51 TREC Spanish
LDC99T42 Treebank-3
LDC94T4B-1 UN Parallel Text (English)
LDC94T4B-3 UN Parallel Text (Spanish)

Tipster

LDC95T13 Mandarin Chinese News Text
LDC95T9 Spanish News Text
LDC93T3A TIPSTER Complete
LDC93T3B TIPSTER Volume 1
LDC93T3C TIPSTER Volume 2
LDC93T3D TIPSTER Volume 3

TRAD

LDC2018T13 TRAD Arabic-French Parallel Text -- Newsgroup
LDC2018T21 TRAD Arabic-French Parallel Text -- Newswire
LDC2018T02 TRAD Chinese-French Parallel Text -- Blog
LDC2018T17 TRAD Chinese-French Parallel Text -- Broadcast News

TREC

LDC2001T55 Arabic Newswire Part 1
LDC95T13 Mandarin Chinese News Text
LDC95T9 Spanish News Text
LDC93T3A TIPSTER Complete
LDC93T3B TIPSTER Volume 1
LDC93T3C TIPSTER Volume 2
LDC93T3D TIPSTER Volume 3
LDC2000T52 TREC Mandarin
LDC2000T51 TREC Spanish
LDC2007V02 TRECVID 2003 Keyframes & Transcripts
LDC2010V01 TRECVID 2004 Keyframes & Transcripts
LDC2007V01 TRECVID 2005 Keyframes & Transcripts
LDC2010V02 TRECVID 2006 Keyframes

VACE

LDC2012V01 2005 NIST/USF Evaluation Resources for the VACE Program - Broadcast News
LDC2011V05 2006 NIST/USF Evaluation Resources for the VACE Program - Meeting Data Test Set Part 1
LDC2011V06 2006 NIST/USF Evaluation Resources for the VACE Program - Meeting Data Test Set Part 2
LDC2011V03 NIST/USF Evaluation Resources for the VACE Program - Meeting Data Test Set Part 1
LDC2011V04 NIST/USF Evaluation Resources for the VACE Program - Meeting Data Test Set Part 2
LDC2011V01 NIST/USF Evaluation Resources for the VACE Program - Meeting Data Training Set Part 1
LDC2011V02 NIST/USF Evaluation Resources for the VACE Program - Meeting Data Training Set Part 2

VAST

LDC2023V01 2019 NIST Speaker Recognition Evaluation Test Set -- Audio-Visual
LDC2019S09 First DIHARD Challenge Development - Eight Sources
LDC2019S12 First DIHARD Challenge Evaluation - Nine Sources
LDC2022S06 Second DIHARD Challenge Evaluation - Eleven Sources
LDC2022S12 Third DIHARD Challenge Development
LDC2022S14 Third DIHARD Challenge Evaluation
LDC2019S05 VAST Chinese Speech and Transcripts