LDC Corpora ⇔ Projects
Many of the corpora in the Catalog were developed for, or used in, sponsored research projects. Some of those resources were training and test data for benchmark tests of language-based systems developed during the project. A corpus is associated with a given project either because it was developed for the project, it was used in the project or it was considered otherwise relevant to the work of the project.
ACE
LDC2017T10 | Abstract Meaning Representation (AMR) Annotation Release 2.0 | |
LDC2020T02 | Abstract Meaning Representation (AMR) Annotation Release 3.0 | |
LDC2005T09 | ACE 2004 Multilingual Training Corpus | |
LDC2008T03 | ACE 2005 English SpatialML Annotations | |
LDC2011T02 | ACE 2005 English SpatialML Annotations Version 2 | |
LDC2010T09 | ACE 2005 Mandarin SpatialML Annotations | |
LDC2006T06 | ACE 2005 Multilingual Training Corpus | |
LDC2014T18 | ACE 2007 Multilingual Training Corpus | |
LDC2015T20 | ACE 2007 Spanish DevTest - Pilot Evaluation | |
LDC2010T18 | ACE Time Normalization (TERN) 2004 English Evaluation Data V1.0 | |
LDC2005T07 | ACE Time Normalization (TERN) 2004 English Training Data v 1.0 | |
LDC2003T11 | ACE-2 Version 1.0 | |
LDC2024T05 | Automatic Content Extraction for Portuguese | |
LDC2005T33 | BBN Pronoun Coreference and Entity Type Corpus | |
LDC2019T07 | Chinese Abstract Meaning Representation 1.0 | |
LDC2011T08 | Datasets for Generic Relation Extraction (reACE) | |
LDC2004T14 | Proposition Bank I | |
LDC2009T11 | REFLEX Entity Translation Training/DevTest | |
LDC2004T09 | TIDES Extraction (ACE) 2003 Multilingual Training Data |
AIDA
LDC2023T10 | AIDA Scenario 1 and 2 Reference Knowledge Base | |
LDC2024T02 | AIDA Scenario 1 Practice Topic Annotation | |
LDC2023T11 | AIDA Scenario 1 Practice Topic Source Data | |
LDC2024T06 | AIDA Scenario 2 Practice Topic Annotation | |
LDC2024T04 | AIDA Scenario 2 Practice Topic Source Data | |
LDC2023S01 | AIDA Ukrainian Broadcast and Telephone Speech Audio and Transcripts |
American National Corpus (ANC)
LDC2005T35 | American National Corpus (ANC) Second Release | |
LDC2010T22 | Manually Annotated Sub-Corpus First Release | |
LDC2013T12 | Manually Annotated Sub-Corpus Third Release |
AQUAINT
LDC2008T25 | AQUAINT-2 Information-Retrieval Text Research Collection | |
LDC2005T33 | BBN Pronoun Coreference and Entity Type Corpus |
ATIS
LDC2021T04 | ATIS - Seven Languages | |
LDC93S4A | ATIS0 Complete | |
LDC93S4B | ATIS0 Pilot | |
LDC93S4B-2 | ATIS0 Read | |
LDC93S4B-3 | ATIS0 SD Read | |
LDC93S5 | ATIS2 | |
LDC95S26 | ATIS3 Test Data | |
LDC94S19 | ATIS3 Training Data | |
LDC2019T04 | Multilingual ATIS |
BOLT
LDC2014T12 | Abstract Meaning Representation (AMR) Annotation Release 1.0 | |
LDC2017T10 | Abstract Meaning Representation (AMR) Annotation Release 2.0 | |
LDC2020T02 | Abstract Meaning Representation (AMR) Annotation Release 3.0 | |
LDC2020T07 | Abstract Meaning Representation 2.0 - Four Translations | |
LDC2019T01 | BOLT Arabic Discussion Forum Parallel Training Data | |
LDC2018T10 | BOLT Arabic Discussion Forums | |
LDC2021T07 | BOLT Chinese Co-reference -- Discussion Forum, SMS/Chat, and Conversational Telephone Speech | |
LDC2017T05 | BOLT Chinese Discussion Forum Parallel Training Data | |
LDC2016T05 | BOLT Chinese Discussion Forums | |
LDC2018T15 | BOLT Chinese SMS/Chat | |
LDC2021T11 | BOLT Chinese SMS/Chat Parallel Training Data | |
LDC2016T19 | BOLT Chinese-English Word Alignment and Tagging -- Discussion Forum Training | |
LDC2020T15 | BOLT Chinese-English Word Alignment and Tagging -- Conversational Telephone Speech Training | |
LDC2019T13 | BOLT Chinese-English Word Alignment and Tagging -- SMS/Chat Training | |
LDC2021T14 | BOLT Egyptian Arabic Co-reference -- Discussion Forum, SMS/Chat, and Conversational Telephone Speech | |
LDC2021T18 | BOLT Egyptian Arabic PropBank and Sense -- Discussion Forum, SMS/Chat, and Conversational Telephone Speech | |
LDC2017T07 | BOLT Egyptian Arabic SMS/Chat and Transliteration | |
LDC2021T15 | BOLT Egyptian Arabic SMS/Chat Parallel Training Data | |
LDC2021T12 | BOLT Egyptian Arabic Treebank - Conversational Telephone Speech | |
LDC2018T23 | BOLT Egyptian Arabic Treebank - Discussion Forum | |
LDC2021T17 | BOLT Egyptian Arabic Treebank - SMS/Chat | |
LDC2020T05 | BOLT Egyptian Arabic-English Word Alignment -- Conversational Telephone Speech Training | |
LDC2019T18 | BOLT Egyptian Arabic-English Word Alignment -- SMS/Chat Training | |
LDC2019T06 | BOLT Egyptian-English Word Alignment -- Discussion Forum Training | |
LDC2020T20 | BOLT English Co-reference -- Discussion Forum, SMS/Chat, and Conversational Telephone Speech | |
LDC2017T11 | BOLT English Discussion Forums | |
LDC2020T21 | BOLT English PropBank and Sense -- Discussion Forum, SMS/Chat, and Conversational Telephone Speech | |
LDC2018T19 | BOLT English SMS/Chat | |
LDC2020T09 | BOLT English Translation Treebank - Chinese Discussion Forum | |
LDC2021T19 | BOLT English Translation Treebank - Chinese SMS/Chat | |
LDC2022T06 | BOLT English Translation Treebank - Egyptian Arabic SMS/Chat | |
LDC2019T15 | BOLT English Treebank - Discussion Forum | |
LDC2021T03 | BOLT English Treebank - SMS/Chat | |
LDC2018T18 | BOLT Information Retrieval Comprehensive Training and Evaluation | |
LDC2013T21 | Chinese Treebank 8.0 | |
LDC2016T13 | Chinese Treebank 9.0 | |
LDC2024T03 | LoReHLT Hausa Representative Language Pack |
CAMIO
LDC2022T07 | CAMIO Transcription Languages |
CHiME
LDC2017S07 | CHiME2 Grid | |
LDC2017S10 | CHiME2 WSJ0 | |
LDC2017S24 | CHiME3 |
Communicator
LDC2004T15 | 2000 Communicator Dialogue Act Tagged | |
LDC2002S56 | 2000 Communicator Evaluation | |
LDC2004T16 | 2001 Communicator Dialogue Act Tagged | |
LDC2003S01 | 2001 Communicator Evaluation |
CoNLL
LDC2015T12 | 2006 CoNLL Shared Task - Arabic & Czech | |
LDC2015T11 | 2006 CoNLL Shared Task - Ten Languages | |
LDC2018T08 | 2007 CoNLL Shared Task - Arabic & English | |
LDC2018T06 | 2007 CoNLL Shared Task - Basque, Catalan, Czech & Turkish | |
LDC2018T07 | 2007 CoNLL Shared Task - Greek, Hungarian & Italian | |
LDC2012T03 | 2009 CoNLL Shared Task Part 1 | |
LDC2012T04 | 2009 CoNLL Shared Task Part 2 | |
LDC2017T13 | 2015-2016 CoNLL Shared Task |
DARPA-CSR
LDC2005S08 | BBN/AUB DARPA Babylon Levantine Arabic Speech and Transcripts | |
LDC93S6A | CSR-I (WSJ0) Complete | |
LDC93S6C | CSR-I (WSJ0) Other | |
LDC93S6B | CSR-I (WSJ0) Sennheiser | |
LDC94S13A | CSR-II (WSJ1) Complete | |
LDC94S13C | CSR-II (WSJ1) Other | |
LDC94S13B | CSR-II (WSJ1) Sennheiser | |
LDC95S23 | CSR-III Speech | |
LDC95T6 | CSR-III Text | |
LDC96S33 | CSR-IV HUB3 | |
LDC96S31 | CSR-IV HUB4 |
DASL
LDC2003T15 | SLX Corpus of Classic Sociolinguistic Interviews |
DEFT
LDC2014T12 | Abstract Meaning Representation (AMR) Annotation Release 1.0 | |
LDC2017T10 | Abstract Meaning Representation (AMR) Annotation Release 2.0 | |
LDC2020T02 | Abstract Meaning Representation (AMR) Annotation Release 3.0 | |
LDC2020T07 | Abstract Meaning Representation 2.0 - Four Translations | |
LDC2020L02 | Chinese Lexical Resources for Gender, Number, Animacy | |
LDC2019T03 | DEFT Chinese Committed Belief Annotation | |
LDC2020T19 | DEFT Chinese Light and Rich ERE Annotation | |
LDC2019T16 | DEFT English Committed Belief Annotation | |
LDC2023T04 | DEFT English Light and Rich ERE Annotation | |
LDC2016T07 | DEFT Narrative Text | |
LDC2019T09 | DEFT Spanish Committed Belief Annotation | |
LDC2018T01 | DEFT Spanish Treebank | |
LDC2016T23 | Richer Event Description | |
LDC2023T13 | TAC KBP Belief and Sentiment - Comprehensive Training and Evaluation Data 2016-2017 | |
LDC2017T09 | The EventStatus Corpus |
DIRHA
LDC2018S01 | DIRHA English WSJ Audio |
DOE/IRS2008-0256
LDC2023L01 | Moroccan Arabic - English Lexical Database |
EARS
LDC97S66 | 1996 English Broadcast News Dev and Eval (HUB4) | |
LDC97S44 | 1996 English Broadcast News Speech (HUB4) | |
LDC97T22 | 1996 English Broadcast News Transcripts (HUB4) | |
LDC98S71 | 1997 English Broadcast News Speech (HUB4) | |
LDC98T28 | 1997 English Broadcast News Transcripts (HUB4) | |
LDC2001S91 | 1997 HUB4 Broadcast News Evaluation Non-English Test Material | |
LDC2002S11 | 1997 HUB4 English Evaluation Speech and Transcripts | |
LDC2002S22 | 1997 HUB5 Arabic Evaluation | |
LDC2002T39 | 1997 HUB5 Arabic Transcripts | |
LDC2002S24 | 1997 HUB5 German Evaluation | |
LDC2003T03 | 1997 HUB5 German Transcripts | |
LDC2002S25 | 1997 HUB5 Spanish Evaluation | |
LDC2003T04 | 1997 HUB5 Spanish Transcripts | |
LDC98S73 | 1997 Mandarin Broadcast News Speech (HUB4-NE) | |
LDC98T24 | 1997 Mandarin Broadcast News Transcripts (HUB4-NE) | |
LDC2002S10 | 1998 HUB5 English Evaluation | |
LDC2003T02 | 1998 HUB5 English Transcripts | |
LDC2002S13 | 2001 HUB5 English Evaluation | |
LDC2002S12 | 2001 HUB5 Mandarin Evaluation | |
LDC2003T01 | 2001 HUB5 Mandarin Transcripts | |
LDC2004S11 | 2002 Rich Transcription Broadcast News and Conversational Telephone Speech | |
LDC99L23 | American English Spoken Lexicon | |
LDC2005S07 | Arabic CTS Levantine Fisher Training Data Set 3, Speech | |
LDC2005T03 | Arabic CTS Levantine Fisher Training Data Set 3, Transcripts | |
LDC2003T12 | Arabic Gigaword | |
LDC2001T55 | Arabic Newswire Part 1 | |
LDC2005S08 | BBN/AUB DARPA Babylon Levantine Arabic Speech and Transcripts | |
LDC96S46 | CALLFRIEND American English-Non-Southern Dialect | |
LDC2019S21 | CALLFRIEND American English-Non-Southern Dialect Second Edition | |
LDC96S47 | CALLFRIEND American English-Southern Dialect | |
LDC2020S08 | CALLFRIEND American English-Southern Dialect Second Edition | |
LDC2019S18 | CALLFRIEND Canadian French Second Edition | |
LDC96S49 | CALLFRIEND Egyptian Arabic | |
LDC2019S04 | CALLFRIEND Egyptian Arabic Second Edition | |
LDC96S55 | CALLFRIEND Mandarin Chinese-Mainland Dialect | |
LDC2018S09 | CALLFRIEND Mandarin Chinese-Mainland Dialect Second Edition | |
LDC96S56 | CALLFRIEND Mandarin Chinese-Taiwan Dialect | |
LDC2020S06 | CALLFRIEND Mandarin Chinese-Taiwan Dialect Second Edition | |
LDC97L20 | CALLHOME American English Lexicon (PRONLEX) | |
LDC97S42 | CALLHOME American English Speech | |
LDC97T14 | CALLHOME American English Transcripts | |
LDC97S45 | CALLHOME Egyptian Arabic Speech | |
LDC2002S37 | CALLHOME Egyptian Arabic Speech Supplement | |
LDC97T19 | CALLHOME Egyptian Arabic Transcripts | |
LDC2002T38 | CALLHOME Egyptian Arabic Transcripts Supplement | |
LDC96L15 | CALLHOME Mandarin Chinese Lexicon | |
LDC96S34 | CALLHOME Mandarin Chinese Speech | |
LDC96T16 | CALLHOME Mandarin Chinese Transcripts | |
LDC2003T09 | Chinese Gigaword | |
LDC2005T14 | Chinese Gigaword Second Edition | |
LDC2005T08 | Discourse Graphbank | |
LDC99L22 | Egyptian Colloquial Arabic Lexicon | |
LDC2003T05 | English Gigaword | |
LDC2005T12 | English Gigaword Second Edition | |
LDC2005S13 | Fisher English Training Part 2, Speech | |
LDC2005T19 | Fisher English Training Part 2, Transcripts | |
LDC2004S13 | Fisher English Training Speech Part 1 Speech | |
LDC2004T19 | Fisher English Training Speech Part 1 Transcripts | |
LDC2005S15 | HKUST Mandarin Telephone Speech, Part 1 | |
LDC2005T32 | HKUST Mandarin Telephone Transcript Data, Part 1 | |
LDC2018S18 | HUB5 Mandarin Telephone Speech and Transcripts Second Edition | |
LDC98S69 | HUB5 Mandarin Telephone Speech Corpus | |
LDC98T26 | HUB5 Mandarin Transcripts | |
LDC2005S14 | Levantine Arabic QT Training Data Set 4 (Speech + Transcripts) | |
LDC2006S29 | Levantine Arabic QT Training Data Set 5, Speech | |
LDC2006T07 | Levantine Arabic QT Training Data Set 5, Transcripts | |
LDC95T13 | Mandarin Chinese News Text | |
LDC95T21 | North American News Text Corpus | |
LDC98T30 | North American News Text Supplement | |
LDC2004S08 | RT-03 MDE Training Data Speech | |
LDC2004T12 | RT-03 MDE Training Data Text and Annotations | |
LDC2005S16 | RT-04 MDE Training Data Speech | |
LDC2005T24 | RT-04 MDE Training Data Text/Annotations | |
LDC2004S10 | Santa Barbara Corpus of Spoken American English Part III | |
LDC2005S25 | Santa Barbara Corpus of Spoken American English Part IV | |
LDC2006T12 | Spanish Gigaword First Edition | |
LDC2009T21 | Spanish Gigaword Second Edition | |
LDC2001S13 | Switchboard Cellular Part 1 Audio | |
LDC2001S15 | Switchboard Cellular Part 1 Transcribed Audio | |
LDC2001T14 | Switchboard Cellular Part 1 Transcription | |
LDC2004S07 | Switchboard Cellular Part 2 Audio | |
LDC97S62 | Switchboard-1 Release 2 | |
LDC98S75 | Switchboard-2 Phase I | |
LDC99S79 | Switchboard-2 Phase II | |
LDC2002S06 | Switchboard-2 Phase III Audio | |
LDC98S72 | Taiwanese Putonghua Speech and Transcripts | |
LDC98T25 | TDT Pilot Study Corpus | |
LDC2000S92 | TDT2 Careful Transcription Audio | |
LDC2000T44 | TDT2 Careful Transcription Text | |
LDC99S84 | TDT2 English Audio | |
LDC2001S93 | TDT2 Mandarin Audio Corpus | |
LDC2001T57 | TDT2 Multilanguage Text Version 4.0 | |
LDC2001S94 | TDT3 English Audio | |
LDC2001S95 | TDT3 Mandarin Audio | |
LDC2001T58 | TDT3 Multilanguage Text Version 2.0 |
GALE
LDC97S66 | 1996 English Broadcast News Dev and Eval (HUB4) | |
LDC97S44 | 1996 English Broadcast News Speech (HUB4) | |
LDC97T22 | 1996 English Broadcast News Transcripts (HUB4) | |
LDC98S71 | 1997 English Broadcast News Speech (HUB4) | |
LDC98T28 | 1997 English Broadcast News Transcripts (HUB4) | |
LDC2001S91 | 1997 HUB4 Broadcast News Evaluation Non-English Test Material | |
LDC2002S11 | 1997 HUB4 English Evaluation Speech and Transcripts | |
LDC2002S22 | 1997 HUB5 Arabic Evaluation | |
LDC2002T39 | 1997 HUB5 Arabic Transcripts | |
LDC2002S24 | 1997 HUB5 German Evaluation | |
LDC2003T03 | 1997 HUB5 German Transcripts | |
LDC2002S25 | 1997 HUB5 Spanish Evaluation | |
LDC2003T04 | 1997 HUB5 Spanish Transcripts | |
LDC98S73 | 1997 Mandarin Broadcast News Speech (HUB4-NE) | |
LDC98T24 | 1997 Mandarin Broadcast News Transcripts (HUB4-NE) | |
LDC2002S10 | 1998 HUB5 English Evaluation | |
LDC2003T02 | 1998 HUB5 English Transcripts | |
LDC2002S13 | 2001 HUB5 English Evaluation | |
LDC2002S12 | 2001 HUB5 Mandarin Evaluation | |
LDC2003T01 | 2001 HUB5 Mandarin Transcripts | |
LDC2004S11 | 2002 Rich Transcription Broadcast News and Conversational Telephone Speech | |
LDC2009T05 | 2008 NIST Metrics for Machine Translation (MetricsMATR08) Development Data | |
LDC2011T05 | 2008/2010 NIST Metrics for Machine Translation (MetricsMaTr) GALE Evaluation Set | |
LDC2017T10 | Abstract Meaning Representation (AMR) Annotation Release 2.0 | |
LDC2020T02 | Abstract Meaning Representation (AMR) Annotation Release 3.0 | |
LDC2005T09 | ACE 2004 Multilingual Training Corpus | |
LDC2005T07 | ACE Time Normalization (TERN) 2004 English Training Data v 1.0 | |
LDC2003T11 | ACE-2 Version 1.0 | |
LDC93T1 | ACL/DCI | |
LDC99L23 | American English Spoken Lexicon | |
LDC2012T21 | Annotated English Gigaword | |
LDC2005S07 | Arabic CTS Levantine Fisher Training Data Set 3, Speech | |
LDC2005T03 | Arabic CTS Levantine Fisher Training Data Set 3, Transcripts | |
LDC2004T18 | Arabic English Parallel News Part 1 | |
LDC2003T12 | Arabic Gigaword | |
LDC2011T11 | Arabic Gigaword Fifth Edition | |
LDC2009T30 | Arabic Gigaword Fourth Edition | |
LDC2007T40 | Arabic Gigaword Third Edition | |
LDC2004T17 | Arabic News Translation Text Part 1 | |
LDC2001T55 | Arabic Newswire Part 1 | |
LDC2012T07 | Arabic Treebank - Broadcast News v1.0 | |
LDC2016T02 | Arabic Treebank - Weblog | |
LDC2003T07 | Arabic Treebank: Part 1 - 10K-word English Translation | |
LDC2003T06 | Arabic Treebank: Part 1 v 2.0 | |
LDC2005T02 | Arabic Treebank: Part 1 v 3.0 (POS with full vocalization + syntactic analysis) | |
LDC2010T13 | Arabic Treebank: Part 1 v 4.1 | |
LDC2004T02 | Arabic Treebank: Part 2 v 2.0 | |
LDC2011T09 | Arabic Treebank: Part 2 v 3.1 | |
LDC2005T20 | Arabic Treebank: Part 3 (full corpus) v 2.0 (MPG + Syntactic Analysis) | |
LDC2004T11 | Arabic Treebank: Part 3 v 1.0 | |
LDC2012T09 | Arabic-Dialect/English Parallel Text | |
LDC2005T33 | BBN Pronoun Coreference and Entity Type Corpus | |
LDC2005S08 | BBN/AUB DARPA Babylon Levantine Arabic Speech and Transcripts | |
LDC2000T43 | BLLIP 1987-89 WSJ Corpus Release 1 | |
LDC2002L49 | Buckwalter Arabic Morphological Analyzer Version 1.0 | |
LDC2004L02 | Buckwalter Arabic Morphological Analyzer Version 2.0 | |
LDC96S46 | CALLFRIEND American English-Non-Southern Dialect | |
LDC2019S21 | CALLFRIEND American English-Non-Southern Dialect Second Edition | |
LDC96S47 | CALLFRIEND American English-Southern Dialect | |
LDC2020S08 | CALLFRIEND American English-Southern Dialect Second Edition | |
LDC2019S18 | CALLFRIEND Canadian French Second Edition | |
LDC96S49 | CALLFRIEND Egyptian Arabic | |
LDC2019S04 | CALLFRIEND Egyptian Arabic Second Edition | |
LDC96S55 | CALLFRIEND Mandarin Chinese-Mainland Dialect | |
LDC2018S09 | CALLFRIEND Mandarin Chinese-Mainland Dialect Second Edition | |
LDC96S56 | CALLFRIEND Mandarin Chinese-Taiwan Dialect | |
LDC2020S06 | CALLFRIEND Mandarin Chinese-Taiwan Dialect Second Edition | |
LDC97L20 | CALLHOME American English Lexicon (PRONLEX) | |
LDC97S42 | CALLHOME American English Speech | |
LDC97T14 | CALLHOME American English Transcripts | |
LDC97S45 | CALLHOME Egyptian Arabic Speech | |
LDC2002S37 | CALLHOME Egyptian Arabic Speech Supplement | |
LDC97T19 | CALLHOME Egyptian Arabic Transcripts | |
LDC2002T38 | CALLHOME Egyptian Arabic Transcripts Supplement | |
LDC96L15 | CALLHOME Mandarin Chinese Lexicon | |
LDC96S34 | CALLHOME Mandarin Chinese Speech | |
LDC96T16 | CALLHOME Mandarin Chinese Transcripts | |
LDC2005T13 | CCGbank | |
LDC96L14 | CELEX2 | |
LDC2005T10 | Chinese English News Magazine Parallel Text | |
LDC2003T09 | Chinese Gigaword | |
LDC2011T13 | Chinese Gigaword Fifth Edition | |
LDC2009T27 | Chinese Gigaword Fourth Edition | |
LDC2005T14 | Chinese Gigaword Second Edition | |
LDC2007T38 | Chinese Gigaword Third Edition | |
LDC2005T06 | Chinese News Translation Text Part 1 | |
LDC2005T23 | Chinese Proposition Bank 1.0 | |
LDC2001T11 | Chinese Treebank 2.0 | |
LDC2004T05 | Chinese Treebank 4.0 | |
LDC2005T01 | Chinese Treebank 5.0 | |
LDC2007T36 | Chinese Treebank 6.0 | |
LDC2010T07 | Chinese Treebank 7.0 | |
LDC2013T21 | Chinese Treebank 8.0 | |
LDC2016T13 | Chinese Treebank 9.0 | |
LDC2002L27 | Chinese-English Translation Lexicon Version 3.0 | |
LDC2018T20 | Concretely Annotated English Gigaword | |
LDC2005T08 | Discourse Graphbank | |
LDC99L22 | Egyptian Colloquial Arabic Lexicon | |
LDC2009T01 | English CTS Treebank with Structural Metadata | |
LDC2003T05 | English Gigaword | |
LDC2011T07 | English Gigaword Fifth Edition | |
LDC2009T13 | English Gigaword Fourth Edition | |
LDC2005T12 | English Gigaword Second Edition | |
LDC2007T07 | English Gigaword Third Edition | |
LDC2012T02 | English Translation Treebank: An-Nahar Newswire | |
LDC2012T13 | English Web Treebank | |
LDC2006T10 | English-Arabic Treebank v 1.0 | |
LDC95T11 | European Language Newspaper Text | |
LDC2005S13 | Fisher English Training Part 2, Speech | |
LDC2005T19 | Fisher English Training Part 2, Transcripts | |
LDC2004S13 | Fisher English Training Speech Part 1 Speech | |
LDC2004T19 | Fisher English Training Speech Part 1 Transcripts | |
LDC2007S02 | Fisher Levantine Arabic Conversational Telephone Speech | |
LDC2007T04 | Fisher Levantine Arabic Conversational Telephone Speech, Transcripts | |
LDC2013T14 | GALE Arabic-English Parallel Aligned Treebank -- Broadcast News Part 1 | |
LDC2014T03 | GALE Arabic-English Parallel Aligned Treebank -- Broadcast News Part 2 | |
LDC2013T10 | GALE Arabic-English Parallel Aligned Treebank -- Newswire | |
LDC2014T08 | GALE Arabic-English Parallel Aligned Treebank -- Web Training | |
LDC2014T19 | GALE Arabic-English Word Alignment -- Broadcast Training Part 1 | |
LDC2014T22 | GALE Arabic-English Word Alignment -- Broadcast Training Part 2 | |
LDC2014T05 | GALE Arabic-English Word Alignment Training Part 1 -- Newswire and Web | |
LDC2014T10 | GALE Arabic-English Word Alignment Training Part 2 -- Newswire | |
LDC2014T14 | GALE Arabic-English Word Alignment Training Part 3 -- Web | |
LDC2015T06 | GALE Chinese-English Parallel Aligned Treebank -- Training | |
LDC2013T23 | GALE Chinese-English Word Alignment and Tagging -- Broadcast Training Part 1 | |
LDC2014T25 | GALE Chinese-English Word Alignment and Tagging -- Broadcast Training Part 2 | |
LDC2015T04 | GALE Chinese-English Word Alignment and Tagging -- Broadcast Training Part 3 | |
LDC2015T18 | GALE Chinese-English Word Alignment and Tagging -- Broadcast Training Part 4 | |
LDC2012T16 | GALE Chinese-English Word Alignment and Tagging Training Part 1 -- Newswire and Web | |
LDC2012T20 | GALE Chinese-English Word Alignment and Tagging Training Part 2 -- Newswire | |
LDC2012T24 | GALE Chinese-English Word Alignment and Tagging Training Part 3 -- Web | |
LDC2013T05 | GALE Chinese-English Word Alignment and Tagging Training Part 4 -- Web | |
LDC2017T06 | GALE English-Chinese Parallel Aligned Treebank -- Training | |
LDC2008T02 | GALE Phase 1 Arabic Blog Parallel Text | |
LDC2007T24 | GALE Phase 1 Arabic Broadcast News Parallel Text - Part 1 | |
LDC2008T09 | GALE Phase 1 Arabic Broadcast News Parallel Text - Part 2 | |
LDC2009T03 | GALE Phase 1 Arabic Newsgroup Parallel Text - Part 1 | |
LDC2009T09 | GALE Phase 1 Arabic Newsgroup Parallel Text - Part 2 | |
LDC2008T06 | GALE Phase 1 Chinese Blog Parallel Text | |
LDC2009T02 | GALE Phase 1 Chinese Broadcast Conversation Parallel Text - Part 1 | |
LDC2009T06 | GALE Phase 1 Chinese Broadcast Conversation Parallel Text - Part 2 | |
LDC2007T23 | GALE Phase 1 Chinese Broadcast News Parallel Text - Part 1 | |
LDC2008T08 | GALE Phase 1 Chinese Broadcast News Parallel Text - Part 2 | |
LDC2008T18 | GALE Phase 1 Chinese Broadcast News Parallel Text - Part 3 | |
LDC2009T15 | GALE Phase 1 Chinese Newsgroup Parallel Text - Part 1 | |
LDC2010T03 | GALE Phase 1 Chinese Newsgroup Parallel Text - Part 2 | |
LDC2007T20 | GALE Phase 1 Distillation Training | |
LDC2012T06 | GALE Phase 2 Arabic Broadcast Conversation Parallel Text Part 1 | |
LDC2012T14 | GALE Phase 2 Arabic Broadcast Conversation Parallel Text Part 2 | |
LDC2013S02 | GALE Phase 2 Arabic Broadcast Conversation Speech Part 1 | |
LDC2013S07 | GALE Phase 2 Arabic Broadcast Conversation Speech Part 2 | |
LDC2013T04 | GALE Phase 2 Arabic Broadcast Conversation Transcripts Part 1 | |
LDC2013T17 | GALE Phase 2 Arabic Broadcast Conversation Transcripts Part 2 | |
LDC2012T18 | GALE Phase 2 Arabic Broadcast News Parallel Text | |
LDC2014S07 | GALE Phase 2 Arabic Broadcast News Speech Part 1 | |
LDC2015S01 | GALE Phase 2 Arabic Broadcast News Speech Part 2 | |
LDC2014T17 | GALE Phase 2 Arabic Broadcast News Transcripts Part 1 | |
LDC2015T01 | GALE Phase 2 Arabic Broadcast News Transcripts Part 2 | |
LDC2012T17 | GALE Phase 2 Arabic Newswire Parallel Text | |
LDC2013T01 | GALE Phase 2 Arabic Web Parallel Text | |
LDC2013T11 | GALE Phase 2 Chinese Broadcast Conversation Parallel Text Part 1 | |
LDC2013T16 | GALE Phase 2 Chinese Broadcast Conversation Parallel Text Part 2 | |
LDC2013S04 | GALE Phase 2 Chinese Broadcast Conversation Speech | |
LDC2013T08 | GALE Phase 2 Chinese Broadcast Conversation Transcripts | |
LDC2014T04 | GALE Phase 2 Chinese Broadcast News Parallel Text Part 1 | |
LDC2014T11 | GALE Phase 2 Chinese Broadcast News Parallel Text Part 2 | |
LDC2013S08 | GALE Phase 2 Chinese Broadcast News Speech | |
LDC2013T20 | GALE Phase 2 Chinese Broadcast News Transcripts | |
LDC2014T15 | GALE Phase 2 Chinese Newswire Parallel Text Part 1 | |
LDC2014T20 | GALE Phase 2 Chinese Newswire Parallel Text Part 2 | |
LDC2014T26 | GALE Phase 2 Chinese Web Parallel Text | |
LDC2015T05 | GALE Phase 3 and 4 Arabic Broadcast Conversation Parallel Text | |
LDC2015T07 | GALE Phase 3 and 4 Arabic Broadcast News Parallel Text | |
LDC2015T19 | GALE Phase 3 and 4 Arabic Newswire Parallel Text | |
LDC2016T08 | GALE Phase 3 and 4 Arabic Web Parallel Text | |
LDC2016T09 | GALE Phase 3 and 4 Chinese Broadcast Conversation Parallel Text | |
LDC2016T15 | GALE Phase 3 and 4 Chinese Broadcast News Parallel Text | |
LDC2016T25 | GALE Phase 3 and 4 Chinese Newswire Parallel Text | |
LDC2017T02 | GALE Phase 3 and 4 Chinese Web Parallel Text | |
LDC2015S11 | GALE Phase 3 Arabic Broadcast Conversation Speech Part 1 | |
LDC2016S01 | GALE Phase 3 Arabic Broadcast Conversation Speech Part 2 | |
LDC2015T16 | GALE Phase 3 Arabic Broadcast Conversation Transcripts Part 1 | |
LDC2016T06 | GALE Phase 3 Arabic Broadcast Conversation Transcripts Part 2 | |
LDC2016S07 | GALE Phase 3 Arabic Broadcast News Speech Part 1 | |
LDC2017S02 | GALE Phase 3 Arabic Broadcast News Speech Part 2 | |
LDC2016T17 | GALE Phase 3 Arabic Broadcast News Transcripts Part 1 | |
LDC2017T04 | GALE Phase 3 Arabic Broadcast News Transcripts Part 2 | |
LDC2014S09 | GALE Phase 3 Chinese Broadcast Conversation Speech Part 1 | |
LDC2015S06 | GALE Phase 3 Chinese Broadcast Conversation Speech Part 2 | |
LDC2014T28 | GALE Phase 3 Chinese Broadcast Conversation Transcripts Part 1 | |
LDC2015T09 | GALE Phase 3 Chinese Broadcast Conversation Transcripts Part 2 | |
LDC2015S13 | GALE Phase 3 Chinese Broadcast News Speech | |
LDC2015T25 | GALE Phase 3 Chinese Broadcast News Transcripts | |
LDC2016T11 | GALE Phase 4 Arabic Broadcast Conversation Parallel Sentences | |
LDC2017S15 | GALE Phase 4 Arabic Broadcast Conversation Speech | |
LDC2017T12 | GALE Phase 4 Arabic Broadcast Conversation Transcripts | |
LDC2016T20 | GALE Phase 4 Arabic Broadcast News Parallel Sentences | |
LDC2018S05 | GALE Phase 4 Arabic Broadcast News Speech | |
LDC2018T14 | GALE Phase 4 Arabic Broadcast News Transcripts | |
LDC2016T27 | GALE Phase 4 Arabic Newswire Parallel Sentences | |
LDC2016T14 | GALE Phase 4 Arabic Weblog Parallel Sentences | |
LDC2015T14 | GALE Phase 4 Chinese Broadcast Conversation Parallel Sentences | |
LDC2016S03 | GALE Phase 4 Chinese Broadcast Conversation Speech | |
LDC2016T12 | GALE Phase 4 Chinese Broadcast Conversation Transcripts | |
LDC2015T21 | GALE Phase 4 Chinese Broadcast News Parallel Sentences | |
LDC2017S25 | GALE Phase 4 Chinese Broadcast News Speech | |
LDC2017T18 | GALE Phase 4 Chinese Broadcast News Transcripts | |
LDC2015T24 | GALE Phase 4 Chinese Newswire Parallel Sentences | |
LDC2016T04 | GALE Phase 4 Chinese Weblog Parallel Sentences | |
LDC2005S15 | HKUST Mandarin Telephone Speech, Part 1 | |
LDC2005T32 | HKUST Mandarin Telephone Transcript Data, Part 1 | |
LDC2000T50 | Hong Kong Hansards Parallel Text | |
LDC2000T47 | Hong Kong Laws Parallel Text | |
LDC2000T46 | Hong Kong News Parallel Text | |
LDC2004T08 | Hong Kong Parallel Text | |
LDC2018S18 | HUB5 Mandarin Telephone Speech and Transcripts Second Edition | |
LDC98S69 | HUB5 Mandarin Telephone Speech Corpus | |
LDC98T26 | HUB5 Mandarin Transcripts | |
LDC95T8 | Japanese Business News Text | |
LDC99T34 | Japanese Business News Text Supplement | |
LDC2000T45 | Korean Newswire | |
LDC2005S14 | Levantine Arabic QT Training Data Set 4 (Speech + Transcripts) | |
LDC95T13 | Mandarin Chinese News Text | |
LDC2001T02 | Message Understanding Conference (MUC) 7 | |
LDC2003T18 | Multiple-Translation Arabic (MTA) Part 1 | |
LDC2005T05 | Multiple-Translation Arabic (MTA) Part 2 | |
LDC2003T17 | Multiple-Translation Chinese (MTC) Part 2 | |
LDC2004T07 | Multiple-Translation Chinese (MTC) Part 3 | |
LDC2002T01 | Multiple-Translation Chinese Corpus | |
LDC2010T21 | NIST 2008 Open Machine Translation (OpenMT) Evaluation | |
LDC2010T01 | NIST Open MT 2008 Evaluation (MT08) Selected References and System Translations | |
LDC95T21 | North American News Text Corpus | |
LDC98T30 | North American News Text Supplement | |
LDC2007T21 | OntoNotes Release 1.0 | |
LDC2008T04 | OntoNotes Release 2.0 | |
LDC2009T24 | OntoNotes Release 3.0 | |
LDC2011T03 | OntoNotes Release 4.0 | |
LDC2013T19 | OntoNotes Release 5.0 | |
LDC2004T23 | Prague Arabic Dependency Treebank 1.0 | |
LDC2004T14 | Proposition Bank I | |
LDC2004S08 | RT-03 MDE Training Data Speech | |
LDC2004T12 | RT-03 MDE Training Data Text and Annotations | |
LDC2005S16 | RT-04 MDE Training Data Speech | |
LDC2005T24 | RT-04 MDE Training Data Text/Annotations | |
LDC2004S10 | Santa Barbara Corpus of Spoken American English Part III | |
LDC2005S25 | Santa Barbara Corpus of Spoken American English Part IV | |
LDC2013T18 | Semantic Textual Similarity (STS) 2013 Machine Translation | |
LDC2006T12 | Spanish Gigaword First Edition | |
LDC2009T21 | Spanish Gigaword Second Edition | |
LDC95T9 | Spanish News Text | |
LDC99T41 | Spanish Newswire Text, Volume 2 | |
LDC2001S13 | Switchboard Cellular Part 1 Audio | |
LDC2001S15 | Switchboard Cellular Part 1 Transcribed Audio | |
LDC2001T14 | Switchboard Cellular Part 1 Transcription | |
LDC2004S07 | Switchboard Cellular Part 2 Audio | |
LDC97S62 | Switchboard-1 Release 2 | |
LDC98S75 | Switchboard-2 Phase I | |
LDC99S79 | Switchboard-2 Phase II | |
LDC2002S06 | Switchboard-2 Phase III Audio | |
LDC98S72 | Taiwanese Putonghua Speech and Transcripts | |
LDC98T25 | TDT Pilot Study Corpus | |
LDC2000S92 | TDT2 Careful Transcription Audio | |
LDC2000T44 | TDT2 Careful Transcription Text | |
LDC99S84 | TDT2 English Audio | |
LDC2001S93 | TDT2 Mandarin Audio Corpus | |
LDC2001T57 | TDT2 Multilanguage Text Version 4.0 | |
LDC2001S94 | TDT3 English Audio | |
LDC2001S95 | TDT3 Mandarin Audio | |
LDC2001T58 | TDT3 Multilanguage Text Version 2.0 | |
LDC2005S11 | TDT4 Multilingual Broadcast News Speech Corpus | |
LDC2005T16 | TDT4 Multilingual Text and Annotations | |
LDC2004T09 | TIDES Extraction (ACE) 2003 Multilingual Training Data | |
LDC93T3A | TIPSTER Complete | |
LDC2018T13 | TRAD Arabic-French Parallel Text -- Newsgroup | |
LDC2018T21 | TRAD Arabic-French Parallel Text -- Newswire | |
LDC2018T02 | TRAD Chinese-French Parallel Text -- Blog | |
LDC2018T17 | TRAD Chinese-French Parallel Text -- Broadcast News | |
LDC2000T52 | TREC Mandarin | |
LDC2000T51 | TREC Spanish | |
LDC99T42 | Treebank-3 | |
LDC94T4B-1 | UN Parallel Text (English) | |
LDC94T4B-3 | UN Parallel Text (Spanish) |
GENOA
LDC2004S05 | ISL Meeting Speech Part 1 | |
LDC2004T10 | ISL Meeting Transcripts Part 1 |
HAVIC
LDC2018V01 | HAVIC MED Event E051-E060 -- Videos, Metadata and Annotation | |
LDC2022V01 | HAVIC MED Novel 1 Test -- Videos, Metadata and Annotation | |
LDC2022V02 | HAVIC MED Novel 2 Test -- Videos, Metadata and Annotation | |
LDC2019V01 | HAVIC MED Progress Test -- Videos, Metadata and Annotation | |
LDC2021V01 | HAVIC MED Training Data -- Videos, Metadata and Annotation | |
LDC2016V01 | HAVIC Pilot Transcription |
Hub4
LDC98T31 | 1996 CSR HUB4 Language Model | |
LDC97S66 | 1996 English Broadcast News Dev and Eval (HUB4) | |
LDC97S44 | 1996 English Broadcast News Speech (HUB4) | |
LDC97T22 | 1996 English Broadcast News Transcripts (HUB4) | |
LDC98S71 | 1997 English Broadcast News Speech (HUB4) | |
LDC98T28 | 1997 English Broadcast News Transcripts (HUB4) | |
LDC2001S91 | 1997 HUB4 Broadcast News Evaluation Non-English Test Material | |
LDC2002S11 | 1997 HUB4 English Evaluation Speech and Transcripts | |
LDC98S73 | 1997 Mandarin Broadcast News Speech (HUB4-NE) | |
LDC98T24 | 1997 Mandarin Broadcast News Transcripts (HUB4-NE) | |
LDC98S74 | 1997 Spanish Broadcast News Speech (HUB4-NE) | |
LDC98T29 | 1997 Spanish Broadcast News Transcripts (HUB4-NE) | |
LDC2000S86 | 1998 HUB4 Broadcast News Evaluation English Test Material | |
LDC2015S05 | Mandarin Chinese Phonetic Segmentation and Tone | |
LDC95T21 | North American News Text Corpus | |
LDC98T30 | North American News Text Supplement |
Hub5-LVCSR
LDC2002S22 | 1997 HUB5 Arabic Evaluation | |
LDC2002T39 | 1997 HUB5 Arabic Transcripts | |
LDC2002S23 | 1997 HUB5 English Evaluation | |
LDC2002S24 | 1997 HUB5 German Evaluation | |
LDC2003T03 | 1997 HUB5 German Transcripts | |
LDC2002S25 | 1997 HUB5 Spanish Evaluation | |
LDC2003T04 | 1997 HUB5 Spanish Transcripts | |
LDC2002S10 | 1998 HUB5 English Evaluation | |
LDC2003T02 | 1998 HUB5 English Transcripts | |
LDC2002S09 | 2000 HUB5 English Evaluation Speech | |
LDC2002T43 | 2000 HUB5 English Evaluation Transcripts | |
LDC2002S13 | 2001 HUB5 English Evaluation | |
LDC2002S12 | 2001 HUB5 Mandarin Evaluation | |
LDC2003T01 | 2001 HUB5 Mandarin Transcripts | |
LDC97L20 | CALLHOME American English Lexicon (PRONLEX) | |
LDC97S42 | CALLHOME American English Speech | |
LDC97T14 | CALLHOME American English Transcripts | |
LDC97S45 | CALLHOME Egyptian Arabic Speech | |
LDC2002S37 | CALLHOME Egyptian Arabic Speech Supplement | |
LDC97T19 | CALLHOME Egyptian Arabic Transcripts | |
LDC2002T38 | CALLHOME Egyptian Arabic Transcripts Supplement | |
LDC97L18 | CALLHOME German Lexicon | |
LDC97S43 | CALLHOME German Speech | |
LDC97T15 | CALLHOME German Transcripts | |
LDC96L17 | CALLHOME Japanese Lexicon | |
LDC96S37 | CALLHOME Japanese Speech | |
LDC96T18 | CALLHOME Japanese Transcripts | |
LDC96L15 | CALLHOME Mandarin Chinese Lexicon | |
LDC96S34 | CALLHOME Mandarin Chinese Speech | |
LDC96T16 | CALLHOME Mandarin Chinese Transcripts | |
LDC96L16 | CALLHOME Spanish Lexicon | |
LDC96S35 | CALLHOME Spanish Speech | |
LDC96T17 | CALLHOME Spanish Transcripts | |
LDC99L22 | Egyptian Colloquial Arabic Lexicon | |
LDC2018S18 | HUB5 Mandarin Telephone Speech and Transcripts Second Edition | |
LDC98S69 | HUB5 Mandarin Telephone Speech Corpus | |
LDC98T26 | HUB5 Mandarin Transcripts | |
LDC98S70 | HUB5 Spanish Telephone Speech Corpus | |
LDC98T27 | HUB5 Spanish Transcripts | |
LDC97S62 | Switchboard-1 Release 2 | |
LDC2001T60 | Syllable-Final /s/ Lenition |
JANUS
LDC2004S05 | ISL Meeting Speech Part 1 | |
LDC2004T10 | ISL Meeting Transcripts Part 1 |
LID
LDC96S46 | CALLFRIEND American English-Non-Southern Dialect | |
LDC2019S21 | CALLFRIEND American English-Non-Southern Dialect Second Edition | |
LDC96S47 | CALLFRIEND American English-Southern Dialect | |
LDC2020S08 | CALLFRIEND American English-Southern Dialect Second Edition | |
LDC96S48 | CALLFRIEND Canadian French | |
LDC2019S18 | CALLFRIEND Canadian French Second Edition | |
LDC96S49 | CALLFRIEND Egyptian Arabic | |
LDC2019S04 | CALLFRIEND Egyptian Arabic Second Edition | |
LDC96S50 | CALLFRIEND Farsi | |
LDC2014S01 | CALLFRIEND Farsi Second Edition Speech | |
LDC2014T01 | CALLFRIEND Farsi Second Edition Transcripts | |
LDC96S51 | CALLFRIEND German | |
LDC96S52 | CALLFRIEND Hindi | |
LDC96S53 | CALLFRIEND Japanese | |
LDC96S54 | CALLFRIEND Korean | |
LDC96S55 | CALLFRIEND Mandarin Chinese-Mainland Dialect | |
LDC2018S09 | CALLFRIEND Mandarin Chinese-Mainland Dialect Second Edition | |
LDC96S56 | CALLFRIEND Mandarin Chinese-Taiwan Dialect | |
LDC2020S06 | CALLFRIEND Mandarin Chinese-Taiwan Dialect Second Edition | |
LDC2023S08 | CALLFRIEND Russian Speech | |
LDC2023T09 | CALLFRIEND Russian Text | |
LDC96S57 | CALLFRIEND Spanish-Caribbean Dialect | |
LDC96S58 | CALLFRIEND Spanish-Non-Caribbean Dialect | |
LDC96S59 | CALLFRIEND Tamil | |
LDC96S60 | CALLFRIEND Vietnamese |
Linguistic Atlas Project
LDC2012S03 | Digital Archive of Southern Speech | |
LDC2016S05 | Digital Archive of Southern Speech - NLP Version |
LORELEI
LDC2020T02 | Abstract Meaning Representation (AMR) Annotation Release 3.0 | |
LDC2023T10 | AIDA Scenario 1 and 2 Reference Knowledge Base | |
LDC2023S01 | AIDA Ukrainian Broadcast and Telephone Speech Audio and Transcripts | |
LDC2024T03 | LoReHLT Hausa Representative Language Pack | |
LDC2021T02 | LORELEI Akan Representative Language Pack | |
LDC2018T04 | LORELEI Amharic Representative Language Pack - Monolingual and Parallel Text | |
LDC2022T05 | LORELEI Bengali Representative Language Pack | |
LDC2020T10 | LORELEI Entity Detection and Linking Knowledge Base | |
LDC2024T01 | LORELEI Farsi Representative Language Pack | |
LDC2023T07 | LORELEI Indonesian Representative Language Pack | |
LDC2022T01 | LORELEI Kinyarwanda Incident Language Pack | |
LDC2020T11 | LORELEI Oromo Incident Language Pack | |
LDC2018T11 | LORELEI Somali Representative Language Pack - Monolingual and Parallel Text | |
LDC2023T01 | LORELEI Swahili Representative Language Pack | |
LDC2023T02 | LORELEI Tagalog Representative Language Pack | |
LDC2023T03 | LORELEI Tamil Representative Language Pack | |
LDC2023T08 | LORELEI Thai Representative Language Pack | |
LDC2020T22 | LORELEI Tigrinya Incident Language Pack | |
LDC2020T24 | LORELEI Ukrainian Representative Language Pack | |
LDC2024T07 | LORELEI Uyghur Incident Language Pack | |
LDC2020T17 | LORELEI Vietnamese Representative Language Pack | |
LDC2022T03 | LORELEI Wolof Representative Language Pack | |
LDC2023T06 | LORELEI Zulu Representative Language Pack |
Machine Reading
LDC2020T04 | Machine Reading Phase 1 IC Training Data | |
LDC2019T14 | Machine Reading Phase 1 NFL Scoring Training Data |
MADCAT
LDC2014T13 | MADCAT Chinese Pilot Training Set | |
LDC2012T15 | MADCAT Phase 1 Training Set | |
LDC2013T09 | MADCAT Phase 2 Training Set | |
LDC2013T15 | MADCAT Phase 3 Training Set |
MALACH
LDC2014S04 | USC-SFI MALACH Interviews and Transcripts Czech | |
LDC2012S05 | USC-SFI MALACH Interviews and Transcripts English | |
LDC2019S11 | USC-SFI MALACH Interviews and Transcripts English – Speech Recognition Edition |
MIXER
LDC2019S09 | First DIHARD Challenge Development - Eight Sources | |
LDC2019S12 | First DIHARD Challenge Evaluation - Nine Sources | |
LDC2023S02 | Mixer 3 Speech | |
LDC2020S03 | Mixer 4 and 5 Speech | |
LDC2013S03 | Mixer 6 Speech | |
LDC2023S04 | Mixer 7 Spanish Speech | |
LDC2023S09 | REMIX Telephone Collection | |
LDC2022S06 | Second DIHARD Challenge Evaluation - Eleven Sources | |
LDC2022S12 | Third DIHARD Challenge Development | |
LDC2022S14 | Third DIHARD Challenge Evaluation |
MT08
LDC2010T01 | NIST Open MT 2008 Evaluation (MT08) Selected References and System Translations |
MUC
LDC2003T13 | Message Understanding Conference (MUC) 6 | |
LDC96T10 | Message Understanding Conference (MUC) 6 Additional News Text | |
LDC2001T02 | Message Understanding Conference (MUC) 7 | |
LDC2010T15 | Message Understanding Conference 7 Timed (MUC7_T) | |
LDC95T21 | North American News Text Corpus | |
LDC93T3A | TIPSTER Complete | |
LDC93T3B | TIPSTER Volume 1 | |
LDC93T3C | TIPSTER Volume 2 | |
LDC93T3D | TIPSTER Volume 3 |
NIEUW
LDC2022S09 | Xi'an Guanzhong Object Naming |
NIST Automatic Meeting Recognition
LDC2004S09 | NIST Meeting Pilot Corpus Speech | |
LDC2004T13 | NIST Meeting Pilot Corpus Transcripts and Metadata |
NIST LRE
LDC2006S31 | 2003 NIST Language Recognition Evaluation | |
LDC2008S05 | 2005 NIST Language Recognition Evaluation | |
LDC2009S05 | 2007 NIST Language Recognition Evaluation Supplemental Training Set | |
LDC2009S04 | 2007 NIST Language Recognition Evaluation Test Set | |
LDC2014S06 | 2009 NIST Language Recognition Evaluation Test Set | |
LDC2018S06 | 2011 NIST Language Recognition Evaluation Test Set | |
LDC2022S10 | 2017 NIST Language Recognition Evaluation Training and Development Sets | |
LDC2023S01 | AIDA Ukrainian Broadcast and Telephone Speech Audio and Transcripts | |
LDC2023S02 | Mixer 3 Speech | |
LDC2019S02 | Multi-Language Conversational Telephone Speech 2011 -- Arabic Group | |
LDC2018S03 | Multi-Language Conversational Telephone Speech 2011 -- Central Asian | |
LDC2018S08 | Multi-Language Conversational Telephone Speech 2011 -- Central European | |
LDC2019S15 | Multi-Language Conversational Telephone Speech 2011 -- East Asian | |
LDC2019S06 | Multi-Language Conversational Telephone Speech 2011 -- English Group | |
LDC2020S05 | Multi-Language Conversational Telephone Speech 2011 -- Mandarin Chinese | |
LDC2016S11 | Multi-Language Conversational Telephone Speech 2011 -- Slavic Group | |
LDC2017S14 | Multi-Language Conversational Telephone Speech 2011 -- South Asian | |
LDC2018S12 | Multi-Language Conversational Telephone Speech 2011 -- Spanish | |
LDC2017S09 | Multi-Language Conversational Telephone Speech 2011 -- Turkish |
NIST MT
LDC2009T05 | 2008 NIST Metrics for Machine Translation (MetricsMATR08) Development Data | |
LDC2014T09 | HyTER Networks of Selected OpenMT08/09 Sentences | |
LDC2010T10 | NIST 2002 Open Machine Translation (OpenMT) Evaluation | |
LDC2010T11 | NIST 2003 Open Machine Translation (OpenMT) Evaluation | |
LDC2010T12 | NIST 2004 Open Machine Translation (OpenMT) Evaluation | |
LDC2010T14 | NIST 2005 Open Machine Translation (OpenMT) Evaluation | |
LDC2010T17 | NIST 2006 Open Machine Translation (OpenMT) Evaluation | |
LDC2010T21 | NIST 2008 Open Machine Translation (OpenMT) Evaluation | |
LDC2013T07 | NIST 2008-2012 Open Machine Translation (OpenMT) Progress Test Sets | |
LDC2010T23 | NIST 2009 Open Machine Translation (OpenMT) Evaluation | |
LDC2013T03 | NIST 2012 Open Machine Translation (OpenMT) Evaluation | |
LDC2014T02 | NIST 2012 Open Machine Translation (OpenMT) Progress Test Five Language Source | |
LDC2013T18 | Semantic Textual Similarity (STS) 2013 Machine Translation |
NIST OpenSAT
LDC2022S01 | 2017 NIST OpenSAT Pilot - SSSF | |
LDC2023S06 | 2019 OpenSAT Public Safety Communications Simulation |
NIST Public Safety
LDC2023S06 | 2019 OpenSAT Public Safety Communications Simulation |
NIST SRE
LDC96S61 | 1996 Speaker Recognition Benchmark | |
LDC99S80 | 1997 Speaker Recognition Benchmark | |
LDC98S76 | 1998 Speaker Recognition Benchmark | |
LDC99S81 | 1999 Speaker Recognition Benchmark | |
LDC2001S97 | 2000 NIST Speaker Recognition Evaluation | |
LDC2002S34 | 2001 NIST Speaker Recognition Evaluation Corpus | |
LDC2004S04 | 2002 NIST Speaker Recognition Evaluation | |
LDC2010S03 | 2003 NIST Speaker Recognition Evaluation | |
LDC2006S44 | 2004 NIST Speaker Recognition Evaluation | |
LDC2011S04 | 2005 NIST Speaker Recognition Evaluation Test Data | |
LDC2011S01 | 2005 NIST Speaker Recognition Evaluation Training Data | |
LDC2011S10 | 2006 NIST Speaker Recognition Evaluation Test Set Part 1 | |
LDC2012S01 | 2006 NIST Speaker Recognition Evaluation Test Set Part 2 | |
LDC2011S09 | 2006 NIST Speaker Recognition Evaluation Training Set | |
LDC2011S11 | 2008 NIST Speaker Recognition Evaluation Supplemental Set | |
LDC2011S08 | 2008 NIST Speaker Recognition Evaluation Test Set | |
LDC2011S05 | 2008 NIST Speaker Recognition Evaluation Training Set Part 1 | |
LDC2011S07 | 2008 NIST Speaker Recognition Evaluation Training Set Part 2 | |
LDC2017S06 | 2010 NIST Speaker Recognition Evaluation Test Set | |
LDC2019S20 | 2016 NIST Speaker Recognition Evaluation Test Set | |
LDC2020S04 | 2018 NIST Speaker Recognition Evaluation Test Set | |
LDC2023V01 | 2019 NIST Speaker Recognition Evaluation Test Set -- Audio-Visual | |
LDC2023S03 | 2019 NIST Speaker Recognition Evaluation Test Set -- CTS Challenge | |
LDC2024S05 | Call My Net 1 | |
LDC2019S09 | First DIHARD Challenge Development - Eight Sources | |
LDC2019S12 | First DIHARD Challenge Evaluation - Nine Sources | |
LDC2013S05 | Greybeard | |
LDC2024S01 | KASET - Kurmanji and Sorani Kurdish Speech and Transcripts | |
LDC2023S02 | Mixer 3 Speech | |
LDC2020S03 | Mixer 4 and 5 Speech | |
LDC2013S03 | Mixer 6 Speech | |
LDC2023S04 | Mixer 7 Spanish Speech | |
LDC2009T26 | NXT Switchboard Annotations | |
LDC2023S09 | REMIX Telephone Collection | |
LDC2022S06 | Second DIHARD Challenge Evaluation - Eleven Sources | |
LDC2001S13 | Switchboard Cellular Part 1 Audio | |
LDC2001S15 | Switchboard Cellular Part 1 Transcribed Audio | |
LDC2001T14 | Switchboard Cellular Part 1 Transcription | |
LDC2004S07 | Switchboard Cellular Part 2 Audio | |
LDC93S8 | Switchboard Credit Card | |
LDC97S62 | Switchboard-1 Release 2 | |
LDC98S75 | Switchboard-2 Phase I | |
LDC99S79 | Switchboard-2 Phase II | |
LDC2002S06 | Switchboard-2 Phase III Audio |
OpenHaRT
LDC2012T15 | MADCAT Phase 1 Training Set | |
LDC2013T09 | MADCAT Phase 2 Training Set | |
LDC2013T15 | MADCAT Phase 3 Training Set |
PEA-TRAD
LDC2018T13 | TRAD Arabic-French Parallel Text -- Newsgroup | |
LDC2018T21 | TRAD Arabic-French Parallel Text -- Newswire | |
LDC2018T02 | TRAD Chinese-French Parallel Text -- Blog | |
LDC2018T17 | TRAD Chinese-French Parallel Text -- Broadcast News |
RATS
LDC2017S20 | RATS Keyword Spotting | |
LDC2018S10 | RATS Language Identification | |
LDC2024S03 | RATS Low Speech Density | |
LDC2021S08 | RATS Speaker Identification | |
LDC2015S02 | RATS Speech Activity Detection |
REFLEX-MTE
LDC2009T11 | REFLEX Entity Translation Training/DevTest |
RM
LDC96S39 | RM Isolated and Spelled Word Data |
ROAR
LDC2019S09 | First DIHARD Challenge Development - Eight Sources | |
LDC2019S12 | First DIHARD Challenge Evaluation - Nine Sources | |
LDC2004S05 | ISL Meeting Speech Part 1 | |
LDC2004T10 | ISL Meeting Transcripts Part 1 | |
LDC2022S06 | Second DIHARD Challenge Evaluation - Eleven Sources | |
LDC2022S14 | Third DIHARD Challenge Evaluation |
RT
LDC2007S12 | 2004 Spring NIST Rich Transcription (RT-04S) Evaluation Data | |
LDC2007S11 | 2004 Spring NIST Rich Transcription (RT-04S) Development Data | |
LDC2011S06 | 2005 Spring NIST Rich Transcription (RT-05S) Evaluation Set | |
LDC2019S09 | First DIHARD Challenge Development - Eight Sources | |
LDC2019S12 | First DIHARD Challenge Evaluation - Nine Sources | |
LDC2022S06 | Second DIHARD Challenge Evaluation - Eleven Sources | |
LDC2022S12 | Third DIHARD Challenge Development |
SemEval
LDC2016T10 | SDP 2014 & 2015: Broad Coverage Semantic Dependency Parsing | |
LDC2011T01 | SemEval-2010 Task 1 OntoNotes English: Coreference Resolution in Multiple Languages |
SID
LDC2001S13 | Switchboard Cellular Part 1 Audio | |
LDC2001S15 | Switchboard Cellular Part 1 Transcribed Audio | |
LDC2001T14 | Switchboard Cellular Part 1 Transcription | |
LDC2004S07 | Switchboard Cellular Part 2 Audio | |
LDC98S75 | Switchboard-2 Phase I | |
LDC99S79 | Switchboard-2 Phase II | |
LDC2002S06 | Switchboard-2 Phase III Audio |
SPINE
LDC2000S96 | Speech in Noisy Environments (SPINE) Evaluation Audio | |
LDC2000T54 | Speech in Noisy Environments (SPINE) Evaluation Transcripts | |
LDC2000S87 | Speech in Noisy Environments (SPINE) Training Audio | |
LDC2000T49 | Speech in Noisy Environments (SPINE) Training Transcripts | |
LDC2001S04 | Speech in Noisy Environments (SPINE2) Part 1 Audio | |
LDC2001T05 | Speech in Noisy Environments (SPINE2) Part 1 Transcripts | |
LDC2001S06 | Speech in Noisy Environments (SPINE2) Part 2 Audio | |
LDC2001T07 | Speech in Noisy Environments (SPINE2) Part 2 Transcripts | |
LDC2001S08 | Speech in Noisy Environments (SPINE2) Part 3 Audio | |
LDC2001T09 | Speech in Noisy Environments (SPINE2) Part 3 Transcripts | |
LDC2001S99 | Speech in Noisy Environments 1 (SPINE1 CODED) Coded Audio |
TAC
LDC2024T09 | MultiTACRED | |
LDC2023T13 | TAC KBP Belief and Sentiment - Comprehensive Training and Evaluation Data 2016-2017 | |
LDC2017T17 | TAC KBP Chinese Cross-lingual Entity Linking - Comprehensive Training and Evaluation Data 2011-2014 | |
LDC2019T08 | TAC KBP Chinese Regular Slot Filling - Comprehensive Training and Evaluation Data 2014 | |
LDC2019T17 | TAC KBP Cold Start - Comprehensive Evaluation Data 2012-2017 | |
LDC2018T03 | TAC KBP Comprehensive English Source Corpora 2009-2014 | |
LDC2018T16 | TAC KBP English Entity Linking - Comprehensive Training and Evaluation Data 2009-2013 | |
LDC2020T03 | TAC KBP English Event Argument - Training and Evaluation Data 2014-2015 | |
LDC2020T13 | TAC KBP English Event Nugget Detection and Coreference - Comprehensive Training and Evaluation Data 2014-2015 | |
LDC2018T22 | TAC KBP English Regular Slot Filling - Comprehensive Training and Evaluation Data 2009-2014 | |
LDC2021T08 | TAC KBP English Sentiment Slot Filling -- Comprehensive Training and Evaluation Data 2013-2014 | |
LDC2021T06 | TAC KBP English Surprise Slot Filling -- Comprehensive Training and Evaluation Data 2010 | |
LDC2020T08 | TAC KBP English Temporal Slot Filling - Comprehensive Training and Evaluation Data 2011 and 2013 | |
LDC2019T19 | TAC KBP Entity Discovery and Linking - Comprehensive Evaluation Data 2016-2017 | |
LDC2019T02 | TAC KBP Entity Discovery and Linking - Comprehensive Training and Evaluation Data 2014-2015 | |
LDC2019T12 | TAC KBP Evaluation Source Corpora 2016-2017 | |
LDC2020T18 | TAC KBP Event Argument - Comprehensive Training and Evaluation Data 2016-2017 | |
LDC2014T16 | TAC KBP Reference Knowledge Base | |
LDC2016T26 | TAC KBP Spanish Cross-lingual Entity Linking - Comprehensive Training and Evaluation Data 2012-2014 | |
LDC2018T24 | TAC Relation Extraction Dataset |
Talkbank
LDC2005T35 | American National Corpus (ANC) Second Release | |
LDC2004V01 | FORM1 Kinematic Gesture | |
LDC2003V01 | FORM2 Kinematic Gesture | |
LDC2003L01 | Grassfields Bantu Fieldwork: Dschang Lexicon | |
LDC2003S02 | Grassfields Bantu Fieldwork: Dschang Tone Paradigms | |
LDC2001S16 | Grassfields Bantu Fieldwork: Ngomba Tone Paradigms | |
LDC2004L01 | Klex: Finite-State Lexical Transducer for Korean | |
LDC2004T03 | Morphologically Annotated Korean Text | |
LDC2003S06 | Santa Barbara Corpus of Spoken American English Part II | |
LDC2004S10 | Santa Barbara Corpus of Spoken American English Part III | |
LDC2005S25 | Santa Barbara Corpus of Spoken American English Part IV | |
LDC2003T15 | SLX Corpus of Classic Sociolinguistic Interviews | |
LDC2004S12 | TalkBank Ethology Data: Field Recordings of Vervet Monkey Calls |
TDT
LDC2010T18 | ACE Time Normalization (TERN) 2004 English Evaluation Data V1.0 | |
LDC98T25 | TDT Pilot Study Corpus | |
LDC2000S92 | TDT2 Careful Transcription Audio | |
LDC2000T44 | TDT2 Careful Transcription Text | |
LDC99S84 | TDT2 English Audio | |
LDC2001S93 | TDT2 Mandarin Audio Corpus | |
LDC2001T57 | TDT2 Multilanguage Text Version 4.0 | |
LDC2001S94 | TDT3 English Audio | |
LDC2001S95 | TDT3 Mandarin Audio | |
LDC2001T58 | TDT3 Multilanguage Text Version 2.0 | |
LDC2005S11 | TDT4 Multilingual Broadcast News Speech Corpus | |
LDC2005T16 | TDT4 Multilingual Text and Annotations | |
LDC2007V02 | TRECVID 2003 Keyframes & Transcripts | |
LDC2007V01 | TRECVID 2005 Keyframes & Transcripts |
TERN
LDC2010T18 | ACE Time Normalization (TERN) 2004 English Evaluation Data V1.0 |
TIDES
LDC2005T09 | ACE 2004 Multilingual Training Corpus | |
LDC2010T18 | ACE Time Normalization (TERN) 2004 English Evaluation Data V1.0 | |
LDC2005T07 | ACE Time Normalization (TERN) 2004 English Training Data v 1.0 | |
LDC2003T11 | ACE-2 Version 1.0 | |
LDC93T1 | ACL/DCI | |
LDC2004T18 | Arabic English Parallel News Part 1 | |
LDC2003T12 | Arabic Gigaword | |
LDC2004T17 | Arabic News Translation Text Part 1 | |
LDC2001T55 | Arabic Newswire Part 1 | |
LDC2003T07 | Arabic Treebank: Part 1 - 10K-word English Translation | |
LDC2003T06 | Arabic Treebank: Part 1 v 2.0 | |
LDC2005T02 | Arabic Treebank: Part 1 v 3.0 (POS with full vocalization + syntactic analysis) | |
LDC2004T02 | Arabic Treebank: Part 2 v 2.0 | |
LDC2005T20 | Arabic Treebank: Part 3 (full corpus) v 2.0 (MPG + Syntactic Analysis) | |
LDC2004T11 | Arabic Treebank: Part 3 v 1.0 | |
LDC2005T33 | BBN Pronoun Coreference and Entity Type Corpus | |
LDC2000T43 | BLLIP 1987-89 WSJ Corpus Release 1 | |
LDC2002L49 | Buckwalter Arabic Morphological Analyzer Version 1.0 | |
LDC2004L02 | Buckwalter Arabic Morphological Analyzer Version 2.0 | |
LDC2005T13 | CCGbank | |
LDC96L14 | CELEX2 | |
LDC2005T10 | Chinese English News Magazine Parallel Text | |
LDC2003T09 | Chinese Gigaword | |
LDC2005T14 | Chinese Gigaword Second Edition | |
LDC2005T06 | Chinese News Translation Text Part 1 | |
LDC2005T23 | Chinese Proposition Bank 1.0 | |
LDC2001T11 | Chinese Treebank 2.0 | |
LDC2004T05 | Chinese Treebank 4.0 | |
LDC2005T01 | Chinese Treebank 5.0 | |
LDC2007T36 | Chinese Treebank 6.0 | |
LDC2010T07 | Chinese Treebank 7.0 | |
LDC2013T21 | Chinese Treebank 8.0 | |
LDC2002L27 | Chinese-English Translation Lexicon Version 3.0 | |
LDC2007T02 | English Chinese Translation Treebank v 1.0 | |
LDC2003T05 | English Gigaword | |
LDC2005T12 | English Gigaword Second Edition | |
LDC95T11 | European Language Newspaper Text | |
LDC2000T50 | Hong Kong Hansards Parallel Text | |
LDC2000T47 | Hong Kong Laws Parallel Text | |
LDC2000T46 | Hong Kong News Parallel Text | |
LDC2004T08 | Hong Kong Parallel Text | |
LDC95T8 | Japanese Business News Text | |
LDC99T34 | Japanese Business News Text Supplement | |
LDC2000T45 | Korean Newswire | |
LDC95T13 | Mandarin Chinese News Text | |
LDC2001T02 | Message Understanding Conference (MUC) 7 | |
LDC2003T18 | Multiple-Translation Arabic (MTA) Part 1 | |
LDC2005T05 | Multiple-Translation Arabic (MTA) Part 2 | |
LDC2003T17 | Multiple-Translation Chinese (MTC) Part 2 | |
LDC2004T07 | Multiple-Translation Chinese (MTC) Part 3 | |
LDC2006T04 | Multiple-Translation Chinese (MTC) Part 4 | |
LDC2002T01 | Multiple-Translation Chinese Corpus | |
LDC95T21 | North American News Text Corpus | |
LDC98T30 | North American News Text Supplement | |
LDC2004T23 | Prague Arabic Dependency Treebank 1.0 | |
LDC2004T14 | Proposition Bank I | |
LDC2006T12 | Spanish Gigaword First Edition | |
LDC2009T21 | Spanish Gigaword Second Edition | |
LDC95T9 | Spanish News Text | |
LDC99T41 | Spanish Newswire Text, Volume 2 | |
LDC98T25 | TDT Pilot Study Corpus | |
LDC2000S92 | TDT2 Careful Transcription Audio | |
LDC2000T44 | TDT2 Careful Transcription Text | |
LDC99S84 | TDT2 English Audio | |
LDC2001S93 | TDT2 Mandarin Audio Corpus | |
LDC2001T57 | TDT2 Multilanguage Text Version 4.0 | |
LDC2001S94 | TDT3 English Audio | |
LDC2001S95 | TDT3 Mandarin Audio | |
LDC2001T58 | TDT3 Multilanguage Text Version 2.0 | |
LDC2005S11 | TDT4 Multilingual Broadcast News Speech Corpus | |
LDC2005T16 | TDT4 Multilingual Text and Annotations | |
LDC2004T09 | TIDES Extraction (ACE) 2003 Multilingual Training Data | |
LDC93T3A | TIPSTER Complete | |
LDC2000T52 | TREC Mandarin | |
LDC2000T51 | TREC Spanish | |
LDC99T42 | Treebank-3 | |
LDC94T4B-1 | UN Parallel Text (English) | |
LDC94T4B-3 | UN Parallel Text (Spanish) |
Tipster
LDC95T13 | Mandarin Chinese News Text | |
LDC95T9 | Spanish News Text | |
LDC93T3A | TIPSTER Complete | |
LDC93T3B | TIPSTER Volume 1 | |
LDC93T3C | TIPSTER Volume 2 | |
LDC93T3D | TIPSTER Volume 3 |
TRAD
LDC2018T13 | TRAD Arabic-French Parallel Text -- Newsgroup | |
LDC2018T21 | TRAD Arabic-French Parallel Text -- Newswire | |
LDC2018T02 | TRAD Chinese-French Parallel Text -- Blog | |
LDC2018T17 | TRAD Chinese-French Parallel Text -- Broadcast News |
TREC
LDC2001T55 | Arabic Newswire Part 1 | |
LDC95T13 | Mandarin Chinese News Text | |
LDC95T9 | Spanish News Text | |
LDC93T3A | TIPSTER Complete | |
LDC93T3B | TIPSTER Volume 1 | |
LDC93T3C | TIPSTER Volume 2 | |
LDC93T3D | TIPSTER Volume 3 | |
LDC2000T52 | TREC Mandarin | |
LDC2000T51 | TREC Spanish | |
LDC2007V02 | TRECVID 2003 Keyframes & Transcripts | |
LDC2010V01 | TRECVID 2004 Keyframes & Transcripts | |
LDC2007V01 | TRECVID 2005 Keyframes & Transcripts | |
LDC2010V02 | TRECVID 2006 Keyframes |
VACE
LDC2012V01 | 2005 NIST/USF Evaluation Resources for the VACE Program - Broadcast News | |
LDC2011V05 | 2006 NIST/USF Evaluation Resources for the VACE Program - Meeting Data Test Set Part 1 | |
LDC2011V06 | 2006 NIST/USF Evaluation Resources for the VACE Program - Meeting Data Test Set Part 2 | |
LDC2011V03 | NIST/USF Evaluation Resources for the VACE Program - Meeting Data Test Set Part 1 | |
LDC2011V04 | NIST/USF Evaluation Resources for the VACE Program - Meeting Data Test Set Part 2 | |
LDC2011V01 | NIST/USF Evaluation Resources for the VACE Program - Meeting Data Training Set Part 1 | |
LDC2011V02 | NIST/USF Evaluation Resources for the VACE Program - Meeting Data Training Set Part 2 |
VAST
LDC2023V01 | 2019 NIST Speaker Recognition Evaluation Test Set -- Audio-Visual | |
LDC2019S09 | First DIHARD Challenge Development - Eight Sources | |
LDC2019S12 | First DIHARD Challenge Evaluation - Nine Sources | |
LDC2022S06 | Second DIHARD Challenge Evaluation - Eleven Sources | |
LDC2022S12 | Third DIHARD Challenge Development | |
LDC2022S14 | Third DIHARD Challenge Evaluation | |
LDC2019S05 | VAST Chinese Speech and Transcripts |