The College of Arts Sciences Search

Language Corpora

You are here

Access

Cornell Linguistics researchers who need access to any of these corpora should contact system administrators Bruce McKee (bwm55@cornell.edu) or Stacy Dickerman (smd246@cornell.edu) for assistance. 

(available from Phonetics Lab server)

Buckeye Corpus
CELEX Lexical Database
Sounds of the World's Languages
Spoken Karaim
TIMIT
University of Victoria Phonetic Database
University of South Florida Phoneme Database

Linguistics Data Consortium Corpora

Corpus types: In the corpus identifier the letter immediately following the year indicates the type of corpus.
"T" indicates a text corpus
"S" indicates a speech audio corpus
"V" indicates a video corpus
"L" indicates a lexicon

2011 - 2015

2015

LDC2015L01 SenSem Lexicons
LDC2015S01 GALE Phase 2 Arabic Broadcast News Speech Part 2
LDC2015S02 RATS Speech Activity Detection
LDC2015S03 Subglottal Resonances Database
LDC2015S04 Mandarin-English Code-Switching in South-East Asia
LDC2015S05 Mandarin Chinese Phonetic Segmentation and Tone
LDC2015S06 GALE Phase 3 Chinese Broadcast Conversation Speech Part 2
LDC2015T01 GALE Phase 2 Arabic Broadcast News Transcripts Part 2
LDC2015T02 SenSem Databank
LDC2015T04 GALE Chinese-English Word Alignment and Tagging Broadcast Training Part 3
LDC2015T05 GALE Phase 3 and 4 Arabic Broadcast Conversation Parallel Text
LDC2015T06 GALE Chinese-English Parallel Aligned Treebank--Training
LDC2015T07 GALE Phase 3 and 4 Arabic Broadcast News Parallel Text
LDC2015T09 GALE Phase 3 Chinese Broadcast Conversation Transcripts Part 2

2014

LDC2014S01 CALLFRIEND Farsi Second Edition Speech
LDC2014S02 King Saud University Arabic Speech Database
LDC2014S03 Multi-Channel WSJ Audio
LDC2014S04 USF-SFI MALACH Interviews and Transcripts Czech
LDC2014S05 Hispanic-English Database
LDC2014S06 NIST Language Recognition Evaluation Test Set
LDC2014S07 GALE Phase 2 Arabic Broadcast News Speech Part 1
LDC2014S08 United Nations Proceedings Speech
LDC2014T01 CALLFRIEND Farsi Second Edition Transcripts
LDC2014T02 NIST 2012 Open Machine Translation (OpenMT) Progress Test Five Language Source
LDC2014T03 GALE Arabic-English Parallel Aligned Treebank - Broadcast News Part 2
LDC2014T04 GALE Phase 2 Chinese Broadcast News Parallel Text Part 1
LDC2014T05 GALE Arabic-English Word Alignment Training Part 1 -- Newswire and Web
LDC2014T06 ETS Corpus of Non-Native Written English
LDC2014T07 Domain-Specific Hyponym Relations
LDC2014T08 GALE Arabic-English Parallel Aligned Treebank -- Web Training
LDC2014T09 HyTER Networks of Selected OpenMT08/09 Sentences
LDC2014T11 GALE Phase 2 Chinese Broadcast News Parallel Text Part 2
LDC2014T12 Abstract Meaning Representation (AMR) Annotation Release 1.0
LDC2014T13 MADCAT Chinese Pilot Training Set
LDC2014T14 GALE Arabic-English Word Alignment Training Part 3 -- Web
LDC2014T15 GALE Phase 2 Chinese Newswire Parallel Text Part 1
LDC2014T16 TAC KBP Reference Knowledge Base
LDC2014T17 GALE Phase 2 Arabic Broadcast News Transcripts Part 1
LDC2014T18 ACE 2007 Multilingual Training Corpus
LDC2014T19 GALE Arabic-English Word Alignment - Broadcast Training Part 1
LDC2014T20 GALE Phase 2 Chinese Newswire Parallel Text Part 2
LDC2014T21 Chinese Discourse Treebank 0.5
LDC2014T22 GALE Arabic-English Word Alignment Broadcast Training Part 2
LDC2014T25 GALE Chinese-English Word Alignment and Tagging -- Broadcast Training Part 2
LDC2014T26 GALE Phase 2 Chinese Web Parallel Text

2013

LDC2013E07 Deep NLU Exploration - DEFT Pilot Source Text and Annotations
LDC2013E11 DEFT Phase 1 Sample Narrative Text Creation
LDC2013E19 DEFT Phase 1 Narrative Text Source Data R1
LDC2013E28 DEFT Phase 1 ERE Annotation Sample
LDC2013E29 DEFT Phase 1 Narrative Text Source Data R2
LDC2013E30 DEFT Phase 1 AMR Annotation Sample
LDC2013E44 DEFT Phase 1 ERE Annotation R1
LDC2013E47 DEFT Phase 1 AMR Annotation R1
LDC2013E64 DEFT Phase 1 ERE Annotation R3
LDC2013E65 TAC 2011 KBP English Temporal Slot Filling Assessment Results
LDC2013E88 DEFT - Source Data for Event Anomaly Pilot Annotation Exercise
LDC2013E93 DEFT - Source Data for Speech and Belief Anomaly Pilot Annotation Exercises
LDC2013E95 DEFT Narrative Text Source Data R3
LDC2013E117 DEFT Phase 1 AMR Annotation R3
LDC2013L01 Maninkakan Lexicon
LDC2013S03 Mixer 6 Speech
LDC2013S04 GALE Phase 2 Chinese Broadcast Conversation Speech
LDC2013S07 GALE Phase 2 Arabic Broadcast Conversation Speech Part 2
LDC2013S08 GALE Phase 2 Chinese Broadcast News Speech
LDC2013T01 Chinese-English Biology and Chemistry Abstract Parallel Text
LDC2013T02 GALE Phase 2 Arabic Web Parallel Text
LDC2013T03 NIST 2012 Open Machine Translation (OpenMT) Evaluation
LDC2013T04 GALE Phase 2 Arabic Broadcast Conversation Transcripts Part 1
LDC2013T05 GALE Chinese-English Word Alignment and Tagging Training Part 4 -- Web
LDC2013T06 1993-2007 United Nations Parallel Text
LDC2013T07 NIST 2008-2012 Open Machine Translation (OpenMT) Progress Test Sets
LDC2013T08 GALE Phase 2 Chinese Broadcast Conversation Transcripts
LDC2013T10 GALE Arabic-English Parallel-Aligned Treebank - Newswire
LDC2013T11 GALE Phase 2 Chinese Broadcast Conversation Parallel Text Part 1
LDC2013T12 Manually Annotated Sub-Corpus Third Release
LDC2013T13 Chinese Proposition Bank 3.0
LDC2013T14 GALE Arabic-English Parallel Aligned Treebank -- Broadcast News Part 1
LDC2013T15 MADCAT Phase 3 Training Set
LDC2013T16 GALE Phase 2 Chinese Broadcast Conversation Parallel Text Part 2
LDC2013T17 GALE Phase 2 Arabic Broadcast Conversation Transcripts Part 2
LDC2013T18 Semantic Textual Similarity (STS) 2013 Machine Translation
LDC2013T19 OntoNotes Release 5.0
LDC2013T20 GALE Phase 2 Chinese Broadcast News Transcripts
LDC2013T21 Chinese Treebank 8.0
LDC2013T22 The ARRAU Corpus of Anaphoric Information
LDC2013T23 GALE Chinese-English Word Alignment and Tagging - Broadcast Training Part 1

2012

LDC2012S01 2006 NIST Speaker Recognition Evaluation Test Set Part 2
LDC2012S02 TORGO Database of Dysarthric Articulation
LDC2012S03 Digital Archive of Southern Speech
LDC2012S05 USC-SFI MALACH Interviews and Transcripts English
LDC2012S06 Turkish Broadcast News Speech and Transcripts
LDC2012T01 ModeS TimeBank 1.0
LDC2012T02 English Translation Treebank: An-Nahar Newswire
LDC2012T05 Chinese Dependency Treebank 1.0
LDC2012T07 Arabic Treebank - Broadcast News v1.0
LDC2012T08 Praque Czech-English Dependency Treebank 2.0
LDC2012T09 Arabic-Dialect/English Parallel Text
LDC2012T10 Catalan TimeBank 1.0
LDC2012T11 American English Nickname Collection
LDC2012T12 Spanish TimeBank 1.0
LDC2012T13 English Web Treebank
LDC2012T14 GALE Phase 2 Arabic Broadcast Conversation Parallel Text Part 2
LDC2012T15 Multilingual Automatic Document Classification Analysis and Translation (MADCAT) Phase 1 Training
LDC2012T16 GALE Chinese-English Word Alignment and Tagging Training Part 1 - Newswire and Web
LDC2012T17 GALE Phase 2 Arabic Newswire Parallel Text
LDC2012T18 GALE Phase 2 Arabic Broadcast News Parallel Text
LDC2012T20 GALE Chinese-English Word Alignment and Tagging Training Part 2 - Newswire
LDC2012T21 Annotated English Gigaword
LDC2012T22 Chinese-English Semiconductor Parallel Text
LDC2012T23 Russian-English Computer Security Parallel Text
LDC2012T24 GALE Chinese-English Word Alignment and Tagging Training Part 3 - Web
LDC2012V01 2005 NIST/USF Evaluation Resources for the VACE Program - Broadcast News

2011

LDC0211S01 2005 NIST Speaker Recognition Evaluation Training Data
LDC0211S02 2006 NIST Spoken Term Detection Development Set
LDC2011S03 2006 NIST Spoken Term Detection Evaluation Set
LDC2011S04 2005 NIST Speaker Recognition Evaluation Test Data
LDC2011S05 2008 NIST Speaker Recognition Evaluation Training Set Part 1
LDC2011S06 2005 Spring NIST Rich Transcription (RT-05S) Evaluation Set
LDC2011S07 2008 NIST Speaker Recognition Evaluation Training Set Part 2
LDC2011S08 2008 NIST Speaker Recognition Evaluation Test Set
LDC2011S09 2006 NIST Speaker Recognition Evaluation Training Set
LDC2011S10 2006 NIST Speaker Recognition Evaluation Test Set Part 1
LDC2011S11 2008 NIST Speaker Recognition Evaluation Supplemental Set
LDC2011T01 SemEval-2010 Task 1 OntoNotes English: Coreference Resolution in Multiple Languages
LDC2011T02 ACE 2005 English SpatialML Annotations Version 2
LDC2011T04 Indian Language Part-of-Speech Tagset: Sanskrit
LDC2011T05 2008/2010 NIST Metrics for Machine Translation (MetricsMaTr) GALE Evaluation Set
LDC2011T06 Broadcast News Lattices
LDC2011T07 English Gigaword Fifth Edition
LDC2011T08 Datasets for Generic Relation Extraction (reACE)
LDC2011T09 Arabic Treebank: Part 2 v 3.1
LDC2011T10 French Gigaword Third Edition
LDC2011T11 Arabic Gigaword Fifth Edition
LDC2011T12 Spanish Gigaword Third Edition
LDC2011T13 Chinese Gigaword Fifth Edition
LDC2011V01 NIST/USF Evaluation Resources for the VACE Program - Meeting Data Training Set Part 1
LDC2011V02 NIST/USF Evaluation Resources for the VACE Program - Meeting Data Training Set Part 2
LDC2011V03 NIST/USF Evaluation Resources for the VACE Program - Meeting Data Test Set Part 1
LDC2011V04 Indian Language Part-of-Speech Tagset: Sanskrit
LDC2011V05 2006 NIST/USF Evaluation Resources for the VACE Program, Meeting Data Test Set Part 1
LDC2011V06 2006 NIST/USF Evaluation Resources for the VACE Program, Meeting Data Test Set Part 2

2006 - 2010

2010

LDC2010S01 Fisher Spanish Speech
LDC2010S02 WTIMIT 1.0
LDC2010S03 2003 NIST Speaker Recognition Evaluation
LDC2010S07 Asian Spoken Language Sampler
LDC2010T01 NIST Open Machine Translation 2008 Evaluation (MT08) Selected Reference and System Translations
LDC2010T02 Czech Broadcast News MDE Transcripts
LDC2010T03 GALE Phase 1 Chinese Newsgroup Parallel Text - Part 2
LDC2010T04 Fisher Spanish - Transcripts
LDC2010T05 NPS Internet Chatroom Conversations, Release 1.0
LDC2010T07 Chinese Treebank 7.0
LDC2010T08 Arabic Treebank: Part 3 v 3.2
LDC2010T09 ACE 2005 Mandarin SpatialML Annotations
LDC2010T10 NIST 2002 Open Machine Translation (OpenMT) Evaluation
LDC2010T11 NIST 2003 Open Machine Translation (OpenMT) Evaluation
LDC2010T12 NIST 2004 Open Machine Translation (OpenMT) Evaluation
LDC2010T13 Arabic Treebank: Part 1 v 4.1
LDC2010T14 NIST 2005 Open Machine Translation (OpenMT) Evaluation
LDC2010T15 Message Understanding Conference 7 Timed (MUC7_T)
LDC2010T17 NIST 2006 Open Machine Translation (OpenMT) Evaluation
LDC2010T18 ACE Time Normalization (TERN) 2004 English Evaluation Data V1.0
LDC2010T19 Korean Newswire Second Edition
LDC2010T21 NIST 2008 Open Machine Translation (OpenMT) Evaluation
LDC2010T22 Manually Annotated Sub-Corpus First Release
LDC2010T23 NIST 2009 Open Machine Translation (OpenMT) Evaluation
LDC2010V01 TRECVID 2004 Keyframes & Transcripts
LDC2010V02 TRECVID 2006 Keyframes

2009

LDC2009E58 TAC 2009 KBP Evaluation Reference Knowledge Base
LDC2009L01 An English Dictionary of the Tamil Verb Second Edition
LDC2009S01 CSLU: Numbers Version 1.3
LDC2009S02 Czech Broadcast Conversation Speech
LDC2009S03 CSLU: S4X Release 1.2
LDC2009T01 English CTS Treebank with Structural Metadata
LDC2009T02 GALE Phase 1 Chinese Broadcast Conversation Parallel Text - Part 1
LDC2009T03 GALE Phase 1 Arabic Newsgroup Parallel Text - Part 1
LDC2009T04 2007 NIST Language Recognition Evaluation Test Set
LDC2009T05 2007 NIST Language Recognition Evaluation Supplemental Training Set
LDC2009T06 GALE Phase 1 Chinese Broadcast Conversation Parallel Text - Part 2
LDC2009T07 Unified Linguistic Annotation Text Collection
LDC2009T08 Japanese Web N-gram Version 1
LDC2009T09 GALE Phase 1 Arabic Newsgroup Parallel Text - Part 2
LDC2009T10 Language Understanding Annotation Corpus
LDC2009T11 REFLEX Entity Translation Training/DevTest
LDC2009T12 2008 CoNLL Shared Task Data
LDC2009T13 English Gigaword Fourth Edition
LDC2009T14 Tagged Chinese Gigaword Version 2.0
LDC2009T15 GALE Phase 1 Chinese Newsgroup Parallel Text - Part 1
LDC2009T20 Czech Broadcast Conversation MDE Transcripts
LDC2009T21 Spanish Gigaword Second Edition
LDC2009T22 Arabic Newswire English Translation Collection
LDC2009T23 FactBank 1.0
LDC2009T24 OntoNotes Release 3.0
LDC2009T25 Web 1T 5-gram, 10 European Languages Version 1
LDC2009T26 NXT Switchboard Annotations
LDC2009T27 Chinese Gigaword Fourth Edition
LDC2009T28 French Gigaword Second Edition
LDC2009T29 ACL Anthology Reference Corpus
LDC2009T30 Arabic Gigaword Fourth Edition
LDC2009V01 Audiovisual Database of Spoken American English

2008

LDC2008L02 Hindi WordNet
LDC2008L03 Global Yoruba Lexical Database v. 1.0
LDC2008T02 GALE Phase 1 Arabic Blog Parallel Text
LDC2008T06 GALE Phase 1 Chinese Blog Parallel Text
LDC2008T07 Chinese Proposition Bank 2.0
LDC2008T08 GALE Phase 1 Chinese Broadcast News Parallel Text - Part 2
LDC2008T09 GALE Phase 1 Arabic Broadcast News Parallel Text - Part 2
LDC2008T13 BLLIP North American News Text, Complete
LDC2008T17 CALLHOME Mandarin Chinese Transcripts - XML Version
LDC2008T18 GALE Phase 1 Chinese Broadcast News Parallel Text - Part 3
LDC2008T20 PennBioIE CYP 1.0

2007

LDC2007E37 CoNLL 2007 Shared Task English Test Set, Part 1
LDC2007E38 CoNLL 2007 Shared Task Arabic Test Set, Part 1
LDC2007E39 CoNLL 2007 Shared Task Czech Test Set, Part 1
LDC2007E40 CoNLL 2007 Shared Task English Test Set, Part 2
LDC2007E41 CoNLL 2007 Shared Task Arabic Test Set, Part 2
LDC2007E42 CoNLL 2007 Shared Task Czech Test Set, Part 2
LDC2007T22 2001 Topic Annotated Enron Email Data Set
LDC2007T36 Chinese Treebank 6.0

2006

LDC2006S33 Middle East Technical University Turkish Microphone Speech v. 1.0
LDC2006S42 Korean Broadcast News Speech
LDC2006T03 Korean Propbank
LDC2006T06 ACE 2005 Multilingual Training Corpus
LDC2006T09 Korean Treebank Annotations Version 2.0
LDC2006T13 Web 1T 5-gram Version 1
LDC2006T14 Korean Broadcast News Transcripts

2001 - 2005

2005

LDC2005L01 Mawukakan Lexicon
LDC2005S07 Arabic CTS Levantine Fisher Training Data Set 3, Speech
LDC2005S08 BBN/AUB DARPA Babylon Levantine Arabic Speech and Transcripts
LDC2005S13 Fisher English Training Part 2, Speech
LDC2005S14 Levantine Arabic QT Training Data Set 4 (Speech + Transcripts)
LDC2005S15 HKUST Mandarin Telephone Speech, Part 1
LDC2005S22 Articulation Index
LDC2005S25 Santa Barbara Corpus of Spoken American English Part IV
LDC2005T01 Chinese Treebank 5.0
LDC2005T02 Arabic Treebank: Part 1 v 3.0 (POS with full vocalization + syntactic analysis)
LDC2005T03 Arabic CTS Levantine Fisher Training Data Set 3, Transcripts
LDC2005T05 Multiple-Translation Arabic (MTA) Part 2
LDC2005T06 Chinese News Translation Text Part 1
LDC2005T07 ACE Time Normalization (TERN) 2004 English Training Data v 1.0
LDC2005T08 Discourse Graphbank
LDC2005T09 ACE 2004 Multilingual Training Corpus
LDC2005T10 Chinese English News Magazine Parallel Text
LDC2005T12 English Gigaword Second Edition
LDC2005T13 CCGbank
LDC2005T14 Chinese Gigaword Second Edition
LDC2005T19 Fisher English Training Part 2, Transcripts
LDC2005T20 Arabic Treebank: Part 3 (full corpus) v 2.0 (MPG + Syntactic Analysis)
LDC2005T23 Chinese Proposition Bank 1.0
LDC2005T24 RT-04 MDE Training Data Text/Annotations
LDC2005T28 HARD 2004 Text
LDC2005T29 HARD 2004 Topics and Annotations
LDC2005T30 Arabic Treebank: Part 4 v 1.0 (MPG Annotation)
LDC2005T32 HKUST Mandarin Telephone Transcript Data, Part 1
LDC2005T33 BBN Pronoun Coreference and Entity Type Corpus
LDC2005T35 American National Corpus (ANC) Second Release

2004

LDC2004L01 Klex: Finite-State Lexical Transducer for Korean
LDC2004S01 Czech Broadcast News Speech
LDC2004S02 ICSI Meeting Speech
LDC2004S04 2002 NIST Speaker Recognition Evaluation
LDC2004S05 ISL Meeting Speech Part 1
LDC2004S07 Switchboard Cellular Part 2 Audio
LDC2004S09 NIST Meeting Pilot Corpus Speech
LDC2004S10 Santa Barbara Corpus of Spoken American English Part III
LDC2004S11 2002 Rich Transcription Broadcast News and Conversational Telephone Speech
LDC2004T01 Czech Broadcast News Transcripts
LDC2004T02 Arabic Treebank: Part 2 v 2.0
LDC2004T03 Morphologically Annotated Korean Text
LDC2004T04 ICSI Meeting Transcripts
LDC2004T05 Chinese Treebank 4.0
LDC2004T07 Multiple-Translation Chinese (MTC) Part 3
LDC2004T09 TIDES Extraction (ACE) 2003 Multilingual Training Data
LDC2004T10 ISL Meeting Transcripts Part 1
LDC2004T11 Arabic Treebank: Part 3 v 1.0
LDC2004T13 NIST Meeting Pilot Corpus Transcripts and Metadata
LDC2004T14 Proposition Bank I
LDC2004T15 2000 Communicator Dialogue Act Tagged
LDC2004T16 2001 Communicator Dialogue Act Tagged
LDC2004T17 Arabic News Translation Text Part 1
LDC2004T18 Arabic English Parallel News Part 1
LDC2004T19 Fisher English Training Speech Part 1 Transcripts
LDC2004T23 Prague Arabic Dependency Treebank 1.0
LDC2004V01 FORM1 Kinematic Gesture

2003

LDC2003S01 2001 Communicator Evaluation
LDC2003S03 Korean Telephone Conversations Speech
LDC2003S06 Santa Barbara Corpus of Spoken American English Part II
LDC2003T08 Korean Telephone Conversations Transcripts
LDC2003T11 ACE-2 Version 1.0

2002

LDC2002L49 Buckwalter Arabic Morphological Analyzer Version 1.0
LDC2002S06 Switchboard-2 Phase III Audio
LDC2002S13 2001 HUB5 English Evaluation
LDC2002S56 2000 Communicator Evaluation

2001

(2001 corpora not purchased)

1993 - 2000

2000

LDC2000S85 Santa Barbara Corpus of Spoken American English Part I
LDC2000T45 Korean Newswire

1999

LDC99S79 Switchboard-2 Phase II

1998

LDC98S70 HUB5 Spanish Telephone Speech Corpus
LDC98S71 1997 English Broadcast News Speech (HUB4)
LDC98S73 1997 Mandarin Broadcast News Speech (HUB4-NE)
LDC98S74 1997 Spanish Broadcast News Speech (HUB4-NE)
LDC98S75 Switchboard-2 Phase I
LDC98T24 1997 Mandarin Broadcast News Transcripts (HUB4-NE)
LDC98T27 HUB5 Spanish Transcripts
LDC98T29 1997 Spanish Broadcast News Transcripts (HUB4-NE)

1997

LDC97S62 Switchboard-1 Release 2

1996

LDC96L17 CALLHOME Spanish Transcripts
LDC96L14 CELEX2
LDC96S36 Boston University Radio Speech
LDC96S37 CALLHOME Japanese Speech
LDC96S53 CALLFRIEND Japanese
LDC96T18 CALLHOME Japanese Transcripts

1995

LDC95S26 ATIS3 Test Data
LDC95T7 Treebank-2
LDC95T20 Hansard French/English
LDC95T42 Treebank-3

1994

LDC94S19 ATIS3 Training Data

1993

LDC93S1               TIMIT Acoustic-Phonetic Continuous Speech Corpus
LDC1993S3A          Resource Management 2.0 Complete