ETS Corpus of Non-Native Written English
| Item Name: | ETS Corpus of Non-Native Written English |
| Author(s): | Daniel Blanchard, Joel Tetreault, Derrick Higgins, Aoife Cahill, Martin Chodorow |
| LDC Catalog No.: | LDC2014T06 |
| ISBN: | 1-58563-675-4 |
| ISLRN: | 640-546-772-297-1 |
| DOI: | https://doi.org/10.35111/7ez0-x912 |
| Release Date: | June 16, 2014 |
| Member Year(s): | 2014 |
| DCMI Type(s): | Text |
| Data Source(s): | essays |
| Application(s): | language identification |
| Language(s): | English |
| Language ID(s): | eng |
| License(s): |
ETS Corpus of Non-Native Written English |
| Online Documentation: | LDC2014T06 Documents |
| Licensing Instructions: | Subscription & Standard Members, and Non-Members |
| Citation: | Blanchard, Daniel, et al. ETS Corpus of Non-Native Written English LDC2014T06. Web Download. Philadelphia: Linguistic Data Consortium, 2014. |
| Related Works: | View |
Introduction
ETS Corpus of Non-Native Written English was developed by Educational Testing Service and is comprised of 12,100 English essays written by speakers of 11 non-English native languages as part of an international test of academic English proficiency, TOEFL (Test of English as a Foreign Language). The test includes reading, writing, listening, and speaking sections and is delivered by computer in a secure test center. This release contains 1,100 essays for each of the 11 native languages sampled from eight topics with information about the score level (low/medium/high) for each essay.
The corpus was developed with the specific task of native language identification in mind, but is likely to support tasks and studies in the educational domain, including grammatical error detection and correction and automatic essay scoring, in addition to a broad range of research studies in the fields of natural language processing and corpus linguistics. For the task of native language identification, the following division is recommended: 82% as training data, 9% as development data and 9% as test data, split according to the file IDs accompanying the data set.
Data
The data is sampled from essays written in 2006 and 2007 by test takers whose native languages were Arabic, Chinese, French, German, Hindi, Italian, Japanese, Korean, Spanish, Telugu, and Turkish. The essays are presented in both original raw and tokenized forms and presented in UTF-8 formatted text files. Also included are the prompts (topics) for the essays and metadata about the test takers' proficiency level.
Samples
Please view this original and tokenized samples.
Updates
In July 2014, 1,100 files were added to the corpus, bringing the total number of tokenized and original files to 12,100. All copies distributed after that date contain the full data set.