ETS Corpus of Non-Native Written English

Item Name: ETS Corpus of Non-Native Written English
Author(s): Daniel Blanchard, Joel Tetreault, Derrick Higgins, Aoife Cahill, Martin Chodorow
LDC Catalog No.: LDC2014T06
ISBN: 1-58563-675-4
ISLRN: 640-546-772-297-1
DOI: https://doi.org/10.35111/7ez0-x912
Release Date: June 16, 2014
Member Year(s): 2014
DCMI Type(s): Text
Data Source(s): essays
Application(s): language identification
Language(s): English
Language ID(s): eng
License(s): ETS Corpus of Non-Native Written English
Online Documentation: LDC2014T06 Documents
Licensing Instructions: Subscription & Standard Members, and Non-Members
Citation: Blanchard, Daniel, et al. ETS Corpus of Non-Native Written English LDC2014T06. Web Download. Philadelphia: Linguistic Data Consortium, 2014.

Introduction

ETS Corpus of Non-Native Written English was developed by Educational Testing Service and is comprised of 12,100 English essays written by speakers of 11 non-English native languages as part of an international test of academic English proficiency, TOEFL (Test of English as a Foreign Language). The test includes reading, writing, listening, and speaking sections and is delivered by computer in a secure test center. This release contains 1,100 essays for each of the 11 native languages sampled from eight topics with information about the score level (low/medium/high) for each essay.

The corpus was developed with the specific task of native language identification in mind, but is likely to support tasks and studies in the educational domain, including grammatical error detection and correction and automatic essay scoring, in addition to a broad range of research studies in the fields of natural language processing and corpus linguistics. For the task of native language identification, the following division is recommended: 82% as training data, 9% as development data and 9% as test data, split according to the file IDs accompanying the data set.

Data

The data is sampled from essays written in 2006 and 2007 by test takers whose native languages were Arabic, Chinese, French, German, Hindi, Italian, Japanese, Korean, Spanish, Telugu, and Turkish. The essays are presented in both original raw and tokenized forms and presented in UTF-8 formatted text files. Also included are the prompts (topics) for the essays and metadata about the test takers' proficiency level.

Samples

Please view this original and tokenized samples.

Updates

In July 2014, 1,100 files were added to the corpus, bringing the total number of tokenized and original files to 12,100. All copies distributed after that date contain the full data set.

Available Media

View Fees





Login for the applicable fee