English Gigaword Second Edition

Item Name: English Gigaword Second Edition
Author(s): David Graff, Junbo Kong, Ke Chen, Kazuaki Maeda
LDC Catalog No.: LDC2005T12
ISBN: 1-58563-350-X
ISLRN: 274-788-133-216-1
Release Date: July 15, 2005
Member Year(s): 2005
DCMI Type(s): Text
Data Source(s): newswire
Project(s): TIDES, GALE, EARS
Application(s): natural language processing, language modeling, information retrieval
Language(s): English
Language ID(s): eng
License(s): LDC User Agreement for Non-Members
Online Documentation: LDC2005T12 Documents
Licensing Instructions: Subscription & Standard Members, and Non-Members
Citation: Graff, David, et al. English Gigaword Second Edition LDC2005T12. Web Download. Philadelphia: Linguistic Data Consortium, 2005.

Introduction

English Gigaword Second Edition was produced by Linguistic Data Consortium (LDC) catalog number LDC2005T12 and ISBN 1-58563-350-X. The English Gigaword corpus is a comprehensive archive of newswire text data in English that has been acquired over several years by the LDC. This is the second edition of the English Gigaword corpus.

This edition includes all of the contents in the first edition of the English Gigaword corpus (LDC2003T05) as well as new data from July 2002 through Dec 2004. Also, a new newswire source (the Central New Agency of Taiwan, English Service) has been added in this edition.

The five distinct international sources of English newswire included in this release are the following:

Agence France-Presse, English Service (afp_eng )
Associated Press Worldstream, English Service (apw_eng)
Central News Agency of Taiwan, English Service (cna_eng)
The New York Times Newswire Service (nyt_eng)
The Xinhua News Agency, English Service (xin_eng)

What's New In The Second Edition

  • New newswire data contents from July 2002 to December 2004 have been added for all of the four newswire sources that were represented in the first edition.
  • A new source, the Central News Agency of Taiwan English Service (CNA_ENG), has been added.
  • We have adopted a new naming scheme for filenames and DOC IDs. The new naming scheme represents the source names in a three-letter code and the language name in a three-letter code.
  • Minor formatting improvements (mostly line-wrapping) have been made to some of the data contents originally published in the first edition.

    Pricing

    The Reduced Licensing Fee for this corpus is US$400.

  • Available Media

    View Fees





    Login for the applicable fee