European Language Newspaper Text

Item Name: European Language Newspaper Text
Authors: David Graff
LDC Catalog No.: LDC95T11
ISBN: 1-58563-047-0
Data Type: text
Data Source(s): newswire
Project(s): GALE, TIDES
Application(s): information retrieval, language modeling
Language(s): French, German, Portuguese
Language ID(s): DEU, FRA, POR
Distribution: 1 CD
Member fee: $0 for 1995, 1996 members
Non-member Fee: N/A (Members Only)
Reduced-License Fee: N/A
Extra-Copy Fee: US $150.00
Member License: yes
Readme File: yes
Online documentation: yes
Licensing Instructions: Subscription & Standard Members, and Non-Members
Citation: David Graff
European Language Newspaper Text
Linguistic Data Consortium, Philadelphia

The European Language Newspaper Text corpus is also know as the French Language News Corpus. This corpus includes roughly 100 million words of French, 90 million words of German and 15 million words of Portuguese and has been marked using SGML. The text is taken from the following sources:

  1. Approximately 60 million words of text in French and German have been made available from the Associated Press (AP) World Stream. AP World Stream is a compilation of AP news reports produced in 86 bureaus in 68 countries.

    The Associated Press Worldstream newswire service provides articles in six languages, interleaved on a single data stream. The data is collected via an Associated Press installed telephone line at the LDC.

  2. Approximately 110 million words of text in French, German and Portuguese have been made available from Agence France Presse. Each language was supplied in separate data streams collected via a Dateno MKII satellite receiver and associated equipment at the LDC.
  3. Approximately 20 million words of text in German have been made available from Deutsche Presse Agentur. The text is collected via an AP Datafeatures telephone line installed at the Linguistic Data Consortium.
  4. A smaller part of the corpus comes from Le Monde newspaper. The Le Monde data covers about 5.6 million words of French. It is quite distinct from the AP and AFP materials in its markup approach, because it has been prepared in compliance with the conventions of the Text Encoding Initiative (TEI), rather than having been based on the model of the TIPSTER collections, which were originally developed prior to the establishment of the TEI conventions.


The Reduced Licensing Fee for this corpus is US$150.

Content Copyright