European Language Newspaper Text
| Item Name: | European Language Newspaper Text |
| Author(s): | David Graff |
| LDC Catalog No.: | LDC95T11 |
| ISBN: | 1-58563-047-0 |
| ISLRN: | 082-576-700-069-2 |
| DOI: | https://doi.org/10.35111/1c1n-1906 |
| Member Year(s): | 1995, 1996 |
| DCMI Type(s): | Text |
| Data Source(s): | newswire |
| Project(s): | TIDES, GALE |
| Application(s): | language modeling, information retrieval |
| Language(s): | Portuguese, French, German |
| Language ID(s): | por, fra, deu |
| License(s): |
European Language News User Agreement |
| Online Documentation: | LDC95T11 Documents |
| Licensing Instructions: | Subscription & Standard Members, and Non-Members |
| Citation: | Graff, David. European Language Newspaper Text LDC95T11. Web Download. Philadelphia: Linguistic Data Consortium, 1995. |
| Related Works: | View |
The European Language Newspaper Text corpus is also know as the French Language News Corpus. This corpus includes roughly 100 million words of French, 90 million words of German and 15 million words of Portuguese and has been marked using SGML. The text is taken from the following sources:
- Approximately 60 million words of text in French and German have been made available from the Associated Press (AP) World Stream. AP World Stream is a compilation of AP news reports produced in 86 bureaus in 68 countries.
The Associated Press Worldstream newswire service provides articles in six languages, interleaved on a single data stream. The data is collected via an Associated Press installed telephone line at the LDC.
- Approximately 110 million words of text in French, German and Portuguese have been made available from Agence France Presse. Each language was supplied in separate data streams collected via a Dateno MKII satellite receiver and associated equipment at the LDC.
- Approximately 20 million words of text in German have been made available from Deutsche Presse Agentur. The text is collected via an AP Datafeatures telephone line installed at the Linguistic Data Consortium.
- A smaller part of the corpus comes from Le Monde newspaper. The Le Monde data covers about 5.6 million words of French. It is quite distinct from the AP and AFP materials in its markup approach, because it has been prepared in compliance with the conventions of the Text Encoding Initiative (TEI), rather than having been based on the model of the TIPSTER collections, which were originally developed prior to the establishment of the TEI conventions.