Arabic CTS Levantine Fisher Training Data Set 3, Transcripts
|Item Name:||Arabic CTS Levantine Fisher Training Data Set 3, Transcripts|
|Author(s):||Mohamed Maamouri, Tim Buckwalter, Hubert Jin|
|LDC Catalog No.:||LDC2005T03|
|Release Date:||January 15, 2005|
|Language(s):||North Levantine Arabic, South Levantine Arabic|
|Language ID(s):||apc, ajp|
LDC User Agreement for Non-Members
|Online Documentation:||LDC2005T03 Documents|
|Licensing Instructions:||Subscription & Standard Members, and Non-Members|
|Citation:||Maamouri, Mohamed, Tim Buckwalter, and Hubert Jin. Arabic CTS Levantine Fisher Training Data Set 3, Transcripts LDC2005T03. Web Download. Philadelphia: Linguistic Data Consortium, 2005.|
Arabic CTS Levantine Fisher Training Data Set 3, Transcripts was developed by the Linguistic Data Consortium and contains transcripts for approximately 50 hours of Levantine Arabic speech.
The corresponding speech files for these transcripts are available in Arabic CTS Levantine Fisher Training Data Set 3, Speech (LDC2005S07).
The Fisher telephone conversation collection protocol was created at LDC to address a critical need of developers trying to build robust automatic speech recognition (ASR) systems. Previous collection protocols, such as CALLFRIEND and Switchboard-II and the resulting corpora, have been adapted for ASR research but were in fact developed for language and speaker identification respectively. Although the CALLHOME protocol and corpora were developed to support ASR technology, they feature small numbers of speakers making telephone calls of relatively long duration with narrow vocabulary across the collection. CALLHOME conversations are challengingly natural and intimate. Under the Fisher protocol, a very large number of participants each make a few calls of short duration speaking to other participants, whom they typically do not know, about assigned topics. This maximizes inter-speaker variation and vocabulary breadth although it also increases formality.
Previous protocols such as CALLHOME, CALLFRIEND, and Switchboard relied upon participant activity to drive the collection. Fisher is unique in being platform driven rather than participant driven. Participants who wish to initiate a call may do so; however, the collection platform initiates the majority of calls. Participants need only answer their phones at the times they specified when registering for the study.
To encourage a broad range of vocabulary, Fisher participants are asked to speak on an assigned topic which is selected at random from a list, which changes every 24 hours and which is assigned to all subjects paired on that day. Some topics are inherited or refined from previous Switchboard studies while others were developed specifically for the Fisher protocol.
This corpus contains Arabic transcripts for 322 telephone conversations in UTF-8 format and associated documentation including a word list with frequency of occurences. The list shows all the occurences of words in their pronunciation spellings mapped to their corresponding canonical forms, as well as their raw frequency (the amount of times they appear in the corpus) and source document frequency (the number of documents in which they appear in the corpus).
Here are the other corpora that comprise the totality of Arabic training data:
- Arabic CTS Levantine Fisher Training Data Set 3, Speech (LDC2005S07)
- Levantine Arabic QT Training Data Set 4 (Speech + Transcripts) (LDC2005S14)
- Levantine Arabic QT Training Data Set 5, Speech (LDC2006S29)
- Levantine Arabic QT Training Data Set 5, Transcripts (LDC2006T07)
For an example of the data in this corpus, please view this sample (TXT).
None at this time.