Mandarin Chinese Phonetic Segmentation and Tone
| Item Name: | Mandarin Chinese Phonetic Segmentation and Tone |
| Author(s): | Jiahong Yuan, Neville Ryant, Mark Liberman |
| LDC Catalog No.: | LDC2015S05 |
| ISBN: | 1-58563-710-6 |
| ISLRN: | 567-512-470-543-8 |
| DOI: | https://doi.org/10.35111/djnc-2014 |
| Release Date: | April 20, 2015 |
| Member Year(s): | 2015 |
| DCMI Type(s): | Sound, Text |
| Data Source(s): | broadcast news |
| Project(s): | Hub4 |
| Application(s): | speech recognition, phonetics, prosody, pronunciation modeling, phonology |
| Language(s): | Mandarin Chinese |
| Language ID(s): | cmn |
| License(s): |
Mandarin Chinese Phonetic Segmentation and Tone User Agreement |
| Online Documentation: | LDC2015S05 Documents |
| Licensing Instructions: | Subscription & Standard Members, and Non-Members |
| Citation: | Yuan, Jiahong, Neville Ryant, and Mark Liberman. Mandarin Chinese Phonetic Segmentation and Tone LDC2015S05. Web Download. Philadelphia: Linguistic Data Consortium, 2015. |
| Related Works: | View |
Introduction
Mandarin Chinese Phonetic Segmentation and Tone was developed by the Linguistic Data Consortium (LDC) and contains 7,849 Mandarin Chinese "utterances" and their phonetic segmentation and tone labels separated into training and test sets. The utterances were derived from 1997 Mandarin Broadcast News Speech and Transcripts (HUB4-NE) (LDC98S73 and LDC98T24, respectively). That collection consists of approximately 30 hours of Chinese broadcast news recordings from Voice of America, China Central TV and KAZN-AM, a commercial radio station based in Los Angeles, CA.
The ability to use large speech corpora for research in phonetics, sociolinguistics and psychology, among other fields, depends on the availability of phonetic segmentation and transcriptions. This corpus was developed to investigate the use of phone boundary models on forced alignment in Mandarin Chinese. Using the approach of embedded tone modeling (also used for incorporating tones for automatic speech recognition), the performance on forced alignment between tone-dependent and tone-independent models was compared.
Data
Utterances were considered as the time-stamped between-pause units in the transcribed news recordings. Those with background noise, music, unidentified speakers and accented speakers were excluded. A test set was developed with 300 utterances randomly selected from six speakers (50 utterances for each speaker). The remaining 7,549 utterances formed a training set.
The utterances in the test set were manually labeled and segmented into initials and finals in Pinyin, a Roman alphabet system for transcribing Chinese characters. Tones were marked on the finals, including Tone1 through Tone4, and Tone0 for the neutral tone. The Sandhi Tone3 was labeled as Tone2. The training set was automatically segmented and transcribed using the LDC forced aligner, which is a Hidden Markov Model (HMM) aligner trained on the same utterances (Yuan et al. 2014). The aligner achieved 93.1% agreement (of phone boundaries) within 20 ms on the test set compared to manual segmentation. The quality of the phonetic transcription and tone labels of the training set was evaluated by checking 100 utterances randomly selected from it. The 100 utterances contained 1,252 syllables: 15 syllables had mistaken tone transcriptions; two syllables showed mistaken transcriptions of the final, and there were no syllables with transcription errors on the initial.
Each utterance has three associated files: a flac compressed wav file, a word transcript file, and a phonetic boundaries and label file.
Samples
Please view this audio sample, transcript sample and phonetic labels sample.
Acknowledgement
This work was supported in part by National Science Foundation Grant No. IIS-0964556.
Updates
None at this time
Additional Licensing Instructions
This 'members-only' corpora is available to current members who can request the data at the listed reduced-license fee. Contact ldc@ldc.upenn.edu for information about becoming a member.