Mandarin Chinese Phonetic Segmentation and Tone

Item Name: Mandarin Chinese Phonetic Segmentation and Tone
Author(s): Jiahong Yuan, Neville Ryant, Mark Liberman
LDC Catalog No.: LDC2015S05
ISBN: 1-58563-710-6
ISLRN: 567-512-470-543-8
DOI: https://doi.org/10.35111/djnc-2014
Release Date: April 20, 2015
Member Year(s): 2015
DCMI Type(s): Sound, Text
Data Source(s): broadcast news
Project(s): Hub4
Application(s): speech recognition, phonetics, prosody, pronunciation modeling, phonology
Language(s): Mandarin Chinese
Language ID(s): cmn
License(s): Mandarin Chinese Phonetic Segmentation and Tone User Agreement
Online Documentation: LDC2015S05 Documents
Licensing Instructions: Subscription & Standard Members, and Non-Members
Citation: Yuan, Jiahong, Neville Ryant, and Mark Liberman. Mandarin Chinese Phonetic Segmentation and Tone LDC2015S05. Web Download. Philadelphia: Linguistic Data Consortium, 2015.
Related Works: View

Introduction

Mandarin Chinese Phonetic Segmentation and Tone was developed by the Linguistic Data Consortium (LDC) and contains 7,849 Mandarin Chinese "utterances" and their phonetic segmentation and tone labels separated into training and test sets. The utterances were derived from 1997 Mandarin Broadcast News Speech and Transcripts (HUB4-NE) (LDC98S73 and LDC98T24, respectively). That collection consists of approximately 30 hours of Chinese broadcast news recordings from Voice of America, China Central TV and KAZN-AM, a commercial radio station based in Los Angeles, CA.

The ability to use large speech corpora for research in phonetics, sociolinguistics and psychology, among other fields, depends on the availability of phonetic segmentation and transcriptions. This corpus was developed to investigate the use of phone boundary models on forced alignment in Mandarin Chinese. Using the approach of embedded tone modeling (also used for incorporating tones for automatic speech recognition), the performance on forced alignment between tone-dependent and tone-independent models was compared.

Data

Utterances were considered as the time-stamped between-pause units in the transcribed news recordings. Those with background noise, music, unidentified speakers and accented speakers were excluded. A test set was developed with 300 utterances randomly selected from six speakers (50 utterances for each speaker). The remaining 7,549 utterances formed a training set.

The utterances in the test set were manually labeled and segmented into initials and finals in Pinyin, a Roman alphabet system for transcribing Chinese characters. Tones were marked on the finals, including Tone1 through Tone4, and Tone0 for the neutral tone. The Sandhi Tone3 was labeled as Tone2. The training set was automatically segmented and transcribed using the LDC forced aligner, which is a Hidden Markov Model (HMM) aligner trained on the same utterances (Yuan et al. 2014). The aligner achieved 93.1% agreement (of phone boundaries) within 20 ms on the test set compared to manual segmentation. The quality of the phonetic transcription and tone labels of the training set was evaluated by checking 100 utterances randomly selected from it. The 100 utterances contained 1,252 syllables: 15 syllables had mistaken tone transcriptions; two syllables showed mistaken transcriptions of the final, and there were no syllables with transcription errors on the initial.

Each utterance has three associated files: a flac compressed wav file, a word transcript file, and a phonetic boundaries and label file.

Samples

Please view this audio sample, transcript sample and phonetic labels sample.

Acknowledgement

This work was supported in part by National Science Foundation Grant No. IIS-0964556.

Updates

None at this time

Additional Licensing Instructions

This 'members-only' corpora is available to current members who can request the data at the listed reduced-license fee. Contact ldc@ldc.upenn.edu for information about becoming a member.

Available Media

View Fees





Login for the applicable fee