Morphologically Annotated Korean Text September 17, 2003 Na-Rae Han University of Pennsylvania nrh@babel.ling.upenn.edu Contributors: Seung-yun Yang (syyang@unagi.cis.upenn.edu) Mike Maxwell (maxwell@ldc.upenn.edu) ** Note: this document is in ksc-5601 encoding. Characters in Hangul (Korean alphabet) can be displayed with Korean xterminals such as hanterm, or by selecting Korean encoding in common web browsers such as Netscape or Internet Explorer. The file readme.html contains the same information, but using Unicode character entities for Hangul characters. ----------------------------------------------------------------------- - Morphologically analyzed and part-of-speech annotated Korean corpus - Encoded in ksc-5601 character set - Size of corpus 1,574 sentences 41,024 words (with tokenized symbols) 77,173 morphemes - Data format: one head word per line, word and its morphologically analyzed output are separated by a tab. Within analysis, each morpheme is followed by "/" and its part-of-speech; morphemes are separated by "+". i.e., 유엔/NPR+은/PAU. ^EOS is a special symbol denoting the end of a sentence. - The morphologically tagged output is compatible with Klex, the Finite-State Transducer Lexicon of Korean (LDC2004L01). - The morphologically tagged output conforms to the Korean Treebank POS annotation standards, as found in ftp://ftp.cis.upenn.edu/pub/ircs/tr/01-09/. - The original text of the corpus is a part of the Korean Newswire corpus (LDC2000T45). The newswire corpus is a collection of Korean Press Agency news articles from June 2, 1994, to March 20, 2000. The portion included in this release consists of a small number of hand-picked articles. - The corpus is a part of the Korean Treebank Phase 2. Between 2001 and 2002 the project was conducted under subcontract from Cogentex Inc, sponsor number Cogentex 5-33436. The original text was tokenized using a tokenization script, which was then automatically analyzed using Klex. Since there can be multiple possible morphological analyses, the output was fed through a statistical ranking system in order to select the best possible analysis for the word in the text environment. The part-of-speech tagged result was then manually corrected by Seung-yun Yang and Na-Rae Han, graduate students in the University of Pennsylvania Linguistics Department. - The corpus uses a Part-of-Speech tag set which is based on the one employed by the Korean Treebank Project with slight modification. The POS tagging guidelines for the Korean Treebank can be found at: ftp://ftp.cis.upenn.edu/pub/ircs/tr/01-09/. Noun NNC common noun 학교/NNC 학생/NNC NNU numeric noun 1/NNU 하나/NNU 한/NNU NNX dependent noun 것/NNX 마리/NNX NPN pronoun 나/NPN 너/NPN 우리/NPN 그녀/NPN NPR proper noun 김대중/NPR 한국/NPR 클린턴/NPR NFW foreign word Clinton/NFW UN/NFW Post- PCA case postposition 이/PCA 을/PCA position PAD adverbial 으로/PAD 에서/PAD PAN* adnominal 의/PAN 이라는/PAN PAU auxiliary 은/PAU 도/PAU 마저/PAU PCJ conjunctive 과/PCJ Predicate VV verb 먹/VV+다/EFN 가/VV+다/EFN VJ adjective 예쁘/VJ+다/EFN 작/VJ+다/EFN VX auxiliary predicate 않/VX+다/EFN 말/VX+다/EFN Verbal EPF pre-final ending 먹/VV+으시/EFN+었/EPF+다/EFN ending EFN final ending 먹/VV+었/EFN+다/EFN 먹/VV+냐/EFN ECS** non-final ending 먹/VV+고/ECS 먹/VV+어서/ECS EAN adnominal ending 먹/VV+는/EAN 먹/VV+던/EAN ENM nominalization ending 먹/VV+음/ENM 먹/VV+기/ENM Etc CO copula 학생/NNC+이/CO+다/EFN ADV adverb 빨리/ADV 또/ADV ADC conjunctive adverb 그러나/ADC 그리고/ADC DAN adnominal modifier 이런/DAN 그/DAN 모든/DAN XSF suffix 영희/NPR+씨/XSF 우리/NPN+들/XSF XPF prefix 제/XPF+5/NNU+분대/NNC XSV verbalization suffix 공부/NNC+하/XSV+다/EFN XSJ adjectivization suffix 침착/NNC+하/XSJ+다/EFN IJ interjection 아/IJ 예/IJ 그래/IJ Symbol SFN sentence-final symbols . ? !! ...... SCM comma , SLQ left delimiters: " ' ( < [ { SRQ right delimiters: " ' ) > ] } SSY symbol * not included in Korean Trebank phase 1 ** ECS and EAU in Korean Treebank phase 1