Title | Predicting Chinese abbreviations from definitions: An empirical learning approach using support vector regression |
Authors | Sun, Xu Wang, Hou-Feng Wang, Bo |
Affiliation | Peking Univ, Sch Elect Engn & Comp Sci, Inst Computat Linguist, Beijing 100871, Peoples R China. Univ Tokyo, Dept Comp Sci, Grad Sch Informat Sci & Technol, Tokyo 1130033, Japan. |
Keywords | statistical natural language processing abbreviation prediction support vector regression word clustering DICTIONARY |
Issue Date | 2008 |
Publisher | 计算机科学技术学报英文版 |
Citation | JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY.2008,23,(4),602-611. |
Abstract | In Chinese, phrases and named entities play a central role in information retrieval. Abbreviations, however, make keyword-based approaches less effective. This paper presents an empirical learning approach to Chinese abbreviation prediction. In this study, each abbreviation is taken as a reduced form of the corresponding definition (expanded form), and the abbreviation prediction is formalized as a scoring and ranking problem among abbreviation candidates, which are automatically generated from the corresponding definition. By employing Support Vector Regression (SVR) for scoring, we can obtain multiple abbreviation candidates together with their SVR values, which are used for candidate ranking. Experimental results show that the SVR method performs better than the popular heuristic rule of abbreviation prediction. In addition, in abbreviation prediction, the SVR method outperforms the hidden Markov model (HMM). |
URI | http://hdl.handle.net/20.500.11897/292073 |
ISSN | 1000-9000 |
DOI | 10.1007/s11390-008-9156-5 |
Indexed | SCI(E) EI 中国科技核心期刊(ISTIC) 中国科学引文数据库(CSCD) |
Appears in Collections: | 信息科学技术学院 计算语言学教育部重点实验室 |