|
文摘
|
最大熵模型以其能够较好地包容各种约束信息及与自然语言模型相适应等优点在词性标注研究中取得了良好的效果。因此，将其作为基本框架，提出了一种融合语言特征的最大熵蒙古文词性标注模型。首先，根据蒙古文构词特点及统计分析结果，定义并选取特征模板，利用训练语料提取了大量的候选特征集合，针对错误或者无效的特征通过设置一些规则筛选特征。然后，训练最大熵概率模型参数。实验结果表明，融合蒙古文形态特征的最大熵模型可以较好地标注蒙古文。 |
|
其他语种文摘
|
Part of speech tagging is one of the basic research for natural language processing fields, which plays an important role on the syntactic analysis, semantic analysis and machine translation, etc. Maximum entropy model is an outstanding statistical model for its good integration of various constraints and it has been favored in the part of speech tagging research. An approach combining linguistic morphological features for Mongolian part of speech tagging based on maximum entropy model is proposed in this paper. Mongolian has great and long history. Nonetheless, there is less research about Mongolian language processing. Mongolian is a typical agglutinative language that is characterized by rich morphology, with a high level of ambiguity. Firstly, based on the analysis of Mongolian scripts, the context feature and internal feature templates are defined and extracted from the training corpus. Then, various morphological features of words are integrated in the maximum entropy model and the IIS algorithm is employed to calculate the parameters of maximum entropy model. Experimental results on the close and open testing set prepared for Mongolian POS tagging task show that the integration of morphological features of the maximum entropy model outperforms the HMM model and can be fitful for Mongolian scripts. |
|
来源
|
计算机研究与发展
,2011,48(12):2385-2390 【核心库】
|
|
关键词
|
形态特征
;
最大熵模型
;
蒙古文
;
词性标注
;
参数估计
|
|
地址
|
1.
合肥学院计算机科学与技术系, 安徽省网络与智能信息处理重点实验室, 合肥, 230601
2.
内蒙古大学蒙古学学院, 呼和浩特, 010021
3.
中国科学院合肥物质科学研究院, 合肥, 230001
|
|
语种
|
中文 |
|
文献类型
|
研究性论文 |
|
ISSN
|
1000-1239 |
|
学科
|
自动化技术、计算机技术 |
|
基金
|
国家自然科学基金项目
;
国家教育部人文社会科学研究项目
|
|
文献收藏号
|
CSCD:4408067
|
了解气象卫星更多信息，请访问