JAIST Repository >
a. 知識科学研究科・知識科学系 >
a10. 学術雑誌論文等 >
a10-1. 雑誌掲載論文 >
このアイテムの引用には次の識別子を使用してください:
http://hdl.handle.net/10119/9212
|
タイトル: | Improving effectiveness of mutual information for substantival multiword expression extraction |
著者: | Zhang, Wen Yoshida, Taketoshi Tang, Xijin Ho, Tu Bao |
キーワード: | Substantival multiword expression Mutual information Enhanced mutual information Collocation optimization EMICO |
発行日: | 2009-02-20 |
出版者: | Elsevier |
誌名: | Expert Systems with Applications |
巻: | 36 |
号: | 8 |
開始ページ: | 10919 |
終了ページ: | 10930 |
DOI: | 10.1016/j.eswa.2009.02.026 |
抄録: | One of the deficiencies of mutual information is its poor capacity to measure association of words with unsymmetrical co-occurrence, which has large amounts for multi-word expression in texts. Moreover, threshold setting, which is decisive for success of practical implementation of mutual information for multi-word extraction, brings about many parameters to be predefined manually in the process of extracting multiword expressions with different number of individual words. In this paper, we propose a new method as EMICO (Enhanced Mutual Information and Collocation Optimization) to extract substantival multiword expression from text. Specifically, enhanced mutual information is proposed to measure the association of words and collocation optimization is proposed to automatically determine the number of individual words contained in a multiword expression when the multiword expression occurs in a candidate set. Our experiments showed that EMICO significantly improves the performance of substantival multiword expression extraction in comparison with a classic extraction method based on mutual information. |
Rights: | NOTICE: This is the author's version of a work accepted for publication by Elsevier. Wen Zhang, Taketoshi Yoshida, Xijin Tang, and Tu-Bao Ho, Expert Systems with Applications, 36(8), 2009, 10919-10930, http://dx.doi.org/10.1016/j.eswa.2009.02.026 |
URI: | http://hdl.handle.net/10119/9212 |
資料タイプ: | author |
出現コレクション: | a10-1. 雑誌掲載論文 (Journal Articles)
|
このアイテムのファイル:
ファイル |
記述 |
サイズ | 形式 |
13876.pdf | | 545Kb | Adobe PDF | 見る/開く |
|
当システムに保管されているアイテムはすべて著作権により保護されています。
|