|
JAIST Repository >
a. 知識科学研究科・知識科学系 >
a10. 学術雑誌論文等 >
a10-1. 雑誌掲載論文 >
このアイテムの引用には次の識別子を使用してください:
http://hdl.handle.net/10119/12352
|
| タイトル: | Modeling the diversity and log-normality of data |
| 著者: | Than, Khoat
Ho, Tu Bao |
| キーワード: | machine learning
topic modeling
lognormal distribution |
| 発行日: | 2014 |
| 出版者: | IOS Press |
| 誌名: | Intelligent Data Analysis |
| 巻: | 18 |
| 号: | 6 |
| 開始ページ: | 1067 |
| 終了ページ: | 1088 |
| DOI: | 10.3233/IDA-140685 |
| 抄録: | We investigate two important properties of real data: diversity and log-normality. Log-normality accounts for the fact that data follow the lognormal distribution, whereas diversity measures variations of the attributes in the data. To our knowledge, these two inherent properties have not been paid much attention from the machine learning community, especially from the topic modeling community. In this article, we fill in this gap in the framework of topic modeling. We first investigate whether or not these two properties can be captured by the most well-known Latent Dirichlet Allocation model (LDA), and find that LDA behaves inconsistently with respect to diversity. Particularly, it favors data of low diversity, but works badly on data of high diversity. Then, we argue that these two inherent properties can be captured well by endowing the topic-word distributions in LDA with the lognormal distribution. This treatment leads to a new model, named Dirichlet-lognormal topic model (DLN). Using the lognormal distribution complicates the learning and inference of DLN, compared with those of LDA. Hence, we used variational method, in which model learning and inference are reduced to solving convex optimization problems. Extensive experiments strongly suggest that (1) the predictive power of DLN is consistent with respect to diversity, and that (2) DLN works consistently better than LDA for datasets whose diversity is large, and for datasets which contain many log-normally distributed attributes. Justifications for these results require insights into the used statistical distributions and will be discussed in the article. |
| Rights: | Reprinted from Intelligent Data Analysis, 18(6), Khoat Than, Tu Bao Ho, Modeling the diversity and log-normality of data, 1067-1088, Copyright 2014, with permission from IOS Press. |
| URI: | http://hdl.handle.net/10119/12352 |
| 資料タイプ: | author |
| 出現コレクション: | a10-1. 雑誌掲載論文 (Journal Articles)
|
このアイテムのファイル:
| ファイル |
記述 |
サイズ | 形式 |
|---|
| 20262.pdf | | 230Kb | Adobe PDF | 見る/開く |
|
当システムに保管されているアイテムはすべて著作権により保護されています。
|
